Custom Azure solutions using ADFS and SPO permissions group for ACL?

This is a stretch, but say we have a custom ASP.NET website in Azure we hope/plan to secure with ADFS. Possible somehow to use SPO Permission groups to manage those permissions?

Basically what we are trying to do is move some custom functionality outside of SharePoint to Azure, but we would like SPO Permission groups to determine who can run those external solutions.