Power BI embedded reports not loading

Hi,

We have two PBI embedded reports that uses RLS backed by an A2 capacity gen 2. The reports work fine in the Power BI service but nothing shows up in the reports. I can't see that there are any errors occuring, it's just stuck on the loading icon flashing. I feel a bit blind with this, are there any logs I can look at? 
I have tried:

- rebublishing report

- creating a new capacity and switch to that

Thanks