RLS Problems when Uploading Report to Power bi Server

I think this comes down to the different security architectures between PBIRS and the Power BI Service. PBIRS does not have workgroups so they had to adapt the security model. By default when you upload a report to PBIRS it automatically generates a RSReaderRole in the data model and I'm assuming it injects users in there at run time or something like that. But once you create your own roles it no longer does this and you have to populate the roles yourself.

So to fix your access issue you need to click on the "..." menu for your report, then go into "Manage" and click on the "Row Level Security" tab. Then simply add yourself and any other users or groups to one or more of the roles that you created.