The Test as role feature doesn't work for DirectQuery models with Single Sign-On (SSO) enabled.

Hi Chipsnump ,

Thank you for reaching out to the Microsoft Fabric Community Forum.

At this point, since this behaviour is impacting production dashboards in your tenant and you are expecting escalation and progress tracking, the next step would be to open a Microsoft Support ticket directly from your Power BI Admin Portal. Community members do not have access to tenant-side diagnostics, and escalation can only be managed through a formal support case.

Please include the following when raising the ticket:
• Activity ID and Timestamp from the error dialog
• Workspace name + Dataset name (non-confidential)
• Whether DirectQuery + SSO is enabled and for which source
• When this was last working successfully in your environment

This will allow the engineering team to validate whether this is a regression associated with a recent service update and provide you with tracking.

Please use thebelow link for rasing the support ticket:Create a Fabric and Power BI Support Ticket - Power BI | Microsoft Learn

Hope this helps. Please reach out for further assistance.

Thank you.