Automated Testing Tool

[tameemyousaf]

Is there any automated testing tool for Power BI?

[thscoreto]

Thank you for your useful sharing!!!

Note: https://thscore.to/

[Sastry_Chirravu]

@tameemyousaf  You can try Datagaps BI Validator for Power BI Report testing. BI Validator supports to automate the Power BI testing with respect to data, UI, Bookmarks, all other meta data attributes, Load testing etc. It is a comprehensive tool with regular enhancements for the add on features of Power BI. Click here to Download

[ash12281]

Do you know approximate costing for this tool?

[Sastry_Chirravu]

Please share your mail id or else mail to sastry.chirravuri@datagaps.com

[Brendon]

@tameemyousaf , as others have said, it depends what you're trying to test. If you're trying to test the user experience with the frontend, as @acbg is, then you would probably want to use tools like Selenium, Tosca, UFT, etc to interact with the UI.

If you're interested in testing that the visuals are configured with the correct filters and such, in other words, that they are displaying the data you expect them to display, then you could still use the tools above but you'd need to build something to query your database to get your expected result. This second scenario is what I've been doing for a client. It's not simple but it's definitely possible. 

I found that this approach worked well but there were other challenges (like running thousands of tests in a reasonable timeframe, cost of maintenance, distinct skillset to the rest of the team) that eventually lead me to build my own tool. If you're interested, you can check it out here.

[acbg]

I am also looking for the same, an automated testing tool for reports in power bi service.
Wanting to test the reports in the service on the following:
When slicers are applied, is the card/chart yielding correct results and exporting it correctly.
Also when a button is selected is it navigating to correct page or bookmark.

Dax studio is not a great tool if your data is changing, as you still have to type in the expected results. And of course it does not check the front end navigation.

Does anyone have any other ideas?

[Sastry_Chirravu]

@acbg Datagaps provide end to end automated testing solutions for Power BI Reports. With Datagaps BI Validator you can automate testing of each individual visual data against Data Source queries and can check whether the actions provided in the Buttons are as expected with respect to Navigation links,Bookmarks etc. Test cases can be created from Individual Visuals to 100s of reports and trigger the test cases or suit of test cases through CI/CD and get notified with results posted back to your mail. For any futher queries you can reach out to support@datagaps.com or check the webinar link Automate The Testing of Power BI using BI Validator - Webinar - YouTube

[Greg_Deckler]

@tameemyousaf Depends what you are trying to test but in general, no, there is no specific tool for automated testing with Power BI like there is for Dynamics 365 CRM for instance. What are you testing?

If you are trying to test user interaction, potentially RPA like Power Automate

If this is embedding, if you embed the Power BI reports in a JavaScript application, most of the testing could be testing the JS scripts. Some other references as follows:

https://www.youtube.com/watch?v=UFbCh5TaR4w

https://microsoft.github.io/PowerBI-JavaScript/demo/v2-demo/index.html

If you are trying to test DAX - https://powerpivotpro.com/2018/09/automated-testing-using-dax-for-power-bi/

If you are trying to test Power Query, could probably do it similar to above testing DAX

If you have R and Python code, not sure.

[amitchandak]

@tameemyousaf , I am not able to recall one quickly.

Check this article if this can help a bit -https://powerpivotpro.com/2018/09/automated-testing-using-dax-for-power-bi/