Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
tameemyousaf
Helper I
Helper I

Automated Testing Tool

Is there any automated testing tool for Power BI?

9 REPLIES 9
thscoreto
New Member

Thank you for your useful sharing!!!

 

Note: https://thscore.to/

Sastry_Chirravu
Frequent Visitor

@tameemyousaf  You can try Datagaps BI Validator for Power BI Report testing. BI Validator supports to automate the Power BI testing with respect to data, UI, Bookmarks, all other meta data attributes, Load testing etc. It is a comprehensive tool with regular enhancements for the add on features of Power BI. Click here to Download

Do you know approximate costing for this tool?

Please share your mail id or else mail to sastry.chirravuri@datagaps.com

Brendon
Frequent Visitor

@tameemyousaf , as others have said, it depends what you're trying to test. If you're trying to test the user experience with the frontend, as @acbg is, then you would probably want to use tools like Selenium, Tosca, UFT, etc to interact with the UI.

 

If you're interested in testing that the visuals are configured with the correct filters and such, in other words, that they are displaying the data you expect them to display, then you could still use the tools above but you'd need to build something to query your database to get your expected result. This second scenario is what I've been doing for a client. It's not simple but it's definitely possible. 

 

I found that this approach worked well but there were other challenges (like running thousands of tests in a reasonable timeframe, cost of maintenance, distinct skillset to the rest of the team) that eventually lead me to build my own tool. If you're interested, you can check it out here.

acbg
Resolver III
Resolver III

I am also looking for the same, an automated testing tool for reports in power bi service.
Wanting to test the reports in the service on the following:
When slicers are applied, is the card/chart yielding correct results and exporting it correctly.
Also when a button is selected is it navigating to correct page or bookmark.

Dax studio is not a great tool if your data is changing, as you still have to type in the expected results. And of course it does not check the front end navigation.

Does anyone have any other ideas?

@acbg Datagaps provide end to end automated testing solutions for Power BI Reports. With Datagaps BI Validator you can automate testing of each individual visual data against Data Source queries and can check whether the actions provided in the Buttons are as expected with respect to Navigation links,Bookmarks etc. Test cases can be created from Individual Visuals to 100s of reports and trigger the test cases or suit of test cases through CI/CD and get notified with results posted back to your mail. For any futher queries you can reach out to support@datagaps.com or check the webinar link Automate The Testing of Power BI using BI Validator - Webinar - YouTube

Greg_Deckler
Super User
Super User

@tameemyousaf Depends what you are trying to test but in general, no, there is no specific tool for automated testing with Power BI like there is for Dynamics 365 CRM for instance. What are you testing?

 

If you are trying to test user interaction, potentially RPA like Power Automate

 

If this is embedding, if you embed the Power BI reports in a JavaScript application, most of the testing could be testing the JS scripts. Some other references as follows:

https://www.youtube.com/watch?v=UFbCh5TaR4w

https://microsoft.github.io/PowerBI-JavaScript/demo/v2-demo/index.html

 

If you are trying to test DAX - https://powerpivotpro.com/2018/09/automated-testing-using-dax-for-power-bi/

 

If you are trying to test Power Query, could probably do it similar to above testing DAX

 

If you have R and Python code, not sure.


Follow on LinkedIn
@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...
amitchandak
Super User
Super User

@tameemyousaf , I am not able to recall one quickly.

Check this article if this can help a bit -https://powerpivotpro.com/2018/09/automated-testing-using-dax-for-power-bi/

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Power BI Carousel June 2024

Power BI Monthly Update - June 2024

Check out the June 2024 Power BI update to learn about new features.

PBI_Carousel_NL_June

Fabric Community Update - June 2024

Get the latest Fabric updates from Build 2024, key Skills Challenge voucher deadlines, top blogs, forum posts, and product ideas.

Top Solution Authors