End-To-End Basic Testing

[sevenhills]

Hi,

We have the below components and the data flows in sequential as below:

1. SharePoint Files
2. ADLS Gen 2
3. Power BI DataFlows
4. Power BI Datasets
5. Power BI Paginated Reports
6. Power BI (self-service) Reports
7. Power BI Apps

A) Is there a way we can do end-to-end testing? Are there any tools?

       I would like to do end-to-end basic testing. Say, file list, first line content and file rows/lines count. 

       Say, right from source to apps, did the data went through.

b) If end-to-end is not possible, I can do as multi-steps. 

      Say, Power shell checking the files, file rows from SharePoint, ADLSg2, PBI DataFlows.

      Say, PBI DataFlows to PBI Datasets

      Say, PBI Datasets to  Reports and Apps.

      Note: I understand data testing may take lot of effort. Here, all I am doing is to verify the file content travelled from start to end or not.

Any pointers or advice is appreciated 🙂 

Thanks

[sevenhills]

Note: I understand data testing may take lot of effort. Here, all I am doing is to verify the file content travelled from start to end or not. NOT COMPLETE data testing

My use case for testing

- In a date range, how many files exists in source, similarly in data flow, data set and reports

- I have entity, query, table, report that maintains the list info all along

- I have hundreds of files that travels all along for each report.

- I would like to have some automated end-to-end basic testing. I am aware it is tough or not possible all as one but atleast trying to the extent possible.

Thanks

[lbendlin]

I woud say the vast majority of steps can be covered via Powershell  - the API calls to refresh the dataflow. dataset etc, and some DAX queries against the XMLA endpoint

By the way, Power Automate allows you to be notified when a dataflow refresh has completed which you can then use to trigger the dataset refreshes.

[sevenhills]

Thanks @lbendlin 

If you have any links of posts that talks about these kind of testing, please could you share.

Optional: Also, how to combine each segment results and do the end-to-end testing?

FYI, I cannot use Power Automate yet, as we dont have license for it.
We are still debating to get that one or with ADF, which may be out of context for this post.

[lbendlin]

I think you're on your own there. Implement it step by step.  Here are some inspirational links

Solved: Unit testing in Power BI - Microsoft Power BI Community

but they are only for the final step.

[sevenhills]

thank you

I will wait for others to reply