Check if Power BI Dataset tables were refreshed with new data

[coding7]

Hi all,

I need to create a Power BI report that shows whether a specific Report/Dataset has been successfully refreshed or not.

In my case, it is about whether the tables composing the dataset have new data or not. It is possible that the refresh was successful but no new data was inserted.

Is there a way to obtain this information? Essentially, the final report would be a matrix with the names of the reports/datasets and then the status. For example, if it was green, it means new data was inserted; if there was no change in the data (countrows), then it would be red, etc. (similiar with below image)

Unfortunately I don't have premium licenses, as that would enable connecting to the XMLA endpoint and executing some DMVs to obtain this information.

Another possibility is to execute countrows in the source, and since I'm using Spark, I would use DESCRIBE HISTORY to obtain the differences in counts between the current and previous versions. However, in this case, the challenge would be the mapping with report names and tables, as I have many tables and reports, and manual mapping would be very time-consuming and bad in terms of management.

It might be possible to obtain the information using the Power BI API as well, but I'm not as familiar with that.

Therefore, if anyone has any ideas or suggestions, I would greatly appreciate it.

Thanks a lot !

[Anonymous · Accepted solution]

Hi @coding7 ,

To check the status of a refresh operation, use the GET verb on the refresh object by specifying the . If the operation is in progress, returns , as in the following example response body:requestIdstatusInProgress

More details: Enhanced refresh with the Power BI REST API - Power BI | Microsoft Learn

How to Get Your Question Answered Quickly 

If it does not help, please provide more details.

Best Regards
Community Support Team _ Rongtie

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Greg_Deckler]

@coding7 What about using scorecards?

[coding7]

Hey @Greg_Deckler thanks a lot for your reply|

I actually never used that feature, but do you know of any examples or something like that? I think I'll explore that option because from what I've seen in Microsoft's documentation, it seems intuitive. Thanks again ✌️

[jolind1996]

It is possible to check if a Power BI dataset has been refreshed with new data by using the Power BI API. You can use the Get Refresh History API to retrieve the refresh history of a dataset, which includes information about the status, start time, and end time of each refresh. You can then use this information to determine if the dataset has been successfully refreshed and if new data has been inserted.

Here is an example of how you can use the Get Refresh History API to retrieve the refresh history of a dataset:

GET https://api.powerbi.com/v1.0/myorg/groups/{groupId}/datasets/{datasetId}/refreshes

In this example, {groupId} is the ID of the workspace that contains the dataset, and {datasetId} is the ID of the dataset. You will need to replace these placeholders with the actual IDs of your workspace and dataset.

Once you have retrieved the refresh history of the dataset, you can use the information to create a report that shows the status of the refreshes.

Best regards,

Johannes

[coding7]

Hi @jolind1996 Thanks a lot, yes it could be a possibility!
Actually, it was one of the options I was considering, creating a notebook and making the API call to get the information. Since I'm not very familiar with the API, this could be a good starting point for studying.

Thank you very much. 👍