How to automate custom partitioning dataset refresh

Hi Everyone, Need you kind support and experties on enabling dataset refresh in an automated way. In my project we are pulling the data from databricks/unity catalog by using connector as Azure d...

Need Help

Anonymous
2 years ago
Hi lavankumar1989a

lbendlin Thank you very much for your prompt reply and here allow me to share some of it.

Utilize the XMLA endpoint for advanced refresh and partition management.

Advanced incremental refresh and real-time data with the XMLA endpoint in Power BI - Power BI | Microsoft Learn

This method requires your Power BI dataset to be hosted in a workspace assigned to a Premium capacity, as XMLA endpoints are a feature of Power BI Premium.

If your Power BI service is hosted on Azure, you can use Azure Automation to create runbooks that refresh partitions on a schedule.

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
lbendlin
2 years ago
Query folding is NOT a requirement for incremental refresh. It is very desirable, but incremental refresh will also work without it.

Anyway - you can run your XMLA script from anywhere, including Powershell or Power Automate.
SaiTejaTalasila
2 years ago
Hi lavankumar1989a ,

You can refer this -
https://www.fourmoo.com/2022/01/12/using-the-power-bi-async-rest-api-to-refresh-a-partition-with-power-automate-using-an-https-url/

I hope it will be helpful.

Thanks,
Sai Teja

lavankumar1989a

Helper II

2 years ago

Thanks lbendlin for your quick response.

Why we are not using incremental refresh is, we have lot of power query applied steps for that fact table and due to that it doesn't support for query folding. To leverage incremental refresh along with premium, table should support query folding other wise parameters won't be enable while applying the incremental refresh in PowerBI desktop level.

Hence we partitioned big fact using tabulaer editor and tried refreshing each partition using SSMS and it tooks very very lest time when compared to my original dataset.

So now i am looking to refresh the partitions automatically instead of manully in SSMS. So please suggest the relavent solutions if any. Thanks in adavance

SaiTejaTalasila