topic Refresh dashboard once the data bricks tables are updated with the new data or Scheduled refresh? in Developer

Refresh dashboard once the data bricks tables are updated with the new data or Scheduled refresh?

ssspk — Wed, 27 Sep 2023 14:11:21 GMT

Hello All,

We have used Azure DataBricks as a data source to build the dashboard. We need to refresh the dashboard once the databricks tables are updated with the new data.

(OR)

Scheduled refresh to refresh the data from Azure databricks automatically. Like every day at a specified time.

Access Azure Databricks data source using the Power BI service...

Does anyone come across the same situation?

Where i can find the below configurations,?

Azure Databricks dataset for the report in the Power BI service, expand Data source credentials, and click Edit credentials

Link: Connect Power BI to Azure Databricks - Azure Databricks | Microsoft Learn

Thanks in Advance...

Re: Refresh dashboard once the data bricks tables are updated with the new data or Scheduled refresh?

tackytechtom — Wed, 27 Sep 2023 18:17:41 GMT

Hi ssspk ,

I suggest you create a notebook in Azure Databricks that calls the Dataset Refresh API in Power BI for your dataset right after all the tables in databricks have been loaded. Here a video for inspiration:

How To Refresh Your Power Bi Dataset Using Python? #python #powerbi #biconsultingpro - YouTube

If you orchestrate the loading of the notebooks in an ETL tool like Azure Data Factory, you could do the same via an Azure Data Factory Pipeline:

https://www.tackytech.blog/how-to-refresh-power-bi-datasets-from-data-factory-with-managed-identity/

Let me know if this helps 🙂

/Tom
https://www.tackytech.blog/
https://www.instagram.com/tackytechtom/