Azure Blob Storage Schedule Refresh

[Anonymous]

Dear Power BI users,

I am currently working on a project where multiple parquet files are imported from a single Azure Blob Storage and transformed using Python scripts. In this thread an example is given for automatic refresh with Azure Blob Storage as dataset source.

Surprisingly, the dataset does not have an automatic refresh option, as shown below:

Here is an overview of one of the tables advanced editor. There are 5 tables imported from the Azure Blob Storage, which all have the same import/transformation structure.

The final goal is to have an automatic daily refresh of the dataset for the dashboard using Azure Blob Storage as data source with transformations in Python.

Thanks in advance!

[v-yanjiang-msft]

Hi @Anonymous ,

I think the problem still lies in the data source, what will appear when you click on the Discover Data Sources in your snapshot？As only the Azure Blob Storage data source supports refresh, I guess it's the multiple parquet files cause your problem, maybe you can do some processing before you import the data in Power BI.

Here's some information may help you.
https://docs.microsoft.com/en-us/power-bi/connect-data/service-admin-troubleshoot-unsupported-data-source-for-refresh

https://www.sqlshack.com/how-to-access-data-from-azure-blob-storage-using-power-bi/

https://stackoverflow.com/questions/51696655/read-multiple-parquet-files-in-a-folder-and-write-to-single-csv-file-using-pytho

Best Regards,
Community Support Team _ kalyj

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Anonymous]

Hello @v-yanjiang-msft ,

Thanks for your reply.

I contacted the Power BI help desk and they proposed adding a Power BI Gateway.

With a person gateway running locally on my laptop the refresh is succesful. This would however require my laptop to be running 24/7 for scheduled refreshed.

I am currently looking into a gateway hosted remotely, will give an update if I got it working.

Kind regards,

Mark