Forum Discussion

AssimilateThis9's avatar
AssimilateThis9
Regular Visitor
4 years ago

Dashboard doesn't refresh from Azure Blob Storage

Hi,

 

I've created a simple test dashboard and published it to our app service, the data source is a .csv stored in Azure Blob. I have created a scheduled refresh, I have updated the .csv file (and confirmed the upload) before the scheduled refresh, but the dashboard app never changes, the data is not updated/refreshed.

 

To access the azure blob from Powerbi I followed this article

https://www.sqlshack.com/how-to-access-data-from-azure-blob-storage-using-power-bi/

 

Firstly (and this may or may not be related to my issue) was that I had some issues selecting the correct .csv file from my azure storage when there are multiple .csv's saved in the same container. In this article there is only 1 .csv in the container, but I have several. I found that when following the procedure in this article no matter which file I selected to connect to it always uses the first (alphabetical) file in the list, but then fails to import it correctly, and most of the columns in the table result in null data. 

 

In order to test further I have removed all but 1 .csv file from the container, and then the procedure works. This is the powerquery that is created to connect to the file -

 

Can someone help firstly with why my dashboard doesn't refresh, then secondly why the import procedure in the article doesn't select the correct file? (for the second issue I'll post additional information later, firstly I would just like to understand what is causing the refresh issue)

 

Thanks

 

3 Replies

  • I figured out what is going on with this. When you have more than 1 file in your azure blob storage, DON'T use the "combine files" button, click on the "binary" link in the first column of the file list. This takes you through the same dialogue to complete the import process, however the powerquery that is generated is different.

     

    Using the "combine files" button it generates powerquery that references your file based on its position in your list of files in your container. If that position changes, ie if you add or remove other files, then the refresh fails because its looking at the wrong file. If you use the "binary" link method it generates entirely different powerquery, which refers to your file by name, not by position. From then on your refreshes will succeed. 

     

    Very confusing, and I haven't seen any explanation of this in any of the documentation.

    • Akshay_M's avatar
      Akshay_M
      Icon for Helper I rankHelper I

      What happens if you click on the "Reset to Default" button?

      If that does still not work, what about refreshing from Power BI Desktop (With the latest version) and upload and refresh again?

       
  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi AssimilateThis9 ,

     

    This section outlines Power BI data handling practices when it comes to storing, processing, and transferring customer data.

    Power BI security white paper 

     

    Hope it helps,

     

    Best Regards,
    Community Support Team _ Caitlyn

    If this post helps then please consider Accept it as the solution to help the other members find it more quickly.