Forum Discussion

JMSNYC's avatar
JMSNYC
Helper III
8 years ago
Solved

How to dynamically append files when Folder is in Microsoft Azure Blob?

Hi.

 

I need to append daily files, with

  • a same structure
  • a different date at the end of the file name.xlsx
  • a location into the same folder on a Microsoft Azure Blob container

I tried the Get Data>More>File>Folder ... but it only allows me to browse my local drive.

 

Any ideas ?

 

Thanks,

JM

  • Hi JMSNYC,

     

    Based on my test, all the files from different folders will be imported by this way. So we should filter the files that we don't need out before you combine the files.

     

     

    In Power query, we can filte the unrelated files out directly and combine the files later like this.

     

     

    Regards,

    Frank

3 Replies

  • v-frfei-msft's avatar
    v-frfei-msft
    Community Support

    Hi JMSNYC

     

    Based on my test, we can combine the files from the folder in Microsoft Azure Blob. Firstly we got the file list from the Azure Blob Storage then we can combine the files in power query.

     

     

    Then we can get the result as we need. What’s more, if you remove or add some other files with same structure, once you refresh

    the data in power bi desktop, all the files could be combined dynamically.

     

     

    Regards,

    Frank

    • JMSNYC's avatar
      JMSNYC
      Helper III

      Thank you Frank for your message.

       

      Actually, I am doing exactly what you propose, except ... at the end of the query there is a variation ...

       

      1/ My client files are organized in Folders within the Azure Blob

       

       

      Hence, I only need to automatically append the files within this folder ... but 

       

      2/ When I open the Blob, Folder structure is no longer visible, and all files are mixed up, and so I cannot take one example file and ask Power BI to append all of them :-(

       

       

      Do you see my issue ? And if so, could you please propose ... some extra steps (?) ... I missed ?

       

      Thanks for your very detailed support, already.

      JM

       

       

      • v-frfei-msft's avatar
        v-frfei-msft
        Community Support

        Hi JMSNYC,

         

        Based on my test, all the files from different folders will be imported by this way. So we should filter the files that we don't need out before you combine the files.

         

         

        In Power query, we can filte the unrelated files out directly and combine the files later like this.

         

         

        Regards,

        Frank