How to read a directory of Parquet files in power Bi? ie with their changing GUIDs

[Tdawg90]

The new Parquet connector is fine, however a common scenario is using Scala/spark/bricks ect in the production on the data files.  In all cases that I'm familiar with, files are written per partition with guids.  

In my specific case, because this is cooked data for dashboards, I can keep it to a single partition on an ADLS Gen2 Blob storage.  However the GUID will change with each set of daily data.  And then the refresh will 404 on the subsequent refreshes. 

How can I have PBI read a directory of parquet files, or supply wild signs in the path?

[MezTemplar]

Here is the query I use

let

    Source = AzureStorage.Blobs("https://mystorageaccount.blob.core.windows.net"),

    AuditLogs = Source{[Name="logsfolder"]}[Data],

    LogContent = Table.Column(AuditLogs,"Content"),

    CombineFiles = List.Transform(LogContent , (row) => Parquet.Document(row)),

    LogTable = Table.Combine(CombineFiles)

in

    LogTable

[alicanerturk]

Hi,

I retrieve a Parquet file from a URL. If you need to do the same, you can follow these instructions:

1. Click on Transform Data.

2. Create a Blank Query.

3. Enter the following code in the query editor:let
   // URL of the Parquet file
   Source = Binary.Buffer(Web.Contents(""YOUR URL"")),
   // Load the Parquet file into a table
   Table = Parquet.Document(Source)
   in
   Table

4. Replace "YOUR URL" with the actual URL of your Parquet file.

   Thank you.

[Azure_newbie]

Did you found the solution?

[amitchandak]

@Tdawg90 , You can add azure data lake gen 2 folder and try out

[Tdawg90]

I'm guessing you're referring to ADLS Gen2 File Share? Or is there another connector I'm not seeing.  The Local 'folder' option only seems to all local directories