Forum Discussion

jaryszek's avatar
jaryszek
Super User
1 year ago
Solved

How to get multiple CSV files from Blob storage using power query?

Hi,

I have 3 different csv files and do not want to go and filter each binary file like here in this link (it requires to creare 3 seperate queries): 
Solved: How to transform multiple CSV files from Blob stor... - Microsoft Fabric Community

I want to get just all tables automatically (in dynamic way) based on file names in blob storage as seperated queries. 
It is possible?

Best,
Jacek

  • Starting here:

    Add a column with

    Table.AddColumn(Source, "Custom", each Csv.Document([Content],[Delimiter=",", Columns=8, Encoding=65001, QuoteStyle=QuoteStyle.None]))

    Produces this:

    Keep/Remove any columns you want. I chose to only keep the original file name:

    = Table.SelectColumns(#"Added Custom",{"Name", "Custom"})

    Now press the little icon:

    Select all the fields you want:

    To produce this:

     

    Now this is the simplest case. As you can see the column headings are repeated.

    You can fix this by changing the "Table.Addcolumn".

    For example like this:

    = Table.AddColumn(Source, "Custom", each 
         let 
            csv = Csv.Document([Content],[Delimiter=",", Columns=8, Encoding=65001, QuoteStyle=QuoteStyle.None]),
            csv_with_headers =  Table.PromoteHeaders(csv, [PromoteAllScalars=true])
         in csv_with_headers)

    You will have to change the Expand columns step and you get this:

     

    Did I answer your question? Then please mark my post as the solution and make it easier to find for others having a similar problem.
    If I helped you, please click on the Thumbs Up to give Kudos.

     

    Kees Stolker

    A big fan of Power Query and Excel

2 Replies

  • Starting here:

    Add a column with

    Table.AddColumn(Source, "Custom", each Csv.Document([Content],[Delimiter=",", Columns=8, Encoding=65001, QuoteStyle=QuoteStyle.None]))

    Produces this:

    Keep/Remove any columns you want. I chose to only keep the original file name:

    = Table.SelectColumns(#"Added Custom",{"Name", "Custom"})

    Now press the little icon:

    Select all the fields you want:

    To produce this:

     

    Now this is the simplest case. As you can see the column headings are repeated.

    You can fix this by changing the "Table.Addcolumn".

    For example like this:

    = Table.AddColumn(Source, "Custom", each 
         let 
            csv = Csv.Document([Content],[Delimiter=",", Columns=8, Encoding=65001, QuoteStyle=QuoteStyle.None]),
            csv_with_headers =  Table.PromoteHeaders(csv, [PromoteAllScalars=true])
         in csv_with_headers)

    You will have to change the Expand columns step and you get this:

     

    Did I answer your question? Then please mark my post as the solution and make it easier to find for others having a similar problem.
    If I helped you, please click on the Thumbs Up to give Kudos.

     

    Kees Stolker

    A big fan of Power Query and Excel