Forum Discussion
How to get multiple CSV files from Blob storage using power query?
Hi,
I have 3 different csv files and do not want to go and filter each binary file like here in this link (it requires to creare 3 seperate queries):
Solved: How to transform multiple CSV files from Blob stor... - Microsoft Fabric Community
I want to get just all tables automatically (in dynamic way) based on file names in blob storage as seperated queries.
It is possible?
Best,
Jacek
Starting here:
Add a column with
Table.AddColumn(Source, "Custom", each Csv.Document([Content],[Delimiter=",", Columns=8, Encoding=65001, QuoteStyle=QuoteStyle.None]))Produces this:
Keep/Remove any columns you want. I chose to only keep the original file name:
= Table.SelectColumns(#"Added Custom",{"Name", "Custom"})Now press the little icon:
Select all the fields you want:
To produce this:
Now this is the simplest case. As you can see the column headings are repeated.
You can fix this by changing the "Table.Addcolumn".
For example like this:
= Table.AddColumn(Source, "Custom", each let csv = Csv.Document([Content],[Delimiter=",", Columns=8, Encoding=65001, QuoteStyle=QuoteStyle.None]), csv_with_headers = Table.PromoteHeaders(csv, [PromoteAllScalars=true]) in csv_with_headers)You will have to change the Expand columns step and you get this:
Did I answer your question? Then please mark my post as the solution and make it easier to find for others having a similar problem.
If I helped you, please click on the Thumbs Up to give Kudos.Kees Stolker
A big fan of Power Query and Excel
2 Replies
- PwerQueryKeesSuper User
Starting here:
Add a column with
Table.AddColumn(Source, "Custom", each Csv.Document([Content],[Delimiter=",", Columns=8, Encoding=65001, QuoteStyle=QuoteStyle.None]))Produces this:
Keep/Remove any columns you want. I chose to only keep the original file name:
= Table.SelectColumns(#"Added Custom",{"Name", "Custom"})Now press the little icon:
Select all the fields you want:
To produce this:
Now this is the simplest case. As you can see the column headings are repeated.
You can fix this by changing the "Table.Addcolumn".
For example like this:
= Table.AddColumn(Source, "Custom", each let csv = Csv.Document([Content],[Delimiter=",", Columns=8, Encoding=65001, QuoteStyle=QuoteStyle.None]), csv_with_headers = Table.PromoteHeaders(csv, [PromoteAllScalars=true]) in csv_with_headers)You will have to change the Expand columns step and you get this:
Did I answer your question? Then please mark my post as the solution and make it easier to find for others having a similar problem.
If I helped you, please click on the Thumbs Up to give Kudos.Kees Stolker
A big fan of Power Query and Excel