Forum Discussion
Loading files from multiple sub folders with the same file ending
- 6 years ago
Hi Sibrulotte ,
I have created a sample for your reference. Please refer to the steps as below.
1. Create a parameter as below in power query.
2. Filter the file name column based on the parameter.
3. Expand the filterd table to get the excepted result.
For more details, please check the M code as below.
let Source = Folder.Files("D:\Case\xxxxxxx"), #"Filtered Rows" = Table.SelectRows(Source, each Text.Contains([Name], Parameter1)), #"Filtered Hidden Files1" = Table.SelectRows(#"Filtered Rows", each [Attributes]?[Hidden]? <> true), #"Invoke Custom Function1" = Table.AddColumn(#"Filtered Hidden Files1", "Transform File", each #"Transform File"([Content])), #"Renamed Columns1" = Table.RenameColumns(#"Invoke Custom Function1", {"Name", "Source.Name"}), #"Removed Other Columns1" = Table.SelectColumns(#"Renamed Columns1", {"Source.Name", "Transform File"}), #"Expanded Table Column1" = Table.ExpandTableColumn(#"Removed Other Columns1", "Transform File", Table.ColumnNames(#"Transform File"(#"Sample File"))), #"Changed Type" = Table.TransformColumnTypes(#"Expanded Table Column1",{{"Source.Name", type text}, {"Column1", type text}, {"Column2", type text}, {"Column3", type text}}) in #"Changed Type"
Hi Sibrulotte ,
I have created a sample for your reference. Please refer to the steps as below.
1. Create a parameter as below in power query.
2. Filter the file name column based on the parameter.
3. Expand the filterd table to get the excepted result.
For more details, please check the M code as below.
let
Source = Folder.Files("D:\Case\xxxxxxx"),
#"Filtered Rows" = Table.SelectRows(Source, each Text.Contains([Name], Parameter1)),
#"Filtered Hidden Files1" = Table.SelectRows(#"Filtered Rows", each [Attributes]?[Hidden]? <> true),
#"Invoke Custom Function1" = Table.AddColumn(#"Filtered Hidden Files1", "Transform File", each #"Transform File"([Content])),
#"Renamed Columns1" = Table.RenameColumns(#"Invoke Custom Function1", {"Name", "Source.Name"}),
#"Removed Other Columns1" = Table.SelectColumns(#"Renamed Columns1", {"Source.Name", "Transform File"}),
#"Expanded Table Column1" = Table.ExpandTableColumn(#"Removed Other Columns1", "Transform File", Table.ColumnNames(#"Transform File"(#"Sample File"))),
#"Changed Type" = Table.TransformColumnTypes(#"Expanded Table Column1",{{"Source.Name", type text}, {"Column1", type text}, {"Column2", type text}, {"Column3", type text}})
in
#"Changed Type"
Alright, definitly getting the correct usage, but I'm weary:
In these folders I have a mega ton load of files that I do not want to touch or try to query or this will severlyu slow down my extraction. Will this not do that at the first step?
I don't have enough files for the moment but 60 days down the line it would turn to a total cluster.