Regarding help for merging multiple CSVs in Power BI and automating them

[Anonymous]

I have a requirement where I have to merge files manually. probably about 20+. But, all files have multiples sheets and similar format. Now, for example: I have sheets ABC1, DEF2 and EFG3. In power BI, each of those will be shown as a table. My requirement is to merge ALL the ABC1, DEF2 and EFG3 data in one place from ALL the CSVs. I was facing issues in that. And also, I feel, that would lead to performance issues in Power BI. Obviously, one other approach would be to automate this using triggers in Power BI Automate. But, this is not what the client wants and I am not too familiar with Power Automate. Shall appreciate if you can help me run down steps to merge these files please. None of the videos or content online could help get a resolution in my case. 

@rajendraongole1 incase you would have an idea.

Many thanks!

[Anonymous · Accepted solution]

Hi @Anonymous 

Just as Greg_Deckler posted that you can use a Folder query.

You can put all the CSV files in one folder and select Folder as the data source.

Then click the combine file in the Home pane in the power query:

Please check this document for the detailed description:

Combine CSV files in Power Query - Power Query | Microsoft Learn

Best Regards

Zhengdong Xu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Anonymous]

@Greg_Deckler - Agreed and that is the approach I have been taking. But, due to the unstructured data and the inconsistent format, facing issues. Also, this is going to cause performance issues in the long run. Especially when the data will increase with time.

[Greg_Deckler]

@Anonymous Generally you would use a Folder query for this.