Power BI file optimisation based on many csv/xls daily exports

[3ug3n]

Hello everyone,

I'm contacting the group because after many research I can't find any satisfactory answer - with any certainty.

I have a Power BI file based on merging and analysing around 20 local folders containing CSVs and XLS files produced/gathered on a daily basis (~3000).

As can be expected, it takes a very long time to refresh the daily reports.

What do you recommend I do to optimise this - knowing that i cannot merge those files upstreams ?

Is there a way to create a table (internal or linked somewhere) to store the merged CSVs and then to:
- update it incrementally (even if it eventually bloats)
- do the ~30 daily analysis queries from it without having to recompile/filter/transform everything every time ?

Thank you very much in advance for your suggestions and possible links that detail/explain them !

Have a nice weekend

[parry2k]

@3ug3n this post has the answer to your question How you can incrementally refresh any Power BI data source (This example is a CSV File) - FourMoo | ...