Forum Discussion
How to deal with timeouts when combining multiple tables read from the Sharepoint folder.
The use of incremental refresh is good in many situations (not just dataflows), but merge steps can be costly for performance, especially if you end up processing all your Excel files multiple times. Do you need to do the merges? Could you have separate tables in your model instead?
While building, the tip to "Keep Top Rows" is a good one, so you only work with data from 2-3 files while building.
Also, see this article - Chris Webb's BI Blog: Excel.Workbook() And The delayTypes Option In Power Query/Power BI Chris Webb's BI Blog (crossjoin.co.uk)
Pat
Thanks ppm1,
I think your idea would be very useful when I have a trouble while updating Data Flow in Power BI Service. However, in my case, the problem is that while developing ETL using Power Query. So the target is a bit different.
I would appreciate it if you could share another idea with me.
Solution SageThe use of incremental refresh is good in many situations (not just dataflows), but merge steps can be costly for performance, especially if you end up processing all your Excel files multiple times. Do you need to do the merges? Could you have separate tables in your model instead?
While building, the tip to "Keep Top Rows" is a good one, so you only work with data from 2-3 files while building.
Also, see this article - Chris Webb's BI Blog: Excel.Workbook() And The delayTypes Option In Power Query/Power BI Chris Webb's BI Blog (crossjoin.co.uk)
Pat