Forum Discussion
Super long refresh times despite incremental refresh
v-sshirivolu Hi!
After some more experimenting and remaking all the calculated columns, reinstalling power bi etc it now works. I also noticed during on of the tests where a refresh took 2 hours, that it completed with a warning, and that warning was referencing a table that wasn't even loaded into the model.
So seems that perhaps some metadata or other stuff had been slightly corrupted? Either way now after rebuild it's only taking 3 minutes to refresh, with the idenditcal aggregation etc...
Hi F003Yum ,
Your Snowflake history shows incremental refresh is working, and the SHOW COLUMNS and SHOW PRIMARY KEYS queries are expected metadata calls. The main cause of slow or inconsistent refresh is the Table.Group step, which can break query folding and force processing to the Power BI engine. When folding is lost, each partition executes locally, increasing refresh time even with incremental refresh. To improve performance, move aggregations to Snowflake via a view or native query and verify folding using View Native Query. Keeping transformations foldable lets the source handle execution efficiently.
v-sshirivolu Hi!
After some more experimenting and remaking all the calculated columns, reinstalling power bi etc it now works. I also noticed during on of the tests where a refresh took 2 hours, that it completed with a warning, and that warning was referencing a table that wasn't even loaded into the model.
So seems that perhaps some metadata or other stuff had been slightly corrupted? Either way now after rebuild it's only taking 3 minutes to refresh, with the idenditcal aggregation etc...