Forum Discussion
Power BI incremental refresh problem
Question on power bi incremental refresh. Have this setup and having an issue when running incremental refresh from the service: non folded TOP 1000 queries equal to the number of partitions chosen f...
From what I can tell, it's running a data preview query for every step in the power query script * the number of partitions. So if # of partitions is large, an insane number of these queries are run - and the source is big data/ADLS Gen 2 with spark on top
I'm also interested in a solution.
Since the timestamps are included in the index of the SQL table the incremental refresh query performing well.
The prior query (data preview) during incremental refresh from PBI service is very slow due to select top 1000 instruction