Forum Discussion

ddfreedie's avatar
ddfreedie
Helper I
5 years ago

PowerBi Incremental load issue

Hi   I am facing issue with Incremental loading in PBI.   Basically i am working on setting up a table on my own and checking how to enable incremental loads.   As part of that, i created a tab...
Need Help
Tips and Tricks
GilbertQ's avatar
GilbertQ
Super User
5 years ago

Hi ddfreedie 

 

The reason for the top 1000 is to make sure that the table matches the definitions before loading the data.

 

It will only do this for the first incremental loading of the data. 

 

If your incremental refresh is also set to be the last 120 months, then it will have to do that for each and every month. This is how it works by design.

ddfreedie's avatar
ddfreedie
Helper I
5 years ago

Thank you for the response. 
but I tried doing a few incremental and every time it does 120 queries to get max date + 120 queries to get data top 1000 from all partitions + 1 query to get top 1000 with no filters

 

Also does this 1000 record load into the dataset/data flow or is it only for some validation purpose. 

It could just be once top 1 * as the partitions are PBI own and end of the day it is the same table. 🙂 this makes no sense to me unfortunately!!