Incremental Data Loading

[RajD]

Hello,

I've millions of rows in Sql Server table (Data Source) and I'm using Power BI Desktop to import data. Is there a way to do Incremental refersh in Power BI desktop?. I know it's avilable in Premium version but is there a way or work around to do Incremental refresh in Power Bi desktop?. 

Thanks..

[Anonymous · Accepted solution]

Hi @RajD ,

You can consider to manually input custom t-sql query in connector based on current date, it should get specific date range records based system date.

Power BI Desktop Query Parameters, Part2 – Dynamic Data Masking and Query Parameters

Power Query Current Date Filter

Regards,

Xiaoxin Sheng

[d_gosbell]

I don't believe that there is anyway to actually do an incremental load on a Desktop model. Typically you would setup the RangeStart and RangeEnd parameters and default them to a smaller date range so that you don't have to process millions of rows on your desktop, then you'd configure the incremental loading on powerbi.com in order to load the full dataset. 

If what you are looking for is some way of loading the entire dataset onto your Desktop then I don't believe there is any workaround for this (other than loading all rows anytime you do a refresh). Incremental processing requires support for defining multiple partitions and Power BI Desktop does not support this. And even if you could "hack" in multiple partitions there is a really good chance that any changes you made to the model would then overwrite these.