Forum Discussion
Is it possible to implement Incremental Refresh based upon Last Modified Date?
Hey Anonymous ,
it's possible but not that simple. The reason for that is, incremental refresh means new data will be added. The database engine that is powering a Power BI dataset supports table partioning. A partion is described by a start and end value, often these values are datetime data types but not necessarily have to. If you are familiar with data warehousing than it's necessary to understand that the database engine does not do upserts, instead it does partition purge and partition load.
By default Power BI's incremental refresh supports a modified date, this article explains the intricate workings of Power BI's incremental refresh: https://learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview?WT.mc_id=DP-MVP-5003068
I also recommend reading everything related about incremental refresh by the Tabular Editor team, starting here: https://docs.tabulareditor.com/te3/tutorials/incremental-refresh/incremental-refresh-setup.html.
Hopefully, this gets you started
Tom
Hey Anonymous ,
it's possible but not that simple. The reason for that is, incremental refresh means new data will be added. The database engine that is powering a Power BI dataset supports table partioning. A partion is described by a start and end value, often these values are datetime data types but not necessarily have to. If you are familiar with data warehousing than it's necessary to understand that the database engine does not do upserts, instead it does partition purge and partition load.
By default Power BI's incremental refresh supports a modified date, this article explains the intricate workings of Power BI's incremental refresh: https://learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview?WT.mc_id=DP-MVP-5003068
I also recommend reading everything related about incremental refresh by the Tabular Editor team, starting here: https://docs.tabulareditor.com/te3/tutorials/incremental-refresh/incremental-refresh-setup.html.
Hopefully, this gets you started
Tom