Question regarding Incremental Refresh and changing data

[Deermeat]

Hello,

I have a question regarding incremental refresh that I can't seem to find online.

I have a Stored Procedure (SP) on my SQL server that I am using dataflow to get information out of. The SP will output all end of the month data + the newest daily data. This means on the date:

• 16th April 2022, it will have data from 31 Jan 2022, 28 Feb 2022, 31 March 2022, and 16 April 2022
• 17th April 2022, it will have data from 31 Jan 2022, 28 Feb 2022, 31 March 2022, and 17 April 2022. 
• 1st May 2022, it will have data from 31 Jan 2022, 28 Feb 2022, 31 March 2022, 30 April 2022, and 1st May 2022.

As you can see, the SP will:

• Add new daily information
• Remove old daily information
• Add end of month data if at end of month

From my understanding, incremental refresh will be able to add on the new daily information and the new end of month data, but will it be able to remove the old daily information?

Thank you!

[GilbertQ · Accepted solution]

Hi @Deermeat 

You can use the Detect Data Changes and point this to the column which will tell the Incremental Refresh engine which columns have changed and how to refresh the required data

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Docs

[Deermeat]

Hi @GilbertQ 

Understood. Thank you for your help