Forum Discussion

BigLo's avatar
BigLo
Helper III
4 years ago

Json Incremental Refresh

Hello, I've a webservice to import a json file. This json contains a lot of data and I'd like to not have to import the whole json anymore. So I added a parameter to my service to filter the dat...
Need Help
Show and Tell
BigLo's avatar
BigLo
Helper III
4 years ago

Thanks for your support.

 

I set up my incremental refresh this way.
I'm using 'RangeStart' as a parameter for my web service request to not load full data (json). I can consider that they are in the archive partition of my dataset (on the service).

 

my table

 

my incremental refresh policy is 1 year of archived data, 3 days of refreshed data.

 

I understand that for my incremental refresh, Power BI will delete all data whose 'LASTMODIFICATION' date is less than -1 year and greater than -3 days. Append the data from my json whose 'LASTMODIFICATION' date is greater than -3 days.
But if I modified a record who are already in the archive but before the RangeStart?

My PowerBI dataset on 2022-06-23 00:00:00

IDRECORDLINKDATEWORKHOURLASTMODIFICATION
125265420-06-2022620-06-2022 07:06
226486411-06-2022711-06-2022 09:45
3151549622-06-20222,522-06-2022 17:06

The record I want to refresh

IDRECORDLINKDATEWORKHOURLASTMODIFICATION
226486411-06-20227,523-06-2022 09:45

 

 

What will happen? my record with ID = 2 in the archive is before the RangeStart of incremental Refresh.

PowerBI duplicate this record?