Starting December 3, join live sessions with database experts and the Microsoft product team to learn just how easy it is to get started
Learn moreShape the future of the Fabric Community! Your insights matter. That’s why we created a quick survey to learn about your experience finding answers to technical questions. Take survey.
Solved! Go to Solution.
hi @SLI
Do you have a specific date column defined as LastUpdated date and specified the incremental policy in a the relevant table? Also make sure you have loaded the hisotrical data and refresh rows in the last ( XX) days. detect data changes also critical to LastUpdatedDate changes.
The duplicated data is because of how you set up the filter. It as to be >= RangeStart and < RangeEnd. If you set >= and <= that's when you get dups
Thank you.
hi @SLI
please refer this documentation for configuration
https://docs.microsoft.com/en-us/power-bi/service-premium-incremental-refresh#refresh-ranges
Important
Thanks
Hi, I have the same problem, were you able to fix this? I have a single INSERT_DT column which I am using for my RangeStart and RangeEnd filter, my settings are keep last 2 years of data and refresh for the last 2 days. It runs once a day, but all the daily snapshots are getting duplicated
Hi @oscarmqz
yes my problem was resolved by adding a new column (dateLastUpdate) that i used for my RangeStart and RangeEnd filter
this column isn't updated in the source data, it shows only the last date of the update
please refer to this documentation
https://docs.microsoft.com/en-us/power-bi/service-premium-incremental-refresh#filter-date-column-upd...
regards
hi @SLI
How did you generate the "dataLastUpdate" column? I am having issues with duplicated values and my date.time column is comign from source system.
Thanks
Hi @Anonymous
Sorry for the delay of my answer i've created a new column named "DateOfUpdate" and update this column with the datetime of the insertion of data
This solved my problem
the column has been added directly on the datawarehouse and data updated by SSIS
best regards
Hi,
i know this is an older thread, but when you say you created a dateLastUpdate column and that it is not updated in the source, how exactly are you generating that column? Also, what column are you using for the incremental filters?
thanks
Scott
hi @SLI
Do you have a specific date column defined as LastUpdated date and specified the incremental policy in a the relevant table? Also make sure you have loaded the hisotrical data and refresh rows in the last ( XX) days. detect data changes also critical to LastUpdatedDate changes.
Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.
User | Count |
---|---|
94 | |
90 | |
83 | |
76 | |
49 |
User | Count |
---|---|
145 | |
141 | |
109 | |
69 | |
55 |