Forum Discussion
Initial data load for incremental refresh on a nearly useless datetime column
JTsoi I would look into writing an extension/script that updates your system last modified dates in Dynamics 365 to something reasonable.
Hi JTsoi,
I agree with GeraldGEmerick. You want to get this cleaned up in Dynamics directly. Anything you do to try and resolve this externally is going to be a patch work solution at best.
Is the old ERP still up? Are you still in progress of the transition or is the transition over now?
The way I would approach this is to wipe it all out of D365 and do the import from the old system again, but this time have some ETL step that sets that modified date to something reasonable.
Hi JTsoi,
I agree with GeraldGEmerick. You want to get this cleaned up in Dynamics directly. Anything you do to try and resolve this externally is going to be a patch work solution at best.
Is the old ERP still up? Are you still in progress of the transition or is the transition over now?
The way I would approach this is to wipe it all out of D365 and do the import from the old system again, but this time have some ETL step that sets that modified date to something reasonable.
Hi tayloramy, sorry for the slow response, I've been out sick for a couple of days.
Fortunately for me, my team leader, who also did the transition from the old ERP to Dynamics 365, basically thought "this is a hell of a risky change, let's give us some buffer space" and literally scheduled a year's worth of experimenting and user acceptance testing just to make sure the transition wouldn't screw us over when we do it for real. On my side, one of the tasks I'm working is basically porting over older Power BI reports that used the old ERP's data, and I saw incremental refreshing and went "ooh shiny" and tried adding it.
What I'm hearing is that this is fundamentally more of a source data problem and not a Power BI sort of problem. I'll talk with my team lead and see what he can do. He's already informed me that modifying the data during the actual migration itself isn't possible, but afterwards might be possible. I'm still cautious because I still don't believe you can modify the systemLastModified field in Dynamics 365 directly, but I've been wrong before!
I'll accept yours and GeraldGEmerick's posts as solutions, thanks for your answers letting me take up your time! Thank you as well cengishanarslan, even if I can't use your solution.
Jonathan T.