Forum Discussion

PBILover's avatar
PBILover
Helper V
1 year ago

Incremental dataset refresh

How to perform incremental refresh based on modified date in Power BI?

I have a requirement where-in I need Incremental refresh with the ability to handle modifications. i have  record created  date and record modified date. I have INCR dataset refresh policy set on the created date for last 10 days.

For example: can I configure Incremental refresh on date modifed field, and suppose a record that was pulled in previous load is now modified in source thereby having a new Date modifed, then is the Incremental load able to delete the older record from the model when loading the new version of this row?

If not supported by Power BI incremental refresh, then is there any way to handle such scenario in Power BI? 

I am using SYnapse as a Source of the data .

Thanks

Need Help

17 Replies

  • Deku's avatar
    Deku
    Super User
    1 year ago

    You can only ever refresh a full partition, not a particular row. If the older version of the row is in archived partition it will remain. You can extend the window of active partitions and set a polling expression so that partitions without an updated modified date are not refreshed.

     

    See this Chris webb post on the topic

  • v-achippa's avatar
    v-achippa
    Community Support
    1 year ago

    Hi PBILover,

     

    Thank you for reaching out to Microsoft Fabric Community.

     

    Thank you Deku for the prompt response.

     

    As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided by the super user resolved your issue? or let us know if you need any further assistance.
    If our super user response resolved your issue, please mark it as "Accept as solution" and click "Yes" if you found it helpful.

     

    Thanks and regards,

    Anjan Kumar Chippa

    • v-achippa's avatar
      v-achippa
      Community Support
      1 year ago

      Hi @PBILover,

       

      We wanted to kindly follow up to check if the solution provided by the super user resolved your issue.
      If our super user response resolved your issue, please mark it as "Accept as solution" and click "Yes" if you found it helpful.

       

      Thanks and regards,

      Anjan Kumar Chippa

      • v-achippa's avatar
        v-achippa
        Community Support
        1 year ago

        Hi @PBILover,

         

        As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided by the super user resolved your issue.
        If our super user response resolved your issue, please mark it as "Accept as solution" and click "Yes" if you found it helpful.

         

        Thanks and regards,

        Anjan Kumar Chippa

  • v-achippa's avatar
    v-achippa
    Community Support
    1 year ago

    Hi PBILover,

     

    As we haven’t heard back from you, we are closing this thread for now. If you have any further issue, please raise a new thread in the community forum, we are ready to assist you on it.

    Thank you for being part of Microsoft Fabric Community.

     

    Thanks and regards,

    Anjan Kumar Chippa