Forum Discussion

Jeanxyz's avatar
Jeanxyz
Icon for Power Participant rankPower Participant
2 years ago
Solved

incremental data refresh via data flow and merge query

I have been struggling with this issue for days, wonder if anyone could help.    Background: We have crated a power bi report using source data from Jira (via a custom PB connector). After publish...
Need Help
  • parry2k's avatar
    parry2k
    2 years ago

    Jeanxyz I think you found the root cause and here are a few suggestions:

     

    - after you finished appending, remove duplicate on id (or whatever column it is used for relationship)

    - 2nd, use 24-hour data pull in the dataflow and use that in Power BI for both merge and append.

     

     

lbendlin's avatar
lbendlin
Icon for Super User rankSuper User
2 years ago
which didn't work because the Date column used in the incremental refresh is not static.

please explain what you mean by that.

 

Have you considered using an incremental refresh dataset with the hot partition set to one day?  That would remove the need for the dataflow and the merge.