Forum Discussion

Jeanxyz's avatar
Jeanxyz
Icon for Power Participant rankPower Participant
2 years ago
Solved

incremental data refresh via data flow and merge query

I have been struggling with this issue for days, wonder if anyone could help.    Background: We have crated a power bi report using source data from Jira (via a custom PB connector). After publish...
Need Help
  • parry2k's avatar
    parry2k
    2 years ago

    Jeanxyz I think you found the root cause and here are a few suggestions:

     

    - after you finished appending, remove duplicate on id (or whatever column it is used for relationship)

    - 2nd, use 24-hour data pull in the dataflow and use that in Power BI for both merge and append.

     

     

parry2k's avatar
parry2k
Icon for Super User rankSuper User
2 years ago

Jeanxyz I think you found the root cause and here are a few suggestions:

 

- after you finished appending, remove duplicate on id (or whatever column it is used for relationship)

- 2nd, use 24-hour data pull in the dataflow and use that in Power BI for both merge and append.

 

 

Jeanxyz's avatar
Jeanxyz
Icon for Power Participant rankPower Participant
2 years ago

The problem is solved after I apply sorting by last update date, and remove duplicates by Issue ID. Thanks!