How to configure dataflow to use incremental refresh when pulling data from API

[ArturPL]

Hi Power BI Community!

I have a problem with incremental refresh policy in dataflow when trying to pull data from external API. I have M script which pulls the data using GET request with access_token and StartDate and EndDate parameters. I can only pull data from 1 day because of API limitations and amount of data and to avoid API timeouts. For that I used RangeStart and RangeEnd parameter in code, similar as in my desktop version of dashboard, which was working fine. I can see that dataflow pulled data for one defined date in RangeStart and RangeEnd params.

But here the problem occurs. I cannot set up incremental refresh policy becasue it says: 

"Can't save dataflow

Model is invalid because it contains duplicate query names. Error: This document contains a duplicate member 'RangeStart'"

As I read somewhere, in dataflows there is no need to use RangeStart and RangeEnd since it's pulling incrementally using existing datetime column for that. But how I should do it with pullnig data from API? How to pass parameters to my GET request? Is there any solution for this? Workaround or something?

Thanks and regards,

Artur

[jellyjoe]

Hi @ArturPL,

Sorry to dig out the old topic but did you find a solution to your issue?
I have a similar problem.

Kind regards

[Anonymous]

Hi @ArturPL ,

Please  Make sure you are configuring incremental refreshes based on the documentation.

Using incremental refresh with dataflows - Power Query | Microsoft Learn

I have also found a similar post, please refer to it to see if it helps you.

Solved: API Incremental Refresh - Microsoft Power BI Community

How to Get Your Question Answered Quickly 

If it does not help, please provide more details .

Best Regards
Community Support Team _ Rongtie

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.