Forum Discussion
How to configure dataflow to use incremental refresh when pulling data from API
Hi Power BI Community!
I have a problem with incremental refresh policy in dataflow when trying to pull data from external API. I have M script which pulls the data using GET request with access_token and StartDate and EndDate parameters. I can only pull data from 1 day because of API limitations and amount of data and to avoid API timeouts. For that I used RangeStart and RangeEnd parameter in code, similar as in my desktop version of dashboard, which was working fine. I can see that dataflow pulled data for one defined date in RangeStart and RangeEnd params.
But here the problem occurs. I cannot set up incremental refresh policy becasue it says:
"Can't save dataflow
Model is invalid because it contains duplicate query names. Error: This document contains a duplicate member 'RangeStart'"
As I read somewhere, in dataflows there is no need to use RangeStart and RangeEnd since it's pulling incrementally using existing datetime column for that. But how I should do it with pullnig data from API? How to pass parameters to my GET request? Is there any solution for this? Workaround or something?
Thanks and regards,
Artur
2 Replies
- AnonymousNot applicable
Hi ArturPL ,
Please Make sure you are configuring incremental refreshes based on the documentation.
Using incremental refresh with dataflows - Power Query | Microsoft Learn
I have also found a similar post, please refer to it to see if it helps you.
Solved: API Incremental Refresh - Microsoft Power BI Community
How to Get Your Question Answered Quickly
If it does not help, please provide more details .
Best Regards
Community Support Team _ RongtieIf this post helps, then please consider Accept it as the solution to help the other members find it more quickly.