Forum Discussion

ArturPL's avatar
ArturPL
New Member
3 years ago

How to configure dataflow to use incremental refresh when pulling data from API

Hi Power BI Community!

 

I have a problem with incremental refresh policy in dataflow when trying to pull data from external API. I have M script which pulls the data using GET request with access_token and StartDate and EndDate parameters. I can only pull data from 1 day because of API limitations and amount of data and to avoid API timeouts. For that I used RangeStart and RangeEnd parameter in code, similar as in my desktop version of dashboard, which was working fine. I can see that dataflow pulled data for one defined date in RangeStart and RangeEnd params.

But here the problem occurs. I cannot set up incremental refresh policy becasue it says: 

"Can't save dataflow

Model is invalid because it contains duplicate query names. Error: This document contains a duplicate member 'RangeStart'"

 

As I read somewhere, in dataflows there is no need to use RangeStart and RangeEnd since it's pulling incrementally using existing datetime column for that. But how I should do it with pullnig data from API? How to pass parameters to my GET request? Is there any solution for this? Workaround or something?

 

Thanks and regards,

Artur

 

2 Replies