Forum Discussion
Only query new records
- 5 years ago
JamesLeach Honestly there is no great solution for this. I think ImkeF (biaccountant.com) wrote a blog article on this that probably was the "cleanest" but there's really no "good" way.
Seems like what you want is incremental refresh though, which Power BI has but not sure how that might work exactly with the API you are calling.
JamesLeach Honestly there is no great solution for this. I think ImkeF (biaccountant.com) wrote a blog article on this that probably was the "cleanest" but there's really no "good" way.
Seems like what you want is incremental refresh though, which Power BI has but not sure how that might work exactly with the API you are calling.
- JamesLeach5 years agoFrequent Visitor
Hey Greg,
Thanks for the response! I was afraid the news was going to be something like that. I couldn't find the blog post you referenced but I'm pretty sure this is the thread where it's discussed. I've actually used that in the past querying and API where I had to pull data page by page...
Incremental refresh isn't a good option in this case, at least with the API data but, since there are many ways to handle things, I decided to create an Azure function that acts as a 'middleman' between Power BI and the Web API (that I pay for based on queries). The function queries Azure table storage to see if it has a record and if not, queries the API and then writes it to the table storage, returning the appropriate data, either way.
Thanks again!
Be well,
James