Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now! Learn more

Reply
robinHH
Frequent Visitor

Optimization of Data refresh in Power Query with usage of a Rest API

Dear Community,

I have a simple Power BI Desktop model which has one CSV-Document as a source in which every day 1,000 geolocations (longitude and latitude) are added.

In Power Query Editor each of the geolocations is reverse geocoded (Zip is analysed base on longitude and latitude). In order to do that a REST API of OpenStreetMaps is used. 

My question:
Is there a possibility to only recalculate the zip codes of the data that is new in the CSV document? Else, the amount of data growth daily and the time of refresh becomes quite high due to the low speed of the API.

 

Looking forward to you feedback 🙂
Rob 

1 ACCEPTED SOLUTION
parry2k
Super User
Super User

@robinHH you have somehow to work with Incremental Refresh and look for new lat/lng based on new records assuming there is some time stamp that can help you with incremental refresh which is the minimum requirement to get this going.

 

There are many posts on how to implement incremental refresh using CSV or RestAPI which can get you over the line.

 

Check my latest blog post Compare Budgeted Scenarios vs. Actuals I would  Kudos if my solution helped. 👉 If you can spend time posting the question, you can also make efforts to give Kudos to whoever helped to solve your problem. It is a token of appreciation!

Visit us at https://perytus.com, your one-stop-shop for Power BI-related projects/training/consultancy.



Subscribe to the @PowerBIHowTo YT channel for an upcoming video on List and Record functions in Power Query!!

Learn Power BI and Fabric - subscribe to our YT channel - Click here: @PowerBIHowTo

If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤


Did I answer your question? Mark my post as a solution. Proud to be a Super User! Appreciate your Kudos 🙂
Feel free to email me with any of your BI needs.

View solution in original post

1 REPLY 1
parry2k
Super User
Super User

@robinHH you have somehow to work with Incremental Refresh and look for new lat/lng based on new records assuming there is some time stamp that can help you with incremental refresh which is the minimum requirement to get this going.

 

There are many posts on how to implement incremental refresh using CSV or RestAPI which can get you over the line.

 

Check my latest blog post Compare Budgeted Scenarios vs. Actuals I would  Kudos if my solution helped. 👉 If you can spend time posting the question, you can also make efforts to give Kudos to whoever helped to solve your problem. It is a token of appreciation!

Visit us at https://perytus.com, your one-stop-shop for Power BI-related projects/training/consultancy.



Subscribe to the @PowerBIHowTo YT channel for an upcoming video on List and Record functions in Power Query!!

Learn Power BI and Fabric - subscribe to our YT channel - Click here: @PowerBIHowTo

If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤


Did I answer your question? Mark my post as a solution. Proud to be a Super User! Appreciate your Kudos 🙂
Feel free to email me with any of your BI needs.

Helpful resources

Announcements
Power BI DataViz World Championships

Power BI Dataviz World Championships

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now!

December 2025 Power BI Update Carousel

Power BI Monthly Update - December 2025

Check out the December 2025 Power BI Holiday Recap!

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.