Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

A new Data Days event is coming soon! This time we’re going bigger than ever. Fabric, Power BI, SQL, AI and more. Don't miss out.

Reply
Anonymous
Not applicable

Incremental Refresh for Dataflow calling Source API Multiple TImes

We have Dataflows that utilize API Sources that we would like to incrementally refresh. These are working as expected since the source filters the data to the latest snapshot data which has a Data Through Date that allows us to detect the period we want to refresh. We are using incremental to support reporting on current and prior period data.

 

The issue we are seeing is that each time the incremental refresh runs, Power BI makes multiple calls to the source API.  While this doesn't present a problem for most of our sources, we have a couple that provide larger result sets and are memory intensive.  Making multiple calls to the source (5-8x within 30 seconds of the refresh starting) uses too much memory and ultimately brings down that API.  

 

When we run full refreshes, the Power BI Service only calls the source once.  

 

A couple of things to note:

  1. The Dataflow has one Entity (The API Source)
  2. There are multiple transformation steps (e.g. taking the JSON Doc, converting it to a table, applying data types, etc.)

 

Any idea why the Source API would be called so many times in rapid succession?

1 REPLY 1
lbendlin
Super User
Super User

When you say Incremental Refresh are you referring to the Power BI version (including RangeStart and RangeEnd datetime filters for the data source, and Power BI's partition management), or something that you have created manually in your query?

Helpful resources

Announcements
May Power BI Update Carousel

Power BI Monthly Update - May 2026

Check out the May 2026 Power BI update to learn about new features.

Fabric SQL PBI Data Days

Data Days 2026 coming soon!

Sign up to receive a private message when registration opens and key events begin.

New to Fabric survey Carousel

New to Fabric Survey

If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.