Forum Discussion

icassiem's avatar
icassiem
Icon for Post Prodigy rankPost Prodigy
2 years ago
Solved

Large Volume of data broken into chunks with multiple API Calls

Good day, 

I have posted in service but thought this might be suited to desktop

 

I have a large dataset (1m records), we are trying to provide the data to a client via an API that has a param for orgID and areaID

The API only returns the dataset for the combination of orgID + areaID

"Me thinking out loud"

1. For powerbi to load all data, should i do a loop and meaning get a list of orgID + areaID and execute the API per combination and append the dataset > How ?

2. Not sure if Direct Mode can do this, as the API was developed on the bases of Lazy load similar to an app based on user selection fetches data for the selection - but this is not what i understand of pbi

 

Please what other options do i have, as loading the data in a storage layer is not an option as its built for external clients power users?

 

Please Any Help, Thanks

2 Replies