Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Power BI incremental refresh policy limitation

Hi Guys,   I am struggeling with such problem. I have a power BI report which is configured to pull the data from REST API and has defined incremental refresh policy. API however has a limitation o...
Need Help
lbendlin's avatar
lbendlin
Icon for Super User rankSuper User
2 years ago

Please read the article again, and then set your incremental refresh to store the last three years and to refresh the last day.

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Please read my answer again.

 

Setting up last 3 years causes that API is being requested in 1 year chunks in the initial dataset build, which causes API faults.  To prove it I could send yt video.

 

As I wrote in the first post, API is limited (!) to 10k records and 30secs timeout, so the question is: is it possile to achive some kind of solution with that setup which I got? 

 

The conclusion is that API is serving small portion of data and the desired resolution would be how to catch those small chunks in dataset and build on that data analysis.

 

Regards,

Artur

  • lbendlin's avatar
    lbendlin
    Icon for Super User rankSuper User
    2 years ago

    Store these replies as Parquet files and then ingest the Parquet files into a dataset.