Forum Discussion
How to Fetch 11M+ Rows from OData Entity in Power BI with Incremental Refresh?
Hi Anonymous ,
Since our database is very large, we plan to initially load all historical data up to the last 6 months. Going forward, we will enable incremental refresh to automatically load only new and updated data.
Hi Atul0215 ,
Thank you for reaching out to the Microsoft Fabric Community Forum about the issue you are encountering.
Thank you for the helpful response Akash_Varuna. As Akash suggested, the provided answer is accurate and should help resolve the issue. Additionally refer the Odata Feed documentation . If it works for you, please consider giving Kudos and marking it as the accepted solution to help others find it more easily.
If still facing difficulty in resolving the issue, please feel free to reachout.
Regards,
Pallavi.
Hello Anonymous
Thank you for your response. I have already tried the solutions mentioned by Akash_Varuna , but I am still unable to refresh or load the data, even in Dataflows. I only need to fetch a single entity that contains a very large amount of data.
Regarding incremental refresh, my understanding is that it only retrieves new or changed data, whereas I need the complete historical dataset, which is quite large.
I am now exploring the BYOD (Bring Your Own Database) solution to handle this large dataset. Would this be a good approach in my case?
Any further guidance would be greatly appreciated.
Hi Atul0215 Bring Your Own Database is a good approach but please do look care of the cost and hosting of the database and according to the budget
If this post helped please do give a kudos and accept this as a solution
Thanks In Advance
