Forum Discussion
How power BI handle large DataSet?
Hi TomMartens
Thanks for your reply , I think you suggestion have some useful benefits. I have few dounts needs to clarify on your suggestion ,since im new to this method.
1. Separate the content from the data by using two different pbix files - What is usecase for this method, is it also supports size management?
2.. Azure Automation script- According to my understanding, you're suggesting that you write an Azure automation script that pulls data from elastic search and converts it into small documents and save it in blob storage, which you can then connect to PowerBI using Azure Blob Storage. Correct me if i was wrong.
Thanks
Hey Maggi029 ,
in regards to 1
next to be able to develop the data model and the content in parallel, it's important to know, that you can't download the pbix file once you have enabled incremental refresh.
Incremental refresh does not directly support handling large files, but you can reduce the duration of a data refresh as only the incremental will be added to the model. This will become a little bit more complex if the source are files, but there are many posts out there, which are describing the proper configuration. The one of GilbertQ is my favorite: How you can incrementally refresh any Power BI data source (This example is a CSV File) - Reporting/Analytics Made easy with FourMoo and Power BI
in regards to 2
Yes, accessing files from a blob store, is more simple than publishing a single large pbix file to the Power BI service.
Regards,
Tom