Forum Discussion
Large JSON file (86GB) won't load into PowerBi
We've got the following problem:
We are trying to load a 86 GB JSON-File as a datasource into PowerBi, after loading it as a datasource (eating over 600GB of RAM and almost 9 hours), we still need to modify the content (e.g. transform into table, rename column ...). So if we refresh our data we have to wait another few hours getting the message: "evaluation in progress". After that it skips back to "waiting for other queries" and seems stuck there for a few hours once again. After all we haven't got any results.
Therefore the question if someone has had the same issue and found a solution?
or
Is there a (faster) way to load this amount of JSON-data?
Hi Anonymous ,
Prepare simple example data containing all the cases that appear in the data. Then perform your conversion operation in the power query. When there are no problems, modify the data source to a formal file to refresh your data. However, this can also be time consuming. The best way is to put the data into a database. For example, SQL server and configure incremental refresh to shorten the refresh time.
Best Regards
Community Support Team _ chenwu zhu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
1 Reply
- v-chenwuz-msft
Community Support
Hi Anonymous ,
Prepare simple example data containing all the cases that appear in the data. Then perform your conversion operation in the power query. When there are no problems, modify the data source to a formal file to refresh your data. However, this can also be time consuming. The best way is to put the data into a database. For example, SQL server and configure incremental refresh to shorten the refresh time.
Best Regards
Community Support Team _ chenwu zhu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.