Multiple json Affecting Performance

[Anonymous]

hello All,

I am a little bit stumped and wondering if its a powerBI issue or something Im messing up from my end.

I am trying to read Json data through a webservice. The problem is that the webservice only allows a certain number of rows to be exported per api call, so I have to call the same webservice multiple times and then append all the queries. 

The problem is that the entire thing takes forever to reload and takes up a lot of my system memory. Is there a workaround to optimize this process?

Would I be better off using a .NET wrapper to assemble the table outside powerBI and then loading it into PowerBI?

Any help will be greatly appreciated. Thank You!

[TeigeGao · Accepted solution]

Hi @Anonymous ,

Generally, in your scenario, PowerBI will store all data in memory, as a result, it will use so much memory. Actually, when the data amount is large, we can consider using some ETL tool to handle this operation, the ETL tool works well in handling memory when combine data.

Best Regards,

Teige