Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
4 years ago

Group Data From Azure Table timeout

My report has two table A and B,

A is from Azure Table,

B is generated by A (B = select A.*, sum(A.xxx) from A inner join A )

 

And I found that if data source is from Azure Table, although refreshing dialog said that A and B is about 200MB, it takes more than 20GB data in my disk. Desktop refreshing takes more than 1 hour, and schedule refresh in Power BI Service timeout.

 

I wonder is it a bug when data is from Azure Table? 

To work around this issue, currently I will use an azure function to aggrate data then Power BI consume it directly. But if power bi could aggregate data, it would be better.

4 Replies

  • Anonymous , While loading power will show the huge size, and later when you save it it will not show that much of size.

     

    I usually prefer a deployment pipeline for this. so I do not have to load all data in dev. I load limited data using power query parameters and change that to a bigger range in power bi service.

     

    In case you want to opt for that

    This a power bi premium feature

    Premium- Deployment Pipeline, Load More Data on Test/Prod : https://youtu.be/l69cnWkoGX0

    • Anonymous's avatar
      Anonymous
      Not applicable

      Hi, amitchandak 

      In fact, fetching all data from one table is fine for me, but if do aggregate in power query from a Azure Table source, it will timeout

      • amitchandak's avatar
        amitchandak
        Super User

        Anonymous , Try to increase memory management cache to 10-12 GB and check. It should be supported by RAM and Virtual Memory - Under options and setting

         

         

         

        Try same in dataflow onces. does it make any difference?