Forum Discussion

MP_123's avatar
MP_123
Microsoft Employee
9 years ago

Data Capacity

hi,

i have a sql view with size of 16000MB, i have abput 4 duplicates of this view in the .pbix file in order to deal with complex data & business.

is it too big fot power BI to deal with? my computer crushes again and again when trying to apply query.

(i have pro User)

what are my options?

thanks a lot

** comments after checking

 

i have another report with table size of 337 in Azure  SQL Datawarehouse and importing has no problem.

 

the view with 16000 MB is on SQL server, but has complex M functions.

 

another comment- my computer crushes even though the query is only select * from table

(16000 MB and about ~90M rows)

i suspect that this even crushes the server

7 Replies

  • MP_123's avatar
    MP_123
    Microsoft Employee

    Hi,

    please can somoene tell me with whom I can get advice from?

     

    thanks

    • hugoberry's avatar
      hugoberry
      Responsive Resident

      If your computer crushes that might be sign of a bigger issue. Might need to check the system event logs for that.

      As for how much data you can fit in Power BI Dektop, you still are long way to go. I've managed to load 4 bn rows (232-2 to be precise) into Power BI.

       

      https://querypower.com/2017/02/04/power-bi-desktop-limit/

       

      As to your particular case run though the following checklist:

      • have you defined a CommandTimeout?
      • have you tried to Buffer the data? Very useful if you are doing lots of M processing in your queries.
      • have you tried splitting out the initial select query into chunks? I know that Power BI gives you very little control over the parallelism that you can achieve, but you can trick it with merging queries that wait on other queries to finish (Table.Combine)
      • check the trace logs from Power BI and also fire profiler on SQL Server side to get an idea on what is actually happening with that select * from table
      • MP_123's avatar
        MP_123
        Microsoft Employee

        hi hugoberry thank you very much for you reply

         

        can you elaborte more about the checklist? i don't know these things you mentioned.

        what is that CommandTimeout? where can I defined it? also don't know what is buffering the data

        thanks a lot again