Forum Discussion

kuperov's avatar
kuperov
New Member
10 years ago
Solved

Power BI Desktop Limits -- stops loading after ~95 million rows?

Hi,   I am having trouble loading a large data set into Power BI. I have two tables: 'Loans' (42 million rows) and 'Payments' (2 billion rows), both stored in PostgreSQL.   The first loads just f...
  • kuperov's avatar
    kuperov
    10 years ago

    Problem sorta solved -- I'm giving up.

     

    If anyone with the same problem finds this thread, you can stop Power BI from truncating the data by increasing hte CommandTimeout parameter. In your import query:

     

    Source = PostgreSQL.Database("localhost", "loans",[CommandTimeout=#duration(1,1,1,1)]),

     

    There seems to be an inbuilt query limit of 10 minutes or so, and Power BI doesn't notify you if that timeout is binding; it just truncates the data. Obviously reading 2,000,000,000 rows takes >10 min. (Hey @Microsoft -- you should probably fix this or some of your users are going to get very wrong results sometimes.)

     

    In my case Power BI loaded the data then borked anyway, saying it don't have enough memory. It's not clear to me what this means -- there is plenty of virtual memory in a 64 bit process so I guess physical memory? -- maybe these implicit limits could be made clearer to users, too.