Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
10 years ago

Power BI not Importing All Records

Hi All,    I've got a very simple data table (although very large) from Access that I've tried to import into Power BI, however not all of the records are coming over. I don't have any filters on t...
Need Help
pqian's avatar
pqian
Icon for Microsoft Employee rankMicrosoft Employee
10 years ago

I haven't heard anything like this. Definitely a serious issue if this is a bug. Can you use "Send a frown" button from the workbook that's missing data, and report the issue that way?

 

Another thing to try: PowerQuery for Excel, see if the issue repros there.

Anonymous's avatar
Anonymous
Not applicable
10 years ago

I'll try Power Query.

 

Just an update - I reuploaded my data table and it stopped at the exact same place. I haven't done a lot of testing, but it looks like PowerBI can only import 1,048,501 records in one table. 

  • pqian's avatar
    pqian
    Icon for Microsoft Employee rankMicrosoft Employee
    10 years ago

    Anonymous This maybe related to an issue we uncovered recently around error handling during importing. I suspect that around 1 million rows there is an error and we aren't handling it correctly. This issue should be fixed soon.

     

    Meanwhile, here are somethings you can try:

    1. Split into multiple tables with Skip+Top, see if you can get to all the data that way

    2. Add a Table.Buffer() to your query, that may have better error handling but will require large amount of memory.

  • ryans's avatar
    ryans
    Icon for Helper I rankHelper I
    10 years ago

    Anonymous it can definitely handle more than 1,048,501 records so don't discount it yet! I have tables with 5 mm + records I am working with.

    • Anonymous's avatar
      Anonymous
      Not applicable
      10 years ago

      ryans Well that's good news and bad news then. I'm happy to hear that PowerBI should be able to handle the size, but now I'm left with my original problem. :catsad:

       

      I hope it's what pqian said and it should be fixed soon.

      • pqian's avatar
        pqian
        Icon for Microsoft Employee rankMicrosoft Employee
        10 years ago

        Anonymous Give Table.Buffer a try, if it is the issue I mentioned, then it means at 1mil rows the server returned an error, you still need to go chase that down.

         

        Actually you can use any function that breaks folding to the DB and require buffering rows locally. A simple split column should do it too.