Forum Discussion

jstupl's avatar
jstupl
Regular Visitor
9 years ago
Solved

import CSV file with more than 1048576 rows

Hi,   I want to upload a CSV file with more than 1048576 rows. It works fine until it hits that number. Suspiciously, that number is also the maximum number of rows for Excel...   Is there way to...
Need Help
  • jstupl's avatar
    jstupl
    9 years ago

    And finally a solution:

     

    1) Import the data with the Power BI desktop app.

    2) Save as Power BI .pbix file.

    3) Import pbix file to online app.

jstupl's avatar
jstupl
Regular Visitor
9 years ago

Hi Anonymous,

 

Thanks for your reply. I thought that Power Bi, contrary to Excel, had a larger limit to the number of rows it could handle.

 

It looks like that Power Bi has the same restriction to 1,048,576 rows?

 

Thanks,

Jan

Anonymous's avatar
Anonymous
Not applicable
9 years ago

Hi jstupl,

There is no limit on the rows of data you can import into Power BI. Are you able to see all the data in Excel? If not, please use other program to open CSV file, make sure you can view complete data in the opened CSV file and then import data from CSV to Power BI.

Thanks,
Lydia

  • jstupl's avatar
    jstupl
    Regular Visitor
    9 years ago

    Hi Anonymous,

     

    I cannot see all the data in Excel because Excel has a limit at 1,048,576 rows. However, I can see all the data when I open the file with wordpad. Also, if I cut away the first 1,048,576 rows of the file before importing, the dataset will import into Power Bi, until it hits 1,048,576 rows again, and then stops.

     

    So to me that is a very strong indication that there is actually a limit to Power Bi, at least to the number of lines it can import from a CSV file.

     

    Do  you have an idea how to get around that?

     

    Best,

    Jan

    • Anonymous's avatar
      Anonymous
      Not applicable
      9 years ago

      I think it's not quite that Power BI and Excel can't handle that many rows, it's that they can't parse a CSV file beyond those rows. I'm sure Power BI shares some code with Excel for handling files. I would try changing the file extension and trying to import it as a delimited text file instead of a CSV.

      • jstupl's avatar
        jstupl
        Regular Visitor
        9 years ago

        Hi Anonymous,

        Thanks for suggesting a workaround.

         

        I tried witching the extension to .txt. I got: "Power Bi only supports Excel, Power Bi Desktop, and CSV files".

         

        Excel cannot handle more than 1,048,576 rows. That is the maximum you can have in a worksheet.

         

        Best,

        Jan