Forum Discussion

jstupl's avatar
jstupl
Regular Visitor
9 years ago
Solved

import CSV file with more than 1048576 rows

Hi,   I want to upload a CSV file with more than 1048576 rows. It works fine until it hits that number. Suspiciously, that number is also the maximum number of rows for Excel...   Is there way to...
Need Help
  • jstupl's avatar
    jstupl
    9 years ago

    And finally a solution:

     

    1) Import the data with the Power BI desktop app.

    2) Save as Power BI .pbix file.

    3) Import pbix file to online app.

Anonymous's avatar
Anonymous
Not applicable
9 years ago

Hi jstupl,

If you use Excel to open the CSV file, you are hitting the Excel row limitation which is 1,048,576. Reference: https://support.office.com/en-us/article/Excel-specifications-and-limits-ca36e2dc-1f09-4620-b726-67c00b05040f?ui=en-US&rs=en-US&ad=US .

In your scenario, to see the raw data in CSV file, you can consider to split the imported CSV file into different worksheets using VBA code or other online tool, then import CSV file to Power BI.

There is a similar thread about handling large CSV file for your reference.

https://social.technet.microsoft.com/Forums/office/en-US/54ca6d3a-4b1c-4318-aa8c-7ac803d3af69/what-is-the-maximum-file-size-for-csv-that-excel-can-open-excel-2013-64bit?forum=excel
 

Thanks,
Lydia Zhang

  • jstupl's avatar
    jstupl
    Regular Visitor
    9 years ago

    Hi Anonymous,

     

    Thanks for your reply. I thought that Power Bi, contrary to Excel, had a larger limit to the number of rows it could handle.

     

    It looks like that Power Bi has the same restriction to 1,048,576 rows?

     

    Thanks,

    Jan

    • Anonymous's avatar
      Anonymous
      Not applicable
      9 years ago

      Hi jstupl,

      There is no limit on the rows of data you can import into Power BI. Are you able to see all the data in Excel? If not, please use other program to open CSV file, make sure you can view complete data in the opened CSV file and then import data from CSV to Power BI.

      Thanks,
      Lydia

      • jstupl's avatar
        jstupl
        Regular Visitor
        9 years ago

        Hi Anonymous,

         

        I cannot see all the data in Excel because Excel has a limit at 1,048,576 rows. However, I can see all the data when I open the file with wordpad. Also, if I cut away the first 1,048,576 rows of the file before importing, the dataset will import into Power Bi, until it hits 1,048,576 rows again, and then stops.

         

        So to me that is a very strong indication that there is actually a limit to Power Bi, at least to the number of lines it can import from a CSV file.

         

        Do  you have an idea how to get around that?

         

        Best,

        Jan