Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
6 years ago

880 MB CSV File

Hey Hey,

 

I have a 880 MB CSV which holds +- 17.000.000 rows.

I want to make a selection but unfortunately i get " error, not enough memory".

Does anybody know how to work with large CSV files?
Do i need to make use of another program?

Thanks in advance,

Vianney

Need Help

2 Replies

  • Greg_Deckler's avatar
    Greg_Deckler
    Icon for Community Champion rankCommunity Champion
    6 years ago

    Anonymous - Hard to troubleshoot something like that, how much memory do you have? Not sure what you mean by "trying to make a selection". I have worked with large CSV files in the 5-6 million row range. 

     

    One thing to check, go to File | Options and settings | Options. In Data Load, uncheck Auto date/time for new files. Also uncheck this under Data Load for the CURRENT FILE. Save your PBIX and refresh.

     

  • amitjzaveri's avatar
    amitjzaveri
    Icon for Resolver II rankResolver II
    6 years ago

    You can import a large CSV file via an ODBC driver. Here are the steps:

     

    1) Assuming ODBC driver is installed in your PC make sure to add "Microsoft Access Text Driver" to User DSN

     

    2) In Power BI

    Get Data > Other > ODBC > Connect

     

    3) DSN

    Select CSVFile or whatever name you have given

     

    4) Advanced Option - Connection String

    dbq=d:\filepath\;extensions=asc,csv,tab,txt

     

    5) Advanced Option - SQL Query

    select * from filename.csv

     

    Click OK

     

    6) If asked for credentials 

    Select "Default or Custom" and don't enter in any credential details unless necessary

     

    Click Connect

     

    Now data preview should come.

     

    Click Load or Transform

     

    Cheers!

     

    Mark this as an answer in case this resolves the issue