880 MB CSV File

[Anonymous]

Hey Hey,

I have a 880 MB CSV which holds +- 17.000.000 rows.

I want to make a selection but unfortunately i get " error, not enough memory".

Does anybody know how to work with large CSV files?
Do i need to make use of another program?

Thanks in advance,

Vianney

[amitjzaveri]

You can import a large CSV file via an ODBC driver. Here are the steps:

1) Assuming ODBC driver is installed in your PC make sure to add "Microsoft Access Text Driver" to User DSN

2) In Power BI

Get Data > Other > ODBC > Connect

3) DSN

Select CSVFile or whatever name you have given

4) Advanced Option - Connection String

dbq=d:\filepath\;extensions=asc,csv,tab,txt

5) Advanced Option - SQL Query

select * from filename.csv

Click OK

6) If asked for credentials 

Select "Default or Custom" and don't enter in any credential details unless necessary

Click Connect

Now data preview should come.

Click Load or Transform

Cheers!

Mark this as an answer in case this resolves the issue

[Greg_Deckler]

@Anonymous - Hard to troubleshoot something like that, how much memory do you have? Not sure what you mean by "trying to make a selection". I have worked with large CSV files in the 5-6 million row range. 

One thing to check, go to File | Options and settings | Options. In Data Load, uncheck Auto date/time for new files. Also uncheck this under Data Load for the CURRENT FILE. Save your PBIX and refresh.