Power query not loading all columns of a CSV

[hsimahf]

Hi,

I am using Power Query to manipulate data from a CSV. This CSV has many columns (5913) and only a couple of rows (4). As you might imagine, one of the first things I want to do is transpose the data. When I load the CSV into Power Query and then transpose it, I only get 2,672 rows. This is without any filtering or anything which would explain why the number of rows has gone down.

I have tried to find some evidence of a column limit on Power Query which might explain why some of the data is not making it through, but I have only seen references to limits of 10,000+ columns which would be sufficient for the data I have.

Of course I can transpose it using Excel first and then import as an Excel file, which is my current workaround, but this adds an extra manual step I would prefer to avoid since I am planning to repeat a process loading possibly hundreds of files this way.

Does anybody have any ideas as to what might cause this / how I can change it? Thank you in advance

If you want to try and recreate:

• The data in question can be accessed here: https://www.hestia.earth/cycle/xrfcawitqz2o?dataState=recalculated download the 'expanded' csv)
• Within that folder I am using the file ImpactAssessment-recalculated-expanded

[Chewdata]

Hey!

This may be caused by how the csv.document() 'read's' your csv-file. 
However it is hard to debug without the code or a sample of the original file. 

I see that you file also has  comma's in the values. You can try to alter the options in de Imported CSV step:
= Csv.Document(URLTOYOURCSV,[Delimiter=",", columns=10, Encoding=65001, QuoteStyle=QuoteStyle.None])

• remove the columns=x  expression, it will then try to load all available columns.
• Replace QuoteStyle=QuoteStyle.None for CsvStyle=CsvStyle.QuoteAfterDelimiter

[v-ssriganesh]

Hi @hsimahf,

May I ask if you have resolved this issue? If so, please mark it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

[hsimahf · Accepted solution]

Strangely, I may have fixed this. Firstly, a screenshot showing that my last column was the 2671st column.

I then clicked on the source, changed it to read it as a Text file rather than a CSV, then changed it back to CSV. Voila, all 5913 now appear. No idea why but posting here in case of use to others.