Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
Jarek_Warsaw
Regular Visitor

Indexing csv files read from directory

Hello,

I’m attempting to load CSV files from a directory and would like to add an index to each of them, which would allow me to track error coordinates in the source data.

After reading the directory, I tried the following:

= Table.TransformColumns(Source, {"Content", each Table.AddIndexColumn(Csv.Document(_), "Index", 1, 1)})

This does add an index, but it seems that ‘Csv.Document(_)’ converts the binary form into a list with comma separators and places each line into a single ‘cell’. This transformation results in numerous errors in the data.

Is there a method to index these CSV files while maintaining their binary form?

 

Thanks a lot,

Jarek

1 ACCEPTED SOLUTION
lbendlin
Super User
Super User

Is there a method to index these CSV files while maintaining their binary form?

No.  At the very minimum you need to split the binary by the row delimiter  (for example LF), inject the index column, and then reassemble the binary.  Although at that point you might as well fully decode the files and load them into Power BI.

View solution in original post

1 REPLY 1
lbendlin
Super User
Super User

Is there a method to index these CSV files while maintaining their binary form?

No.  At the very minimum you need to split the binary by the row delimiter  (for example LF), inject the index column, and then reassemble the binary.  Although at that point you might as well fully decode the files and load them into Power BI.

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors