Forum Discussion

FabricRooky's avatar
FabricRooky
Advocate I
2 years ago
Solved

Loading Tab Separated CSV file into Delta Tables

Hello,   Is there a way to load a Tab Separated CSV file into Delta Tables from the lakehouse? The image / error below explains well my paint point :   I guess it is not possible? unless w...
data engineering
Lakehouse
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi FabricRooky 

     

    We have escalated it internally and got a confirmation that Tab is treated as a whitespace in Spark which we use to convert the data to a delta table. It is not supported currently. Please vote up the Microsoft Idea. It is in “Under Review” status which means this idea is under PG’s review.

     

    frithjof_v Thank you for paying attention to this and providing the link to the idea.

     

    Best Regards,
    Jing
    If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!

FabricRookyµ007's avatar
FabricRookyµ007
Regular Visitor
2 years ago

no, they are not in qutation marks... (no need, right)

frithjof_v's avatar
frithjof_v
Community Champion
2 years ago

I see. I don't have experience with tab delimited csv.

 

I tested both with and without quotation marks now. Both got errors.

 

With quotation marks the error is "Bad CSV header line (...)".

 

Without quotation marks the error I get is the same as the one you show.

 

 

I also tested loading a comma-delimited CSV into table and it works.

 

So the problem seems to occur when trying to load tab-delimited csv into table.