Forum Discussion

GFJ_BR's avatar
GFJ_BR
New Member
2 years ago
Solved

Parcial data missing from CSV/Text imported with double delimiter

Hello all.   I´m having some trouble with a file that was generated with ££ as the delimiter. This delimiter is common here in my team and we never had this problem before. The problem is that aft...
Need Help
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi GFJ_BR 

     

    Maybe this can be an alternative. First bring data into only one column without splitting, then use Split column By Delimiter feature to split it into multiple columns by "££". 

    let
    Source = Table.FromColumns({Lines.FromBinary(File.Contents("C:\xxxxxxxxxxxxxxxxxxxx.csv"), null, null, 65001)})
in
    Source

     

    Best Regards,
    Jing
    If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!

GFJ_BR's avatar
GFJ_BR
New Member
2 years ago

The file is generated with TERADATA SQL ASSISTANT, and I use the same aplication to create other files from other databases and had no errors during importing the files.
I noticed that for this database in specific the text file generated is slight different from the other ones, but have no idea why this is happening. I'm not changing nothing in configurations. 
The difference is exactly in the delimiter.

 

The data in file usually appear like this:

NRC££ID_PARQUE_PCC££INSTÂN./DESIG.££CNL££CIDADE££ÚLT.ATUAL.££DT_RETIRADA££ID_STATUS_PC££CLASSE££SEG

 

For this database the text inside the file shows this:

TR. CHAVE＃RAMAL＃ID FIXA＃DOC＃TITULAR＃LOGIN COTA플O＃N. PEDIDO＃DT. PEDIDO＃VENC. PEDIDO＃ST. PEDIDO

 

Based on some special characters that in first scenario exporting OK and in the second NOT OK, probably this is realy and encoding problem, but I really not changing nothing in config before file exporting. And to make the picture more weird, both MS EXCEL and also MS POWER BI recognizes the ££ as the delimiter in the second file. 

 

Both examples were opened in NOTEPAD++ as plain text files.

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi GFJ_BR 

 

Maybe this can be an alternative. First bring data into only one column without splitting, then use Split column By Delimiter feature to split it into multiple columns by "££". 

let
    Source = Table.FromColumns({Lines.FromBinary(File.Contents("C:\xxxxxxxxxxxxxxxxxxxx.csv"), null, null, 65001)})
in
    Source

 

Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!