Forum Discussion
Parcial data missing from CSV/Text imported with double delimiter
Hi GFJ_BR
Maybe this can be an alternative. First bring data into only one column without splitting, then use Split column By Delimiter feature to split it into multiple columns by "££".
let Source = Table.FromColumns({Lines.FromBinary(File.Contents("C:\xxxxxxxxxxxxxxxxxxxx.csv"), null, null, 65001)}) in SourceBest Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!
As per my previous response, "££" will not work if you put the parameters in an 'options' record. The 'DelimiterStyle error is just going to confuse things further so I think you should throw that away.
--
We know that ££ is a legitimate delimiter so I think you should focus your investigation elsewhere. Possibly a different encoding, possibly investigate how the file was produced in the first place (different language/ regional settings/source software?)
The file is generated with TERADATA SQL ASSISTANT, and I use the same aplication to create other files from other databases and had no errors during importing the files.
I noticed that for this database in specific the text file generated is slight different from the other ones, but have no idea why this is happening. I'm not changing nothing in configurations.
The difference is exactly in the delimiter.The data in file usually appear like this:
NRC££ID_PARQUE_PCC££INSTÂN./DESIG.££CNL££CIDADE££ÚLT.ATUAL.££DT_RETIRADA££ID_STATUS_PC££CLASSE££SEG
For this database the text inside the file shows this:
TR. CHAVE＃RAMAL＃ID FIXA＃DOC＃TITULAR＃LOGIN COTA플O＃N. PEDIDO＃DT. PEDIDO＃VENC. PEDIDO＃ST. PEDIDO
Based on some special characters that in first scenario exporting OK and in the second NOT OK, probably this is realy and encoding problem, but I really not changing nothing in config before file exporting. And to make the picture more weird, both MS EXCEL and also MS POWER BI recognizes the ££ as the delimiter in the second file.
Both examples were opened in NOTEPAD++ as plain text files.
Hi GFJ_BR
Maybe this can be an alternative. First bring data into only one column without splitting, then use Split column By Delimiter feature to split it into multiple columns by "££".
let Source = Table.FromColumns({Lines.FromBinary(File.Contents("C:\xxxxxxxxxxxxxxxxxxxx.csv"), null, null, 65001)}) in SourceBest Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!
