Forum Discussion
Bug: Copy Data Delimited File Settings
Hi Anonymous ,
The internal team has confirmed that its not a bug. This is by-design behavior. Escape char should also be escaped. The correct csv value is "x\\y\\z"
Hope this helps. Please let us know if you have any further questions.
Hi Anonymous
Thanks for the ask and using Microsoft Fabric Community.
At this time, we are reaching out to the internal team to get some help on this. We will update you once we hear back from them.
Appreciate your patience.
Thanks.
Hi Anonymous ,
The internal team has confirmed that its not a bug. This is by-design behavior. Escape char should also be escaped. The correct csv value is "x\\y\\z"
Hope this helps. Please let us know if you have any further questions.This is a dangerous design. The point of a quoted field is to treat anything between the quotes as free text. Being required to specify an escape charater means there will always be a chance that the job will fail because the free text data could legitimatey contain that escape character. To make this work I'd have to create a process to pre-screen the data looking for escape characters and adjusting them before loading.
A far better solution is to remove the requirement to have an escape character. If I could set it to "none" then I'll never have a problem loading a quoted free-text field.
Hi Anonymous
It should be delimited text expected behavior. If the escape char doesn't be escaped , how could we handle the case when escape character is the last char of column. It will make it bad data.
Take below example, csv data is "xyx\". If the last escape character isn't escaped, it will wrongly escape the quote character and make the whole data bad. The correct data should be "xyx\\". Then it will be consumed correctly.