Escape character vanishes on load. JSON field. Databricks connector

Hi Anonymous

Thanks for the reply.

Your first suggestion sadly won't work, because the fields we are dealing with a custom fields in SAP. New ones can be added and the are barely any restriction for neither label or value. In other words, at any point there can be double quotes in the strings. Therefore we have no reliable way to do the replace value without messing with the required double quotes of the JSON structure.

As for your second suggestion, how exactly would you go about validating and correcting the JSON string with a custom column and M?

Thanks and beste regards

Manuel