Forum Discussion
Importing CSV File
- Anonymous2 years ago
Yes i think that i am doing properly.
Importing with Management Studio it works fine.
Hi Torin78 ,
i think you can use a Derived Column transformation to create a new column that parses the JSON string.You can use the parse function to convert the JSON string into a structured format.
If your JSON strings are nested, use the Flatten transformation to break down the JSON into individual columns.
Add a Sink transformation to write the transformed data to your desired destination. You can also use this JSON code and have a look at this topic: azure data factory - ADF Copy activity to handle csv files with json fields - Stack Overflow
{
"type": "DerivedColumn",
"name": "ParseJSON",
"derivedColumns": [
{
"name": "ParsedJSON",
"expression": "parse({YourJSONColumn})"
}
]
}
Best Regards
Yilong Zhou
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
- Torin782 years agoNew Member
Hi Yilingo Zhou i dont want to parse the json i want to store the whole json in a filed, but the pipeline break the field when it find a ",".
- Anonymous2 years agoNot applicable
Hi Torin78 ,
Here are some steps you can follow:
1. Define the Source Dataset:
In ADF, create a dataset for your CSV file.
Ensure that the Column Delimiter is set to , and the Quote Character is set to ".
2. Use Data Flow:
Create a Data Flow in ADF.
Add a Source transformation and connect it to your CSV dataset.
In the Source settings, ensure that the Quote Character is set to ".Best Regards
Yilong Zhou
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
- Anonymous2 years agoNot applicable
Yes i think that i am doing properly.
Importing with Management Studio it works fine.