Forum Discussion
pipeline Copy Activity JSON file with multiple documents - Mapping
Wasn't clear from your description where you intend to send the data or what your specific issue was. But I attempted this using the example file and send it to a lakehouse table.
You have to set set up a collection reference which is the array you want to iterate over. In your structure that would be `$['value']` from there you map the columns relative to the collection path. Screenshot of my mapping...
27 rows copied from the example file...
If you are trying to send it somewhere else should be similar principle. Note in the example I also added an additional column `runDTS` for debug.
Then Write some code in python notebooks and rest UI/UX in Data Factory. This is how I should do:
Python --> Spark Dataframe --> Convert to Delta Table ( This part programmimg code ) and once delta table is ready, write copy activity in Fabric Data Factory.