Forum Discussion
Unable to configure 'Copy data' activity for csv output from API - Marketo
Microsoft EmployeeHi pmcmonag2
Thanks for using Microsoft Fabric Community.
1. Can the Copy data activity be configured to take a csv response (rather than json)?
- Currently, the Microsoft Fabric Copy data activity is not directly configured to take a CSV response from a REST API call. While the Copy data activity can work with structured data formats like CSV (typically delimited text formats), it requires the data to be presented in a way it can parse. Directly interpreting a raw CSV response from a web activity might necessitate additional processing. However, it can handle delimited text files (like CSV) stored in Azure Blob Storage.
2. What is the Fabric alternative to creating a linked dataset to output a response or variable? (to output web activity response)
- In Microsoft Fabric, you can leverage the "For Each" activity to iterate through the array of responses obtained from the Web activity. Within this loop, you can utilize a nested "Copy data" activity to process each individual CSV response as a dataset. This approach allows you to handle the CSV data effectively. This approach allows you to treat the CSV data as a dataset within the Copy data activity.
3. Can the Copy data activity be configured to accept output from an activity (like a variable)? (rather than a fabric entity like a warehouse/lakehouse)
- It's important to note that the Copy data activity in Microsoft Fabric cannot directly accept output from an activity (like a variable) as its source. It requires a Fabric object (warehouse, lakehouse) as the input. Therefore, an intermediate approach like the "For Each" activity becomes necessary to process the CSV data retrieved from the Web activity.
I hope this information helps.
Thank you.
Thanks for the responses v-cboorla-msft .
I still don't quite understand how the ForEach approach in 2) can be implemented, as doesn't the restriction you call out in 3) still apply? It's important to note that the Copy data activity in Microsoft Fabric cannot
directly accept output from an activity (like a variable) as its source
The CopyData within the Foreach Loop still appears to require a Fabric object (lakehouse) as a source?
Perhaps easier to understand the output if I save off just the 'Response' off the call in a variable.{ "name": "CSVResponse",
"value": "email,firstName,lastName,company,leadScore\[email protected],Pat,McMonag,Microsoft,null\n
}
But this still makes it no easier to use CopyData within a ForEach?- v-cboorla-msft
Hi pmcmonag2
Apologies for the inconvenience and the delay in reponse.
Please reach out to our support team to gain deeper insights and explore potential solutions. It's highly recommended that you reach out to our support team. Their expertise will be invaluable in suggesting the most appropriate approach.
Please go ahead and raise a support ticket to reach our support team:
https://support.fabric.microsoft.com/support
After creating a Support ticket please provide the ticket number as it would help us to track for more information.
Thank you.
- v-cboorla-msft
Hi pmcmonag2
We haven’t heard from you on the last response and was just checking back to see if you've had a chance to submit a support ticket. If you have, a reference to the ticket number would be greatly appreciated. This will allow us to track the progress of your request and ensure you receive the most efficient support possible.
Thank you.
