Unable to map destination in copy activity due to hierarchical data.

[Anonymous]

I'm facing an issue extracting the payload from an REST API call with a copy activity. 

In Synapse we were able to map this hierarchy and extract the lower 'value'. Containing the csv'data. 

Within Fabric, this is not possible, it seems. 

Output when reading the .json in a notebook, looks like; 

{'d': {'error': None, 'filterValues': [], 'payload': 'Department Tracker,User Department Name,User Name,Time Off Type,Booking Start Date,Booking End Date,Time Off Hrs,Time Off Days,Approval Status,Time Off Comments,Employee ID,User Email,External\r\nxxx.BE.ADMIN,Administration,"xx, xx",Vacation previous year,14/02/22,14/02/22,4.00,0.50,Approved,,xx,xx@xx.eu,NO\r\xxxx.BE.ADMIN,Administration,"xx, xx",Vacation previous year,21/02/22,21/02/22,8.00,1.00,Approved,,xxx,xx.xx@xx.eu,NO\r\n.....}}

I need to get started from the part after; 'payload' and treat the data as csv to start transforming it further. 

Thanks in advance for your possible assistance. 

[v-cboorla-msft]

Hi @Anonymous 

Thanks for using Microsoft Fabric Community.

Could you please provide some additional information like screenshots of the copy activity configuration, this will help us to understand your query and guide you in better way.

Mean while please refer similar thread that might help you : Solved: Copy activity from REST in CSV format - Microsoft Fabric Community

Thank you.

[Anonymous · Accepted solution]

This came up; 

But it got solved using a function in Pyspark when processing the data in a notebook. 

[v-cboorla-msft]

Hi @Anonymous 

Glad that your query got resolved and able to find some insights and thank you for sharing the same with the community as it can be helpful to others.
Please continue using Fabric Community for further queries.

Thank you.