topic Re: Synapse - Dynamic Filename in Data Engineering

Synapse - Dynamic Filename

Ivan1980 — Mon, 27 May 2024 09:34:02 GMT

Source: SAP REST API
Sink: CSV files on my blob storage

I am extracting the source based on a keydate parameter,

"/RESTAdapter/XYZ/Dashboard/Advances?$top=1000&$skip=0&$keydate=2024-05-27"

I would like the sink filename to be Advances20240527.csv

Re: Synapse - Dynamic Filename

Anonymous — Mon, 27 May 2024 09:43:32 GMT

Hi @Ivan1980 ,

Thanks for using Fabric Community.
Can you please share the screenshot of your pipeline to understand your pipeline flow and configuration?
If you can provide these details, I can understand your query and guide you better.

I would also like to know is keydate value is dynamic?

Re: Synapse - Dynamic Filename

Anonymous — Wed, 29 May 2024 14:51:46 GMT

Hello @Ivan1980 ,

We haven’t heard from you on the last response and was just checking back to see if you got a chance to check my previous response.

Thanks

Re: Synapse - Dynamic Filename

Anonymous — Thu, 30 May 2024 11:18:51 GMT

Hello @Ivan1980 ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .
Otherwise, will respond back with the more details and we will try to help .

Thanks

Re: Synapse - Dynamic Filename

jwinchell40 — Fri, 31 May 2024 12:57:59 GMT

@Ivan1980 - You can parameterize the filename for the destination. The link below shows the view from ADF; but you can do this in Fabric Pipelines as well. I had been doing it when pulling data from an API like you.

https://learn.microsoft.com/en-us/answers/questions/1332645/how-to-set-sink-filename-to-variable-value