Dataflow - Automatically Triggered with Parameters

[tan_thiamhuat]

I am testing something on the Copy Data from SFTP Server to SQL Server, and to be triggered upon arrival of files into the SFTP Server. I am trying to use Parameter for the Filename which is sent to the Outlook for notification. However, I notice with Parameter, each time we need to key in the filename manually. Is that the correct method I am using for the Parameter?

[Rufyda]

Hi
Glad that your query got resolved. Please continue using Fabric Community for any help regarding your queries.

[v-prasare · Accepted solution]

hi @tan_thiamhuat ,

As we haven’t heard back from you, we wanted to kindly follow up to check if there is any progress on above mentioned issue. let me know if you still need any further help here.

Thanks,

Prashanth Are

MS Fabric community support

[v-prasare]

hi @tan_thiamhuat ,

As we haven’t heard back from you, we wanted to kindly follow up to check if there is any progress on above mentioned issue. let me know if you still need any further help here.

Thanks,

Prashanth Are

MS Fabric community support

[v-prasare]

Hi @tan_thiamhuat,

Thanks for reaching MS Fabric Community support.

Using pipeline parameters manually requires to enter values during each run, which is not feasible for automated workflows triggered by file arrival. manual parameter input is not a suitable approach when aiming for automation.

To automate your pipeline and avoid manual inputs, use dynamic content by first checking the SFTP folder for files using Get Metadata . This activity returns the list of files in the folder, loop through files in Metadata activity and use each filename directly in your copy activity and in your email notification.

This way, the pipeline automatically picks up whatever file is present, processes it, and includes the filename in the message, all without needing to set any manual parameters.

Thanks,

Prashanth Are

MS Fabric community support

If this post resolves your issue, please mark it as "Accept as solution" and give kudos if you found it helpful.

[tan_thiamhuat]

I get the idea, but where do I put the loop condition to loop through the files for their filenames?

[v-prasare]

Hi @tan_thiamhuat,

start by using the Get Metadata activity and set the Field List to childItems — this fetches all the file names in the SFTP folder. Then, add a ForEach activity after Get Metadata to loop through each file. Inside the loop, place your If Condition and use @item().name to access the current file name. This lets the pipeline process each file one by one and send notifications with the correct filename

Thanks,

Prashanth Are

MS Fabric community support