Dataflow - Automatically Triggered with Parameters

[tan_thiamhuat]

I am testing something on the Copy Data from SFTP Server to SQL Server, and to be triggered upon arrival of files into the SFTP Server. I am trying to use Parameter for the Filename which is sent to the Outlook for notification. However, I notice with Parameter, each time we need to key in the filename manually. Is that the correct method I am using for the Parameter?

[v-prasare]

Hi @tan_thiamhuat,

Thanks for reaching MS Fabric Community support.

Using pipeline parameters manually requires to enter values during each run, which is not feasible for automated workflows triggered by file arrival. manual parameter input is not a suitable approach when aiming for automation.

To automate your pipeline and avoid manual inputs, use dynamic content by first checking the SFTP folder for files using Get Metadata . This activity returns the list of files in the folder, loop through files in Metadata activity and use each filename directly in your copy activity and in your email notification.

This way, the pipeline automatically picks up whatever file is present, processes it, and includes the filename in the message, all without needing to set any manual parameters.

Thanks,

Prashanth Are

MS Fabric community support

If this post resolves your issue, please mark it as "Accept as solution" and give kudos if you found it helpful.

[tan_thiamhuat]

I get the idea, but where do I put the loop condition to loop through the files for their filenames?