How to create event stream, reflex and connect it to pipeline.

[rautd]

Hi All,

We have pipeline which reads multiple zip files and then execute these multiple zip files parallely to generate output. Right now this pipeline is triggerd manually after placing multiple files in landing folder.

We want to automate this process i.e. the moment the files are placed in landing folder the pipeline should be triggered automatically.

To achieve this result, we have created event stream and reflex. But the thing is when the file is placed in landing folder, we can see this file in event stream as well as in reflex but the pipeline is not triggered.

Can somebody guide us in how to achieve this automatic triggering of pipeline using event stream and reflex in Fabric and what could be the reason that we are not able to achieve the result.

Thanks,

Deepmala

[Anonymous · Accepted solution]

Hi @rautd ,

Currently Fabric supports Scheduled triggers for pipelines. But more triggers will be added to Microsoft Fabric shortly. Fabric can use the schedule to automatically run pipeline. We are adding more triggers supported by ADF in Microsoft Fabric.

For more details please refer: Differences between Data Factory in Fabric and Azure

Inside the Fabric Data Factory Pipeline Design Canvas, there is a Trigger button to create a Reflex Trigger for the pipeline, see details: Data pipelines storage event triggers in Data Factory (Preview) 
As for pipelines, they cannot be used as a source or destination for Eventstream.

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly.