How can I automate a pipeline in Fabric?

[supri03]

Hey all, 

I've successfully established a pipeline to import data from Azure Blob into our Fabric Lakehouse. Now, I'm exploring ways to automate the addition of new files from different sources into our Lakehouse. Specifically, is there a method to schedule this pipeline for automatic updates as new data arrives? Additionally, it's crucial that changes in the source data reflect accurately within our Fabric environment.

If this is possible in Fabric, how can I achieve this?

Thanks!

[NandanHegde]

Hey,

unfirtunately as of today Pipelines only support scheudled trigger and there are no APIs associated with the pipelines to trigger them externally.

So for now, event based triggers are not possible for Fabric pipelines.

[supri03]

Oh Alright, do you have a resource or documentation that talks about this? 

[v-cboorla-msft · Accepted solution]

Hi @supri03 

Thanks for using Microsoft Fabric Community.

Currently Fabric supports Scheduled triggers for pipelines. But more triggers will be added to Microsoft Fabric shortly. Fabric can use the schedule to automatically run pipeline. We are adding more triggers supported by ADF in Microsoft Fabric.

For more details please refer: Link

I hope this information helps. Please do let us know if you have any further questions.

Thanks.

[v-cboorla-msft]

Hi @supri03 

Glad that your query got resolved.

Please continue using Fabric Community for any help regarding your queries.

[NandanHegde]

https://community.fabric.microsoft.com/t5/Data-Pipelines/Is-it-possible-to-do-an-event-based-trigger...

MSFT doc:

https://learn.microsoft.com/en-us/fabric/data-factory/pipeline-runs