Forum Discussion

KGU_16031986's avatar
KGU_16031986
Advocate I
1 year ago
Solved

How to Trigger pipeline using Event trigger

I have an ETL which I need to trigger when blob created or updated. In my Azure storage, My blob path is landing/General/test.csv My storage account:Peausefilesystem How do I get this created, ...
  • wardy912's avatar
    1 year ago

    Hi KGU_16031986 

     

     I know you are only having issues with a small part of this, but for other community users I will detail the full configuration. Firstly, you will need to register 'Microsoft.EventGrid' in your azure subscription. Go to Subscription/Resource providers and search 'Microsoft.EventGrid' and click 'register'.

     

    In your data pipeline, select 'triggers' from the top toolbar, then 'add trigger'. You'll be presented with this menu on the right.

     

    When you select 'select source monitor' you are presented with a list of option, choose 'Azure blob storage events', then you will see a menu where you can select your storage account.

     

     

    Next you need to configure the alert, choose all events you want to be included in the trigger, for this example i've select 'blobcreated', 'blobdeleted' and 'blobrenamed'.

    Now we need to add a filter that contains the full path. Use 'Subject', 'Begins with', then add the following path

     

    /blobServices/default/containers/<your-storage-account-name>/blobs/landing/General/test.csv

     

     

    Click save, then create rule.

     

    In my test pipeline, I have a set variable activity to show the successful test.

    When I change the title of test.csv in my storage account the pipeline runs. 

     

     

    You can view the details of the trigger by opening the activator. Go to 'triggers' on the top tool bar of the pipeline, view triggers, the 'open in Activator'

     

     

     

    I hope this helps, please give a thumbs up and mark as solved if it does, thanks!