topic Re: Unable to Create Blob Storage Event Triggers in Data Pipeline-fabric in Pipelines

Unable to Create Blob Storage Event Triggers in Data Pipeline-fabric

Anonymous — Thu, 13 Jun 2024 11:39:33 GMT

Hi Team,

We have a requirement where the data pipeline needs to run when a file is being created newly or overwritten in a particular folder in ADLS container. Unfortunately, I am facing issues while doing so. Please provide your insights on this.

Here is the brief of how it was tried to create.

1. Navigated to Pipeline where trigger needs to be added.

2. Click on Trigger(Preview) and selected on Source

2.1 Selected Storage account as :Connect to existing Azure Storage Blob account.

2.2 Then selected subscription and container name where trigger needs to monitor.

2.3 Selected the required Workspace Correctly.

3. In Configure Alert part:

Event Types: BlobCreated and BlobRenamed are selected

Filter Condition: Filed as "Subject", Opertaor as "String In", Value as "/blobServices/default/{container_name}/{FileSystem-name}/{directory_name}/{filename.json}"

and Then Review->Create Source

Below Screenshot is the output I received(tried multiple times in multiple ways)

Please provide the appropriate solution which would be of great help. Thanks in advance.

Re: Unable to Create Blob Storage Event Triggers in Data Pipeline-fabric

KimTutein — Fri, 14 Jun 2024 05:54:40 GMT

I have the same problem. Any insight in this would be very helpfull.

Re: Unable to Create Blob Storage Event Triggers in Data Pipeline-fabric

v-cboorla-msft — Fri, 14 Jun 2024 07:42:29 GMT

Hi Anonymous

Thanks for using Microsoft Fabric Community.

I tried to repro the scenario and didn't find any difficulty in creating trigger(preview) for Azure storage blob account. Find the screenshot for reference.

For additional information please refer : Data pipelines storage event triggers in Data Factory (Preview)

Please refer to these links that might help you :

Link1: Synapse Pipeline Storage Trigger - client does not have authorization to perform action 'Microsoft.EventGrid/eventSubscriptions/write' - Stack Overflow

Link2: Unable to create Storage Event trigger in Synapse Data Factory - Microsoft Q&A

If there are duplicate triggers, you might face this issue. To fix this, navigate to your blob storage resource in the Azure portal. Go to the Events blade. From there you’ll see all the triggers that the data factories added to your blob storage. Delete the duplicates.

I hope this information helps. Please do let us know if you have any further queries.

Thank you.

Re: Unable to Create Blob Storage Event Triggers in Data Pipeline-fabric

KimTutein — Mon, 17 Jun 2024 05:31:08 GMT

Hi Amrutha Varshini

I have the same problem and done some more testing as to your advise. I found I was not able to make an event stream on a storage account with private endpoint. If I try to make an event stream with private endpoint I get the error below (the workspace has private endpoint to the storage account):

However if I try to set up an event stream to a storage account without private endpoint I get success when greating the events:

Even thouth I get the success in making the event I do however ge an error when trying to create the trigger like this:

I get this error:

Any idea of what is going wrong (I have been granted "EventGrid Contributor" in the subscription)?

Re: Unable to Create Blob Storage Event Triggers in Data Pipeline-fabric

Anonymous — Mon, 17 Jun 2024 11:11:25 GMT

Hi v-cboorla-msft ,

In my case, it seems to be an Authentication issue and i got it resolved by checking with my Admin Team. Thanks for the inputs.

Re: Unable to Create Blob Storage Event Triggers in Data Pipeline-fabric

v-cboorla-msft — Mon, 17 Jun 2024 13:39:04 GMT

Hi Anonymous

Glad that your query got resolved.
Please continue using Fabric Community for further queries.

Thank you.

Re: Unable to Create Blob Storage Event Triggers in Data Pipeline-fabric

nandan1990 — Fri, 09 Aug 2024 13:10:12 GMT

Hi can you please let us know what roles do we need to be assign so that we can fix the error in the screenshot. we are creating a storage based event trigger in fabric for azure blob storage account under the same subscription. while user is trying to access the admin storage account we are getting this error.

Re: Unable to Create Blob Storage Event Triggers in Data Pipeline-fabric

Asolomon — Tue, 12 Nov 2024 14:18:34 GMT

Mine just spins without error, it won't make the connection either. It would be helpful if we could get a prescriptive approach from the azure side to see if the set up in Azure needs to be changed. I've allowed event subscriptions on my storage account, I'm wondering if there is anything else that needs to be done.

Re: Unable to Create Blob Storage Event Triggers in Data Pipeline-fabric

juanmendez — Sat, 15 Mar 2025 07:53:29 GMT

It seems that this functionality isn't enabled in "South Central US", Am I Right?

I did a test on east-us-2 and worked.

Re: Unable to Create Blob Storage Event Triggers in Data Pipeline-fabric

Asolomon — Mon, 17 Mar 2025 12:36:33 GMT

My issue got resolved by granting (EventGrid Contributor) permissions on the storage account for the AD group we wanted to permission. Hope this helps.