Forum Discussion

CoulterJames2's avatar
CoulterJames2
Icon for Advocate II rankAdvocate II
9 months ago
Solved

Data Activator rule creation fails due to existing system topic

My customer is trying to create a Data Activator rule to run a data pipeline to ingest a file when a file lands in a storage account. However, the rule creation process is failing because an Event Grid system topic already exists for the storage account, and this is associated with Windows Defender for Storage (anti-virus check). There does not seem to be a way to configure Data Activator to use an existing topic, and neither is there a way to specify Data Activator as the destination from the System Topic side. Co-pilot suggested using "web hook" as the destination and pasting in the URL of the Data Activator rule, but no such URL is visible, so I think something has changed in Data Activator. Any suggestions on how this can be achieved? 

  • Hi Gopi, thanks for the answer. We did find a workaround which was to disable Defender on the storage account, which in turn deleted the Event Grid and system topic. We then went through the Data Activator wizard, and then re-enabled Defender, which added an event subscription to the system topic created by Data Activator. 

3 Replies

  • v-prasare's avatar
    v-prasare
    Icon for Community Support rankCommunity Support

    Hi CoulterJames2,

    This is a known limitation with Microsoft Fabric Data Activator when used with a Microsoft Defender for Storage-enabled storage account

     

    I’d encourage you to submit your detailed feedback and ideas via Microsoft's official feedback channels, such as the Microsoft Fabric Ideas.

     

    Feedback submitted here is often reviewed by the product teams and can lead to meaningful improvement. since clearer guidance would definitely help capacity administrators interpret these metrics more confidently. This helps the product group prioritize improvements, and the more customers that raise this, the faster it gets addressed.

     

    thanks,

    Prashanth

     

  • Hi CoulterJames2 

     

    We’ve run into this same issue, and the behaviour you’re seeing is expected. Data Activator tries to create its own Event Grid system topic for the storage account, but because Windows Defender for Storage already created one for that same account, the creation fails. Event Grid only allows one system topic per resource, so Data Activator simply can’t create another one on top of it.

     

    Right now Data Activator doesn’t support reusing an existing system topic, and that’s why the wizard fails straight away. Nothing is wrong with your setup — it’s just a limitation of how system topics work today.

     

    The only reliable workaround we’ve been able to use is to keep the Defender-created system topic and attach your own Event Grid subscription to it. From there, send events to something lightweight like a Logic App or Function, and have that trigger your Fabric pipeline. It works fine in production and avoids touching the Defender integration.

     

    Hopefully Microsoft adds support for connecting Data Activator to an existing system topic in the future, but at the moment, this is the only practical way forward.

     

    Hope this helps.

     

    – Gopi Krishna

     

     

    • CoulterJames2's avatar
      CoulterJames2
      Icon for Advocate II rankAdvocate II

      Hi Gopi, thanks for the answer. We did find a workaround which was to disable Defender on the storage account, which in turn deleted the Event Grid and system topic. We then went through the Data Activator wizard, and then re-enabled Defender, which added an event subscription to the system topic created by Data Activator.