Data Activator is not triggering action data pipeline

[PunChili]

Dear Community,

I would like to be informed when a .csv file, situated in a specific folder in OneLake is created and/or updated. Based on these tow inidents a datapipeline should be triggered. It includes a notebook which creates a delta table and overwrites the data in the table. For this scenario I use the realtime data activator.

1. The first time I uploaded the .csv file the data activator was triggered and executed the pipeline successfully.

2. The second time i changed a value in the .csv file already uploaded in OneLake. I can see in the activation details that my modified file was detected, but the action aka data pipeline is not triggered. 

It is  a gold_lh event; the condition includes operation on every value and the advaced settings is wait time for late-arriving events 5 Minutes.

What do I miss?

PS: the test action works as well 😉

[v-saisrao-msft]

Hi @PunChili,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

[PunChili]

created: Data Activator triggers an action when file in one... - Microsoft Fabric Community

[v-saisrao-msft]

Hi @PunChili,

Thanks for sharing your findings and submitting the idea to the Fabric Ideas forum! That’s a great step. If others in the community face similar challenges, they can upvote your suggestion to bring more visibility to it.

If any of the responses were helpful, please consider accepting the most suitable one as a solution. This helps others in the community facing similar issues.

Thank you.

[PunChili · Accepted solution]

I think I found the solution, in the documentation it is explained that "if the the file is created or replaced"; this only happens when the file is really uploaded manually (or by a notebook) in the browser in onelake in fabric. When it is only changed in the onelake file explorer for windows preview feature and saved there, ONLY the activation details arrive but NO action is triggered.

It would be nice to have a possibility to trigger an action when the data within the file is modified.

[suparnababu8]

Hi @PunChili 

Thank you for your sugegstion. Yes I agree with you. Requesting you pls submit your idea here Fabric Ideas - Microsoft Fabric Community If you get enough votes. Microsoft may consider this and will implement and release in future.

Have a good day!

Thank you!!

Did I answer your question? Mark my post as a solution!

Proud to be a Super User!

[PunChili]

@suparnababu8 this is no dataset (semantic model). It is a .csv file in OneLake, which is created as a delta table.

The activation details show - l say almost immediately - that there was a change on the file. But no action is triggered.

[suparnababu8]

Hi @PunChili 

• Data activator will not work properly, if you are using a  direct Lake dataset, there’s a known bug where Data Activator doesn’t notice changes unless you manually refresh the dataset. This is a current limitation that Microsoft is working to fix.
• Data activator might not be detecting chnages in real time. Ideally it will check for updates every 5minutes.

If you need more info pls read the below threads. It might helps you.

Re: Data Activator not trigger the alers only send... - Microsoft Fabric Community

Solved: Re: Data Activator Not Capturing Trigger - Microsoft Fabric Community

Re: Data Activator Trigger Event Data, passing to ... - Microsoft Fabric Community

Thank you!!!

Did I answer your question? Mark my post as a solution!

Proud to be a Super User!

[PunChili]

thank you @suparnababu8 for the info.