topic Re: Create eventstream from Lakehouse to Activator in Eventstream

Create eventstream from Lakehouse to Activator

bramvdbemt — Thu, 02 Jan 2025 14:14:38 GMT

Hi,

We have a data lakehouse and would like to use that data to create a trigger. So for example, we have a table with transaction data. Everytime a new row is added where the transaction value is greater than 10,000 I would like to trigger a message. I think the right approach should be retrieving the data from my lakehouse via an eventstream to an activator but this does not work for me. I can't find any way on how to load the data properly to the eventstream and thus also not via the eventstream to Activator. Also directly in activator did not seem to work for me.

I used external source -> OneLake events and then I connected to my lakehouse. See attached screenshot:

Re: Create eventstream from Lakehouse to Activator

Anonymous — Fri, 03 Jan 2025 01:31:36 GMT

Hi bramvdbemt ,

The OneLake events in external source is not used by eventstream to detect data, it is used to detect if behaviors such as creating, deleting, modifying Fabric artifacts, etc., for example, creating, deleting dataflow, etc., have occurred in your OneLake.

If you need to use eventstream to connect to data in your Lakehouse, you need to make sure that transactional data in your lakehouse can be read and monitored, and that updates from the lakehouse are pushed to the Event Hub.This requires you to set up an Event Hub to receive new data from lakehouse.

Best Regards,
Dino Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Create eventstream from Lakehouse to Activator

bramvdbemt — Fri, 03 Jan 2025 08:43:15 GMT

Hi Dino,

By Event Hub, do you mean an Eventhouse in Fabric?

Best regards,

Bram van den Bemt

Re: Create eventstream from Lakehouse to Activator

Anonymous — Fri, 03 Jan 2025 08:58:24 GMT

Hi bramvdbemt ,

No. I mean the Event Hubs in the Microsoft Azure:

Azure Event Hubs documentation | Microsoft Learn

Best Regards,
Dino Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Create eventstream from Lakehouse to Activator

bramvdbemt — Fri, 03 Jan 2025 09:04:36 GMT

Hi Dino,

Thank you!

Do you by any chance happen to know another way to create triggers on a data lakehouse. For example, new rows are added to a specific table in the lakehouse and a column in that row exceeds a certain value, then sent an email to person X?

Re: Create eventstream from Lakehouse to Activator

Anonymous — Mon, 06 Jan 2025 02:19:22 GMT

Hi bramvdbemt ,

If you still want to use Eventstream, I'm afraid that's the only way I can do it. There may be other tools that can accomplish the same thing, but I'm sorry that one is out of the scope of my technical support.

Best Regards,
Dino Tao

Re: Create eventstream from Lakehouse to Activator

bramvdbemt — Wed, 08 Jan 2025 08:27:21 GMT

Hi all,

For those wondering, I found this article of Dennes that described how to connect your lakehouse to an eventhouse and after that use data activator from the eventhouse. Here is the article: https://www.red-gate.com/simple-talk/blogs/microsoft-fabric-using-lakehouse-data-in-real-time-dashboards/