Forum Discussion
MQTT Data Into Fabric
You can abuse Logstash for that, even with eventhouses.
Ingest Logs using Logstash into Real-Time Intelligence | Microsoft Fabric Blog | Microsoft Fabric
Hello Kirikugo,
You want to send telemetry from an sensor running somewhere in the world and ingest it into Fabric, especially in an Eventstream for real-time insights.
You have a Raspberry PI it seems you installed some MQTT broker (eg. Mosquitto?) on the RPI to make the data available.
This can be challlenging if you want to connect from the Eventstream to your device. Your RPI needs to be accessible fot the Eventstream so this means inbound access from the cloud to your device. This is not a secure approach and makes your device and local network vulnerable.
It's recommended to forward the telemetry from the RPI directly to the Eventstream by using eg. the custom source Kafka or EventHub compatible endpoint. You only need to write some custom code on the RPI to make that outbound call.
A more enterprise is adding a cloud IoT Gateway service in between like the Azure Evengrid MQTT Broker (check this post on how to connect devices to that gateway) or the Azure IoT Hub (how to ingest to the IoT Hub, check this post; how to connect a device, see this blog post).