one lake
1 Topic
Ingest Data from Streaming API
I am trying to ingest data into my Lakehouse from a streaming API (https://developer-specs.company-information.service.gov.uk/streaming-api/guides/overview) I currently do this using a Function App that connects to the API and packages and stores files every 8 minutes. The Function then reconnects using the latest timestamp processed. This is the recommended method in the above link. How can I recreate this in Fabric pipelines/eventstream to ingest the streaming data into OneLake? ThanksSolved20KViews0likes6Comments