Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Data Days is here! Join us now for 60+ days of learning, challenges, and connection. Learn more

Use OneLake as ingestion storage for Real Time File ingestion

In the current setup, if we want to process incoming files (like XML files), we have to use an Azure Storage account and Azure Event Grid to make Fabric RTI aware that there's a new file to process. This adds overhead to the deployment and maintenance.

 

Why not enable this functionality in OneLake? In one of the use cases I have, the ESB can save the XML file in OneLake. This then triggers Fabric RTI to read the file into the ingestion database as raw text and from that point on, we can process the file. This removes the external dependencies, storage and monitoring to check if all the files are there. 

Status: New