Forum Discussion
Ingesting XML data from custom endpoint to Lakehouse
Hello
How about saving the XML output to the files section in a Lakehouse and then use some T-SQL skills to unfold or in any other way handle the data?
If you are querying a custom endpoint, it does not sound like a streaming data set. I would look into using a pipeline in Fabric - land the data in raw format in the Files folder in a Lakehouse, or, if you can, process the data in the Copy activity using an XML schema.
Cheers
Brian
Most Valuable ProfessionalHello
How about saving the XML output to the files section in a Lakehouse and then use some T-SQL skills to unfold or in any other way handle the data?
If you are querying a custom endpoint, it does not sound like a streaming data set. I would look into using a pipeline in Fabric - land the data in raw format in the Files folder in a Lakehouse, or, if you can, process the data in the Copy activity using an XML schema.
Cheers
Brian