Hi,
I did not find any references in the Fabric documentation about invoking Spark notebooks/ pipelines through an authentication REST API endpoint. Has anyone been successful in calling these artifacts (preferably with additional parameters) through an HTTPS call? If not, is this feature on the roadmap? Or is it necessary that data engineers manually log into Fabric portal and invoke these?
My scenario is that my app uploads data into the Fabric Files/ folder. Immediately a pipeline should be invoked to de-duplicate the data and convert it into a Silver lakehouse (see medallion architecture). In order to ensure a near real-time flow, I cannot wait for a periodically running pipeline to pick it up sometime in the future.
Best regards,
Dutta.
