The management of Spark jobs is done via the GUI Create an Apache Spark job definition - Microsoft Fabric | Microsoft Learn
This is fine for ad-hoc development, but not suitable for serious operationalising/automation of Spark pipelines. Please support a REST API and/or python SDK for developers to create/execute/monitor Spark jobs programmatically
2 Comments
- nishalitNew MemberRestAPI and SDK support for Spark Job is planned and we already activtly working on this feature..
- fbcideas_migusrNew MemberStatus added:Planned
Recent ideas
Data Pipelines - Run only selected activities
For debugging and testing pipeline activities during development, allow us to select one or multiple activities and run only the selected pipeline activities. For example, I'm working on editing ...frithjof_v15 hours agoCommunity ChampionNew617Views11likes2CommentsSemantic model connection bindings should be in source control (Git)
Semantic model data source connection bindings should be source controlled. A semantic model can contain multiple data source references, each of which can be mapped to a separate Fabric data connec...frithjof_v22 hours agoCommunity ChampionNew20Views1like0CommentsBulk changing column names in Visualizations Pane
We often use raw/api column names or measures with a set nomenclature to be consistent and to keep track of them but we do not want to display these names in the visuals. Currently we have to change ...vishal1401971 day agoFrequent VisitorNew6Views0likes0Comments