Very excited about Fabric in general, and the support for data scientists with delta as the underlying interoperability.
However, it is currently impossible to build a sophisticated Fabric Spark pipeline with more than 2 or 3 python files. This is the current set up really supports one notebook at a time, rather than a folder of python files/modules. To include python files as reference files/modules, we have to upload them or provide and ABFS link one at a time
In contrast Databricks allow "workspace files" where developers can author arbitrary number of python files in the workspace, and then they work as normal python files for importing.
Work with Python and R modules | Databricks on AWS
The ability to work with an arbitrary number of python files will be essential for any serious Spark pipeline development
miguel
on:
Personalized Source List in Get Data
on:
RLS testing UI (Test RLS roles directly in the ser...
on:
DO NOT CONVERT my Workspace to Fabric Free Trial W...
on:
MS Fabric: Manage Connections and gateways with Fo...
on:
CU% over time: Filter by workspace (Capacity Metri...
YSD
on:
Support the SSE protocol as Fabric Eventstream sou...