Databricks ConnectV2 for Microsoft Fabric?

Question

Databricks ConnectV2 lets you use Visual Studio Code as an IDE to debug Databricks notebooks:
Debug your code and notebooks by using Visual Studio Code | Databricks Blog

Does Microsoft Fabric or Azure Synapse Analytics (ASA) provide similar functionality?

shawn_eary · Answer

I just noticed in Fabric that there is an "Open in VS Code" button for my notebook. Not sure why I didn't notice it before. When I click that button, my notebook opens in VSCode as a *.ipynb file. I can then step through my program until I get to this line

mssparkutils.fs.ls("./Files")

at which point I get the error:
"NameError: name 'mssparkutils' is not defined"

anonymous · Answer

Hi&nbsp;Shawn_Eary&nbsp;,
Thanks for using Fabric Community. Apologies for the delay in reply from our side.&nbsp;
You can refer to this documentation :&nbsp;link&nbsp;Please install Synapse VS code in Visual Studio and download the necessary software.Hope this helps. Do let us know if you have any further queries.

&nbsp;

anonymous · Answer

Hi&nbsp;Shawn_Eary&nbsp;,Following up to check whether your issue has been resolved. Please let us know if you have any further queries.

shawn_eary · Answer

The extension was and still is installed, but now I'm getting a different error and I'm not sure why. Now this line:&nbsp;spark.read.format("csv").option("header", "true").load(f)&nbsp;spits out the error:NameError: name 'spark' is not defined&nbsp;When I started up the debugger, I was given an option to choose between the Python Environments and Existing Jupyter Server:I chose Environments -&gt; Python 3.11.6:&nbsp;Because I didn't know of a Jupyter Server URL that MS Fabric provides.Is there some way for me to get access to a Spark context and the files in my MS Fabric instance instead of apparently running my Python Notebook locally?My understanding is that Databricks already has the functionality I'm looking for.&nbsp;

anonymous · Answer

Hi Shawn_Eary&nbsp;,The issue which you are facing is due to the Python environment which you are using. You should use the synapse-spark-kernel for your notebook code to run without any error.I have attached the screenshot for your reference.

&nbsp;
While adding the Synapse VS code extension into your Visual Studio, there are some prerequisites which have to be installed in your local desktop.&nbsp;If you install those prerequisites successfully, then extension will auto create the synapse-spark-kernel and install pyspark and other packages. You will able to find this environment after installing all the prerequisites.

&nbsp;
Please refer this document for installing the prerequisites :&nbsp;Link&nbsp;
&nbsp;
Yes, you can&nbsp;connect to OneLake via Azure Databricks.Please refer this link for connecting to Databricks:&nbsp;Link2&nbsp;
Hope this helps. Please do let us know if you have any further questions.

Forum Discussion

Databricks ConnectV2 for Microsoft Fabric?

6 Replies

Related content

microsoft fabrics and databricks

Microsoft Fabric and Databricks integration/comparison

Fabric vs Databricks

Mapping Databricks Unity Catalog privileges to Microsoft Fabric – Catalog‑level and table‑level

Databricks ODBC driver error