topic Re: Synapse Extension Error in VS Studio code web in Data Engineering

Synapse Extension Error in VS Studio code web

smpa01 — Sat, 21 Sep 2024 19:17:22 GMT

Is anyone else seeing this, in vs studio code web. I can't execute anything today in the VS Studio code web (In Fabric notebook there is no issue)

Re: Synapse Extension Error in VS Studio code web

Anonymous — Mon, 23 Sep 2024 03:22:50 GMT

Hi @smpa01

According to the error message, it seems the Jupyter extension version is not compatible. Is it possible install another version to make it work?

I don't have any error when running a notebook in VS Code Web, see below. In addition, ensure the kernel is set to “Synapse VS Code - Remote”.

Documentation: Create and manage Fabric notebooks from VS Code for the Web - Microsoft Fabric | Microsoft Learn

Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!

Re: Synapse Extension Error in VS Studio code web

smpa01 — Mon, 23 Sep 2024 03:13:06 GMT

This is the web version which automatically pops up from the Fabric interface, and it does not provide install or uninstall option for Jupyter as one could do in the Desktop VS Studio Code.

Re: Synapse Extension Error in VS Studio code web

Anonymous — Mon, 23 Sep 2024 04:16:20 GMT

Hi @smpa01

VS Code web will install some dependency extensions for us automatically when we install the Synapse VS Code - Remote extension. I have just tested that, see my previous reply. And it allows us to install a specific version as we do that in VS Code desktop.

I notice that your screenshot shows that the number of installed extensions in VS Code Web is 0. Did you open the notebook in VS Code (Web) from Fabric Portal directly without installing the Synapse VS Code - Remote extension first? We need to install this extension before opening a Fabric notebook. Please refer to Create and manage Fabric notebooks from VS Code for the Web - Microsoft Fabric | Microsoft Learn

Install the Synapse VS Code extension for the Web

Go to https://insider.vscode.dev from your browser.
Select the Extensions icon in the left navigation bar.
Search for Synapse and select the Synapse VS Code - Remotes extension
click Install.

Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!

Re: Synapse Extension Error in VS Studio code web

Anonymous — Wed, 25 Sep 2024 07:59:46 GMT

Hi @smpa01

Have you resolved this issue? If my previous reply was helpful, please consider accepting it as a solution. If you have found other solutions, we would greatly appreciate it if you could share them with us. Thank you!

Best Regards,
Jing

Re: Synapse Extension Error in VS Studio code web

smpa01 — Wed, 25 Sep 2024 16:55:09 GMT

@Anonymous your solution worked. I was opening the web vesrion directly from the notebook as you predicted.

Can you please advise me on this , I prefer running the visual studio code from my pc rather than web, I am not sure what am I doing wrong.

I keep on hitting a dead end in VS Code Local

same workbook in fabic vs vscode

PySparkLighter.Log gives me this

12:52:24,643 urllib3.connectionpool WARNING Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1007)'))': /common/discovery/instance?authorization_endpoint=https%3A%2F%2Flogin.windows.net%2Fcommon%2Foauth2%2Fv2.0%2Fauthorize&api-version=1.0 12:52:24,660 root ERROR Failed to initialize Spark Lighter variables. HTTPSConnectionPool(host='login.microsoftonline.com', port=443): Max retries exceeded with url: /common/discovery/instance?authorization_endpoint=https%3A%2F%2Flogin.windows.net%2Fcommon%2Foauth2%2Fv2.0%2Fauthorize&api-version=1.0 (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: self-signed certificate in certificate chain (_ssl.c:1007)'))) 12:52:24,660 root INFO Registering Spark Lighter magics for IPython... 12:52:24,661 root INFO Registered Spark Lighter magics for IPython.

Re: Synapse Extension Error in VS Studio code web

Anonymous — Thu, 26 Sep 2024 08:15:26 GMT

Hi @smpa01 Are you querying from a normal lakehouse or a dataflow Gen2 staging lakehouse?

Re: Synapse Extension Error in VS Studio code web

smpa01 — Thu, 26 Sep 2024 13:17:08 GMT

@Anonymous I can confirm that is from a normal lakehouse.

Re: Synapse Extension Error in VS Studio code web

Anonymous — Fri, 27 Sep 2024 09:37:21 GMT

Hi @smpa01

Can you check in another SparkLighter.log file that whether the remote spark session has been created successfully? If a remote session has been created successfully, you will see something like below. It returns a spark session id.

Otherwise you may refer to my settings in this thread. It might be helpful.

Best Regards,
Jing

Re: Synapse Extension Error in VS Studio code web

smpa01 — Fri, 27 Sep 2024 10:41:53 GMT

@Anonymous before I try out the settings, I can confirm that for all my notebook logs I only see the following and there is no SparkLighter.log