Forum Discussion

DennesTorres's avatar
DennesTorres
Impactful Individual
2 years ago
Solved

VS Code and Synapse Kernel

Hi,

I found on the documentation that I should run Fabric notebooks using the Synapse Kernel.

 

However, the Synapse Kernel doesn't appear for me.

 

I installed java 1.8 and miniconda, I installed Synapse VS Code Extension (image below), I can see the workspaces and lakehouses, but the kernel is not available to run the notebooks.

What am I missing?

 



Kind Regards,

 

Dennes

 

 

data engineering
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi DennesTorres ,
    Apologies for the delay in response.
    Please follow these trouleshooting steps:

    1. Open the VS Code command palette and select/type 'Python: Select Interpreter'

    2. Choose + Enter interpreter path...

    3. Enter Python interpreter path: path\to\envs\${SYNAPSE_CONDA_ENV_NAME}\python

    Please refer this link for further details: VS Code
    Hope this helps. Please let us know if you have any further questions.

  • DennesTorres's avatar
    DennesTorres
    2 years ago

    Hi,

     

    It was not straightforward, but I think it worked. I will need to make more tests to confirm.

     

    It was difficult to understand the path you asked, but based on the variable, I understand it was something inside the miniconda installation folder.

    But there was no python folder there.

    Once again, based on the variable, I understand it was related to a folder ENVS, this was present inside the miniconda installation folder, but there was no python folder inside ENVS. There was a folder called synapse-spark-kernel with a python.exe inside it.

    I tried this path and received many errors I could not identify. But after closing, opening again and insisting a bit, the synapse-spark-kernel was present in the VS Code.

    Thank you!

    Kind Regards,

     

    Dennes

15 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi DennesTorres ,
    Thanks for using Fabric Community.

    While adding the Synapse VS code extension into your Visual Studio, there are some prerequisites which have to be installed in your local desktop. If you install those prerequisites successfully, then extension will auto create the synapse-spark-kernel and install pyspark and other packages. You will able to find this environment after installing all the prerequisites.

    Maybe you have installed conda, but forgot to set the environment variable.

    While adding the Synapse VS code extension into your Visual Studio, there are some prerequisites which have to be installed in your local desktop. If you install those prerequisites successfully, then extension will auto create the synapse-spark-kernel and install pyspark and other packages. You will able to find this environment after installing all the prerequisites.

    Maybe you have installed conda, but forgot to set the environment variable.

     

    When you activate the extension, it will show the initialization progress and output in output channel like this:

     

     

     

     

    Please refer this document for installing the prerequisites : Link1
    Hope this helps. Please let us know if you have any further queries.

    • DennesTorres's avatar
      DennesTorres
      Impactful Individual
      2 years ago

      Hi,

      I installed the pre-reqs and variables, but I already suspect what could be.

      Either it is because I installed the pre-reqs after the extension (I will need to uninstall the extension and install again) or because VS code has a hard time to update the environment variables unless I reboot. When we have 10 different desktops, each one for different purposes and different stuff opened, reboot is not a good thing.

      I will try this and give a feedback later.

       

      Kind Regards,

       

      Dennes

      • Anonymous's avatar
        Anonymous
        Not applicable
        2 years ago

        Hi DennesTorres ,

        Thanks for the update. Looking forward for your feedback.
        Please let us know if you have any further queries.

  • paatrickd's avatar
    paatrickd
    New Member
    2 years ago

    I have a slightly different problem but related to this topic, so I'll post it here.

     

    I did manage to activate the Synapse Kernal in VS Code, however it does not recognize spark. See the code below, spark is of Nonetype.

     

     

    What should I do?

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      Hi paatrickd , I am also facing the same issue and stuck at the same error where my fabric-synapse-runtime-1-2 kernel is not recognising spark.

      Any help/solution that worked for you will be appreciated.

      Thanks.

      • DanielBA's avatar
        DanielBA
        Regular Visitor
        1 year ago

        Have you found a solution? I am getting the same error... 

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      Hi paatrickd ,
      Thanks for using Fabric Community and posting your question.
      Can you please create a new post as the initial ask is different from your issue?
      We will definitely look into the issue and help.

      Thanks for understanding.

    • rafasiqueira's avatar
      rafasiqueira
      Frequent Visitor
      1 year ago

      Found this on another forum which helped:

       

      "In Fabric or Synapse, the Spark session is automatically created/managed when a cluster is ready for notebook to use. However, if you're running this locally (e.g. VS Code), you need to initiate it manually with SparkSession.builder.getOrCreate().

      from pyspark.sql import SparkSession

      spark = SparkSession.builder.appName("Test").getOrCreate()"