Forum Discussion

paatrickd's avatar
paatrickd
New Member
2 years ago
Solved

VS Code Synapse integration not working

Hi,   I want to open a notebook from Fabric in Visual Studio Code.   I followed the installation guide and managed to activate the Synapse Kernal and open a notebook in VS Code, however it does n...
data engineering
data science
data warehouse
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi paatrickd 
    Thanks for using Fabric Community.
    Can you please follow the below troubleshooting steps and provide the details:

    1) Right click the ipython notebook.

     




    2) Open the python log file: ../../logs/${NOTEBOOK_ARTIFACT_ID}/PySparkLighter.log and check the session failure reason.


    Please provide the error details so that I can help you better.

    Thank you.

  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi paatrickd 
    Thanks for the update.
    Maybe you have installed conda, but forgot to set the environment variable. Please check that.
    After creating the conda environment, it will install the spark-lighter-lib whl package from blob. The whl package will be automatically upgraded when the version in the conda environment does not match the minimum required version of the extension. If there is any issue with the upgration, you could run the below code :

    conda activate ${CONDA_ENV_NAME}
pip uninstall spark-lighter-lib
pip install https://path/to/spark-lighter-lib.whl


    Also try these steps.

    1. Open the VS Code command palette and select/type 'Python: Create Terminal'
    2. In the terminal, run the following command: conda install pyspark
    3. Restart VS Code and try again.


    Hope this helps. Please let me know if you have any further questions.

  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi paatrickd ,
    Go to the upper folder to find a folder called logs.

     

paatrickd's avatar
paatrickd
New Member
2 years ago

Hi,

 

Thank you for your response.

 

However, I do not have any logs. When following your troubleshooting steps the directory does not contain any log folder.

 

 

 

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi paatrickd 
Thanks for the update.
Maybe you have installed conda, but forgot to set the environment variable. Please check that.
After creating the conda environment, it will install the spark-lighter-lib whl package from blob. The whl package will be automatically upgraded when the version in the conda environment does not match the minimum required version of the extension. If there is any issue with the upgration, you could run the below code :

conda activate ${CONDA_ENV_NAME}
pip uninstall spark-lighter-lib
pip install https://path/to/spark-lighter-lib.whl


Also try these steps.

  1. Open the VS Code command palette and select/type 'Python: Create Terminal'
  2. In the terminal, run the following command: conda install pyspark
  3. Restart VS Code and try again.


Hope this helps. Please let me know if you have any further questions.

  • BiJoe's avatar
    BiJoe
    Helper II
    2 years ago

    This answer solved my problem not being able to install runtime Apache Spark runtime 1.2, which is installed automatically after runtime 1.1. The Conda environment had no pyspark library due to a wheel download error. In PowerShell I activated the 1.2 runtime Conda environment, then 

     

    pip install https://tridentvscodeextension.blob.core.windows.net/spark-lighter-lib/spark34/spark_lighter_lib-34.0.0.3-py3-none-any.whl

     

    took approximately 10 minutes.  After the download completed, Synapse Pyspark was installed successfully.

  • GalRabin's avatar
    GalRabin
    Icon for Microsoft Employee rankMicrosoft Employee
    2 years ago

    Hello,

    I'm reaching out for assistance regarding an issue I've encountered, which is similar to the one described in the VS Code extension overview - Microsoft Fabric | Microsoft Learn. Despite following all the steps mentioned in the tutorial, I'm facing a problem. I tried to locate the logs that should have been created in the parent directory of the notebook, as per the instructions, but there were no logs to be found.

    Would you be able to help me resolve this issue?

    Thank you.

  • ramonsuarez's avatar
    ramonsuarez
    Advocate II
    2 years ago

    I'm on an Ubuntu machine and spark-lighter-lib is not installed. I cannot find it with Pip, Conda, and APT. Searching for it in Google only directs to two tickets here. Where can I find the wheel or how can I install the package? 

    Thanks

  • l-man's avatar
    l-man
    Frequent Visitor
    2 years ago

    I have been able to follow the recommendations up until this point. When I try to activate the environment, I get the following error:
    CondaError: Run 'conda init' before 'conda activate'

    Running conda init does nothing, the last console log is "No action taken".
    I also tried uninstalling spark-lighter-lib but it was not installed.

    I insalled spark-lighter-lib using the pip command suggested by BiJoe below, this did not fix the problem.