Forum Discussion

Tom117's avatar
Tom117
Frequent Visitor
2 years ago

spark not defined using VSCode Synapse Extension

I am attempting to work on a pyspark notebook locally using VS Code and the Microsoft Synapse extension.   I installed all dependencies as described in the documentation for the extension. I've con...
workspaces
Tom117's avatar
Tom117
Frequent Visitor
2 years ago

Hey, thank you very much for getting back to me!

So, my config looks just about the same with the exception of the "auto_session" and "session_id" properties. They do not exist in my config. 

Additionally, I looked for the log files, however they also do not exist. 

Any idea why that might be the case? Perhaps my instillation has never attempted to connect to the remote? 

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi Tom117 

 

It seems the remote session has not been triggered or started successfully. Can you check the versions of the prerequisite installations, especially the version of the jdk? From this thread, it appears openjdk21 is not supported and openjdk8 is required. And ensure the jdk bin and conda bin paths are added to the Path environment variable on your system. You could add them to the Path environment variable for both user variables and system variables at the same time. 

 

Then restart your computer, open VS Code, delete the notebook from local and from the Local Work Folder. Download a notebook again, open it and wait a while for the kernel to be ready. After that, try running a code cell to start the remote session. 

 

Best Regards,
Jing