topic Re: Notebook | VS Code (Desktop) | Not working... in Data Engineering

Notebook | VS Code (Desktop) | Not working...

__maca__ — Wed, 29 May 2024 13:54:49 GMT

Hi everyone,

I am new here and to the world of Microsoft Fabric. I am trying to run a notebook in VS Code (Desktop) on macOS (M3), but I am unable to run the notebook using the Fabric instance (Spark). While I can load, open, update, and retrieve all notebooks from my workspace, I can't run cells with code like:

df = spark.sql('SELECT * FROM my_lakehouse.my_table') --------------------------------------------------------------------------- AttributeError Traceback (most recent call last) Cell In[3], line 1 ----> 1 spark.sql('SELECT * FROM my_lakehouse.my_table') AttributeError: 'NoneType' object has no attribute 'sql'

I’ve noticed that many users have had similar issues and I’ve tried all the proposed fixes, but nothing works. I have reinstalled everything multiple times, ensuring all requirements (conda, java, etc.) are met. I have also experimented with both environments (1-1 & 1-2). Yet, I still get the following error (log):

root ERROR Failed to initialize Spark Lighter variables. An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext. : java.net.BindException: Can't assign requested address: Service 'sparkDriver' failed after 16 retries (on a random free port)! Consider explicitly setting the appropriate binding address for the service 'sparkDriver' (for example spark.driver.bindAddress for SparkDriver) to the correct binding address.

Has anyone encountered this issue before? I’d really appreciate any help or suggestions.

Thanks!

Re: Notebook | VS Code (Desktop) | Not working...

Anonymous — Thu, 30 May 2024 11:21:17 GMT

Hi @__maca__ ,

Apologize for the issue you are facing. The best course of action is to open a support ticket and have our support team take a closer look at it.

Please reach out to our support team so they can do a more thorough investigation on why this it is happening: Link

After creating a Support ticket please provide the ticket number as it would help us to track for more information.

Hope this helps. Please let us know if you have any other queries.

Re: Notebook | VS Code (Desktop) | Not working...

Anonymous — Fri, 31 May 2024 11:18:47 GMT

Hi @__maca__ ,

We haven’t heard from you on the last response and was just checking back to see if you got a chance to open a support ticket.
After creating a Support ticket please provide the ticket number as it would help us to track for more information.

Thanks