Forum Discussion

dbeavon3's avatar
dbeavon3
Memorable Member
1 year ago
Solved

Another spark pool error - Application id is null

For most of of the spark errors in Fabric, I will at least find driver logs.  Eg. the executors are allocated on the cluster.   Here is one without any logs whatsoever:   "Application id is null"...
data engineering
  • v-prasare's avatar
    v-prasare
    1 year ago

    dbeavon3, Hope you your doing well.

     

    Can you confirm whether this issue is transient or persistent? also please share the Reddit link to the discussion for better visibility and reference?

     

    Thank you for sharing your insights regarding the visibility and limitations with Spark pools and the challenges in identifying issues. Your perspective highlights an important gap that could benefit from further attention. Could you kindly formalize this as feedback, outlining the specific challenges and potential impacts that mentioned? Microsoft Fabric Ideas feedback submitted here is often reviewed by the product teams and can lead to meaningful improvement.

     

     

     

    Thanks,

    Prashanth Are

    MS Fabric Community Support

v-prasare's avatar
v-prasare
Community Support
1 year ago

dbeavon3, Hope you your doing well.

 

Can you confirm whether this issue is transient or persistent? also please share the Reddit link to the discussion for better visibility and reference?

 

Thank you for sharing your insights regarding the visibility and limitations with Spark pools and the challenges in identifying issues. Your perspective highlights an important gap that could benefit from further attention. Could you kindly formalize this as feedback, outlining the specific challenges and potential impacts that mentioned? Microsoft Fabric Ideas feedback submitted here is often reviewed by the product teams and can lead to meaningful improvement.

 

 

 

Thanks,

Prashanth Are

MS Fabric Community Support

dbeavon3's avatar
dbeavon3
Memorable Member
1 year ago

Hi v-prasare 

I had problems two days in a row.  Both days had meaningless messages.

... one day the error was:

Application id is null

... the next day the spark session started, but the stderr subsequently encountered errors and died with a different message:

Session is unable to register ReplId: default


Here is a link to others who are having the meaningless error message:

Slow/Failing Spark Startup Times : r/MicrosoftFabric

 

 

 

 

  • v-prasare's avatar
    v-prasare
    Community Support
    1 year ago

    dbeavon3,

    The details you have shared along with the link to other user's discussions, will undoubtedly contribute to improving our understanding of these issues. by sharing your experience, you are helping to enhance not only our knowledge but also the overall support and experience for our community.

     

    Thank you for taking the time to share your experience and observations regarding the error messages you've encountered. we truly appreciate you bringing this to our attention.

     

     

    Thanks,

    Prashanth Are

    MS Fabric Community Support