Forum Discussion

dbeavon3's avatar
dbeavon3
Icon for Memorable Member rankMemorable Member
11 months ago

PySpark Notebook is Killed after Encountering Bad Gateway (localhost:8998)

Here is yet another crazy error in Fabric Spark...   LivyHttpRequestFailure: Submission failed due to error content =[{"error":{"code":"BadGateway","message":"Upstream service is unreachable","inn...
data engineering
BhaveshPatel's avatar
BhaveshPatel
Icon for Super User rankSuper User
10 months ago

Hi dbeavon3 

 

I have tried this in my own workspace and this is the reason of my recommendation. There is no issue with Livy Server & bad gateway etc.. GET, POST those REST APIs

 

So  Use managed Tables instead ( data + metadata altogether )

SaveAsTable() command in Delta Lake/ Fabric and I can clearly see the issue. 
Check my blog : https://medium.com/@bhaveshpatelaus

dbeavon3's avatar
dbeavon3
Icon for Memorable Member rankMemorable Member
10 months ago

I'm looking for a technical explanation about a specific error message.

Fabric gives lots of random error messages, and if we spent two days re-architecting our soluctions every time we ran into an error then we would be constantly re-writing everything from scratch every week.  I'd rather focus on the errors themselves and make sure we understand their meaning if possible.

  • BhaveshPatel's avatar
    BhaveshPatel
    Icon for Super User rankSuper User
    10 months ago

    Hi dbeavon3 

     

    How it is possible that you are having an error messages while For  others are working fine with Delta Lake/Direct Lake etc..it just an REST APIs

  • tayloramy's avatar
    tayloramy
    Icon for Super User rankSuper User
    10 months ago

    Hi dbeavon3, 

     

    I understand your frustration here, something isn't working and at the very least the error message is useless. 

     

    I suggest opening a ticket with Microsoft as they will be able to dig into the logs more and help, we can only gives suggestions based on our experience here. 

     

    If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution. 

    • v-menakakota's avatar
      v-menakakota
      Icon for Community Support rankCommunity Support
      10 months ago

      Hi  dbeavon3  ,
      Thanks for reaching out to the Microsoft fabric community forum.

       

      I would also take a moment to thank  tayloramy  , for actively participating in the community forum and for the solutions you’ve been sharing in the community forum. Your contributions make a real difference.

      Could you please consider raising a support ticket with Microsoft Fabric so the product team can review the internal logs and identify the root cause of the LivyHttpRequestFailure and BadGateway (localhost:8998) error?

      Please refer below link on how to raise a contact support or support ticket. 
      How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn 

       

      Regards,
      Microsoft Fabric Community Support Team.

      • v-menakakota's avatar
        v-menakakota
        Icon for Community Support rankCommunity Support
        10 months ago

        Hi dbeavon3 ,

        We are following up once again regarding your query. Could you please confirm if the issue has been resolved through the support ticket with Microsoft? 

        If the issue has been resolved, we kindly request you to share the resolution or key insights here to help others in the community. 

         

        Thank you