Forum Discussion

dbeavon3's avatar
dbeavon3
Icon for Memorable Member rankMemorable Member
10 months ago

PySpark Notebook is Killed after Encountering Bad Gateway (localhost:8998)

Here is yet another crazy error in Fabric Spark...   LivyHttpRequestFailure: Submission failed due to error content =[{"error":{"code":"BadGateway","message":"Upstream service is unreachable","inn...
data engineering
dbeavon3's avatar
dbeavon3
Icon for Memorable Member rankMemorable Member
10 months ago

How is it that you consider the external assets to be a so-called "error"?  You should support with an authoritative link.   Obviously I have many blogs and articles that say unmanaged tables are fully supported.

 

In any case, could we please focus on the LivyHttpRequestFailure and the bad gateway?  What does that mean?

BhaveshPatel's avatar
BhaveshPatel
Icon for Super User rankSuper User
10 months ago

Hi dbeavon3 

 

I have tried this in my own workspace and this is the reason of my recommendation. There is no issue with Livy Server & bad gateway etc.. GET, POST those REST APIs

 

So  Use managed Tables instead ( data + metadata altogether )

SaveAsTable() command in Delta Lake/ Fabric and I can clearly see the issue. 
Check my blog : https://medium.com/@bhaveshpatelaus

  • dbeavon3's avatar
    dbeavon3
    Icon for Memorable Member rankMemorable Member
    10 months ago

    I'm looking for a technical explanation about a specific error message.

    Fabric gives lots of random error messages, and if we spent two days re-architecting our soluctions every time we ran into an error then we would be constantly re-writing everything from scratch every week.  I'd rather focus on the errors themselves and make sure we understand their meaning if possible.

    • BhaveshPatel's avatar
      BhaveshPatel
      Icon for Super User rankSuper User
      10 months ago

      Hi dbeavon3 

       

      How it is possible that you are having an error messages while For  others are working fine with Delta Lake/Direct Lake etc..it just an REST APIs

    • tayloramy's avatar
      tayloramy
      Icon for Super User rankSuper User
      10 months ago

      Hi dbeavon3, 

       

      I understand your frustration here, something isn't working and at the very least the error message is useless. 

       

      I suggest opening a ticket with Microsoft as they will be able to dig into the logs more and help, we can only gives suggestions based on our experience here. 

       

      If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution. 

      • v-menakakota's avatar
        v-menakakota
        Icon for Community Support rankCommunity Support
        10 months ago

        Hi  dbeavon3  ,
        Thanks for reaching out to the Microsoft fabric community forum.

         

        I would also take a moment to thank  tayloramy  , for actively participating in the community forum and for the solutions you’ve been sharing in the community forum. Your contributions make a real difference.

        Could you please consider raising a support ticket with Microsoft Fabric so the product team can review the internal logs and identify the root cause of the LivyHttpRequestFailure and BadGateway (localhost:8998) error?

        Please refer below link on how to raise a contact support or support ticket. 
        How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn 

         

        Regards,
        Microsoft Fabric Community Support Team.