Forum Discussion

bekkac579's avatar
bekkac579
Frequent Visitor
1 month ago
Solved

Fabric notebook Py4JJavaError - underlying location does not exist

  We are getting the following error on our Fabric notebook via pipeline runs -   Py4JJavaError An error occurred while calling o6734.collectToPython. : org.apache.spark.SparkException: Job abort...
  • ati_puri's avatar
    1 month ago

    Hi bekkac579 ,

     

    The failure happens only when run via pipeline states that its a SQL Analytics endpoint metadata sync issue. You can add a refresh Sql endpoint activity before calling this code in your pipeline and try once, else you can refresh the query within the code itself. Write a sample warm-up query to activate your SQL endpoint before hitting the actual table and querying it.

     

    Refer link here to understand on this issue - SQL Analytics Endpoint Metadata Sync - Microsoft Fabric | Microsoft Learn

     

    Let me know if the above solution works.

     

    Thanks

    Ati Puri