Forum Discussion

todd-wilson's avatar
todd-wilson
Frequent Visitor
1 year ago
Solved

Cannot reference a Notebook "that attaching" to a different default lakehouse.

I'm running a pipeline starting with a DAG. And getting an error I can't reference a notebook "that attaching to a different default lakehouse". I've tried passing "useRootDefaultLakehouse": True on ...
  • todd-wilson's avatar
    todd-wilson
    1 year ago

    So I fixed this by adding "useRootDefaultLakehouse": True arg to my dag under my silver script.

     

                "args": {
                    "useRootDefaultLakehouse": True
                }
    Larger snippet...
     {
                "name": "notebook_silver",
                "path": "Notebook Silver",
                "timeoutPerCellInSeconds": 3600,
                "dependencies": ["Notebook Bronze"],
                "args": {
                    "useRootDefaultLakehouse": True
                },
            }
     
    My notebook uses absolute abfss paths to access the bronze datalake and the silver datalake so I think it should have worked according to the docs.
     
    "To specify the location to read from, you can use the relative path if the data is from the default lakehouse of your current notebook. Or, if the data is from a different lakehouse, you can use the absolute Azure Blob File"