Forum Discussion
todd-wilson
1 year agoFrequent Visitor
Cannot reference a Notebook "that attaching" to a different default lakehouse.
I'm running a pipeline starting with a DAG. And getting an error I can't reference a notebook "that attaching to a different default lakehouse". I've tried passing "useRootDefaultLakehouse": True on ...
- 1 year ago
So I fixed this by adding "useRootDefaultLakehouse": True arg to my dag under my silver script.
"args": {"useRootDefaultLakehouse": True}Larger snippet...{"name": "notebook_silver","path": "Notebook Silver","timeoutPerCellInSeconds": 3600,"dependencies": ["Notebook Bronze"],"args": {"useRootDefaultLakehouse": True},}My notebook uses absolute abfss paths to access the bronze datalake and the silver datalake so I think it should have worked according to the docs."To specify the location to read from, you can use the relative path if the data is from the default lakehouse of your current notebook. Or, if the data is from a different lakehouse, you can use the absolute Azure Blob File"
todd-wilson
1 year agoFrequent Visitor
So I fixed this by adding "useRootDefaultLakehouse": True arg to my dag under my silver script.
"args": {
"useRootDefaultLakehouse": True
}
Larger snippet...
{
"name": "notebook_silver",
"path": "Notebook Silver",
"timeoutPerCellInSeconds": 3600,
"dependencies": ["Notebook Bronze"],
"args": {
"useRootDefaultLakehouse": True
},
}
My notebook uses absolute abfss paths to access the bronze datalake and the silver datalake so I think it should have worked according to the docs.
"To specify the location to read from, you can use the relative path if the data is from the default lakehouse of your current notebook. Or, if the data is from a different lakehouse, you can use the absolute Azure Blob File"
Anonymous
1 year agoNot applicable
Thank you for sharing the solution with us!