Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago
Solved

How to write data into fabric lakehouse from Databricks notebook

When trying to access one lake Microsoft fabric (lakehouse) from databricks notebook to read data froom adls and write into fabric lakehouse getting this error: path has invalid authority error while...
  • v-cboorla-msft's avatar
    2 years ago

    Hi Anonymous 

     

    Thanks for using Microsoft Fabric Community.

    Apologies for the inconvenience.

    You're correct that having your Databricks workspace and Fabric workspace on different Azure Active Directory (AAD) tenants can cause the "invalid authority" error you're encountering.

    While Microsoft Fabric offers seamless integration with Azure Databricks within the same tenant, there are currently limitations when working across different tenants. This means you cannot directly access an ADLS Gen2 storage account managed by a separate AAD tenant from your Databricks workspace, even with a premium account.

    If you’re using different Microsoft accounts for Databricks and the fabric workspace, you might need to set up a service principal with the necessary permissions on the ADLS resource and configure Databricks to use this service principal for authentication.

    For more details please refer to the following documents.

    Link1 : Connect to Azure Data Lake Storage Gen2 and Blob Storage.

    Link2. Access Azure Data Lake Storage using Microsoft Entra ID (formerly Azure Active Directory) credential passthrough (legacy)

     

    I hope this information helps. Please do let us know if you have any further questions.

     

    Thanks.