Forum Discussion

libpekin's avatar
libpekin
Advocate II
1 year ago
Solved

Ingesting Data from AWS Databricks Delta Share into Fabric Warehouse

Hello, I have a Databricks Delta Share on an AWS Databricks Account and need to ingest data into a Fabric Warehouse (Note: Lakehouse is not an option for this requirement, so Lakehouse-based solutio...
  • v-aatheeque's avatar
    1 year ago

    Hi libpekin ,
    Thanks for raising this question to Microsoft Fabric Community Forum.

    Currently, Microsoft Fabric does not offer a built-in connector that allows direct querying or exposure of Delta Share tables from AWS Databricks into a Fabric Warehouse. The Unity Catalog mirroring feature is supported only with Azure Databricks and has not been extended to AWS Databricks at this time.

     

    • As a workaround, you can automate the ingestion of data from AWS Databricks Delta Share into an intermediate staging layer such as Azure Blob Storage or Azure SQL Database. From there, the data can be ingested into a Fabric Warehouse using T-SQL notebooks or Dataflows Gen2.
    • It's also worth noting that while Lakehouse is currently the only Fabric-native destination with potential support for open Delta Sharing, Warehouse-based direct ingestion from Delta Share is not supported at this stage.
    • Additionally, Fabric now supports direct access to Azure Databricks Unity Catalog tables through the Mirrored Azure Databricks Catalog feature.
    • If you're working with Azure Databricks, this provides a seamless way to integrate Unity Catalog-managed data across other Fabric experiences, including Power BI.
    • For AWS-hosted Delta Shares, however a middle-tier ingestion strategy remains necessary until native support becomes available.

    Hope this helps !!

    If this functionality is important for your use case, we kindly encourage you to share your feedback and submit it as an idea on the Microsoft Fabric Ideas Forum:

    Fabric Ideas - Microsoft Fabric Community

    This platform allows users to submit feature requests and enhancements. Suggestions with higher community votes are reviewed and prioritized by the product team, which helps shape future roadmap decisions.

    If this post was helpful, please consider marking Accept as solution to assist other members in finding it more easily.

    Regards,
    atheeq.