Ingesting Data from AWS Databricks Delta Share into Fabric Warehouse

[libpekin]

Hello,

I have a Databricks Delta Share on an AWS Databricks Account and need to ingest data into a Fabric Warehouse (Note: Lakehouse is not an option for this requirement, so Lakehouse-based solutions are not applicable). The Delta Share contains approximately 200 tables, and I would prefer not to copy each table as Parquet files into OneLake before ingestion.

Does Fabric provide functionality to connect directly to an AWS Databricks Delta Share—similar to Azure Databricks Unity Catalog mirroring—so that I can:

• Expose the schema and tables from the Delta Share

• Read the data efficiently

• Incrementally ingest each table using T-SQL notebooks or Dataflows Gen2?

I have searched various sources but haven’t found a clear implementation guide. Any insights or examples would be greatly appreciated.

Thank you!

[v-aatheeque · Accepted solution]

Hi @libpekin ,
Thanks for raising this question to Microsoft Fabric Community Forum.

Currently, Microsoft Fabric does not offer a built-in connector that allows direct querying or exposure of Delta Share tables from AWS Databricks into a Fabric Warehouse. The Unity Catalog mirroring feature is supported only with Azure Databricks and has not been extended to AWS Databricks at this time.

• As a workaround, you can automate the ingestion of data from AWS Databricks Delta Share into an intermediate staging layer such as Azure Blob Storage or Azure SQL Database. From there, the data can be ingested into a Fabric Warehouse using T-SQL notebooks or Dataflows Gen2.
• It's also worth noting that while Lakehouse is currently the only Fabric-native destination with potential support for open Delta Sharing, Warehouse-based direct ingestion from Delta Share is not supported at this stage.
• Additionally, Fabric now supports direct access to Azure Databricks Unity Catalog tables through the Mirrored Azure Databricks Catalog feature.
• If you're working with Azure Databricks, this provides a seamless way to integrate Unity Catalog-managed data across other Fabric experiences, including Power BI.
• For AWS-hosted Delta Shares, however a middle-tier ingestion strategy remains necessary until native support becomes available.
  
  

Hope this helps !!

If this functionality is important for your use case, we kindly encourage you to share your feedback and submit it as an idea on the Microsoft Fabric Ideas Forum:

Fabric Ideas - Microsoft Fabric Community

This platform allows users to submit feature requests and enhancements. Suggestions with higher community votes are reviewed and prioritized by the product team, which helps shape future roadmap decisions.

If this post was helpful, please consider marking Accept as solution to assist other members in finding it more easily.

Regards,
atheeq.

[libpekin]

Thanks @v-aatheeque ! You've confirmed my research findings. Sounds good, I'll submit this feature as an idea on the Microsoft Fabric Ideas Forum.