SQL Server 2022 Polybase to Fabric Lakehouse tables

[guruper]

We are using SQL Server 2022 Enterprise on Azure VM to process and host around 10 TB of data. Some of the data origins from files in different formats and is stored as JSON documents in the database. We have started digging into Fabric, and the concept of Bronze, Silver, Gold data suits our needs well. We could move all our source imports to a Fabric Lakehouse and end up with Delta tables. But we have a lot of systems that relies on querying the data from SQL Server. Some tables are local in SQL Server and we need to join data from external sources. I have worked quite a lot on Polybase and reading parquet files on Blob storage. What I want to do is to be able to create external tables in SQL Server 2022 against Lakehouse Delta tables. It's probably not possible (yet), but does anyone know if it's on the roadmap? Creating external tables against Warehouse tables could also be relevant. 

[v-cboorla-msft · Accepted solution]

Hi @guruper 

Yes, creating external tables in SQL Server 2022 to directly access data stored in Microsoft Fabric Lakehouse Delta tables is not supported. While Polybase, a feature in SQL Server, allows working with external data sources, it doesn't currently offer direct integration with Fabric Lakehouse Delta tables.

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

I hope this information helps. Please do let us know if you have any further queries.

Thank you

[v-cboorla-msft]

Hi @guruper 

At this time, we are reaching out to the internal team to get some help on this .
We will update you once we hear back from them.
Appreciate your patience.

Thanks.

[guruper]

Thanks! Looking forward hearing from you again 🙂

[v-cboorla-msft · Accepted solution]

Hi @guruper 

Yes, creating external tables in SQL Server 2022 to directly access data stored in Microsoft Fabric Lakehouse Delta tables is not supported. While Polybase, a feature in SQL Server, allows working with external data sources, it doesn't currently offer direct integration with Fabric Lakehouse Delta tables.

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

I hope this information helps. Please do let us know if you have any further queries.

Thank you

[v-cboorla-msft · Accepted solution]

Hi @guruper 

We haven’t heard from you on the last response and was just checking back to see if your query was answered. Otherwise, will respond back with the more details and we will try to help.

Thanks.