Forum Discussion

guruper's avatar
guruper
Regular Visitor
2 years ago
Solved

SQL Server 2022 Polybase to Fabric Lakehouse tables

We are using SQL Server 2022 Enterprise on Azure VM to process and host around 10 TB of data. Some of the data origins from files in different formats and is stored as JSON documents in the database. We have started digging into Fabric, and the concept of Bronze, Silver, Gold data suits our needs well. We could move all our source imports to a Fabric Lakehouse and end up with Delta tables. But we have a lot of systems that relies on querying the data from SQL Server. Some tables are local in SQL Server and we need to join data from external sources. I have worked quite a lot on Polybase and reading parquet files on Blob storage. What I want to do is to be able to create external tables in SQL Server 2022 against Lakehouse Delta tables. It's probably not possible (yet), but does anyone know if it's on the roadmap? Creating external tables against Warehouse tables could also be relevant. 

 

data engineering
Data Integration
data warehouse
  • v-cboorla-msft's avatar
    v-cboorla-msft
    2 years ago

    Hi guruper 

     

    Yes, creating external tables in SQL Server 2022 to directly access data stored in Microsoft Fabric Lakehouse Delta tables is not supported. While Polybase, a feature in SQL Server, allows working with external data sources, it doesn't currently offer direct integration with Fabric Lakehouse Delta tables.

     

    Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

     

    I hope this information helps. Please do let us know if you have any further queries.


    Thank you

  • v-cboorla-msft's avatar
    v-cboorla-msft
    2 years ago

    Hi guruper 

     

    We haven’t heard from you on the last response and was just checking back to see if your query was answered. Otherwise, will respond back with the more details and we will try to help.

     

    Thanks.

4 Replies

  • v-cboorla-msft's avatar
    v-cboorla-msft
    Icon for Microsoft Employee rankMicrosoft Employee
    2 years ago

    Hi guruper 

     

    At this time, we are reaching out to the internal team to get some help on this .
    We will update you once we hear back from them.
    Appreciate your patience.

     

    Thanks.

    • guruper's avatar
      guruper
      Regular Visitor
      2 years ago

      Thanks! Looking forward hearing from you again 🙂

      • v-cboorla-msft's avatar
        v-cboorla-msft
        Icon for Microsoft Employee rankMicrosoft Employee
        2 years ago

        Hi guruper 

         

        Yes, creating external tables in SQL Server 2022 to directly access data stored in Microsoft Fabric Lakehouse Delta tables is not supported. While Polybase, a feature in SQL Server, allows working with external data sources, it doesn't currently offer direct integration with Fabric Lakehouse Delta tables.

         

        Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

         

        I hope this information helps. Please do let us know if you have any further queries.


        Thank you