Forum Discussion

hanzo7's avatar
hanzo7
New Member
10 months ago
Solved

How to Embed a NL to SQL Chatbot using Fabric Data Agent / Copilot with On-Prem Data Gateway?

Hi everyone, I’m exploring a solution architecture that uses Microsoft Fabric to provide Natural Language to SQL (NL2SQL) query capabilities over on-premises databases via Data Gateway. We want to b...
admin
security
  • Vinodh247's avatar
    Vinodh247
    10 months ago

     

    • Is it possible to call Fabric Copilot or Data Agent through an API or SDK from a custom web application (outside Fabric UI)?
        Yes, fabric data agent/copilot can be called from custom apps via SDKs or APIs.

    • If yes, does Copilot only use metadata (schema/columns) to generate SQL, or does it ever transmit raw data to Microsoft’s models?
        Only metadata/schema is used; raw data stays on-premises.

    • Can the results be returned through Fabric APIs securely (with Entra ID authentication)?
        Yes, results can be securely returned via Fabric APIs with Entra ID.

    • Has anyone successfully implemented a similar embedded NL2SQL chatbot or Copilot integration with Fabric yet?
        Limited public examples exist, but embedding Data Agent in custom chat apps is supported.

    • Are there any licensing or capacity considerations when scaling this for multiple clients?
        Yes, you need Copilot capacity (F2+), manage per-user licenses, and scale Fabric SKUs appropriately.

    You can build a chat style NL2SQL UI securely over onprem data.

     

     

     

Vinodh247's avatar
Vinodh247
Icon for Super User rankSuper User
10 months ago

 

  • Is it possible to call Fabric Copilot or Data Agent through an API or SDK from a custom web application (outside Fabric UI)?
      Yes, fabric data agent/copilot can be called from custom apps via SDKs or APIs.

  • If yes, does Copilot only use metadata (schema/columns) to generate SQL, or does it ever transmit raw data to Microsoft’s models?
      Only metadata/schema is used; raw data stays on-premises.

  • Can the results be returned through Fabric APIs securely (with Entra ID authentication)?
      Yes, results can be securely returned via Fabric APIs with Entra ID.

  • Has anyone successfully implemented a similar embedded NL2SQL chatbot or Copilot integration with Fabric yet?
      Limited public examples exist, but embedding Data Agent in custom chat apps is supported.

  • Are there any licensing or capacity considerations when scaling this for multiple clients?
      Yes, you need Copilot capacity (F2+), manage per-user licenses, and scale Fabric SKUs appropriately.

You can build a chat style NL2SQL UI securely over onprem data.

 

 

 

KevinChant's avatar
KevinChant
Icon for Super User rankSuper User
10 months ago

Just to add a bit more detail to this, you can call Fabric Data Agents from Azure AI Foundry which you can then use with your custom apps if you so wish (Copilot Studio is also an option).

You will need the appropriate licenses for either of these.

Also, be aware that you will ned your databases ingested into Fabric in some form in order for this to work.