Use SQL Database in Data Pipelines

[bjoubert]

Hi all,

So I've created a Fabric SQL database in my workpsace and using it to store some configuration for data pipelines

I'm using lookups in Data Pipelines to fetch information from the Fabric SQL database in the same workpsace

That works well

However I just realized that Fabric automatically creates a connection in the "Manage Connections and Gateways" and that this connection relies on my personal tokens for authentication

Also I'm not able to create the same kind of connection directly from the "Manage Connections and Gateways" page.

So is there a way to use a SPN authentication instead. It does not look like it at the moment but is it in the roadmp ?

The reason I'm asking is that I can't rely on the current authentication method for higher environments (TST and PROD).

Also I had quite some issues after updating my password, I had to resave all my pipelines in DEV env so credentials would be synced in pipelines somehow 😕

Thanks

[bjoubert]

Hi @v-sathmakuri ,

Thank you for your feedback,

I'll check the updates, hoping they'll come fast because the current setup is not ideal for production 😉

Have a good day

[v-sathmakuri]

Hi @bjoubert ,

May I ask if the provided solution addressed you ask? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you!!

[v-sathmakuri · Accepted solution]

Hi @bjoubert ,

Thank you for reaching out to Microsoft Fabric Community.

Service Principal (SPN) authentication is not supported for Fabric SQL Database connections used in Data Pipelines. The auto-created connection in “Manage Connections and Gateways” uses your personal token, and you cannot manually recreate it with other credentials. There is ongoing work to support Managed Identity and Service Principal based connections for Fabric items.

Please monitor the roadmap for future releases:  https://roadmap.fabric.microsoft.com/?product=administration%2Cgovernanceandsecurity 

If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it! 

Thank you!!