Forum Discussion
Execute a Data Pipeline from onPrem SQL Server using REST API
Hi,
I'm having an application using a SQL Server in a private cloud on one hand and a F64 on the other.
The Fabric capacity is connected to several source systems gathering data and pushing it into an storage account where the applications database is taking the data from. This process is scheduled to run once a day sometime in the night.
Now my business guys want to klick a button on their App to recalculate figures adhoc which means the Data Pipelines in Fabric need to be triggered somehow from the onPrem SQL Server.
Important to know: I'm not allowed to use a MFA user for this process so I would need to use something like SPN (Service Principal).
From what I read at the documentation, executing Data Pipelines does work through the REST API but only if you have a named user (not SPN). Unfortunately there is nothing from microsoft saying if SPN will ever support executing Data Pipelines through REST API which makes it hard for me to argument if we should go on using Fabric or move on to another platform.
My question: 1. will we ever be able to execute pipelines through REST API using SPN and if so, until when can we expect this to happen.
2. Is there a way to do something similar with other Fabric elements?
Thank you!
Hello PowerFabricator
As of today , executing Microsoft Fabric Data Pipelines through REST APIs using a Service Principal (SPN) is not fully supported.
Microsoft Fabric does provide REST APIs for executing data pipelines, such as the “Run On Demand Item Job” API. However, these APIs currently do not fully support authentication using Service Principals
There are certain workarounds which are already discussed in thus forum:
Instead of using an SPN, you can create a service account in Microsoft Entra ID with MFA disabled
I haven't tried this personally but some developers have suggested using middle-tier services like Logic Apps to authenticate users and then make the necessary calls to the Fabric API
Check this page for support api with SPN
hope this helps
please accept the answer if this is helpful and give kudos
3 Replies
Hello PowerFabricator
As of today , executing Microsoft Fabric Data Pipelines through REST APIs using a Service Principal (SPN) is not fully supported.
Microsoft Fabric does provide REST APIs for executing data pipelines, such as the “Run On Demand Item Job” API. However, these APIs currently do not fully support authentication using Service Principals
There are certain workarounds which are already discussed in thus forum:
Instead of using an SPN, you can create a service account in Microsoft Entra ID with MFA disabled
I haven't tried this personally but some developers have suggested using middle-tier services like Logic Apps to authenticate users and then make the necessary calls to the Fabric API
Check this page for support api with SPN
hope this helps
please accept the answer if this is helpful and give kudos
Hi PowerFabricator,
Thank you for reaching out in Microsoft Community Forum.
Thank you nilendraFabric for the helpful response.
As suggested nilendraFabric, I hope this information was helpful. Please let me know if you have any further questions or you'd like to discuss this further. If this answers your question, please "Accept as Solution" and give it a 'Kudos' so others can find it easily.
Please continue using Microsoft community forum.
Regards,
Pavan.Hi PowerFabricator,
I wanted to follow up since we haven't heard back from you regarding our last response. We hope your issue has been resolved.
If the community member's answer your query, please mark it as "Accept as Solution" and select "Yes" if it was helpful.
If you need any further assistance, feel free to reach out.
Please continue using Microsoft community forum.
Thank you,
Pavan.
