Forum Discussion
Helper IOn-prem data gateways are NOT supported by the Azure Function activity
On-premisis data gateway support for data pipelines has been announced as "shipped" however it on-prem gateways are still not supported by Azure Function activities.
The promise of delivery in Q1 2024 was not made with limits or caveats and it's perfectly sensible to assume that support would extend to a Azure services such as function apps rather than being strictly limited to the copy activity.
When will support be provided for connecting to Azure Functions in private networks via the Azure function pipeline activity?
Relevant links:
https://learn.microsoft.com/en-us/fabric/release-plan/data-factory#opdg
14 Replies
Hi tsunloan ,
Thanks for using Fabric Community.
As I can see we can now use on-prem data source in datapipeline - How to access on-premises data sources in Data Factory - Microsoft Fabric | Microsoft Learn
We can load the data from Onprem to cloud using Copy Activity.
Can you please help me understand with your specific requirment towards on-prem? What are you trying to achieve?
I will try to provide some help on your issue?- tsunloan
My comment was very specific. On-prem gateways are not supported by the Azure Function activity in Fabric pipelines. Azure functions are a valid way of retrieving and transforming data.
From the Fabric roadmap:
The roadmap promised support for on-prem data in Q1 2024 and it does not say anywhere that on-prem support will only be available in the "Copy data" activity.
Hi tsunloan ,
At this time, we are reaching out to the internal team to get some help on this .
We will update you once we hear back from them.Hi tsunloan ,
We have an update from internal team -
" On-prem is only supported and limited towards Copy Activity but not in any other activities. "
Incase if your looking for a specific feature or functionality, I request you to please raise a feature request.Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.
Hope this helps. Please let me know if you have any further queries.
- tsunloan
In addition, on-prem asupport is not available in the "Web" pipeline activity.
API request are another perfectly valid and common way of retrieving data.The declaration that on-prem data is supported in fabric pipelines should be accompanied by a strong disclaimer that on-prem support is strictly limited to the "Copy data" activity.
R1k91Super User
I didn't test it...
maybe you can workaround it using dataflows? I mean calling the APIs from dataflows (that supports gateways) and orchestrating the dataflows call inside Pipelines?
- tsunloan
That's such a heavy handed approach for something that the pipeline activity should provide out-of-the-box.
It seems that nothing in Fabric actually works on it's own without elaborate workarounds or hacks.
Perhaps some of the huge marketing budget should be re-directed to engineering so they can build a working product before shilling it to corporate execs.
