Using VNET Gateway for data pipelines in fabric

[Sooriya_27]

Hi team,

I'm wondering if there is an option to use vnet gateways in data pipelines. Currently we can use it in data flows but I'm wondering if there's any workaround for using it in pipelines or if there's any timeline for that feature to be integrated to data pipelines.

[v-nikhilan-msft · Accepted solution]

Hi @Sooriya_27 
Thanks for using Fabric Community.

As of now, the use of VNET gateways in data pipelines in Microsoft Fabric is not supported. However, it’s mentioned that this feature is in the internal roadmap, which means it might be available in the future.
Solved: Re: Request | Vnet Data Gateway support for Pipeli... - Microsoft Fabric Community

On the other hand, the VNET Data Gateway is generally available for use within Microsoft Fabric (Dataflows Gen2, Power BI Semantic Models, Power BI Paginated Reports) and Power Platform (Dataflows). This gateway is a network security offering that lets you connect your Azure and other data services to Microsoft Fabric and the Power Platform. It ensures that no traffic is exposed to the public endpoint.
VNET Data Gateway for Fabric and Power BI is now Generally Available | Microsoft Fabric Blog | Micro...

Hope this helps. Please let me know if you have any further questions.

[daddiodude]

Hello @v-nikhilan-msft ,

Microsoft has created a circular problem. One one hand, you say that using a Data Pipeline is not supported with a VNet Data Gateway. So you say to use a Dataflow Gen 2. However, Dataflow Gen 2 is not supported by Git Integration, nor by Deployment Pipelines. So right now, I cannot create a realworld setup whereby I can develop a Dataflow in a Development Workspace and migrate it to a Test or Prod Workspace. I can do that with a Data Pipeline, but they don't support my VNet Data Gateway. So I am stuck as I suppose many other developers are. This is a terrible oversight on the part of Microsoft and it really needs to be resolved soon. Please esacalate this if you can. There are quite a few more posts asking for this and getting no response. How do we tell our clients to take Fabric seriously when you cannot actually build a mature solution in it?

Here is an example of a thread related to what I am saying:
Re: Gen2 dataflows and deployment pipelines - Microsoft Fabric Community

Thanks,

Phil

[v-nikhilan-msft]

Hi @Sooriya_27 
We haven’t heard from you on the last response and was just checking back to see if your query got resolved. Otherwise, will respond back with the more details and we will try to help.
Thanks

[v-nikhilan-msft]

Hi @Sooriya_27 
We haven’t heard from you on the last response and was just checking back to see if your query got resolved. Otherwise, will respond back with the more details and we will try to help.
Thanks