Forum Discussion

Sooriya_27's avatar
Sooriya_27
Frequent Visitor
2 years ago
Solved

Using VNET Gateway for data pipelines in fabric

Hi team,

I'm wondering if there is an option to use vnet gateways in data pipelines. Currently we can use it in data flows but I'm wondering if there's any workaround for using it in pipelines or if there's any timeline for that feature to be integrated to data pipelines.

capacities
Data Integration
one lake
workspaces

4 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi Sooriya_27 
    Thanks for using Fabric Community.

    As of now, the use of VNET gateways in data pipelines in Microsoft Fabric is not supported. However, it’s mentioned that this feature is in the internal roadmap, which means it might be available in the future.
    Solved: Re: Request | Vnet Data Gateway support for Pipeli... - Microsoft Fabric Community

    On the other hand, the VNET Data Gateway is generally available for use within Microsoft Fabric (Dataflows Gen2, Power BI Semantic Models, Power BI Paginated Reports) and Power Platform (Dataflows). This gateway is a network security offering that lets you connect your Azure and other data services to Microsoft Fabric and the Power Platform. It ensures that no traffic is exposed to the public endpoint.
    VNET Data Gateway for Fabric and Power BI is now Generally Available | Microsoft Fabric Blog | Microsoft Fabric

    Hope this helps. Please let me know if you have any further questions.

    • daddiodude's avatar
      daddiodude
      New Member
      2 years ago

      Hello Anonymous ,

       

      Microsoft has created a circular problem. One one hand, you say that using a Data Pipeline is not supported with a VNet Data Gateway. So you say to use a Dataflow Gen 2. However, Dataflow Gen 2 is not supported by Git Integration, nor by Deployment Pipelines. So right now, I cannot create a realworld setup whereby I can develop a Dataflow in a Development Workspace and migrate it to a Test or Prod Workspace. I can do that with a Data Pipeline, but they don't support my VNet Data Gateway. So I am stuck as I suppose many other developers are. This is a terrible oversight on the part of Microsoft and it really needs to be resolved soon. Please esacalate this if you can. There are quite a few more posts asking for this and getting no response. How do we tell our clients to take Fabric seriously when you cannot actually build a mature solution in it?

       

      Here is an example of a thread related to what I am saying:
      Re: Gen2 dataflows and deployment pipelines - Microsoft Fabric Community

       

      Thanks,

      Phil

       

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      Hi Sooriya_27 
      We haven’t heard from you on the last response and was just checking back to see if your query got resolved. Otherwise, will respond back with the more details and we will try to help.
      Thanks

      • Anonymous's avatar
        Anonymous
        Not applicable
        2 years ago

        Hi @Sooriya_27 
        We haven’t heard from you on the last response and was just checking back to see if your query got resolved. Otherwise, will respond back with the more details and we will try to help.
        Thanks