Forum Discussion

mark_carlisle's avatar
mark_carlisle
Advocate IV
2 years ago

Data Pipelines: Copy data from Snowflake using on-prem gateway

This recent blog post states Data Pipelines now support the on-prem gateway in public preview. We're required to use the on-prem gateway to access Snowflake but it does not look like Snowflake is yet supported.

 

Is support for Snowflake in developement and can you share any approximate timelines?

General Question
pipelines

5 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi mark_carlisle 
    Thanks for using Fabric Community.

    There isn't official confirmation about direct Snowflake support within Data Pipelines for Microsoft Fabric at this time. However, there are some clues that can help:

    1. On-prem Gateway Preview: The blog post mentioning on-prem gateway support in public preview suggests Microsoft Fabric is working on enabling access to external data sources. Snowflake might be included in future updates. If you want Snowflake to be included you can provide the feedback,which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.
      Feedback channel link: Feedback Link 

    2. Existing Snowflake Connector: Microsoft Fabric already offers a Snowflake connector which is Mirroring Snowflake. Mirroring provides an easy experience to avoid complex ETL (Extract Transform Load) and integrate existing your Snowflake warehouse data with the rest of your data in Microsoft Fabric. You can continuously replicate your existing Snowflake data directly into Fabric's OneLake. For more information please refer to this link: https://learn.microsoft.com/en-us/fabric/database/mirrored-database/snowflake

    Hope this helps. Please let me know if you have any further questions.

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      Hi mark_carlisle 
      We haven’t heard from you on the last response and was just checking back to see if your query got resolved. Otherwise, will respond back with the more details and we will try to help.
      Thanks

      • Anonymous's avatar
        Anonymous
        Not applicable
        2 years ago

        Hi @mark_carlisle 
        We haven’t heard from you on the last response and was just checking back to see if your query got resolved. Otherwise, will respond back with the more details and we will try to help.
        Thanks

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi mark_carlisle 

    I have an update from the internal team:

     

    List of Pipeline Supported Connectors which OPDG availability: Data pipeline connectors in Microsoft Fabric - Microsoft Fabric | Microsoft Learn

     

    Note: There are additional connectors that support OPDG that are not on this list - engineering team is working on providing documentation.

     

    SnowFlake is on the roadmap. No timeline available. Please create/upvote Pipeline SnowFlake OPDG idea on Microsoft Idea

     

    Hope this helps.

     

  • saurabhaj's avatar
    saurabhaj
    Regular Visitor
    2 years ago

    Hi Team,

    I see Snowflake is now supported.

    I am facing an issue where I am unable to see the data gateway dropdown in the copy activity. I saw a lot of videos online and for everyone the data gateway dropdown is seen. PFA Screenshot.


    But, I can see it in DF Gen2 bit not in Pipeline.