topic Re: Data Pipelines: Copy data from Snowflake using on-prem gateway in Pipelines

Data Pipelines: Copy data from Snowflake using on-prem gateway

mark_carlisle — Wed, 27 Mar 2024 17:51:50 GMT

This recent blog post states Data Pipelines now support the on-prem gateway in public preview. We're required to use the on-prem gateway to access Snowflake but it does not look like Snowflake is yet supported.

Is support for Snowflake in developement and can you share any approximate timelines?

Re: Data Pipelines: Copy data from Snowflake using on-prem gateway

Anonymous — Thu, 28 Mar 2024 05:10:34 GMT

Hi mark_carlisle
Thanks for using Fabric Community.

There isn't official confirmation about direct Snowflake support within Data Pipelines for Microsoft Fabric at this time. However, there are some clues that can help:

On-prem Gateway Preview: The blog post mentioning on-prem gateway support in public preview suggests Microsoft Fabric is working on enabling access to external data sources. Snowflake might be included in future updates. If you want Snowflake to be included you can provide the feedback,which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.
Feedback channel link: Feedback Link
Existing Snowflake Connector: Microsoft Fabric already offers a Snowflake connector which is Mirroring Snowflake. Mirroring provides an easy experience to avoid complex ETL (Extract Transform Load) and integrate existing your Snowflake warehouse data with the rest of your data in Microsoft Fabric. You can continuously replicate your existing Snowflake data directly into Fabric's OneLake. For more information please refer to this link: https://learn.microsoft.com/en-us/fabric/database/mirrored-database/snowflake

Hope this helps. Please let me know if you have any further questions.

Re: Data Pipelines: Copy data from Snowflake using on-prem gateway

Anonymous — Thu, 28 Mar 2024 15:50:49 GMT

Hi mark_carlisle

I have an update from the internal team:

List of Pipeline Supported Connectors which OPDG availability: Data pipeline connectors in Microsoft Fabric - Microsoft Fabric | Microsoft Learn

Note: There are additional connectors that support OPDG that are not on this list - engineering team is working on providing documentation.

SnowFlake is on the roadmap. No timeline available. Please create/upvote Pipeline SnowFlake OPDG idea on Microsoft Idea

Hope this helps.

Re: Data Pipelines: Copy data from Snowflake using on-prem gateway

Anonymous — Mon, 01 Apr 2024 15:45:00 GMT

Hi mark_carlisle
We haven’t heard from you on the last response and was just checking back to see if your query got resolved. Otherwise, will respond back with the more details and we will try to help.
Thanks

Re: Data Pipelines: Copy data from Snowflake using on-prem gateway

Anonymous — Tue, 02 Apr 2024 15:40:42 GMT

Hi @mark_carlisle
We haven’t heard from you on the last response and was just checking back to see if your query got resolved. Otherwise, will respond back with the more details and we will try to help.
Thanks

Re: Data Pipelines: Copy data from Snowflake using on-prem gateway

saurabhaj — Tue, 30 Jul 2024 18:10:33 GMT

Hi Team,

I see Snowflake is now supported.

I am facing an issue where I am unable to see the data gateway dropdown in the copy activity. I saw a lot of videos online and for everyone the data gateway dropdown is seen. PFA Screenshot.

But, I can see it in DF Gen2 bit not in Pipeline.