Forum Discussion

quentinyang's avatar
quentinyang
New Member
9 months ago

Dataflow & Scheduled Refresh Gateway Issue

Hi All,   I am trying to set up Gen2 Dataflows to build pipeline from Snowflake, Amazon Redshift, MySQL, etc. Now I keep running into errors like    An exception occurred: DataSource.Error: An er...
capacities
Vinodh247's avatar
Vinodh247
Icon for Super User rankSuper User
9 months ago

The issue is likely env / permission related rather than connector specific.

 

Can you check the following?

  1. Gateway setup - Ensure you are using the same gateway cluster and connection configuration as your boss. Verify your gateway is online and you have admin or user rights to it.

  2. Network/firewall - Confirm outbound access to snowflake/redshift/mysql endpoints is open from your network or the gateway machine. Timeout errors often indicate blocked ports or vpc routing issues.

  3. Authentication scope - Even if credentials are correct, dataflow gen2 connections use service principal or user delegation tokens. Ask your fabric admin to confirm you have the same fabric tenant and data source permissions.

  4. Dataflow region alignment - Verify your workspace, gateway, and data source are in the same region.

  5. ODBC confusion - Fabric gen2 uses native connectors, but under the hood some sources still require ODBC on the gateway host. Ensure the redshift ODBC driver is installed on that gateway server.

If all these match your boss’s setup, recreate the connection under manage connections and gateways and retry the dataflow.

 

 

  • quentinyang's avatar
    quentinyang
    New Member
    9 months ago

    Hi Vinodh!

    Thanks for the reply. Sorry I just realized my post was confusing. We actually didn't use any gateway. Only Cloud Connection.