Forum Discussion

FurkanSa's avatar
FurkanSa
Frequent Visitor
1 year ago
Solved

Onprem PostgreSql to Lakehouse connection error

Hello Data Fam,

A while ago, I was building a data warehouse by connecting to PostgreSQL through a Data Pipeline, then transferring data to a Lakehouse and from there to the Data Warehouse. It was working fine at first, but over time, errors started to occur and now I can't transfer any data at all.

Every time I try, I get an Npgsql timeout error. The gateway status shows as online, but when I test the connection, it returns a failure response.

Has anyone else experienced this issue and found a solution?

Many Thanks

Pipeline

9 Replies

  • jennratten's avatar
    jennratten
    Super User
    1 year ago

    Hello FurkanSa - The answer could vary depending on which error message you are getting.  Can you please post a snip or paste the error message here? 

    • jennratten's avatar
      jennratten
      Super User
      1 year ago

      There could be many possible causes here.  I recommend running a few other tests using something similar to the sample script below with the point being to query a very small amount of data using the same data source connection that is in question as well as one other that's on the same gateway.  This will help narrow down the possibilities.

      • Does it work in a new data pipeline?
      • Does it work in a different workspace?
      • Does a similar small query work in a data pipeline for another data source that is on the same gateway?
      • Does it work in a dataflow gen2?
      • Additional Info:
        • Has the gateway version been updated in the last 5-7 months?  
        • What is the version of the gateway app?

      Sample Script

      SELECT *
FROM your_table_name
LIMIT 1;

       

      Translated Error Message:

      Error Details

      Source to Silver - dimordertype

      • Error Code: 2200
      • Error Type: User configuration issue

      Details:

      • Type=Npgsql.NpgsqlException: Exception while reading from stream (Source: Npgsql)
      • Type=System.TimeoutException: Timeout during reading attempt

      Event ID: 32f30420-ffe9-49e7-98bf-523ae12f9011

       

      • FurkanSa's avatar
        FurkanSa
        Frequent Visitor
        1 year ago

        Thanks for all the suggestions, but I'm still facing the same issue. 😕

        I’ve tried creating a new data pipeline, switching to different workspaces, using smaller queries, and even testing with Dataflow Gen2 — but none of these worked.

        The gateway app version is June 2025. I updated it (previously it was May 2025), thinking it might resolve the issue, but unfortunately, it didn’t help.

        We have several reports using the same gateway with different data sources, and those are working fine. The issue only occurs when trying to connect to PostgreSQL.

        I can successfully access the PostgreSQL server directly, but the gateway cannot. Everything was working fine a few weeks ago — but now the connection fails.

  • Anonymous's avatar
    Anonymous
    Not applicable
    1 year ago

    Hi FurkanSa,

    Thanks for reaching out to the Microsoft fabric community forum and for sharing the error details. This confirms that the timeout is occurring during the data read process from your PostgreSQL source. As jennratten has responded to your query, kindly go through his response and check if the issue can be resolved.

     

    I would also take a moment to thank jennratten, for actively participating in the community forum and for the solutions you’ve been sharing in the community forum. Your contributions make a real difference.

     

    If I misunderstand your needs or you still have problems on it, please feel free to let us know.  

    Best Regards,
    Hammad.