Forum Discussion

Icon for Helper V rank

Helper V

4 years ago

DataSource.Error: Unable to read data from the transport connection:

Hi All, I am having an issue using incremental refresh with dataflows, which I am not sure how to resolve. Current Setup: The dataflow is connected vie "Web" connector and consumes data from ...

Icon for Super User rank

Super User

4 years ago

This needs some more details. Does your API support time range filters? Did you apply them in the URL? How?

H_insight
Helper V
4 years ago
My source is JIRA and I believe it supports time range filters. The issue is that the dataflow runs with a FULL refresh in less than 2 mins with no issue. Only when I try to configure the Incremental Refresh, it keeps failing and gives the error message.

Configuration: Store rows for the last 2 years and refresh for 1 day.
- lbendlin
  Super User
  4 years ago
  The issue is that the dataflow runs with a FULL refresh in less than 2 mins with no issue.
  
  I fail to see the issue here 🙂 What problem are you trying to solve?
  - H_insight
    Helper V
    4 years ago
    What I meant here is that the dataflow runs with no issues IF I run a full refresh. But once the full refresh is complete and I try to configure the incremental refresh, it keeps failing.
    
    In summary, if a dataflow runs with a full refresh in less than 2 mins, what can cause the incremental refresh to fail and give the referenced error?
    
    PS: The full refresh step is to troubleshoot if the dataflow has any errors or timeout issues which may affect the Incremental refresh. That's why I mentioned
    
    The issue is that the dataflow runs with a FULL refresh in less than 2 mins with no issue.
    
    I hope that helps.

Related content