Forum Discussion

AnthonyGenovese's avatar
AnthonyGenovese
Resolver III
3 years ago
Solved

Datasource crednetials missing or Invalid AFTER data is being loaded

We are trying to load some larger on prem SQL Server tables to the Lakehouse via Gen2 Dataflow. We are receiving the below error many minutes after the dataflow has ran.    Error Code: Challenge Er...
  • SidJay's avatar
    3 years ago

    For Gateway-based refreshes we have an existing limitation with token refresh that causes Gateway jobs over an hour to fail. It's not quite as strict as the entire job needing be under an hour, but if portions of the job take more than an hour, the limitation is hit.

     

    Are you temporarily able to partition your refreshes so that the Gateway-based queries are partitioned into jobs that take less than an hour? You can then append (union) the partitions via a separate dataflow that runs in the cloud.

     

    Thanks