Pipeline activities failing with 'Failed to resolve connection ... referenced in activity run ...'

[gacurtin]

Hello, 

A few days ago my pipeline activities started failing with the following error:

Error Code: UserError

Failure Type: User Configuration Issue

Details: Failed to resolve connection [Connection ID] referenced in activity run [Activity ID]' 

Prior to seeing this error, the pipelines ran on schedule every night without any issue.  No changes were made to the source, destination or pipeline prior to experiencing this issue. I own the source, destination and pipeline.

To resolve the error, I have to go to each activity and run a test connection then rerun.  However, this solution only resolves the issue temporarily.  All failed activities are copy data activitities which have an Azure SQL Database as both the source and destination.  All the copy data activities in these pipelines run concurrently (as opposed to sequentially).  

So far I have tried:

o Creating new connections (issue remains)

o Rerunning Pipeline without testing connection (issue remains)

Does anyone know how to permanently resolve this issue?  Currently, it is taking hours everyday to run a test connection on every failed activity.

[SivaReddy24680]

HIi @gacurtin 

I faced the same issue. I actually copied the copy activity from another pipeline and pasted in new pipeline and ran the new pipeline. When I re-build the copy activity, it went fine

[ryan_v]

I was able to fix by adjusting batch counts - was trying to load 55 tables simultaneously via same connection (something that can be done in ADF and Synapse). Adding a batch limit allowed for the pipeline to run..

[lbendlin]

If you have a Pro license you can open a Pro ticket at https://admin.powerplatform.microsoft.com/newsupportticket/powerbi
Otherwise you can raise an issue at https://community.fabric.microsoft.com/t5/Issues/idb-p/Issues .