connector to on prem gateway error: The Data Factory runtime is busy now. Please retry the ...

[smeetsh]

Hi All,

I created a new on premises gateway on one of our servers, its purpose is to read a fileshare. When creating the connector everything seemed fine and it passed its self test with the supplied credentials.

When i create a pipeline to use this connector, I get a message about the data factory runtime being busy. At first I thought i would need to give it a bit of time to set itself up in the background but we are, as we speak, half an hour later.

If i click the "test connection"

The error reads:
The Data Factory runtime is busy now. Please retry the operation later.

If i try to browse the files I get:

I have already restarted the gateway, but that didn't help. There are no pipleines running either.  The server is barely under load with 5% cpu  and 93% memory free. When I go on the server that has the gateway, I can reach the fileshare without any issue.

MS status page shows no issues, but than again that is barely maintained anyway.

Does anyone have any ideas?
Cheers

Hans

[smeetsh]

I have another call with MS today, the new case number is: 2507020030000837

[KevinChant]

Create a local folder on the gateway server and try to connect to that in the pipeline first to verify that the gateway is definitely working okay.

[smeetsh]

They closed the case without resultion, i had to create a new case: 2507020030000837 Microsoft this type of service is as bad as it can get.

[smeetsh]

I have decided to re-install the gateway under my own powerbi user with full admin access, to see if that was the issue. But I still get the "The Data Factory runtime is busy now. Please retry the operation later."

MS support is non existent, very dispappointing!

[smeetsh]

MS techsupport has still not resolved the issue. They had me completely uninstall the gateway and reinstall it. The error code is now  "error 400". So we are no step closer to resolve the issue. I keep having to chase them myself, MS techsupport seems to lack proactivity in solving case that do not get solved in the first instance. Right now I don't even know if my case is escalated or what the status is.

Pretty poor to be honest.

[v-mdharahman]

Hi @smeetsh,

Can you please provide the support ticket number so that we can keep a track of your issue with the support team. 

Best Regards,

Hammad.

[smeetsh]

Hi @v-mdharahman  The ticket number is : 2505160030002613

Also the error is now back again to the original error of it being busy

[smeetsh]

The issue has not been fixed, recreating the connector seemed to have solved it, but after a few dats the probem came back. Microsoft is looking at the network logs from the browser.

It seems to be an intermittent problem, which makes it even worse.

[v-mdharahman]

Hi @smeetsh,

We are following up once again regarding your query. Could you please confirm if the issue has been resolved through the support ticket with Microsoft?

If the issue has been resolved, we kindly request you to share the resolution or key insights here to help others in the community. If we don’t hear back, we’ll go ahead and close this thread.

Should you need further assistance in the future, we encourage you to reach out via the Microsoft Fabric Community Forum and create a new thread. We’ll be happy to help.

Thank you for your understanding and participation.

[smeetsh]

I have done the steps, and raised a ticket

[v-mdharahman]

Hi @smeetsh,

Could you please confirm if the issue has been resolved after raising a support case? If a solution has been found, it would be greatly appreciated if you could share your insights with the community. This would be helpful for other members who may encounter similar issues.

Thank you.

[Carollavecchia]

I have the same problema here

[v-mdharahman]

Hi @Carollavecchia,

Please go through the suggested trouble-shooting steps and check if they solve your issue. If it doesn't then kindly raise a support ticket with Microsoft Support Team.

Thank you,

Hammad.

[v-mdharahman]

Hi @smeetsh,

Thanks for reaching out to the Microsoft fabric community forum.

You mentioned that the gateway passed its self-test with the right credentials and you can access the file share from the server directly which confirms that the gateway and share permissions are likely working.

When the "Test connection" in the pipeline fails with "The Data Factory runtime is busy now", and the file browsing also throws a "Failed to load" message with an Activity ID, it usually means there’s a communication break between the service (ADF or Fabric) and your on-premises gateway. Restarting the gateway was a good move, but this error can still persist if there’s a temporary connectivity issue between the IR and the cloud service or there’s a firewall/proxy/NAT issue especially if multiple gateways are registered under the same tenant or the runtime service just isn’t scaling or assigning backend resources quickly enough.

I recommend these below steps that might help in solving the issue:

* Go to On-premises data gateway UI and do a proper restart of the Windows service (not just closing/reopening the config).

* Then go to the Power Platform Admin Center or Fabric Data Gateway portal, and refreshing the gateway status there.

* Also double check if there are multiple gateways and make sure the correct one is associated with your connector.

Lastly, oi would suggest give it a bit more time. I know 30 minutes seems like a lot, but sometime backend assignments take up to an hour when setting up a new gateway or connector the first time.

If it’s still failing after all that, you can open a Microsoft support ticket. Use the Activity ID to give them enough to trace the issue from their end. You can reach out to Microsoft Support by raising a ticket with Microsoft Support.

Please refer below link on how to raise a contact support or support ticket.
How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn

If I misunderstand your needs or you still have problems on it, please feel free to let us know.  

Best Regards,
Hammad.
Community Support Team

[smeetsh]

Can an admin please remove this answer as a solution, it is not! Please do not mark answers as a solution if your not the TS. It really muddies the resource and on pads your own stats incorrectly.

[v-mdharahman]

Hi @smeetsh,

We are really sorry for the last suggestion been marked as closed from our end because we have given work around that might be helpful for you to resolve your issue.

Also as we suggested for support ticket and the communication happened long back, so as per our community guidelines we marked the reply with work around as solution. However we will open the thread until the issue has been resolved by support team. Once it get closed with support team please post the solution provided by the support team, it will be useful for other community members.

Best Regards,

Hammad.

[smeetsh]

Good morning, I have done all these steps, this is not a solution, please unmark it as "the solution"

[smeetsh]

Good morning,

I have now given it a few days. I just restarted the service, though the services control panel even.  It shows online in the admin portal. Restarting the service did not help.

I even added myself back as owner, in stead of the admin group we normally use. That did not fix it either

[v-mdharahman]

Hi @smeetsh,

Even after going through the suggested trouble-shooting steps if you are still unable to solve the issue you can reach out to Microsoft Support by raising a ticket with Microsoft Support.

Please refer below link on how to raise a contact support or support ticket.
How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn

Best Regards,

Hammad.