Intermittent DM_GWPipeline_Gateway_CanceledError

[awright19]

We have had a string of refresh failures due to the DM_GWPipeline_Gateway_CanceledError error over the last week or so. The dataset affected varies. Most are scheduled refreshes, but it has happened on manual refreshes as well. Generally, when manually starting the refresh again, it works fine. The sources are working fine in other datasets.

Any idea what could be causing this?

[v-pnaroju-msft]

Hi awright19,

We sincerely appreciate your update.

We are following up to check if your query has been resolved. If you have identified a solution, we kindly request you to share it with the community and mark it as the accepted solution. Doing so will help others facing similar challenges and benefit the broader community.

Thank you for your patience.

[andy808]

Has there been any solution found here? We continue to receive this refresh failure error multiple times daily. Any information here would be super helpful. Thanks

[awright19]

To keep everyone updated...the Microsoft ticket has been escalated and they acknowledge that other companies are seeing the same issue.

We were told to increase our disk space, to see if that resolved the issue. We have done so twice now, and are still getting the issue. Less volume of failures, but still there.

[victor_mirante]

They gave the same response to us, but did not explain why the error occurs only with datasets connected to the SQL Server.
We have datasets connected to Analysis Services that are working normally.

[andy808]

We continue to receive the DM_GWPipeline_Gateway_CanceledError error. Are any of you still seeing this error? Has anyone had a response back from Microsoft? Anyone have insight into what is causing this refresh error? Thanks!!

[Luthercop]

We are also facing this issue. Even after updating the gateways, upping the compute resources and rebooting the gateway host machines. The ticket is still open with Microsoft. Not really sure when this issue will be resolved. 

[awright19]

We were told last week that the issue has been escalated. No details on the cause. I haven't heard anything since then.

[ezaidi]

Thanks for keeping us in the loop! Im still having many failures every single day. Some days are worse than others. But out of our 100+ reports, maybe random refresh failures per day. I just keep doing manual refreshes whenever necessary.

[v-pnaroju-msft]

Hi awright19,

Thank you for your response.

We kindly request you to share the solution with the community, as it will assist others facing similar challenges and contribute to the broader community's benefit.

[victor_mirante]

Hello,

I’ve been having the same issue for over a month. I’ve opened a ticket, but they don’t have a solution. In the last email, they said that the latest version of the gateway has this problem, but the issue was already happening before updating to that version.

[v-pnaroju-msft]

Hi awright19,

We are following up to check whether the support ticket raised from your end has provided a resolution to the issue. If it has, we kindly request you to share the solution with the community and mark it as the accepted solution, as this will assist others facing similar challenges and benefit the broader community.

Thank you.

[awright19]

There has been no resolution yet. If and when we get a resolution, I will update this post with information.

Angie

[ezaidi]

Still no resolution here either. I have tried downsizing and limiting our refresh schedules as much as possible. So far nothing has helped. Thanks for keeping us in the loop.

[v-pnaroju-msft]

Hi awright19,

We sincerely apologise for the inconvenience caused.

As the proposed solution did not resolve the issue, we kindly request you to raise a Microsoft support ticket using the link provided below:

Microsoft Fabric Support and Status | Microsoft Fabric

If you find this response helpful, kindly mark it as the accepted solution and provide kudos. This will assist other community members facing similar queries.

Thank you.

[awright19]

We have submitted a ticket to our software provider.

I came in this moring to the largest number of fails yet.

I'm curious if those that reported having a similar issue are still experiencing it.

[sandy_ew]

I have stopped seeing this error for about a week now.  

[andy808]

Yes we are continuing to experience refresh failures with this 'cancelerror', we have submitted a ticket as well.

[ezaidi]

We are experiencing exactly the same issues as you since around january 11th. I have since updated the On Premise Data Gateway, I have added redundancy by creating a cluster and installing another On Premise Data Gateway on a different server. I have reduced the number of concurrent refreshes and removed unecessary refresh schedules. The issue is still persistent and unpredictable affecting random dashboard refresh. Usually manually refreshing works fine. I created another post on this same issue and others have commented that they have the same issue going on.

https://community.fabric.microsoft.com/t5/Service/Scheduled-refresh-randomly-failing-every-day-with-...

We have been working with OPDG for years without problems and all of a sudden these issues are happening. This is an MS issue and needs to be resolved by them.

[Poojara_D12]

Hi @awright19 

The DM_GWPipeline_Gateway_CanceledError occurs when the on-premises data gateway cancels a refresh, often due to resource or timeout issues. Here are potential causes and solutions:

1. Gateway Overload: Check CPU/RAM usage and add resources or nodes to the gateway cluster.
2. Timeouts: Optimize queries and increase the Command Timeout in gateway settings.
3. Concurrent Load: Stagger refresh schedules or increase the concurrent queries limit.
4. Network Issues: Ensure a stable network connection and verify firewall/VPN configurations.
5. Outdated Gateway: Update the gateway to the latest version.
6. Dataset Errors: Review refresh history and optimize problematic datasets.
7. Cluster Issues: Check for failing nodes in a gateway cluster and remove unhealthy ones.

These steps should help identify and resolve the issue.

 

[v-pnaroju-msft]

Hi awright19,

We have not received a response from you regarding the query and were following up to check if you have found a resolution. If you have identified a solution, we kindly request you to share it with the community, as it may be helpful to others facing a similar issue.

If you find the response helpful, please mark it as the accepted solution and provide kudos, as this will help other members with similar queries.

Thank you.