Forum Discussion
Dataflow Gen 1 Refresh Failures starting Last Week
- 1 year ago
Hi ChristopherKing ,
Thanks for using Microsoft Fabric Community and apologies for the delayed response.
Hope your issue got resolved. If not, please consider the following response.Error #1 : "Insufficient memory (8645)"
Even though you're using Premium capacity, if the dataflow connects through an on-premises gateway, the hardware specs of the gateway can impact performance. It's recommended to have:At least 2 cluster members with 16 GB RAM, or ideally 4 with 32 GB
Good CPU, disk speed, and stable network
This could help reduce memory-related refresh failures, especially if your data size or query complexity has grown.
Solved: Dataflow process error - Microsoft Fabric CommunityError #2 : "Cannot acquire lock for model"
This usually happens when a refresh is interrupted or fails to complete cleanly. The lock often clears after 24 hours, but in rare cases it may persist. Microsoft support can clear it manually if needed.Workaround suggestion:
Reassign the dataflow connection to a different gateway (even temporarily). This helps reset the internal connection mapping and resolve lock errors.
Here is the detailed workaround:Solved: Re: "CDSALockAcquireError" when attempting to save... - Microsoft Fabric Community
If the issue still persists even after the above steps, please raise a support ticket with Microsoft through this link.
Hope this helps. Please reach out for further assistance.
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and a kudos would be appreciated.Thank you.
The issues you're encountering with your dataflows—particularly Error #1 (compute engine memory timeout) and Error #2 (lock contention)—are known to occur in Power BI Premium when the capacity is under pressure or not optimized for concurrent workloads. While Premium capacity is designed to handle large datasets and manage memory dynamically, it does have resource limits, especially when multiple complex dataflows or chained dependencies are scheduled closely together. Error #1 suggests that the capacity is running out of memory while executing your dataflow, which can happen if the workload is too high during refresh windows or if recent model/dataflow changes increased memory demands. Error #2 points to a conflict in accessing shared resources, likely caused by overlapping dataflow refresh schedules, particularly in chained dataflows where one depends on another completing first. Although removing and re-adding the workspace to premium resets the capacity state temporarily, this is not sustainable.
To resolve this, first review the refresh schedules in the workspace and stagger them to ensure that dependent dataflows do not run concurrently. Use the Power BI Capacity Metrics app to monitor memory usage, query durations, and refresh overlaps to identify peak load times. Additionally, optimize your dataflows by reducing transformations where possible, using computed tables efficiently, and splitting large dataflows into smaller, modular ones that can refresh independently. If capacity pressure remains high, consider assigning a dedicated capacity or increasing your memory allocation per workload in the Power BI Admin Portal under Capacity Settings → Workloads → Dataflow workload. Lastly, ensure the Power BI service is up-to-date by checking the Power BI Support site for any ongoing service incidents, as backend changes or bugs can occasionally impact stability.
Thank you for the response. Fortunately, Error #1 has not occured again since the first time I removed the workspace from premium capacity and added it back. Also, even when that specific workspace was experiencing that issue, I had 2 other workspaces in the same capacity that had no issue with dataflow refreshes. I have looked at the Fabric Capacity Metrics app, and I see no issues with our usage. I don't think I have ever seen our usage exceed 50%.
I have also looked in Capacity settings, and I do not see a section in Power BI Workloads to manage Dataflow Workloads. We are in GCC, so I don't know if that is different, but these are the options I see:
As for Error #2, I have 5 dataflows that extract data from our SQL servers. These feed into 1 dataflow for end users to consume. The only one of these dataflows that has a scheduled refresh is the first one, which refreshes nightly at 11 pm. I then have Power Automate cloud flows that begin the refresh of the next flow in the series one minute after the previous flow completes. The issue I am seeing, however, occurs with the first flow of the night. It normally runs for about 20 to 30 minutes before completing. When this locking issue occurs, it will run for 30 minutes, the refresh log will show complete for all tables, but the refresh does not finish. A few minutes later, it fails, and the log then only has one line with the above error message. Since the last refresh usually completes around 2 in the morning, this is occuring about 21 hours after there has been any refresh activity on any of the dataflows. This issue occured last week, then cleared up over the weekend, then began again last night.
Thank you,
Chris