Forum Discussion
Dataflow Gen2 Not loading and refreshing data
- 1 year ago
Hello balafbm
DataflowLakehouseInternalSqlNotProvisioned” is associated with SQL analytics endpoint provisioning failures during Dataflow Gen2 refreshes, particularly in migration scenarios from Fabric trial to paid capacity.
Dataflow Gen2 automatically creates a staging lakehouse, but prior to January 2025, a known issue caused the SQL analytics endpoint for this lakehouse to fail provisioning. This led to refresh errors like:
`Refresh failed. The staging lakehouse is not configured correctly` .While this was officially fixed in January 2025, migration from trial to paid capacity can reintroduce configuration mismatches if the workspace or lakehouse isn’t properly reassigned to the new capacity .
Workspaces migrated from trial to paid capacity may retain outdated references to trial resources, causing conflicts in SQL endpoint provisioning
Please check:
Verify workspace assignments to the new paid capacity in the Fabric Admin Portal
Possible solutions:
Existing Lakehouse artifacts in the new Fabric Capacity workspace may lack proper SQL endpoint provisioning.
• Delete the current Lakehouse and create a new one. Republish the Dataflow Gen2 to reference the new LakehouseDisable Staging in Power Query
Please try these and let us know if this works.
Thanks
Thanks for the detailed explanation nilendraFabric .
Here's what worked and what didn't.
When we were on Fabric trial capacity, I had created the dataflow gen2 in a workspace called "BI Production".
Before transitioning to Fabric capacity, I deleted all Fabric artifacts (including dataflow gen2)manually from this workspace.
(We had to delete Fabric artifacts from workspaces, as we were moving from one region to another)
After moving to a Fabric Capacity (F64) , I recreated the same dataflow gen2 manually from scratch in that same "BI Production" workspace, and I got that error which I mentioned in my Original Post.
" An external error occurred while refreshing the dataflow: DataflowLakehouseInternalSqlNotProvisioned "
I am still getting the error after trying the steps mentioned above.
Here's what worked:
I created the dataflow gen2 from scratch in a different workspace which did not have any fabric artifact when we were on trial capacity.
The data loaded perfectly and the refresh works perfectly.
So now, we are still not able to create and load dataflow gen2 in the "BI Production" workspace which had fabric artifcats when we were on trial capacity.
Hoping this can be fixed by Microsoft.
Hi balafbm ,
Sorry to know it didn’t help. Please consider reaching out to Microsoft Support. You can provide them with all the troubleshooting steps you've already taken, which will help them understand the issue better and provide a resolution. They might be able to identify something specific about your admin account setup or provide a solution that isn't immediately obvious.
Below is the link to create Microsoft Support ticket:
How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn
Thanks and Regards