Forum Discussion

bunny96's avatar
bunny96
New Member
7 months ago
Solved

Gen2 Dataflow Refresh Failure - Staging Lakehouse Not Found

I am unable to successfully refresh a Gen2 Dataflow configured to fetch data from SQL Server and store it in a Lakehouse. The dataflow creation process appears to complete, but when attempting to ref...
  • v-karpurapud's avatar
    7 months ago

    Hi bunny96 
    Thank you for reaching out to the Microsoft Fabric community forum.

     

    This problem usually occurs when query-level staging is enabled in Dataflow Gen2, rather than being an issue with the SQL Server source or the destination Lakehouse. When staging is enabled, Microsoft Fabric stores intermediate results in an internal staging Lakehouse. If this staging Lakehouse is missing, incorrectly created, or inaccessible due to workspace or permission changes, you may see the error “Staging lakehouse for dataflow was not found” (StagingLakehouseMissingError).

     

    To fix this, open Dataflow Gen2 in the Power Query editor, select the affected source query, and turn off the Enable staging option in the query or managed settings, as tayloramy suggested. Save the dataflow and try refreshing again. Disabling query-level staging often resolves the issue by preventing Fabric from trying to save intermediate results in the staging Lakehouse.

     

    If the error persists after you disable staging, it means the reference to the internal staging Lakehouse is missing or corrupted. In this case, the recommended solution is to delete and recreate the Dataflow Gen2, making sure a Lakehouse exists in the workspace and you have Contributor or Admin permissions. Recreating the dataflow will restore the required internal staging artifacts and normal refresh behavior.

     

    I hope this helps. If you have more questions, feel free to ask and we’ll be glad to assist further.

     

    Best Regards,

    Microsoft Fabric Community Support Team