Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago
Solved

Unable to Delete DataflowsStagingLakehouse

Hi,

 

I created a Gen2 Dataflow which automatically created DataflowsStagingLakehouse in the workspace.

 

However even after deleting the Dataflow, the DataflowsStagingLakehouse is not getting deleted and giving following error.

 

 

Kindly help in this matter.

 

  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi Anonymous ,

    We have a bug filed to delete the LH & WH upon deletion of the last.
    Ideal workaround is to create a new Workspace as we cannot delete the stagging artifacts manually, but in your case this will not work.

    So inorder to handle your case I request you create a support ticket so the team will be looking into this issue more closely.

    Once you have a SR# , please do share that here, so that we can keep an eye on the same.

    Thank you

15 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    HI Anonymous 

    There are no manually artifacts in the DataflowsStagingLakehouse.

     

    However there are two automatically created atifacts which do not have delete option at all.

    01. SQL Analytics Endpoint

    02. Sematic Model

     

    Both of these do not have delete option in contex menu and both are empty.

    • AndyDDC's avatar
      AndyDDC
      Icon for Most Valuable Professional rankMost Valuable Professional

      Hi Anonymous so 2 things here:

       

      1. Dataflows "DataflowsStagingLakehouse" should now not be appearing in your workspace, these have been hidden.  Can you check if this is the case?  Perhaps create another workspace with a dataflow and see if those artifacts show up.

       

      2. The SQL Endpoint and Semantic Model are automatically created when you create a Lakehouse and can't be deleted.

      • Anonymous's avatar
        Anonymous
        Not applicable

        Thank you AndyDDC  for your insights.

        Anonymous - Few other inputs:

        1. SQL Analytics Endpoint and Sematic Model items have by default no option to be deleted. This is the same if you create a lakehouse yourself.

        2. These items will soon be hidden from users so should not show at all, however if indeed the last dataflow is removed from the workspace the lakehouse and warehouse with the other related items should be removed. After certain time period these items gets removed with the garbage collection.

        Hope this information is helpful.

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi Anonymous ,

    Thank you for using Fabric Community,

    Do you have any other artifacts in that workspace? The automatically created staging lakehouse is shared by all lakehouses, warehouses, dataflows, and pipelines within the same workspace. You can't delete it until you delete everything that could potentially use it or dependent on it. And if you did delete it, the moment you add a new lakehouse, warehouse, etc., the staging lakehouse will automatically be recreated.

    At this time, we are reaching out to the internal team to get some more information on this.
    We will update you once we hear back from them.

  • Hi,

    Any news on this issue? We are currently facing the same thing, where our DataflowStagingLakehouse Semantic model and SQL-Endpoints are preventing us from switching a business critical workspace to our ususal PPU license, causing major dataflow issues.

    • Anonymous's avatar
      Anonymous
      Not applicable

      Hi jesper-MM2 No, still they have not fixed the bug.

       

      Anonymous  Can you please tell us about resolution timelines? This is creating a lot of issues.

      • Anonymous's avatar
        Anonymous
        Not applicable

        Hi Anonymous , jesper-MM2 ,

        I just discussed with the internal but they have no ETA for the fix now.

        Ideal workaround is to create a new Workspace as we cannot delete the stagging artifacts manually.

  • dzav's avatar
    dzav
    Icon for Advocate III rankAdvocate III

    Any updates to this? I'm experiencing the same issue.

    • DavidStrawn's avatar
      DavidStrawn
      Frequent Visitor

      I was able to work with support and they were able to clean up the DataflowsStagingLakehouse artifacts.  Then I was able to convert back to PPU

      • Anonymous's avatar
        Anonymous
        Not applicable

        Hi DavidStrawn ,

        It was great to know that you were able to get to a resolution . We expect you to keep using this forum and also motivate others to do that same . You can always help other community members by answering to their queries

  • After you click on the DataflowsStagingLakehouse of type SQL Analytics-endpoint and go back to your workspace, you are able to delete all the DataflowsStagingLakehouse.