When are these created exactly? And also can they be recreated if they are deleted?
While troubleshooting Dataflow Gen 2 dataflow I deleted the Lakehouse table it created and also the "ghost" staging Lakehouse artifacts.
I thought maybe by simply re-running the dataflow it might recreate the staging Lakehouse artificts but nope it didn't do that.
I also tried deleting and recreating the dataflow "Data destination" it might trigger recreating the staging Lakehouse artificts, to no effect either.
It seems I have to delete my dataflows and recreate them from scratch.
Does anyone have any insight into these staging Lakehouse artificts?
Edit to add:
For example, if I delete all of my Dataflow Gen 2 dataflows as part of a revision or troubleshooting, should I also then delete the Lakehouse staging artifacts so they can be recreated "fresh" when I recreate my Dataflow Gen 2 dataflows ? Are the Lakehouse staging artifacts specifically relevant only to the Dataflow Gen 2 dataflows that created them?
In a new workspace, when an end-user first launches a Dataflow Gen2, a set of staging artifacts, such as a new Lakehouse and a new Data Warehouse, are automatically created for the whole workspace. These artifacts can be used for a set of functionalities available for Dataflow Gen2.
A user is able to see these staging artifacts in the workspace list and lineage and being able to interact with these artifacts.
If a user deletes or modifies any of these staging artifacts, the workspace can be set in a state that won't be able to use these artifacts because of misconfiguration.
APPLIES TO:✔️ Dataflow Gen2 in Microsoft Fabric
Problem area:Data Factory
When trying to refresh a Dataflow gen2 and the error refers to:
null Error: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: PowerBIEntityNotFound: PowerBIEntityNotFound
After deleting the staging artifacts, you're unable to get them back.
Solutions and workarounds
Recreate your Dataflow Gen2 solution in a new workspace.