Forum Discussion
Difference between different Staging lakehouses
Hello Team,
On Onelake Catalog, I see 3 different Staging lakehouses which we didn't create. I understand when we create a Dataflow it creates "DataflowStagingLakehouse" as we check "Enable Loading". But when does StagingLakehouseforDataflows and StagingLakehouseforDataflows_Timestamp is created?
I tried to look at the documentation but I could't find.
Hi DwijaKeerthi ,
These are also generated automatically.
Let's move on to this point:
- StagingLakehouseforDataflows
Fabric requires a kind of technical lakehouse, regardless of whether a target has been defined or not. - StagingLakehouseforDataflows_Timestamp
This is used for internal DataFlow operations.
Here you will find documentation that describes it fairly accurately, I would say.
https://learn.microsoft.com/en-us/fabric/data-factory/data-in-staging-items
https://learn.microsoft.com/en-us/fabric/data-factory/tutorial-dataflows-gen2-pipeline-activity
Here is a Screenshot from the Dokumention
I hope this answer helps you.
Best regards
Feel free to leave kudos or accept it as a solution. This will also help other community members.
- StagingLakehouseforDataflows
4 Replies
Hi DwijaKeerthi ,
These are also generated automatically.
Let's move on to this point:
- StagingLakehouseforDataflows
Fabric requires a kind of technical lakehouse, regardless of whether a target has been defined or not. - StagingLakehouseforDataflows_Timestamp
This is used for internal DataFlow operations.
Here you will find documentation that describes it fairly accurately, I would say.
https://learn.microsoft.com/en-us/fabric/data-factory/data-in-staging-items
https://learn.microsoft.com/en-us/fabric/data-factory/tutorial-dataflows-gen2-pipeline-activity
Here is a Screenshot from the Dokumention
I hope this answer helps you.
Best regards
Feel free to leave kudos or accept it as a solution. This will also help other community members.
- StagingLakehouseforDataflows
Hi DwijaKeerthi,
These are internal staging databases created by Fabric, usually they do not appear in the UI.
You can safely ignore these. Do not manually store any data in them as they can be deleted at any time.
If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.
Thank you tayloramy
Yes I understand that they are internal staging but I was curious why and when they gets created and how are they different form the default lakehouse "DataflowStagingLakehouse"Hi DwijaKeerthi,
Microsoft changes how they do their staging when they update things. THey are in the process of deleting all the unused legacy staging lakehouses and warehouses right now, your admin would have gotten a message in the M365 admin center about it.Newer ones seem to have the timestamp while older ones do not.
If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.
