Forum Discussion
Helper IVDataflowsStagingLakehouse / DataflowsStagingWarehouse in source control
Hi cw88,
In fact, these hidden contents are generated to work with dataflow staging features.
When staging is enabled on your queries (the default behavior), your data is loaded into the staging location, which is an internal Lakehouse only accessible by dataflows itself.
The feature usage is based on your data destinations.
If you are work with data Warehouse destination, you can't disable it becase staging is mandatory for data warehouse.
If you are work with lakehouse and other non-warehouse destinations, you can disable staging to directly written data to the destination.When you not need to use these internal lakehouse any more, you can remove them from the workspace system storage.(they will auto generated if any other contents or features dependency this feature, so remove the dependency contents at first)
Regards,
Xiaoxin Sheng
Helper IVHi Anonymous ,
no, i use fabric content with the integrated source control with azure devops. The workspace items DataflowsStagingLakehouse & DataflowsStagingWarehouse getting detected from source control even though i don't see them in source workspace.
When i push the items from source control to a new workspace, the "staging" objects where also pushed as "normal" lakehouse / warehouse.... 😐
Hi cw88,
In fact, these hidden contents are generated to work with dataflow staging features.
When staging is enabled on your queries (the default behavior), your data is loaded into the staging location, which is an internal Lakehouse only accessible by dataflows itself.
The feature usage is based on your data destinations.
If you are work with data Warehouse destination, you can't disable it becase staging is mandatory for data warehouse.
If you are work with lakehouse and other non-warehouse destinations, you can disable staging to directly written data to the destination.
When you not need to use these internal lakehouse any more, you can remove them from the workspace system storage.(they will auto generated if any other contents or features dependency this feature, so remove the dependency contents at first)
Regards,
Xiaoxin Sheng
Hello Anonymous ,
i know the background from staging warehouse/lakehouse. The question is if it is possible to exclude this objects from source control? Because when the staging objects are committed to source control they get created as "visible objects" in any test/dev workspace.