Forum Discussion
waltheed
Impactful Individual
Impactful IndividualLanding zone in OneLake
We'd like to load data from source systems into a landing zone first, before merging it with our Bronze layer. All in OneLake of course. If we try to do that, choosing overwrite as load option, ...
DennesTorres
Power Participant
Power ParticipantHi,
You are right, when using the lakehouse "Files" as destination, this option is really missing.
To reach this result, you would need to drop the folder, if it already exists, before transfering content to your landing zone.
In my personal opinion, I don't like this that much. By joining the data directly to your Bronze, you lose data lineage. The landing zone would be a good place to keep the blocks of data loaded together and in this way you would know exactly what records or values where loaded each day. To achieve this, your landing zone needs to keep one forlder for each ingestion. Of course, it's a choice, I prefer this design to alway keep track of everything and the storage is not so expensive.
Kind Regards,
Dennes