Forum Discussion
Create table if not exist in Dataflow Gen2 (CI/CD) with lakehouse as destination
- 2 months ago
Hello CCal,
If it's set to an existing table, that table has to already exist, Dataflow Gen2 won't create it for you. And if it gets deleted down the line, it won't come back on the next refresh either.
If it's configured as a new table, Dataflow Gen2 creates the table on the first refresh. If that table is later deleted, it's recreated on the next refresh.
From what I can tell in the docs, there's no built-in setting that says "create it if it's missing, use it if it's already there." So I will start by checking whether your destination is set to New table or Existing table after the deployment.
Microsoft Learn: Dataflow Gen2 data destinations and managed settings
Hello CCal,
If it's set to an existing table, that table has to already exist, Dataflow Gen2 won't create it for you. And if it gets deleted down the line, it won't come back on the next refresh either.
If it's configured as a new table, Dataflow Gen2 creates the table on the first refresh. If that table is later deleted, it's recreated on the next refresh.
From what I can tell in the docs, there's no built-in setting that says "create it if it's missing, use it if it's already there." So I will start by checking whether your destination is set to New table or Existing table after the deployment.
Microsoft Learn: Dataflow Gen2 data destinations and managed settings