Forum Discussion
Post ProdigyChoosing destination target without worrying if the table exists or not
Community ChampionI think this documentation is a good source of information:
(I haven't tested all the possible settings combinations which are listed there.)
My understanding is that if you specify a new table, then the Dataflow Gen2 creates the new table on the first refresh, and then uses this table for all subsequent refreshes. According to the docs, the Dataflow Gen2 might drop and recreate the table on each refresh, depending on which destination configurations are chosen. See more info in link above (although I'm a bit unsure if it actually gets dropped or just overwritten).
If the table gets deleted somehow (also by someone other than the dataflow gen2), the dataflow gen2 will also recreate the table on the next refresh.
It should not be necessary to edit the destination settings after creating the Dataflow Gen2.
It is my understanding that if you specify to use an existing table, it is only possible to select a table which already existed. So you cannot use the existing table option to create a new table.
If the existing table gets deleted somehow, the Dataflow Gen2 will not recreate the table. You would need to recreate the table manually.
Anyway, it should not be necessary to edit the destination settings after you have created the Dataflow Gen2.
Post ProdigyHi,
I've accomplished some proofs.
If I specify the "New table" option and next the name of the this table, the Dataflow gen2 seems to check the table existence: if it doesn't exist then create it, otherwise uses it, appending or replacing data basis on the related option.
I'd like this behaviour because I can create a new dataflow gen2 specifying to create a new table, run it and then run it again without changing the dataflow.
This behaviour should be better documented also directly in the Fabric service.
I've submitted this idea Managing better the New table and the Existing table options for a Data destination
Hi pmscorca ,
It seems that you have gotten a solution. Could you please mark the helpful post as Answered? It will help the others in the community find the solution easily if they face the same problem as yours. Thank you.
Best Regards
Yilong Zhou