Gen2 Dataflow is still writing previously deleted queries to my warehouse.

[rbass]

I have a Gen2 Dataflow the previously had 8 quieries. All of these tables were written into a warehouse. I didn't need 2 of the tables, so I deleted the 2 queries from the Dataflow and dropped the 2 tables from warehouse. Now when I refresh the dataflow the dropped tables reappear. I ran the diagnostics from the dataflow and the logs show that the deleted queries are still being written. Am I doing something wrong? Should I just delete the whole dataflow and make a new one?

[Anonymous]

Hi @rbass ,

Did @nilendraFabric reply solve your problem? If so, please mark it as the correct solution, and point out if the problem persists.

Best regards,

Adamk Kong

[nilendraFabric · Accepted solution]

Hello @rbass 

i am thinking 2 reasons for this.

Dataflow Gen2 may retain references to deleted queries in its internal configuration, even after removal.

1. Recreate the deleted queries in the Dataflow using the exact same names and settings.
2. Republish the Dataflow.
3. Delete the queries again and republish. This forces the Dataflow to update its metadata and fully remove the references

If “automatic settings” are enabled, Dataflow Gen2 may automatically recreate tables during refresh, even if queries are deleted

try to run with manual settings

https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-gen2-data-destinations-and-managed-se...

if this helps please accept the answer