topic Re: Gen2 Dataflow is still writing previously deleted queries to my warehouse. in Dataflow

Gen2 Dataflow is still writing previously deleted queries to my warehouse.

rbass — Thu, 20 Feb 2025 16:14:29 GMT

I have a Gen2 Dataflow the previously had 8 quieries. All of these tables were written into a warehouse. I didn't need 2 of the tables, so I deleted the 2 queries from the Dataflow and dropped the 2 tables from warehouse. Now when I refresh the dataflow the dropped tables reappear. I ran the diagnostics from the dataflow and the logs show that the deleted queries are still being written. Am I doing something wrong? Should I just delete the whole dataflow and make a new one?

Re: Gen2 Dataflow is still writing previously deleted queries to my warehouse.

nilendraFabric — Thu, 20 Feb 2025 20:19:28 GMT

Hello rbass

i am thinking 2 reasons for this.

Dataflow Gen2 may retain references to deleted queries in its internal configuration, even after removal.

1. Recreate the deleted queries in the Dataflow using the exact same names and settings.
2. Republish the Dataflow.
3. Delete the queries again and republish. This forces the Dataflow to update its metadata and fully remove the references

If “automatic settings” are enabled, Dataflow Gen2 may automatically recreate tables during refresh, even if queries are deleted

try to run with manual settings

https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-gen2-data-destinations-and-managed-settings

if this helps please accept the answer

Re: Gen2 Dataflow is still writing previously deleted queries to my warehouse.

Anonymous — Mon, 24 Feb 2025 09:38:12 GMT

Hi rbass ,

Did nilendraFabric reply solve your problem? If so, please mark it as the correct solution, and point out if the problem persists.

Best regards,

Adamk Kong