topic Re: Another Bug. DataPipelines still show deleted Dataflows in Pipelines

Another Bug. DataPipelines still show deleted Dataflows

st_0999 — Sat, 26 Aug 2023 14:11:36 GMT

I had a Dataflow, but because it had too many queries and wouldn't publish, I deleted it, and started afresh, giving it a new name.

But when I now load that into a Data Pipeline, that shows two copies of that Dataflow (the deleted one), and the new one. But since they have both the same name, it still can't recognise the new Data Flow.

So, I have to rename the new Data Flow to something like "Transform_2", even though the Dataflow "Transform" doesn't exist (it was deleted). But the Data Pipeline sees both "Transform", and "Transform_2".

Just makes everything a bit messy IMO. A bug too, IMO.

Re: Another Bug. DataPipelines still show deleted Dataflows

DennesTorres — Mon, 28 Aug 2023 21:51:53 GMT

Hi,

The explanation is a bit confuse.

A pipeline doesn't show a dataflow, it shows an activity configured to call a dataflow.

If you deleted the dataflow, the activity would still be there, but with errors, because the dataflow doesn't exist.

You mentioned "But When I load that into a data pipeline" <-- what you are really doing is not much clear.

However, I could guess that you deleted the dataflow, renamed to the same name as the deleted one and drag-dropped to the data pipeline, duplicating the activity to call the dataflow, but both activities point to the same dataflow (or were pointint, until you started to play with the dataflow names).

Just delete an activity.

Kind Regards,

Dennes

Re: Another Bug. DataPipelines still show deleted Dataflows

HimanshuS-msft — Tue, 29 Aug 2023 16:34:56 GMT

Hi st_0999

I am able to repro the issues and have escalated to the product group the same .
Thanks

Himanshu

Re: Another Bug. DataPipelines still show deleted Dataflows

st_0999 — Fri, 01 Sep 2023 08:24:08 GMT

It took about 12+ hours for the deleted Dataflow to disappear from the Data Pipeline selection menu.

Maybe it goes away faster now.