topic Delete specific records in a table stored in Fabric WH which meet a condition using Dataflow Gen2 in Dataflow

Delete specific records in a table stored in Fabric WH which meet a condition using Dataflow Gen2

Anonymous — Mon, 02 Dec 2024 18:57:06 GMT

Hi,

I want to delete records which meet a specific condition in a table stored in Fabric WH or Azure SQL DB using Fabric Dataflows Gen2.

Any workarounds, solutions, recommendations would be appreciated.

Thanks.

Re: Delete specific records in a table stored in Fabric WH which meet a condition using Dataflow Gen2

lbendlin — Mon, 02 Dec 2024 22:20:44 GMT

The lowest you can go is partitions. You would have to flush and fill the partition that holds these records.

Re: Delete specific records in a table stored in Fabric WH which meet a condition using Dataflow Gen2

Anonymous — Tue, 03 Dec 2024 02:36:10 GMT

Hi Anonymous ,

Using Azure SQL DB: Dataflow Gen2 can be used to transform and load data into an Azure SQL database. This involves copying data from Azure SQL database to Azure SQL database using a replication activity in an Azure Data Factory or Azure Synapse pipeline and then transforming the data using Dataflow.

For more details, you can refer to below document:

Set up your Azure SQL Database connection - Microsoft Fabric | Microsoft Learn

Best Regards,
Adamk Kong

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.