Dataflow duplicate data after refresh

[oKo]

Hi Everyone,

I'm using dataflow connected with Azure Data Lake Storage Gen 2, and load data into Azure SQL DataWarehouse.

After refresh. Data in ADLS is duplicated into a new snapshot without deleting old snapshots.

Even when I deleted Dataflow, data remained the same in ADLS.

How can I delete old snapshots? or How to query only the newest snapshot?

Thanks & Best Regards

K

[ferdsjoseph]

Hi! I am experiencing a similar issue where my dataflow data is duplicated.  It was fine on 10/21/22.  Today, the numbers are doubled after I refreshed the dataflow and the PBI report that uses it as data source.  Did you find a solution to your issue?

[oKo]

Hi everyone,

Do you have any ideas?

Thanks

[GilbertQ]

Hi there

Are you generating the dataflow from the Power BI Service?

[oKo]

Hi @GilbertQ ,

Yes I am

[GilbertQ]

I am not sure why it is duplicating the dataset.

I would suggest opening a Support Case for them to investigate.