Forum Discussion

oKo's avatar
oKo
Frequent Visitor
7 years ago

Dataflow duplicate data after refresh

Hi Everyone,

 

I'm using dataflow connected with Azure Data Lake Storage Gen 2, and load data into Azure SQL DataWarehouse.

After refresh. Data in ADLS is duplicated into a new snapshot without deleting old snapshots.

Even when I deleted Dataflow, data remained the same in ADLS.

 

How can I delete old snapshots? or How to query only the newest snapshot?

 

Thanks & Best Regards

 

K

 

 

Dataflow
Need Help

5 Replies

  • GilbertQ's avatar
    GilbertQ
    Super User
    7 years ago
    Hi there

    Are you generating the dataflow from the Power BI Service?
      • GilbertQ's avatar
        GilbertQ
        Super User
        7 years ago
        I am not sure why it is duplicating the dataset.

        I would suggest opening a Support Case for them to investigate.
  • oKo's avatar
    oKo
    Frequent Visitor
    7 years ago

    Hi everyone,

     

    Do you have any ideas?

     

    Thanks

     

  • ferdsjoseph's avatar
    ferdsjoseph
    Advocate I
    3 years ago

    Hi! I am experiencing a similar issue where my dataflow data is duplicated.  It was fine on 10/21/22.  Today, the numbers are doubled after I refreshed the dataflow and the PBI report that uses it as data source.  Did you find a solution to your issue?