Forum Discussion

minhduc2211's avatar
minhduc2211
Regular Visitor
5 years ago

Duplicated data when importing files from Folder

Hello,

 

I have a table called FACT_Zeiten in Power BI that gets data from an OneDrive folder.

This OneDrive folder has multiple Excel files, with identical data structures, one for each month.

I just added one new Excel file to the folder and refreshed it in Power BI, then noticed a strange behavior: some values were randomly repeated.

The source data (the Excel file) has 1515 rows, but 1530 rows were imported into my Power BI Table.

I copied the Power BI table and put it side by side the Excel table to see what happened, and I found for example all rows of Böhme, Toni are repeated

  • Data in Excel, one row for one day in March 2020
  • Data in Power BI are repeated 

     

What strange is only a few rows are repeated, which I think is random.

Any ideas what could be the cause here and how could I solve this, also for future import?

 

Thanks in advance!

Need Help

2 Replies

  • lbendlin's avatar
    lbendlin
    Super User
    5 years ago

    What kinds of transforms do you run in Power Query?  Are you sure there are no hidden rows in the Excel table?

  • v-easonf-msft's avatar
    v-easonf-msft
    Community Support
    5 years ago

    Hi, minhduc2211 

    As a workaround, for multiple duplicate data imported into the pbix file in import mode, maybe you can consider deduplicating the data directly.

    select all columns(ctrl+a) ->right click ->click 'remove duplicates'

    Best Regards,
    Community Support Team _ Eason
    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.