Data appears twice in power query

[bammyd36]

Hello everyone,

I have an issue with my data. When I get new data from my data source (Athena), it duplicates itself in power query. Right after the last row, the same data appears again from the beginning so instead of having 100 rows I get 200 rows. I've tried to delete the table and connect to the data again but the data still appears twice right from the Navigation step. 

I can't remove duplicates because there is no unique identifier that I can use.

Can you please help?

[RocketRod · Accepted solution]

Verify your data source doesn't have duplicated data. If the source is Excel delete all the rows in the workbook after the last know row.

If that doesn't fix it post your m code. Also if it's duplicating the data, select all columns and click Remive Duplicates....however that's a poor band aid as you really want to find the root cause of the duplicates.

[v-cgao-msft]

Hi @bammyd36 ,

1. 1. If each row is unique, consider using Table.Distinct ()

2. Consider adding an index column in your data source.

If that still doesn't solve the problem, consider publishing the code in the advanced editor, taking care to remove the data source information, we need to know how it is queried.

Best Regards,
Gao
Community Support Team

If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly. If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

How to get your questions answered quickly --  How to provide sample data in the Power BI Forum

[bammyd36 · Accepted solution]

Thank you for your suggestion.

The problem was from the data source so I corrected it from there and added index column.

[RocketRod · Accepted solution]

Verify your data source doesn't have duplicated data. If the source is Excel delete all the rows in the workbook after the last know row.

If that doesn't fix it post your m code. Also if it's duplicating the data, select all columns and click Remive Duplicates....however that's a poor band aid as you really want to find the root cause of the duplicates.