Refresh failed

[Anonymous]

Hi,

I received this error when I was trying to refresh my dataset.

Something went wrong
There was an error when processing the data in the dataset.
Please try again later or contact support. If you contact support, please provide these details.
Data source error: Column 'column' in Table 'table' contains a duplicate value 'value' and this is not allowed for columns on the one side of a many-to-one relationship or for columns that are used as the primary key of a table. Table: table.'

However, I've looked at my dataset and the column in that table is all unique numbers and it has only a one-to-many relationship to another table. What other problems could it be?

[GilbertQ]

Hi there

The one side of your relationship has duplicate values when trying to refresh.

I would refresh the data in Power BI Desktop and possibly you would get the same error and be able to ensure that your table on the one side as unique values in the join column.

[Anonymous]

Hi Gilbert,

I have refreshed my data and it refreshed just fine in desktop. I have also looked at the table and the column and it has no duplicate values. Any idea what's up?

[GilbertQ]

Hi there

That is weird, what happens if you try and refresh it again from the Power BI Service?

And to confirm that there are no parameters in the dataset on the Power BI Service?

[Anonymous]

Hi @GilbertQ ,

Sorry for the late reply. I was out.

I tried refreshing on Power BI desktop and there's the same error that occurs in Power BI Services. It says that I have a duplicate value which I don't see exists. I went to the column and clicked on it and it is all distinct.

Daren

[GilbertQ]

Hi there

Could you go into the Power Query Editor and click on Remove Duplicates from the column and see if that resolves your error.

Also make sure to TRIM the data in your columns, as there could be leading or trailing white spaces?

Typically I have seen when there is that error there are duplicate values.

[Anonymous · Accepted solution]

Hi @GilbertQ 

I've tried removing duplicates and it didn't work. The error message that is prompted gave me an entry that does not even exist, but something similar does. e.g. The error message told me that ABC-1234ABC is duplicated, but that number does not exist, only 1234ABC exist. This problem didn't occur before I posted the question as it was refreshing and working fine in Power BI Desktop. After I had our IT to set up a gateway to refresh in Power BI services, this problem occurred in Services, and the refresh didn't work in Desktop as well.

I have came to another solution where I merged the two tables in Power Query and expanded the needed column and deleted the relationship between the two tables. Though it's a fix, but that didn't explain why this problem happened in the first place.

I am going to mark this as a solution, but if you have any idea why this is happenning or if there's something else I can try, please let me know!

Thanks!

Daren