topic Many to Many - No Duplicates? in Desktop

Many to Many - No Duplicates?

Thigs — Fri, 21 Jan 2022 21:31:32 GMT

Hey all,

I'm working with a new data set that comes from Excel. It has one column for SKUs as a unique identifier. I am trying to link it to a second dataset that has SKUs but not as a unique identifier (One:Many relationship).

Power BI is insisting I can only do a Many:Many. I have removed all blank rows in Power Query, removed any rows where SKU is blank in the first data set in Power Query, and I have checked in both Excel and Power Query for duplicates - everything I've tried says there are no duplicate SKUs. Some might have duplicate values in other columns, but as best I can tell without going line by line, there are no duplicates in the unique identifier. Any ideas on why this would happen and what I can do about it?

Thanks!

Re: Many to Many - No Duplicates?

AlexisOlson — Fri, 21 Jan 2022 23:26:52 GMT

Bear in mind that duplicates in the query editor and duplicates in the model aren't exactly the same since M is case-sensitive and DAX is not. Is it possible that you have some SKUs that differ only by case?

Try clean, trim, and upper case and then remove nulls and remove duplicates on the SKU column.

Text.Upper(Text.Trim(Text.Clean([SKU])))

Re: Many to Many - No Duplicates?

Thigs — Mon, 24 Jan 2022 13:24:39 GMT

Hi! Thanks for the tip - unfortunately, no, this can't be the problem, as all the SKUs are numeric only, which can't have case sensitivity.

Re: Many to Many - No Duplicates?

Anonymous — Wed, 26 Jan 2022 09:58:56 GMT

Hi Thigs ,

Could you check the data type of SKU in two Queries. Is the data type in both queries a numeric type? Is there set to text type?

Please Group By the SKU to check the number of SKU.

If there still some errors, please provide a relevant screenshot so that we can identify the issue.

Best Regards

Community Support Team _ Polly

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Many to Many - No Duplicates?

jaadame — Thu, 09 Feb 2023 02:18:25 GMT

I had the same issue and this worked for me, thanks a lot for the explanation!!

Re: Many to Many - No Duplicates?

Morrit — Thu, 18 Jan 2024 17:10:17 GMT

I would try to first change the data types to text ( since they are an id of sorts i usually make all my id's text so there is no issues with accidentally combining the values as a value)

After that do trim then make sure you remove duplicates after the trim step in power query so trim would be on top.

Re: Many to Many - No Duplicates?

DanIvanek — Thu, 04 Apr 2024 13:01:00 GMT

For me, it was caused by a blank value in the column that is used for connection. Even every record was unique including this blank value.

Try use remove empty and then reconnect

Re: Many to Many - No Duplicates?

Sergii24 — Thu, 04 Apr 2024 13:11:44 GMT

Hi Thigs, try to do the following:

Load your data to PowerBI
go to "Table view", select the table you need and look at column profile
Do you have the same value in number of rows for "Table" and SKU "column"? If not, create a table visual with 2 columns: SKU and Count SKU, then sort it in descending order by SKU number to find the duplicate

If it doesn't help, please send us some statistic of your both dimensional and fact tables as well as details of the column you use as a key (like in the screenshot above).

Could it be that you have any other relationship in your data model that doesn't allow you to create one-to-many relationship?

Re: Many to Many - No Duplicates?

ASTownsend — Mon, 22 Apr 2024 13:25:29 GMT

Thank you Alexis, I couldn't figure it out! Yes, it was due to M being case-sensitive and DAX not, and your solution worked perfectly.

Re: Many to Many - No Duplicates?

jaylyn — Tue, 30 Apr 2024 18:08:57 GMT

I had the same issue. i removed nulls, then clean, then trim, and then made it all lowercase, and them removed duplicates and it worked!