Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
9 years ago
Solved

Remove duplicates not working.. Can't create relationship

Hello,   I have a dataset with customer and a discount structure for that customer per part. I created a concatenate in the edit query screen of the customer, and there are a couple duplicates. Hig...
Need Help
  • Anonymous's avatar
    Anonymous
    9 years ago

    v-sihou-msft

     

    Yes, I double and triple checked. Everything was done the same way as in my example. Must be an error due to such a large data set.

v-sihou-msft's avatar
v-sihou-msft
Icon for Microsoft Employee rankMicrosoft Employee
9 years ago

Anonymous

 

As I tested, the relationship can be created properly between two tables in your sample.

 

Have you get any error when creating relationships? Did you select correct columns?

 

Regards,

Anonymous's avatar
Anonymous
Not applicable
9 years ago

v-sihou-msft

 

Yes, I double and triple checked. Everything was done the same way as in my example. Must be an error due to such a large data set.

  • yaelwass's avatar
    yaelwass
    Icon for Advocate I rankAdvocate I
    9 years ago

    I'm having the same issue but the data set is only around 2000 rows.

     

    Note that there seems to be an inconsisencty in how case sensetivity is handled: the Remove Duplicates feature is case sensetive but the uniquemenss check done when created creating realationshiops between queries is not. To work around this I just format the key column in the query to UPPERCASE. But this is an aside, I'm getting the issue even though cases are the same

     

     

    • tbauch's avatar
      tbauch
      Frequent Visitor
      6 years ago

      Had the same problem. Saw the post about case sensitivity with duplicate removing. Transformed column to all UPPERCASE. Removed duplicates (3rd time)... and then the relationship worked. Make sure everyone reports it so we can get this fixed! 

      • mpi_gov_vn's avatar
        mpi_gov_vn
        Frequent Visitor
        4 years ago

        This really should get more upvotes. My issue was due to incorrect cases, too. I transformed all values to UPPERCASE and things worked out!

    • daniel_1546785's avatar
      daniel_1546785
      Regular Visitor
      8 years ago

      Thank you so much for mentioning this issue with cases in remove duplicates vs joins! I had been struggling with this all day!

      • Anonymous's avatar
        Anonymous
        Not applicable
        8 years ago

        I am getting this issue with the latest version of Desktop as well. My dataset is 4,700 rows of data. Remove Duplicates is applied in the query stage, but when the data is loaded into the data model there are duplicates in the data.

         

        I cannot manually search for the duplicate values in the query because it says 'Limit of 1000 values reached'.

    • EduSurveys's avatar
      EduSurveys
      Icon for Advocate II rankAdvocate II
      6 years ago

      Thank you! This solution worked for me to transform the values to UPPERCASE.