Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
4 years ago

Data not mapping full table - missing section of data

Has anyone experienced an issue where there is only partial mapping between their tables?
 
I work in the Transportation and Logistics industry and am creating the data model from our TMS's Oracle Database.
My CARRIER table is mapped to my LOADS table; however, there are about 9000 loads that show as blank carrier.
I double-checked in the TMS and they are not blank, but I cannot seem to find an explanation.
 
I have the relationship as LOADS:CARRIER = many:1 and I switched the cross filter direction from single to both. It had no affect. I also suspected maybe it was due to the timing of the refresh; however, that was not the case either.
 
Does anyone know of the solution or have any other ideas?
Is there a reason only a section of the table would be skipped on refresh?
Need Help

5 Replies

  • HotChilli's avatar
    HotChilli
    Community Champion
    4 years ago

    Do you mean the data is missing from a column (in Power Query)?

    or are you saying a visual is not showing correct data because the relationship doesn't appear to be working (usually spaces or hidden characters in a field)?

  • Anonymous's avatar
    Anonymous
    Not applicable
    4 years ago

    Hi HotChilli, I believe the latter. The data exists in the dimension table, but is not pairing as expected. I posted in another forum and people also suggested that it may be hidden characters. I am going to try creating a trimmed version of the key and see if that resolves. Are there any other methods or processes you would suggest to resolve?

  • HotChilli's avatar
    HotChilli
    Community Champion
    4 years ago

    Another forum? - This is hard to take, I'm offended.  I can't go on.  No, it's OK, I feel better now.

     

    Put the two fields that are related (one from each table) in a table visual. Make sure each is not using an aggregation for this test.   If the relationship works, you will get a neat matchup for all fields.

    • Anonymous's avatar
      Anonymous
      Not applicable
      4 years ago

      HotChilli - I posted in our internal company forum, so just to see if any immediate colleagues regcognized the issue, then we could deep dive into the data. I think this forum is probably the best place to stay otherwise 🙂

       

      I looked at my setup again on the data model and all of our fields are full with customers and carriers. This model is published as a dataset in our workspace environment and then I have reports built that are connected to that dataset.

       

      It is only in the reports that are built with the data source connection to the dataset that are missing data, not the actual model itself. When I test in sheets with the data model file, everything is all there.

       

      Do you have any thoughts on what else may be occurring?

      Is there any way for me to view all filters at once to see if I have a phantom filter somewhere?

       

  • HotChilli's avatar
    HotChilli
    Community Champion
    4 years ago

    It's all a bit too abstract for me to diagnose accurately.

    Did you try what I suggested in my last post?

    --

    From my earlier post -

    "are you saying a visual is not showing correct data because the relationship doesn't appear to be working" - You have to prove this true or false before going any further.