Forum Discussion
Disappearing and missing data
Make sure you set each column to 'don't summarize'. Also, I like to add a 'count' of one of the columns to the table visualization because table visuals won't show duplicate rows if they exist in the raw data, so checking for a 'count' greater than 1 can help highlight these.
Start by creating 1 table visualization per raw data model table. See if those match up. Then add in the related table columns. You should always start with the 1 side of the relationship, add all those columns first, then add the many side or fact table columns.
Can you provide more info on what you're trying to test/visualize or maybe sample data?
Yes, I have already added "Don't summarize", forgot to mention that. At this point there is just one table, no relationships. I am also confident that there are no duplicates.
To say more about the data, it is a dump of tickets from Help Desk system. It would look like:
Request ID Reporter Name Summary Time to response Time to resolution
A-1234 First Last name My computer is broken 10m 5h
B-1112 First Last name My phone is broken 10m 5h
B-1113 First Last name My mouse is broken 10m 5h
It has many more columns. There are two main ID types - A and B followed by a number. The two time columns I mentioned above are calculated (converted to minutes from whatever system reports, which seems to be miliseconds, this calculation was done by someone else before I took it over) a few times in the Edit Query view. I can see the data exactly as above in the edit data query view, as well as in the table visual in Power BI desktop app. As soon as I publish the report to Report Server and I look at the same table visual I see some rows fine (all A type records are fine) and some records are missing values (only in time columns) and some rows\records are completely gone. Only records with B type IDs are impacted. A and B are both fed by one system.
Request ID Reporter Name Summary Time to response Time to resolution
A-1234 First Last name My computer is broken 10m 5h
B-1112 First Last name My phone is broken Missing value Missing Value
B-1113 - missing row
I did not want to add more confusion, but I noticed that when I played with data type in the time to response column it made it worse. So in the edit query I convereted this column data to duration (from decimal number), and then asked Power BI to extract minutes. Once again, I got values populated in the edit query view, as well as in the table visual in Power Bi desktop app, but this time when I published the report to report server ALL rows with B ID type were gone (not displayed). No idea what is going on, but seems like something is off with this column (same applies to time to resolution column but we can skip this for now) in B ID type records. I was thinking maybe some mathematical error when converting or so? What is very difficult for me to understand is that I see the data in two views (even three, edit query view, table view in power bi app, table visual in power bi app), and then it is gone in the forth one (report view on a "website").
- That is strange. Can you clarify if just the time column data is null or if the entire row is missing?
Are you able to share any sample data to see if we can replicate the problem?
Can you share the M code from Power Query for these calculations? (copy from the Advanced Editor)
Is the original time stamp column displaying correctly (if it has not been removed by the person who did the calculations before you)?