Forum Discussion

Daz4's avatar
Daz4
Helper I
4 years ago
Solved

Missing Rows when loading Dataflow into dataset

I wonder if anyone knows what mihgt be wrong in my data. I have a dataflow that i feed into a dataset and have no filters at all on the dataset. The issue I have is that there are 12 rows missing from the dataset that I can see in the Dataflow. I have tried a fresh dataset just to make sure there are no hidden filters, and have applied no steps other than filtering down to look for a specific row that I can see in my dataflow. I have updated successfully several times to make sure the data is up to date. The source data is fine of course also. 

 

Any ideas anybody???

Need Help
  • FarhanAhmed's avatar
    FarhanAhmed
    4 years ago

    Did you check column statistics (profile), any error in data that is skipping in the Viewing report?

10 Replies

  • levkalm's avatar
    levkalm
    Frequent Visitor
    4 years ago

    Hi,

    I have a similar issue. I have a Dataflow that does the transformation and I see all rows I need to in the specific table, however when I want to pull the table into PBI Desktop, many rows are missing. I tried to re-establish the credentials, didn't work. I tried to add the table again, didn't work. There are also no filters applied or errors there that would block me. What is strange is if I copy the M code from PBI Service to PBI Desktop, the results are same, however still when I connect to the Dataflow from Desktop and select the table, it will not pull in all rows.

    Do you have any suggestion why is that? or what should i try solving this?

    Thanks!

    • Daz4's avatar
      Daz4
      Helper I
      4 years ago

      For me it was just a matter iof trying later. It just seemed toi fix itself in the end. 

      • levkalm's avatar
        levkalm
        Frequent Visitor
        4 years ago

        I could fix yesterday. Had to allow combining data from different sources.

  • FarhanAhmed's avatar
    FarhanAhmed
    Community Champion
    4 years ago

    Do you have any filters applied at the report level?

    Do you have any RLS applied on your report that is limiting the data?

    Is your data missing at Desktop or at PBI Service ?

    • Daz4's avatar
      Daz4
      Helper I
      4 years ago

      There is a filter but it is the same on both Dataflow and Dataset. I have even tried replicating a new Dataset without any filters and the rows still do not appear. 

       

      It seems fine at Service level but missing from Power BI desktop as well as the service level dataset.

       

      No RLS that I have applied, and the missing rows do not seem to have any RLS type rule applicable. For example, on a specific date I have agent x taking 10 calls and a random one of them doesnt show up. I can see the other 9.

      • FarhanAhmed's avatar
        FarhanAhmed
        Community Champion
        4 years ago

        Did you check column statistics (profile), any error in data that is skipping in the Viewing report?

  • Daz4's avatar
    Daz4
    Helper I
    4 years ago

    Thanks I hadn't thought of that, but no errors there or anything else that springs out. I'm rather baffled!

  • tamnm1601's avatar
    tamnm1601
    Advocate I
    3 years ago

    Hi everyone,

     

    I got exactly the same issue. So, eventually, how did you solve it? Just let it be and it fixed itself?

     

    Thanks

  • Anonymous's avatar
    Anonymous
    Not applicable
    1 year ago

    I had a similar issue, the problem for me was that I was filtering in the dataflow based on the condition 

    [column] <> "" which filtered correctly in Powerquery UI. Adding and additional filter [column] <> null solved it for me.