Forum Discussion

1up's avatar
1up
Icon for Resolver I rankResolver I
2 days ago

Combined dataflow - most rows missing

Hello, I am combining 9 dataflows into one dataflow. When doing so I lose most of the source rows. So for example, a source table as verified in PBI works and gives multiple millions rows of data. B...
dataflow
Need Help
maruthisp's avatar
maruthisp
Icon for Super User rankSuper User
1 day ago

Hi 1up​,
Since you confirmed that you're using Append Queries, the source column data types match, and the refresh history shows no errors, I would focus on identifying where the rows are being removed.

Please try these steps:

  1. Open the combined Gen1 dataflow in Power Query Editor.
  2. Temporarily remove the Part Number filter and any other row-filtering steps.
  3. Check the row count of each source table using Table.RowCount().
  4. Check the row count immediately after the Append step, before applying filters.
  5. The appended row count should equal the sum of all nine source tables. If it doesn't, verify the actual row counts returned by the source dataflows and check their refresh status.
  6. If the count matches before filtering but drops afterwards, review the filter conditions, including nulls, leading/trailing spaces and case differences.

You can also check whether Incremental Refresh is enabled on any source or destination tables, as its configured retention period can affect which historical rows are available.

Best Regards,
Maruthi
LinkedIn - http://www.linkedin.com/in/maruthi-siva-prasad/
X            -  Maruthi Siva Prasad - (@MaruthiSP) / X