Data in dataflow not appearing in PIBX.... but then does...?

[marktvc]

Not all data in the Desktop power query is appearing in the from my dataflow.

I have a dataflow wiht 15+ queries in it. 

Dataflow

In one particular query (lets call it MF), I can filter the query by today's date. and it will show 76 records. 

Power BIS Desktop

(after clearing the filter in the Dataflow so we have a full set of data), I have connected to the dataflow and pulled the data from MF and run the same filter and get 55 records.

An hour or so later, the data did appear.  This all links up to a warboard to a direct query and effectst the data in productions as well.

Production Environment

Configruation looks like this:

1 On Prem Sql -> 2 Dataflow - 3 Dataset - 4 Warboard

I have checked the updates times there is 30 minutes between refreshes of 2 and 3 I have run a number of refreshes on the data flow and they complete, but for some reason the Dataset data is not complete both in the cloud service and or PowerBi Desktop.... but  a couple of hours later, it is?

Any thorughts/advice would be much appreciated.

[v-tianyich-msft]

Hi @marktvc ,

During my investigation I have found users in the past who have had similar experiences to you .
The solution given by other forum users was trying to select a base field so that other fields transferred.

For original post, you may refer to Solved: Re: PBI desktop does not pull full data from dataf... - Microsoft Fabric Community

Hope it helps!

Best regards,
Community Support Team_ Scott Chang

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

[marktvc]

Sorry this has not helped.  The issues I am facing is retrieval of row data as against column.

I hvae now sorted on a date field in descending order. and today 2nd of November here are the results

Dataflow MF table showing 71 rows

Power BI Desktop 63 Rows