dataflow data incomplete but preview looks good

[TobiTobsen]

Hi,

in some dataflows we are missing data, eventhoug the preview in dataflow-editor shows all the data correctly.

In some of our dataflows we can see the full data in previews, but when loading the computed entities the data misses some entries. Unfortunately there is no errormessage in the editor or while saving (validating). The update runs without any error, but the data is still incomplete. 

We were able to temporarily help ourselves by copying faulty dataflows (extract JSON and reimport it). The new dataflow works correct, eventhough there are not any changes comparing to the faulty dataflow.

Some backround info: In this simply case, we have 2 dataflows.
1. dataflow gets data via gateway from ERP (works fine).
2. dataflow gets the data from step 1 as linked entity (preview in editor looks good, data is complete). Then some simply ETL within a referenced table (preview works also fine here).

As I said, the data in the preview is complete, but after saving and updating the dataflow we miss some data.

For example, the preview in editor mode shows all of our 1162 items, but the same table only shows 1156 items after loading in PBI-Desktop. There are no filters at all and any new entries (e.g. item no. 1163) will not be shown, eventhough we can see them in preview.

Do you know this issue as well? And how can we prevent that?

Do you think, it is caused by the enhanced compute engine? We disabled it, but it did not help.

We need to understand what's wrong, because it is quite difficult to trust the data if it is incomplete without any error messages.

Thanks and kind regards,
Tobi

[v-jayw-msft]

Hi @TobiTobsen ,

If this issue only happen in some of your dataflow, is there anything special about these dataflow?

You may check the Issues forum here:
https://community.powerbi.com/t5/Issues/idb-p/Issues.

Best Regards,

Jay

[TobiTobsen]

Hi @v-jayw-msft ,

thanks. No, we found incomoplete data only in three different datflows. Do you have something special in mind?

In my opinion those are quite simpel, only filtering, merging and adding columns. The dataflows are independend, e.g. two of them referr to different dataflows (Linked Entities) and those are getting data from different clients of our ERP. But both are corrupt without any errors. And both work fine after reimporting without changing anything.

Kind regards, Tobi