Power BI Service refresh truncates data

[mattberry]

Hi All,

I have a weird issue I can't figure out.  Our ERP system dumps data to CSV files (saved on a network share) every night  I built a dataset using these local files, authored several reports, all using Power BI Desktop. Then I published it all to Power BI Service. The Power BI Service uses an On-Prem gateway to refresh the dataset every night.   This is all plain vanilla stuff...

Then, sometime around 2/15/19 the nightly refresh started truncating the data.  For example, when I refresh in Power BI desktop, the invoice table has 35109 records, the most recent being from 3/7/19.  The Power BI service reports just 34748 records and only through 2/15/19.

So I published the dataset again to replace the dataset in the cloud, and it uploads fine. The online reports show 35109 records as expected.  Then I hit refresh and it fires up the gateway and pulls the SAME DATA I just refreshed from locally.  No errors. The gateway reports accessing each CSV file ok.  But... it truncates the dataset back to 34748!

So I tried something else - I published the dataset as a new dataset.  Again, it uploads 35109 records ok. I assign our on-prem gateway and hit refresh, same result. Pulls in the same data but truncates it at 34748 records.

This was all working fine.  There have been no changes at all on our end.  Somewhere along the line the Power BI Service just started truncating the source data.

Has anyone got any ideas??? I'm completely stumped!

Matt

[v-danhe-msft]

Hi @mattberry ,

It is hard to reproduce your problem, I suggest to create a support ticket for your peoblem:

https://powerbi.microsoft.com/en-us/support/

Regards,

Daniel He