Forum Discussion
Data Model in Service duplicating and replacing rows
- 8 years ago
Hi Ed. As I said over email, we've identified the root cause of this issue. We're currently targeting the fix for our July release.
In the meantime, you can work around the issue by ensuring that your folded queries are always sorted. This can be done by always including (and preserving in downstream queries) all primary keys for a given table. Or, if this isn't possible (as in your case when doing a Group By operation), you can explicitly sort by a set of unique keys before combining. (Also note that it may be necessary to buffer after sorting and before combining to ensure the sort is applied by the folding layer. You'll have to experiment to see whether or not this is necessary.)
Ehren
Yup. I've seen it fix itself, then come back, then fix, etc. Seems a bit random.
Hi all. Do you ever see duplicated rows after refreshing locally in PBIDesktop, or only when refreshing via the Gateway?
Ehren
- edhans8 years agoCommunity Champion
Only via the gateway. I have the June 2018 version 14.16.6724.2 installed, which is what https://www.microsoft.com/en-us/download/details.aspx?id=53127&751be11f-ede8-5a0c-058c-2ee190a24fa6=True is pushing. (it shows a different version there, but it sends the version I listed.)
- Ehren8 years agoMicrosoft Employee
Ok. Does the duplication only happen for rows coming from a SQL Server data source? Or does it happen for other data sources as well?
Ehren
- edhans8 years agoCommunity Champion
Most of our data is from SQL Server, so I've only seen it happen there.
Edit: Actually, 100% of our data through the gateway is SQL Server. In the few cases where we use CSV files or something else, that isn't via the gateway. I'm not mashing up any gateway+non-gateway data.