Forum Discussion

SpikeSpiegel_3's avatar
SpikeSpiegel_3
Frequent Visitor
2 years ago
Solved

Process Add with partitions in SSMS

I created this partition in SSAS (SELECT [dbo].[Dim_Orders].* FROM [dbo].[Dim_Orders] where [DD/MM/YY]>=20190701 and [DD/MM/YY]<=20190930) for Orders table, then I try to use Process Add to only add ...
Need Help
Show and Tell
Tips and Tricks
  • sjoerdvn's avatar
    sjoerdvn
    2 years ago

    If you're using "process add" you need to make sure your query doesn't return any data that has been loaded before. To be honest I don't believe too many people are using "process add", because it requires quite some programming to do this reliable in an operational enviroment.
    You might be better of using incremental refresh.

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi SpikeSpiegel_3 ,

You mentioned that the operation is success when the partition is empty. However, the error message indicates that there are duplicate values.Is the amount of data large? You can write a SQL statement to check whether there are duplicate values ​​in the entire data set.

Something like this:

SELECT [dbo].[Dim_Orders].[Order_Id],COUNT(*) as count FROM [dbo].[Dim_Orders]
GROUP BY [dbo].[Dim_Orders].[Order_Id]
HAVING count > 1

If no value is returned, it means that there are no duplicate values ​​in the data set.

Best Regards,
Wenbin Zhou
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

 

SpikeSpiegel_3's avatar
SpikeSpiegel_3
Frequent Visitor
2 years ago

I tried this code and it returned no value, so there are no duplicates. I don't think that the problem is in Sql server but from the SSAS. The issue there is that I don't know how to fix this problem and don't even know how to access it.