Duplicate import removal - Power Query to CDS

[powerappin]

Hi,

I have a nightly job running to import data from a seperate database into CDS via Power Query. It seems to be consistantly creating duplicates which I am having to amend daily.

The  Power Query setting is set to not delete anything not in the query which is fine however I need it to create new records nightly that appear in the query.

Is there a setting or something I am missing in regards to this?

Thanks

[dax]

Hi @powerappin , 

I am not clear about your requirement, did you want to remove duplicated rows? Or you want to get other values? In addition, you said that "I need it to create new records nightly that appear in the query.", it  seems that you need use job or other step to process this. Did you use power app or power flow?If so, I suggest you could post this in power app or flow forum for more suggestions.

Best Regards,
Zoe Zhi

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.