Forum Discussion
Data Cleaning - Power Query - Removing Duplicates
Hi ronaldbalza2023 ,
The Folder. Files function (used when connecting to a folder as data source) allows one to see when a file in it was last modified. You can sort the Date created column prior to removing duplicates and wrap that sort step in Table.Buffer.
This datetime column must be included in one of the criteria when removing duplicates. You can remove it afterwards if you don't need it. This tecnique requires that you do not use Combine & Transform Data feature as this doesn't take into account when a file was created.
Hi ronaldbalza2023 ,
The Folder. Files function (used when connecting to a folder as data source) allows one to see when a file in it was last modified. You can sort the Date created column prior to removing duplicates and wrap that sort step in Table.Buffer.
This datetime column must be included in one of the criteria when removing duplicates. You can remove it afterwards if you don't need it. This tecnique requires that you do not use Combine & Transform Data feature as this doesn't take into account when a file was created.