A practical workflow for removing duplicate lines, choosing normalization rules, and reviewing what changed before replacing a source list.
5 min readBy Comparable List Editorial Team
A useful list comparison starts with a clear decision, not an upload. This workflow keeps the comparison in your browser and makes the matching rules visible, so the resulting exception list can be reviewed rather than blindly acted upon.
Decide which value is the identity: an email address, SKU, account ID, or the exact line. A repeated line is only a duplicate under a rule you can explain.
Start from the original export or an uploaded TXT/CSV copy. Keep the untouched source and note its date, system, and scope so a removed value can always be traced back.
Trim copied whitespace, ignore case for email addresses and labels, and collapse repeated spaces for names. Do not ignore leading zeroes for SKUs or record IDs unless the source system documents them as formatting.
Open the repeated-entries audit, sample both the kept and removed values, and compare the counts with the source export before copying or downloading the cleaned list.
Ready to check your data?
The tool runs locally in your browser. Review the result before you act on it, especially when a list contains customer, account, or operational data.
Open dedupe listNeed a spreadsheet column selector? Try CSV & Excel compare. For a general workflow, return to the two-list comparator or browse all data-cleaning guides.