List cleanup workflow

How to dedupe a list without losing the useful version

A practical workflow for removing duplicate lines, choosing normalization rules, and reviewing what changed before replacing a source list.

5 min readBy Comparable List Editorial Team

Prepare → compare → reviewPrivate, local list reconciliation

A useful list comparison starts with a clear decision, not an upload. This workflow keeps the comparison in your browser and makes the matching rules visible, so the resulting exception list can be reviewed rather than blindly acted upon.

1. Choose the matching field

Decide which value is the identity: an email address, SKU, account ID, or the exact line. A repeated line is only a duplicate under a rule you can explain.

2. Prepare comparable sources

Start from the original export or an uploaded TXT/CSV copy. Keep the untouched source and note its date, system, and scope so a removed value can always be traced back.

  • Use exports created for the same scope and approximate date.
  • Keep the original source files untouched for audit and recovery.
  • Compare one meaningful field at a time instead of mixing identifiers.

3. Normalize intentionally

Trim copied whitespace, ignore case for email addresses and labels, and collapse repeated spaces for names. Do not ignore leading zeroes for SKUs or record IDs unless the source system documents them as formatting.

4. Review the result before acting

Open the repeated-entries audit, sample both the kept and removed values, and compare the counts with the source export before copying or downloading the cleaned list.

Ready to check your data?

The tool runs locally in your browser. Review the result before you act on it, especially when a list contains customer, account, or operational data.

Open dedupe list

Frequently asked questions

Does this comparison upload my list?

No. The comparison, normalization, audit, and export happen in the browser tab. A share link is an exception: it intentionally encodes list data in the URL, so do not use it for confidential information.

Should I turn on every cleaning option?

No. Use only rules that preserve the identity of every item. Review the Common result and the suggested normalizations before exporting or acting on a difference.

Can I keep this workflow for next time?

Yes. You can save a local template with the selected options, or save a result summary in this browser. Full source lists are never stored unless you explicitly choose that local-device option.

Related tools and guides

Need a spreadsheet column selector? Try CSV & Excel compare. For a general workflow, return to the two-list comparator or browse all data-cleaning guides.