Comparable List
Crawl & sitemap workflow

How to compare URL lists without hiding meaningful differences

Compare complete crawl, sitemap, and export URLs locally while preserving paths, parameters, trailing slashes, and other details that matter in an audit.

5 min readBy Comparable List Editorial Team

Prepare → compare → reviewPrivate, local list reconciliation

A useful list comparison starts with a clear decision, not an upload. This workflow keeps the comparison in your browser and makes the matching rules visible, so the resulting exception list can be reviewed rather than blindly acted upon.

1. Choose the matching field

Decide whether a complete URL, a hostname, or a root domain is the right unit. This workflow compares full URLs; use the domain tool for hostname-level review.

2. Prepare comparable sources

Use sources covering the same host, URL type, date, and crawl rules. Keep one complete URL per line and retain the original exports for investigation.

  • Use exports created for the same scope and approximate date.
  • Keep the original source files untouched for audit and recovery.
  • Compare one meaningful field at a time instead of mixing identifiers.

3. Normalize intentionally

Trim outer whitespace, but do not broadly strip protocols, paths, query strings, or trailing slashes. Those differences can identify separate resources or reveal an implementation problem.

4. Review the result before acting

Sample the Common result first, then inspect each exclusive URL in its source context. Export a difference list only after confirming the two source scopes are comparable.

Ready to check your data?

The tool runs locally in your browser. Review the result before you act on it, especially when a list contains customer, account, or operational data.

Open URL list compare

Frequently asked questions

Does this comparison upload my list?

No. The comparison, normalization, audit, and export happen in the browser tab. A share link is an exception: it intentionally encodes list data in the URL, so do not use it for confidential information.

Should I turn on every cleaning option?

No. Use only rules that preserve the identity of every item. Review the Common result and the suggested normalizations before exporting or acting on a difference.

Can I keep this workflow for next time?

Yes. You can save a local template with the selected options, or save a result summary in this browser. Full source lists are never stored unless you explicitly choose that local-device option.

Related tools and guides

Need a spreadsheet column selector? Try CSV & Excel compare. For a general workflow, return to the two-list comparator or browse all data-cleaning guides.