Remove Duplicate Lines
Paste a list and get a clean copy with every duplicate line removed.
Paste a list of emails, URLs, names, or any other lines and download a deduplicated copy in one click. Optionally ignore case and trim whitespace before comparing.
How it works
- Paste your list into the editor.
- Choose whether to compare case-sensitively and whether to trim each line first.
- Unlock the result and download the deduplicated .txt file.
Use cases
- Dedupe an email list before importing into a newsletter tool.
- Remove duplicate URLs from a scrape.
- Clean a copy-pasted list of names from a meeting invite.
- Drop repeated rows out of a long log paste.
Frequently asked questions
Is the order preserved?
Yes. The first occurrence of every line is kept in its original position. Only later duplicates are removed.
Can I match case-insensitively?
Yes. Untick 'Case-sensitive comparison' and 'Email@x.com' and 'email@x.com' count as the same line.
What about lines with extra spaces?
Enable 'Trim each line before comparing' and lines that only differ in surrounding whitespace are treated as duplicates.
How many lines can I dedupe?
Up to 2 MB of text per job, comfortably hundreds of thousands of lines.
How long is the result kept?
The deduplicated file is auto-deleted after 7 days. Re-download is available during that window via the secure link.
Related tools
- Text Cleaner: Trim, dedupe, sort, case-convert, and find-replace any text in seconds.
- Sort Lines Alphabetically: Paste a list and download the same lines sorted A to Z or Z to A.
- Find and Replace Text: Find every match in a block of text and replace it, with optional regex.
