Remove duplicate lines from any list while keeping first occurrences in order, with optional sorting, trimming and case-insensitive matching built in. Runs entirely in your browser — your numbers never leave this device.
Paste a list — one item per line — and the tool keeps the first occurrence of each line and drops every later repeat, preserving the original order. The result panel reports all three numbers (total lines in, lines kept, lines removed) so you can sanity-check the clean-up before using it: if you pasted 500 email addresses and 37 were removed, the kept list should hold 463 lines. An optional sort then arranges the kept lines alphabetically.
Three options control what counts as “the same line”. Trim compares lines after stripping leading and trailing spaces, which catches the classic “ apple” versus “apple ” pair left behind by spreadsheet exports. Case-insensitive matching treats Apple, apple and APPLE as duplicates and keeps the first form it met. Blank lines are handled deliberately rather than accidentally: however many blank lines your paste contains, at most one survives, at the position of the first one — a list rarely wants its gaps multiplied, and a stanza break is preserved without being duplicated.
This is batch list work that a search-engine widget cannot do at all, and it runs entirely in your browser. Lists of names, addresses, SKUs or keywords are never uploaded or stored — close the tab and the data is gone.
The first. The output preserves the order in which distinct lines first appeared, which matters when the list order means something — a running order, a priority list, steps in a process. If order does not matter, turn on Sort for an alphabetical result.
By default lines are compared exactly, character for character, so “apple ” (with a trailing space) is not the same line as “apple”. Turn on the Trim option to compare lines after surrounding spaces are stripped — that catches most spreadsheet and copy-paste near-duplicates.
They collapse to at most one. If your text contains several blank lines — between sections, or from stray Enter presses — the first blank line is kept in place and the rest are removed. A completely blank input produces no output lines at all.
Not directly — this tool works line by line. Put each word on its own line first (a text editor's replace-all can turn the spaces between words into line breaks), dedupe, then join the lines back. For counting how often words repeat rather than removing them, use the Word Frequency Counter.
The comparison is a single pass with a lookup set, so lists of tens of thousands of lines are handled comfortably in the browser. Extremely large pastes (millions of lines) will be limited by your device's memory rather than by the tool.
No. Deduplication runs in your browser; your list is never sent to a server, stored or tracked.
More in Text Tools · Browse all tools