The Text Line Deduplicator instantly cleans up any text file by removing repeated lines while preserving original order. Just upload your file, optionally enable case‑insensitive matching, and download a version with only unique lines. Ideal for sanitising logs, mailing lists, notes, or exported data – all done privately in your browser.
Two lines are duplicates if their entire content matches exactly. With case‑insensitive mode on, the comparison ignores uppercase/lowercase differences. Trailing spaces and invisible characters are part of the line content, so `hello ` and `hello` would be considered different unless you trim the file first.
Yes, it works with any plain‑text file. Each line is compared as a string, so a CSV line with different data won’t be removed unless the entire line matches a previous one. For structured files you might want to first deduplicate based on a specific field – but for simple line‑by‑line deduplication, it’s perfect.
Blank lines are treated like any other line content. The first blank line is kept; subsequent blank lines are removed. If your file ends with a newline, that trailing empty “line” is typically ignored (the output will not include an extra blank line at the end unless there were multiple consecutive blank lines in the original).