Files
cheatsheet-tldr/tldr/uniq
2025-12-24 00:21:36 +00:00

40 lines
1.1 KiB
Plaintext

---
syntax: markdown
tags: [tldr, common]
source: https://github.com/tldr-pages/tldr.git
---
# uniq
> Output the unique lines from a input or file.
> Since it does not detect repeated lines unless they are adjacent, we need to sort them first.
> See also: `sort`.
> More information: <https://www.gnu.org/software/coreutils/manual/html_node/uniq-invocation.html>.
- Display each line once:
`sort {{path/to/file}} | uniq`
- Display only unique lines:
`sort {{path/to/file}} | uniq {{[-u|--unique]}}`
- Display only duplicate lines:
`sort {{path/to/file}} | uniq {{[-d|--repeated]}}`
- Display number of occurrences of each line along with that line:
`sort {{path/to/file}} | uniq {{[-c|--count]}}`
- Display number of occurrences of each line, sorted by the most frequent:
`sort {{path/to/file}} | uniq {{[-c|--count]}} | sort {{[-nr|--numeric-sort --reverse]}}`
- Compare only the first 10 characters on each line for uniqueness:
`sort {{path/to/file}} | uniq {{[-w|--check-chars]}} 10`
- Compare text after the first 5 characters on each line for uniqueness:
`sort {{path/to/file}} | uniq {{[-s|--skip-chars]}} 5`