| blob | fa9cff0319149e818c1b5f5456aef7fe50b4c363 |
1 '\" te
2 .\" Copyright (c) 2008, Sun Microsystems, Inc. All Rights Reserved
3 .\" Copyright 1989 AT&T
4 .\" Copyright (c) 2007 Sun Microsystems, Inc. - All Rights Reserved.
5 .\" Portions Copyright (c) 1982-2007 AT&T Knowledge Ventures
6 .\" Portions Copyright (c) 1992, X/Open Company Limited All Rights Reserved
7 .\" Sun Microsystems, Inc. gratefully acknowledges The Open Group for permission to reproduce portions of its copyrighted documentation. Original documentation from The Open Group can be obtained online at
8 .\" http://www.opengroup.org/bookstore/.
9 .\" The Institute of Electrical and Electronics Engineers and The Open Group, have given us permission to reprint portions of their documentation. In the following statement, the phrase "this text" refers to portions of the system documentation. Portions of this text are reprinted and reproduced in electronic form in the Sun OS Reference Manual, from IEEE Std 1003.1, 2004 Edition, Standard for Information Technology -- Portable Operating System Interface (POSIX), The Open Group Base Specifications Issue 6, Copyright (C) 2001-2004 by the Institute of Electrical and Electronics Engineers, Inc and The Open Group. In the event of any discrepancy between these versions and the original IEEE and The Open Group Standard, the original IEEE and The Open Group Standard is the referee document. The original Standard can be obtained online at http://www.opengroup.org/unix/online.html.
10 .\" This notice shall appear on any product containing this material.
11 .\" The contents of this file are subject to the terms of the Common Development and Distribution License (the "License"). You may not use this file except in compliance with the License.
12 .\" You can obtain a copy of the license at usr/src/OPENSOLARIS.LICENSE or http://www.opensolaris.org/os/licensing. See the License for the specific language governing permissions and limitations under the License.
13 .\" When distributing Covered Code, include this CDDL HEADER in each file and include the License file at usr/src/OPENSOLARIS.LICENSE. If applicable, add the following below this CDDL HEADER, with the fields enclosed by brackets "[]" replaced with your own identifying information: Portions Copyright [yyyy] [name of copyright owner]
14 .TH UNIQ 1 "Mar 13, 2008"
15 .SH NAME
16 uniq \- report or filter out repeated lines in a file
17 .SH SYNOPSIS
18 .SS "/usr/bin/uniq"
19 .LP
20 .nf
21 \fB/usr/bin/uniq\fR [\fB-c\fR | \fB-d\fR | \fB-u\fR] [\fB-f\fR \fIfields\fR] [\fB-s\fR \fIchar\fR]
22 [\fIinput_file\fR [\fIoutput_file\fR]]
23 .fi
25 .LP
26 .nf
27 \fB/usr/bin/uniq\fR [\fB-c\fR | \fB-d\fR | \fB-u\fR] [\fB-n\fR] [+ \fIm\fR] [\fIinput_file\fR [\fIoutput_file\fR]]
28 .fi
30 .SS "ksh93"
31 .LP
32 .nf
33 \fBuniq\fR [\fB-cdiu\fR] [\fB-D\fR[\fIdelimit\fR]] [\fB-f\fR \fIfields\fR] [\fB-s\fR \fIchars\fR] [\fB-w\fR \fIchars\fR]
34 [\fIinput_file\fR [\fIoutput_file\fR]]
35 .fi
37 .LP
38 .nf
39 \fBuniq\fR [\fB-cdiu\fR] [\fB-D\fR[\fIdelimit\fR]] [\fB-n\fR] [\fB+m\fR] [\fB-w\fR \fIchars\fR] [\fIinput_file\fR [\fIoutput_file\fR]]
40 .fi
42 .SH DESCRIPTION
43 .SS "/usr/bin/uniq"
44 .sp
45 .LP
46 The \fBuniq\fR utility reads an input file comparing adjacent lines and writes
47 one copy of each input line on the output. The second and succeeding copies of
48 repeated adjacent input lines are not written.
49 .sp
50 .LP
51 Repeated lines in the input are not detected if they are not adjacent.
52 .SS "ksh93"
53 .sp
54 .LP
55 The \fBuniq\fR built-in in \fBksh93\fR is associated with the \fB/bin\fR or
56 \fB/usr/bin path\fR. It is invoked when \fBuniq\fR is executed without a
57 pathname prefix and the pathname search finds a \fB/bin/uniq\fR or
58 \fB/usr/bin/uniq\fR executable.
59 .sp
60 .LP
61 \fBuniq\fR reads an input, comparing adjacent lines, and writing one copy of
62 each input line on the output. The second and succeeding copies of the repeated
63 adjacent lines are not written.
64 .sp
65 .LP
66 If \fIoutput_file\fR is not specified, \fBuniq\fR writes to standard output. If
67 \fIinput_file\fR is not specified, or if \fIinput_file\fR is \fB-\fR,
68 \fBuniq\fR reads from standard input, and the start of the file is defined as
69 the current offset.
70 .SH OPTIONS
71 .SS "/usr/bin/uniq"
72 .sp
73 .LP
74 The following options are supported by \fB/usr/bin/uniq\fR:
75 .sp
76 .ne 2
77 .na
78 \fB\fB-c\fR\fR
79 .ad
80 .RS 13n
81 Precedes each output line with a count of the number of times the line occurred
82 in the input.
83 .RE
85 .sp
86 .ne 2
87 .na
88 \fB\fB-d\fR\fR
89 .ad
90 .RS 13n
91 Suppresses the writing of lines that are not repeated in the input.
92 .RE
94 .sp
95 .ne 2
96 .na
97 \fB\fB-f\fR \fIfields\fR\fR
98 .ad
99 .RS 13n
100 Ignores the first \fIfields\fR fields on each input line when doing
101 comparisons, where \fIfields\fR is a positive decimal integer. A field is the
102 maximal string matched by the basic regular expression:
103 .sp
104 .in +2
105 .nf
106 [[:blank:]]*[^[:blank:]]*
107 .fi
108 .in -2
109 .sp
111 If \fIfields\fR specifies more fields than appear on an input line, a null
112 string is used for comparison.
113 .RE
115 .sp
116 .ne 2
117 .na
118 \fB\fB+\fR\fIm\fR\fR
119 .ad
120 .RS 13n
121 Equivalent to \fB-s\fR \fIchars\fR with \fIchars\fR set to \fIm\fR.
122 .RE
124 .sp
125 .ne 2
126 .na
127 \fB\fB\(mi\fR\fIn\fR\fR
128 .ad
129 .RS 13n
130 Equivalent to \fB-f\fR \fIfields\fR with \fIfields\fR set to \fIn\fR.
131 .RE
133 .sp
134 .ne 2
135 .na
136 \fB\fB-s\fR \fIchars\fR\fR
137 .ad
138 .RS 13n
139 Ignores the first \fIchars\fR characters when doing comparisons, where
140 \fIchars\fR is a positive decimal integer. If specified in conjunction with the
141 \fB-f\fR option, the first \fIchars\fR characters after the first \fIfields\fR
142 fields is ignored. If \fIchars\fR specifies more characters than remain on an
143 input line, a null string is used for comparison.
144 .RE
146 .sp
147 .ne 2
148 .na
149 \fB\fB-u\fR\fR
150 .ad
151 .RS 13n
152 Suppresses the writing of lines that are repeated in the input.
153 .RE
155 .SS "ksh93"
156 .sp
157 .LP
158 The following options are supported by the \fBuniq\fR built-in command is
159 \fBksh93\fR:
160 .sp
161 .ne 2
162 .na
163 \fB\fB-c\fR\fR
164 .ad
165 .br
166 .na
167 \fB\fB--count\fR\fR
168 .ad
169 .RS 28n
170 Outputs the number of times each line occurred along with the line.
171 .RE
173 .sp
174 .ne 2
175 .na
176 \fB\fB-d\fR\fR
177 .ad
178 .br
179 .na
180 \fB\fB--repeated | duplicates\fR\fR
181 .ad
182 .RS 28n
183 Outputs only duplicate lines.
184 .RE
186 .sp
187 .ne 2
188 .na
189 \fB\fB-D\fR\fR
190 .ad
191 .br
192 .na
193 \fB\fB--all-repeated\fR[\fB=\fR\fIdelimit\fR]\fR
194 .ad
195 .RS 28n
196 Outputs all duplicate lines as a group with an empty line delimiter specified
197 by \fIdelimit\fR.
198 .sp
199 Specify \fIdelimit\fR as one of the following:
200 .sp
201 .ne 2
202 .na
203 \fB\fBnone\fR\fR
204 .ad
205 .RS 12n
206 Do not delimit duplicate groups.
207 .RE
209 .sp
210 .ne 2
211 .na
212 \fB\fBprepend\fR\fR
213 .ad
214 .RS 12n
215 Prepend an empty line before each group.
216 .RE
218 .sp
219 .ne 2
220 .na
221 \fB\fBseparate\fR\fR
222 .ad
223 .RS 12n
224 Separate each group with an empty line.
225 .RE
227 The value for \fIdelimit\fR can be omitted. The default value is \fBnone\fR.
228 .RE
230 .sp
231 .ne 2
232 .na
233 \fB\fB-f\fR\fR
234 .ad
235 .br
236 .na
237 \fB\fB--skip-fields=\fR\fIfields\fR\fR
238 .ad
239 .RS 28n
240 Skips over \fIfields\fR number of fields before checking for uniqueness. A
241 field is the minimal string matching the \fBBRE
242 [[:\fR\fIblank\fR\fB:]]*[^[:\fR\fIblank\fR\fB:]]*\fR.
243 .RE
245 .sp
246 .ne 2
247 .na
248 \fB\fB-i\fR\fR
249 .ad
250 .br
251 .na
252 \fB\fB--ignore-case\fR\fR
253 .ad
254 .RS 28n
255 Ignore case in comparisons.
256 .RE
258 .sp
259 .ne 2
260 .na
261 \fB\fB+\fR\fIm\fR\fR
262 .ad
263 .RS 28n
264 Equivalent to the \fB-s\fR \fIchars\fR option, with \fIchars\fR set to \fIm\fR.
265 .RE
267 .sp
268 .ne 2
269 .na
270 \fB\fB-\fR\fIn\fR\fR
271 .ad
272 .RS 28n
273 Equivalent to the \fB-f\fR \fIfields\fR option, with \fIfields\fR set to
274 \fIn\fR.
275 .RE
277 .sp
278 .ne 2
279 .na
280 \fB\fB-s\fR\fR
281 .ad
282 .br
283 .na
284 \fB\fB--skip-chars=\fR\fIchars\fR\fR
285 .ad
286 .RS 28n
287 Skips over \fIchars\fR number of characters before checking for uniqueness.
288 .sp
289 If specified with the \fB-f\fR option, the first \fIchars\fR after the first
290 fields are ignored. If the \fIchars\fR specifies more characters than are on
291 the line, an empty string is used for comparison.
292 .RE
294 .sp
295 .ne 2
296 .na
297 \fB\fB-u\fR\fR
298 .ad
299 .br
300 .na
301 \fB\fB--uniq\fR\fR
302 .ad
303 .RS 28n
304 Outputs unique lines.
305 .RE
307 .sp
308 .ne 2
309 .na
310 \fB\fB-w\fR\fR
311 .ad
312 .br
313 .na
314 \fB\fB--check-chars=\fR\fIchars\fR\fR
315 .ad
316 .RS 28n
317 Skips over any specified fields and characters, then compares \fIchars\fR
318 number of characters.
319 .RE
321 .SH OPERANDS
322 .sp
323 .LP
324 The following operands are supported:
325 .sp
326 .ne 2
327 .na
328 \fB\fIinput_file\fR\fR
329 .ad
330 .RS 15n
331 A path name of the input file. If \fIinput_file\fR is not specified, or if the
332 \fIinput_file\fR is \fB\(mi\fR, the standard input is used.
333 .RE
335 .sp
336 .ne 2
337 .na
338 \fB\fIoutput_file\fR\fR
339 .ad
340 .RS 15n
341 A path name of the output file. If \fIoutput_file\fR is not specified, the
342 standard output is used. The results are unspecified if the file named by
343 \fIoutput_file\fR is the file named by \fIinput_file\fR.
344 .RE
346 .SH EXAMPLES
347 .LP
348 \fBExample 1 \fRUsing the \fBuniq\fR Command
349 .sp
350 .LP
351 The following example lists the contents of the \fBuniq.test\fR file and
352 outputs a copy of the repeated lines.
354 .sp
355 .in +2
356 .nf
357 example% \fBcat uniq.test\fR
358 This is a test.
359 This is a test.
360 TEST.
361 Computer.
362 TEST.
363 TEST.
364 Software.
366 example% \fBuniq -d uniq.test\fR
367 This is a test.
368 TEST.
369 example%
370 .fi
371 .in -2
372 .sp
374 .sp
375 .LP
376 The next example outputs just those lines that are not repeated in the
377 \fBuniq.test\fR file.
379 .sp
380 .in +2
381 .nf
382 example% \fBuniq -u uniq.test\fR
383 TEST.
384 Computer.
385 Software.
386 example%
387 .fi
388 .in -2
389 .sp
391 .sp
392 .LP
393 The last example outputs a report with each line preceded by a count of the
394 number of times each line occurred in the file:
396 .sp
397 .in +2
398 .nf
399 example% \fBuniq -c uniq.test\fR
400 2 This is a test.
401 1 TEST.
402 1 Computer.
403 2 TEST.
404 1 Software.
405 example%
406 .fi
407 .in -2
408 .sp
410 .SH ENVIRONMENT VARIABLES
411 .sp
412 .LP
413 See \fBenviron\fR(5) for descriptions of the following environment variables
414 that affect the execution of \fBuniq\fR: \fBLANG\fR, \fBLC_ALL\fR,
415 \fBLC_CTYPE\fR, \fBLC_MESSAGES\fR, and \fBNLSPATH\fR.
416 .SH EXIT STATUS
417 .sp
418 .LP
419 The following exit values are returned:
420 .sp
421 .ne 2
422 .na
423 \fB\fB0\fR\fR
424 .ad
425 .RS 6n
426 Successful completion.
427 .RE
429 .sp
430 .ne 2
431 .na
432 \fB\fB>0\fR\fR
433 .ad
434 .RS 6n
435 An error occurred.
436 .RE
438 .SH ATTRIBUTES
439 .sp
440 .LP
441 See \fBattributes\fR(5) for descriptions of the following attributes:
442 .SS "/usr/bin/uniq"
443 .sp
445 .sp
446 .TS
447 box;
448 c | c
449 l | l .
450 ATTRIBUTE TYPE ATTRIBUTE VALUE
451 _
452 CSI Enabled
453 _
454 Interface Stability Committed
455 _
456 Standard See \fBstandards\fR(5).
457 .TE
459 .SS "ksh93"
460 .sp
462 .sp
463 .TS
464 box;
465 c | c
466 l | l .
467 ATTRIBUTE TYPE ATTRIBUTE VALUE
468 _
469 Interface Stability See below.
470 .TE
472 .sp
473 .LP
474 The \fBksh93\fR built-in binding to \fB/bin\fR and \fB/usr/bin\fR is Volatile.
475 The built-in interfaces are Uncommitted.
476 .SH SEE ALSO
477 .sp
478 .LP
479 \fBcomm\fR(1), \fBksh93\fR(1), , \fBpcat\fR(1), \fBsort\fR(1),
480 \fBuncompress\fR(1), \fBattributes\fR(5), \fBenviron\fR(5), \fBstandards\fR(5)