04-28-2009
use uniq
uniq -c filename
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi,
I need to count the number of occurences of the character " in a file that contains huge number of records.
What command could I use?
Please specify in detail since I am new :|
Thanks much. (3 Replies)
Discussion started by: GMMike
3 Replies
2. UNIX for Dummies Questions & Answers
Hi,
i'd like to know if the following is possible with a shell script, and can't find the answer in the search.
Suppose i have a logfile build like this:
# 8 :riuyzp1028
# 38 : riuyzp1028
# 25 : riuyvzp1032
# 30 : nlkljpa0202
# 1 : nlklja0205
# 38 : riuyzp1028
# 25 :... (4 Replies)
Discussion started by: Freerider
4 Replies
3. Shell Programming and Scripting
hi,
I have a file where i need to count the occurences of a string ex) 'welcome to unix forum'. can anybody help me out (12 Replies)
Discussion started by: siddu_chittari
12 Replies
4. UNIX for Dummies Questions & Answers
Hi All,
I have to count the number of occurences of the character " ; " in a given line.
I had used the following awk command to achieve the same
echo $KOP.dat|awk '{split($1,my,";"); for(i in my)c++ }END{print c-1}'
My file KOP.dat had the following data
... (1 Reply)
Discussion started by: kingofprussia
1 Replies
5. Shell Programming and Scripting
Hi all,
I have a pattern like this in a file:
123 4 56 789
234 5 67 789
121 3 56 789
222 4 65 789
321 6 90 100
478 8 40 789
243 7 80 789
How can I count the number of occurences of '789' (4th column) in this set...?
Thanks for all your help!
K (7 Replies)
Discussion started by: kripssmart
7 Replies
6. Shell Programming and Scripting
Hi,
I am trying to count the max number of occurences of field1 in my apache log
example:
10.0.0.1 field2 field3
10.0.0.2 filed2 field3
10.0.0.1 field2 field3
10.0.0.1 field2 field3
awk result to print out only the most occurence of field1 and number of occurence
and field1 is... (3 Replies)
Discussion started by: phamp008
3 Replies
7. UNIX for Dummies Questions & Answers
Hello world,
Can anybody tell me how to count how many times does a word repeat in a file? There have been many threads on this but they all are heavy loads of Scripting for a starter like me. :D
So, I sat down today and after some hours of reading man pages, I found a simple one-line... (18 Replies)
Discussion started by: satish51392111
18 Replies
8. Shell Programming and Scripting
Hi guys!
I have a problem writing script that would convert this input
into this output:
I have an awk script that counts occurences of a sign in a column, but don't know how to change it so that I would give me desired output.
script
awk '{count++}END{for(j in count)... (2 Replies)
Discussion started by: grincz
2 Replies
9. Shell Programming and Scripting
Hi Guys,
I have 2 files like below
file1
xx
yy
file2
b
yy
b2
xx
c1
yy
xx
yy
Now I want an idea which can count occurences of text from file1 and file2 so outbout would be kind of (9 Replies)
Discussion started by: prashant2507198
9 Replies
10. Shell Programming and Scripting
:b:
Hi Folks,
I have a requirement to find the number of consecutive occurences based on month. Here is the below sample of my requirement.
I have say four columns
CARUSERNAME BRAND_CODE MONTH YEAR
Below is sample Data
John|C|JAN|2013
Tim|C|FEB|2013
Tom|C|Mar|2013
Ron|C|Apr|2013... (4 Replies)
Discussion started by: dinesh1985
4 Replies
UNIQ(1) User Commands UNIQ(1)
NAME
uniq - report or omit repeated lines
SYNOPSIS
uniq [OPTION]... [INPUT [OUTPUT]]
DESCRIPTION
Discard all but one of successive identical lines from INPUT (or standard input), writing to OUTPUT (or standard output).
Mandatory arguments to long options are mandatory for short options too.
-c, --count
prefix lines by the number of occurrences
-d, --repeated
only print duplicate lines
-D, --all-repeated[=delimit-method]
print all duplicate lines delimit-method={none(default),prepend,separate} Delimiting is done with blank lines.
-f, --skip-fields=N
avoid comparing the first N fields
-i, --ignore-case
ignore differences in case when comparing
-s, --skip-chars=N
avoid comparing the first N characters
-u, --unique
only print unique lines
-z, --zero-terminated
end lines with 0 byte, not newline
-w, --check-chars=N
compare no more than N characters in lines
--help display this help and exit
--version
output version information and exit
A field is a run of blanks (usually spaces and/or TABs), then non-blank characters. Fields are skipped before chars.
Note: 'uniq' does not detect repeated lines unless they are adjacent. You may want to sort the input first, or use `sort -u' without
`uniq'.
AUTHOR
Written by Richard M. Stallman and David MacKenzie.
REPORTING BUGS
Report uniq bugs to bug-coreutils@gnu.org
GNU coreutils home page: <http://www.gnu.org/software/coreutils/>
General help using GNU software: <http://www.gnu.org/gethelp/>
COPYRIGHT
Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>.
This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law.
SEE ALSO
The full documentation for uniq is maintained as a Texinfo manual. If the info and uniq programs are properly installed at your site, the
command
info coreutils 'uniq invocation'
should give you access to the complete manual.
GNU coreutils 7.1 July 2010 UNIQ(1)