09-19-2009
awk counting number of occurences
Hi,
I am trying to count the max number of occurences of field1 in my apache log
example:
10.0.0.1 field2 field3
10.0.0.2 filed2 field3
10.0.0.1 field2 field3
10.0.0.1 field2 field3
awk result to print out only the most occurence of field1 and number of occurence
and field1 is dynamic variable, i want to be able to use the same awk command if the log
shows 10.0.0.x
10.0.0.1 3
many thanks
Last edited by phamp008; 09-19-2009 at 01:37 PM..
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi,
I need to count the number of occurences of the character " in a file that contains huge number of records.
What command could I use?
Please specify in detail since I am new :|
Thanks much. (3 Replies)
Discussion started by: GMMike
3 Replies
2. UNIX for Dummies Questions & Answers
Hi,
i'd like to know if the following is possible with a shell script, and can't find the answer in the search.
Suppose i have a logfile build like this:
# 8 :riuyzp1028
# 38 : riuyzp1028
# 25 : riuyvzp1032
# 30 : nlkljpa0202
# 1 : nlklja0205
# 38 : riuyzp1028
# 25 :... (4 Replies)
Discussion started by: Freerider
4 Replies
3. Shell Programming and Scripting
hi,
I have a file where i need to count the occurences of a string ex) 'welcome to unix forum'. can anybody help me out (12 Replies)
Discussion started by: siddu_chittari
12 Replies
4. UNIX for Dummies Questions & Answers
Hi All,
I have to count the number of occurences of the character " ; " in a given line.
I had used the following awk command to achieve the same
echo $KOP.dat|awk '{split($1,my,";"); for(i in my)c++ }END{print c-1}'
My file KOP.dat had the following data
... (1 Reply)
Discussion started by: kingofprussia
1 Replies
5. Shell Programming and Scripting
Hi All
I have the input file OMAK_11.
OMAK 000002EXCLUDE 1341
OMAK 000002EXCLUDE 1341
OMAK 000002EXCLUDE 1341
OMAK 000003EXCLUDE 1341
OMAK 000003EXCLUDE 1341
OMAK 000003EXCLUDE ... (8 Replies)
Discussion started by: dhanamurthy
8 Replies
6. Shell Programming and Scripting
say i've got a text file with >10million sequences:
ssss
ssss
tttttt
uuuuuu
uuuuuu
uuuuuu
...
I'd like to convert the file so that the output will report the number of occurence right by each sequence:
2 ssss
2 ssss
1 tttttt
3 uuuuuu
3 uuuuuu
3 uuuuuu
.... (3 Replies)
Discussion started by: johjoh
3 Replies
7. Shell Programming and Scripting
Hi, I am having the following number in the file tmp
31013.004
20675.336
43318.190
30512.926
48992.559
277893.111
41831.330
8749.113
415980.576
28273.054
I want to add these numbers, I am using following script
awk 'END{print s}{s += $1}' tmp
its giving answer 947239 which is correct,... (3 Replies)
Discussion started by: chaitubek
3 Replies
8. Shell Programming and Scripting
Hi guys!
I have a problem writing script that would convert this input
into this output:
I have an awk script that counts occurences of a sign in a column, but don't know how to change it so that I would give me desired output.
script
awk '{count++}END{for(j in count)... (2 Replies)
Discussion started by: grincz
2 Replies
9. Shell Programming and Scripting
Hi Guys,
I have 2 files like below
file1
xx
yy
file2
b
yy
b2
xx
c1
yy
xx
yy
Now I want an idea which can count occurences of text from file1 and file2 so outbout would be kind of (9 Replies)
Discussion started by: prashant2507198
9 Replies
10. Shell Programming and Scripting
:b:
Hi Folks,
I have a requirement to find the number of consecutive occurences based on month. Here is the below sample of my requirement.
I have say four columns
CARUSERNAME BRAND_CODE MONTH YEAR
Below is sample Data
John|C|JAN|2013
Tim|C|FEB|2013
Tom|C|Mar|2013
Ron|C|Apr|2013... (4 Replies)
Discussion started by: dinesh1985
4 Replies
IGAWK(1) Utility Commands IGAWK(1)
NAME
igawk - gawk with include files
SYNOPSIS
igawk [ all gawk options ] -f program-file [ -- ] file ...
igawk [ all gawk options ] [ -- ] program-text file ...
DESCRIPTION
Igawk is a simple shell script that adds the ability to have ``include files'' to gawk(1).
AWK programs for igawk are the same as for gawk, except that, in addition, you may have lines like
@include getopt.awk
in your program to include the file getopt.awk from either the current directory or one of the other directories in the search path.
OPTIONS
See gawk(1) for a full description of the AWK language and the options that gawk supports.
EXAMPLES
cat << EOF > test.awk
@include getopt.awk
BEGIN {
while (getopt(ARGC, ARGV, "am:q") != -1)
...
}
EOF
igawk -f test.awk
SEE ALSO
gawk(1)
Effective AWK Programming, Edition 1.0, published by the Free Software Foundation, 1995.
AUTHOR
Arnold Robbins (arnold@skeeve.com).
Free Software Foundation Nov 3 1999 IGAWK(1)