07-15-2005
Counting occurences of different strings in a file
Hi,
i'd like to know if the following is possible with a shell script, and can't find the answer in the search.
Suppose i have a logfile build like this:
[15/Jul/2005:10:47:22 0100][3-I] # 8 :riuyzp1028
[15/Jul/2005:10:47:24 0100][3-I] # 38 : riuyzp1028
[15/Jul/2005:10:47:30 0100][3-I] # 25 : riuyvzp1032
[15/Jul/2005:10:47:34 0100][3-I] # 30 : nlkljpa0202
[15/Jul/2005:10:47:34 0100][3-I] # 1 : nlklja0205
[15/Jul/2005:10:47:35 0100][3-I] # 38 : riuyzp1028
[15/Jul/2005:10:47:35 0100][3-I] # 25 : riuyvzp1032
[15/Jul/2005:10:47:37 0100][3-I] # 30 : dsjfhh23
[15/Jul/2005:10:47:38 0100][3-I] # 1 : sdfjkh45
I want a script to count the number of occurences of each unique machine (where "riuyzp1028" is the machine name).
The output i'd like to see is, the machine names followed by the number of occurences...like this:
riuyzp1028 3
riuyvzp1032 2
nlkljpa0202 1
nlklja0205 1
dsjfhh23 1
sdfjkh45 1
I wan't to use this script to be able to check which machine is generating the most entries in my logfile.
Thanks for your help in advance !
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi,
I need to count the number of occurences of the character " in a file that contains huge number of records.
What command could I use?
Please specify in detail since I am new :|
Thanks much. (3 Replies)
Discussion started by: GMMike
3 Replies
2. UNIX for Dummies Questions & Answers
Hi All,
I have to count the number of occurences of the character " ; " in a given line.
I had used the following awk command to achieve the same
echo $KOP.dat|awk '{split($1,my,";"); for(i in my)c++ }END{print c-1}'
My file KOP.dat had the following data
... (1 Reply)
Discussion started by: kingofprussia
1 Replies
3. UNIX for Dummies Questions & Answers
Hi all,
I'm very very new to UNIX and AWK world.Please help me in finding a solution for my problem.
I'm having a file like this
-----------------------------------------------------------------
~Version Information
VERS. 2.0: CWLS log ASCII Standard -VERSION 2.0
WRAP. ... (4 Replies)
Discussion started by: santyshyam
4 Replies
4. Shell Programming and Scripting
say i've got a text file with >10million sequences:
ssss
ssss
tttttt
uuuuuu
uuuuuu
uuuuuu
...
I'd like to convert the file so that the output will report the number of occurence right by each sequence:
2 ssss
2 ssss
1 tttttt
3 uuuuuu
3 uuuuuu
3 uuuuuu
.... (3 Replies)
Discussion started by: johjoh
3 Replies
5. Shell Programming and Scripting
Hi,
I am trying to count the max number of occurences of field1 in my apache log
example:
10.0.0.1 field2 field3
10.0.0.2 filed2 field3
10.0.0.1 field2 field3
10.0.0.1 field2 field3
awk result to print out only the most occurence of field1 and number of occurence
and field1 is... (3 Replies)
Discussion started by: phamp008
3 Replies
6. Shell Programming and Scripting
Hi. I have to delete the content between all the occurrences of the xml tags in a single file.
For example:
* The tags <script>.....................</script> occurs more than once in the same file.
* It follows tagging rules meaning a start tag will be followed by an end tag. Will not have... (9 Replies)
Discussion started by: satheeshkumar
9 Replies
7. Shell Programming and Scripting
Hi guys!
I have a problem writing script that would convert this input
into this output:
I have an awk script that counts occurences of a sign in a column, but don't know how to change it so that I would give me desired output.
script
awk '{count++}END{for(j in count)... (2 Replies)
Discussion started by: grincz
2 Replies
8. Shell Programming and Scripting
I have been working on this for a little while and have been unable to come to a solution. Any help would be appreciated. I am working on a UNIX workstation and have a 30-40 meg text file that I am working with. In my real file there is hundreds of Jobs. Example of input file;
misc logging data... (1 Reply)
Discussion started by: ny_evan
1 Replies
9. Shell Programming and Scripting
I have some text files in a folder f1 with 10 columns. The first five columns of a file are shown below.
aab abb 263-455 263 455
aab abb 263-455 263 455
aab abb 263-455 263 455
bbb abb 26-455 26 455
bbb abb 26-455 26 455
bbb aka 264-266 264 266
bga bga 230-232 230 ... (10 Replies)
Discussion started by: gomez
10 Replies
10. UNIX for Advanced & Expert Users
Hi all,
i have the following line in a record file :
retenu=non
demande=non
script=#vtbackup /path=/save/backup/demande
position=140+70
and i want to use Perl regex to have the following output
key : "retenu" value : "non"
key : "demande" value "non"
key : "script" value :... (2 Replies)
Discussion started by: Fundix
2 Replies
textutil::trim(n) Text and string utilities, macro processing textutil::trim(n)
__________________________________________________________________________________________________________________________________________________
NAME
textutil::trim - Procedures to trim strings
SYNOPSIS
package require Tcl 8.2
package require textutil::trim ?0.7?
::textutil::trim::trim string ?regexp?
::textutil::trim::trimleft string ?regexp?
::textutil::trim::trimright string ?regexp?
::textutil::trim::trimPrefix string prefix
::textutil::trim::trimEmptyHeading string
_________________________________________________________________
DESCRIPTION
The package textutil::trim provides commands that trim strings using arbitrary regular expressions.
The complete set of procedures is described below.
::textutil::trim::trim string ?regexp?
Remove in string any leading and trailing substring according to the regular expression regexp and return the result as a new
string. This is done for all lines in the string, that is any substring between 2 newline chars, or between the beginning of the
string and a newline, or between a newline and the end of the string, or, if the string contain no newline, between the beginning
and the end of the string. The regular expression regexp defaults to "[ \t]+".
::textutil::trim::trimleft string ?regexp?
Remove in string any leading substring according to the regular expression regexp and return the result as a new string. This apply
on any line in the string, that is any substring between 2 newline chars, or between the beginning of the string and a newline, or
between a newline and the end of the string, or, if the string contain no newline, between the beginning and the end of the string.
The regular expression regexp defaults to "[ \t]+".
::textutil::trim::trimright string ?regexp?
Remove in string any trailing substring according to the regular expression regexp and return the result as a new string. This apply
on any line in the string, that is any substring between 2 newline chars, or between the beginning of the string and a newline, or
between a newline and the end of the string, or, if the string contain no newline, between the beginning and the end of the string.
The regular expression regexp defaults to "[ \t]+".
::textutil::trim::trimPrefix string prefix
Removes the prefix from the beginning of string and returns the result. The string is left unchanged if it doesn't have prefix at
its beginning.
::textutil::trim::trimEmptyHeading string
Looks for empty lines (including lines consisting of only whitespace) at the beginning of the string and removes it. The modified
string is returned as the result of the command.
BUGS, IDEAS, FEEDBACK
This document, and the package it describes, will undoubtedly contain bugs and other problems. Please report such in the category textutil
of the Tcllib SF Trackers [http://sourceforge.net/tracker/?group_id=12883]. Please also report any ideas for enhancements you may have for
either package and/or documentation.
SEE ALSO
regexp(n), split(n), string(n)
KEYWORDS
prefix, regular expression, string, trimming
textutil 0.7 textutil::trim(n)