Login or Register to Ask a Question and Join Our Community


UNIX for Advanced & Expert Users

Count number of unique patterns from a log file

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users Count number of unique patterns from a log file
# 8  
Old 07-10-2011
Quote:
Originally Posted by shamrock
nawk nawk...
Who's there? Smilie
# 9  
Old 07-11-2011
Ur Awesome
Smilie Thanks..!!
# 10  
Old 07-14-2011
Data
Hello bartus11

I am having problems using this command especially with files having space inbetween them it gives wrong output, if i try to find two items it gives me count of only 1 i have pasted by example below . Please help

Code:
 
$ vi sample.log
"sample.log" 28 lines, 318 characters
testing1
testing2
test DESTORM=USRT_USER
sample3
sample5
sample5
sam
some more text
radom text
sample text
texting filled here
sample reandome text
some unusual random text
 
text file
some texit
file some text
A
text
some pecular text
sample
sample file log
sample Dont allow to enter
some more sample
taile record
 
test DESTORM=USRT_USER
sample3
sample5
sample5
sam
some more text
radom text
sample text
texting filled here
sample reandome text
some unusual random text
 
text file
some texit
file some text
A
text
some pecular text
sample
sample file log
sample Dont allow to enter
some more sample
"sample.log" 55 lines, 607 characters
$ perl -0072 -ne '/DESTORM=USRT_USER.*Dont allow to enter/s && $i++;END{print "$i\n"}' sample.log
1
$ nawk '/DESTORM=USRT_USER.*Dont allow to enter/{i++}END{print i}' RS=":" sample.log
1
$

---------- Post updated 07-14-11 at 08:12 AM ---------- Previous update was 07-13-11 at 01:54 PM ----------

Smilie
# 11  
Old 07-15-2011
Error forum members any update regarding this ?
need ur help !! Smilie
# 12  
Old 07-19-2011
Quote:
Originally Posted by xtechkid
need ur help !! Smilie
this should nawk it out...Smilie
Code:
nawk '{FS=/DESTORM=USRT_USER.*Dont allow to enter/}END{print NF-1}' sample.log

# 13  
Old 07-19-2011
Data No luck
This gives a result of -1 Smilie .. No LUCK !!
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Count number of unique values in each column of array

What is an efficient way of counting the number of unique values in a 400 column by 1000 row array and outputting the counts per column, assuming the unique values in the array are: A, B, C, D In other words the output should look like: Value COL1 COL2 COL3 A 50 51 52... (16 Replies)
Discussion started by: Geneanalyst
16 Replies

2. Shell Programming and Scripting

Find and count unique date values in a file based on position

Hello, I need some sort of way to extract every date contained in a file, and count how many of those dates there are. Here are the specifics: The date format I'm looking for is mm/dd/yyyy I only need to look after line 45 in the file (that's where the data begins) The columns of... (2 Replies)
Discussion started by: ronan1219
2 Replies

3. Shell Programming and Scripting

Awk to Count Multiple patterns in a huge file

Hi, I have a file that is 430K lines long. It has records like below |site1|MAP |site2|MAP |site1|MODAL |site2|MAP |site2|MODAL |site2|LINK |site1|LINK My task is to count the number of time MAP, MODAL, LINK occurs for a single site and write new records like below to a new file ... (5 Replies)
Discussion started by: reach.sree@gmai
5 Replies

4. Shell Programming and Scripting

count the number of occurring patterns in a file.

Hi, I have a file with a '|' pipe delimeter. I want to find number of counts for a particular pattern in particular field. Is it possible to do it in a single command? 1) want to find total number of "0" in field 4. 2) want to find total number of different records in field 4 ( similar to... (5 Replies)
Discussion started by: rudoraj
5 Replies

5. Shell Programming and Scripting

List unique values and count instances in .csv file

I need to take the second column of a .csv file and count the number of instances of each unique value in that same second column. I'd like the output to be value,count sorted by most instances. Thanks for any guidance! Data example: 317476,317756,0 816063,318861,0 313123,319091,0... (4 Replies)
Discussion started by: batcho
4 Replies

6. Shell Programming and Scripting

Unique count from flat file

Hello Guys I have a flat file with '|~|' delimited When I use to record count using below command awk -FS"+" ' {print $colno}' filename | wc -l the count is fine But when I am trying to find the unique number of record the o/p is always 1 awk -FS"+" ' {print $colno}'... (11 Replies)
Discussion started by: Pratik4891
11 Replies

7. Shell Programming and Scripting

How to count Unique Values from a file.

Hi I have the following info in a file - <Cell id="25D"/> <Cell id="26A"/> <Cell id="26B"/> <Cell id="26C"/> <Cell id="27A"/> <Cell id="27B"/> <Cell id="27C"/> <Cell id="28A"/> I would like to know how would you go about counting all... (4 Replies)
Discussion started by: Prega
4 Replies

8. Shell Programming and Scripting

Count number of Nodes created and write it to a Log file

Dear Experts, I have to count the number of AddressRecords formed in bbc.xml file using unix script file. For example: for below pasted file, I need to write an output to a log file as "No. of Address Records Created=4". Snippet of bbc.xml:- <?xml version="1.0" encoding="UTF-8" ?> -... (1 Reply)
Discussion started by: phani333
1 Replies

9. Shell Programming and Scripting

Count lines between two patterns inside a file

Hi, Im doing a script to find the number of lines included inside a file newly. These lines are in between #ifdef FLAG1 and #else or #endif or #else and #endif. I tried like this, awk '/#ifdef Flag1/,/#e/{print}' aa.c | wc -l awk '/#ifndef Flag1/,/#endif/{print}' aa.c | awk... (6 Replies)
Discussion started by: priyadarshini
6 Replies

10. Shell Programming and Scripting

Script to count unique number of user loged in

Hi all, I am taking my first course in unix and having some problems. I would line to create a scrip that does the following: 1) will tell me the number of users logged in. If a user is logged more than once just count it only ones. 2) want to be able to display the number of users that... (1 Reply)
Discussion started by: elchalateco
1 Replies
Login or Register to Ask a Question