Analyze Statistics


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Analyze Statistics
# 1  
Old 08-25-2006
Analyze Statistics

I have a file which contains records in the format of

2006-08-25 12:06:13|ABC|93
2006-08-25 12:45:55|ABC|203
2006-08-25 01:48:19|DEF|156
2006-08-25 01:49:09|ABC|12798
2006-08-25 02:49:59|GHL|4109
2006-08-25 03:50:50|DEF|234

where the format is "arrive time"|"message type"|"processing time"

I want to find out
- number of records in the file
=> 6 for above case
- number of records in the file for each message type
=> ABC = 3
DEF = 2
GHL = 1
- distribution of message arrive time
=> 12 - 13 = 2
13 - 14 = 2
14 - 15 = 1
15 - 14 = 1
- average processing time
=> 2932.2

Can anyone helps me with this? THANK YOU!
# 2  
Old 08-25-2006
--To find the number of line in the file use
awk 'END{print $NR}'
--to get which message repeated how many time i believe you can follow these step
* cut down the 2nd column sepearated using "|"
say awk 'BEGIN{FS=OFA="|"}{print $2}' srcfile.txt > src_temp.txt
* then sort the src_temp.txt to get the uniq message
sort -o src_temp.txt src_temp.txt | uniq
now search the sorce file using src_temp.txt as your pattern file which actually contain the uniqmessage name

*Probably what you can do is

while read msg
do
{
msgcnt =`grep -c $msg src_file.txt`
echo "$msg = $msgcnt"
}done < src_temp.txt

rm -fr src_temp.txt
-----------------------

I am confused of your third requirement
# 3  
Old 08-25-2006
jambesh, what I want to be able to find out how many records were logged between each time range, I have set the range as a hourly interval, I am hoping to use the timestamp in the first part of the record to distinguish which range is fall into then increment that count. Thanks
# 4  
Old 08-25-2006
See my comments re tis message sent in by "jerrad" "Make grep -c display like grep -n? "
It has a quick little script that will out put (Total times Appears):string
ie
3:ABC
2SmilieEF
etc etc
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Solaris

Snapshot analyze

Hi, Is there any tool is available for analyzing Oracle X86 snapshot output. Thanks in advance. (1 Reply)
Discussion started by: sunnybee
1 Replies

2. UNIX for Dummies Questions & Answers

analyze lines in a file by loop

Hi Dears, I use the below code to analyze lines in a file: for line in `cat ucsv` do echo $line //analyze statements donehowever, if line contains space char, it will be broken. for example, if file content is: #login,full name,email,project,role,action gmwen,Bruce... (3 Replies)
Discussion started by: crest.boy
3 Replies

3. Programming

Using c++ to analyze two file problem

Hi, I have two files: Input_file1.txt 124 235 152 178 156 142 178 163 159 Input_file2.txt 124|5623 452|6698 178|9995 235|7542 159|8852 (1 Reply)
Discussion started by: cpp_beginner
1 Replies

4. UNIX for Dummies Questions & Answers

How to analyze file hashing

What command should I use to analyze file hashing of fixed flat files. How much work does it take for multiple flat files. (3 Replies)
Discussion started by: jbjoat
3 Replies

5. Cybersecurity

How to analyze malicious code

A series on The H about analyzing potentially malicious code flying around on the net. Pretty well written, and a nice read for those interested in how exploits work: CSI:Internet - Alarm at the pizza service CSI:Internet - The image of death CSI:Internet - PDF timebomb CSI:Internet -... (0 Replies)
Discussion started by: pludi
0 Replies

6. Solaris

Analyze packets with snoop

Is there anywhere we can get details about what we should expect to see and not to see in some packets captured with "snoop" during troubleshooting a problem? I know we can capture packes for a failed transaction and compare them with packets for a successful trasaction.Is that the only way to... (4 Replies)
Discussion started by: Pouchie1
4 Replies

7. Solaris

How to analyze the outcome of patchdiag

Hi Gurus, I have installed the stuff needed for patchdiag for patching, its working okay , however after execution of pathcdiag.sparc i am unable to understand the summury which is produced at the end. Please help ! Thanks (3 Replies)
Discussion started by: kumarmani
3 Replies

8. What is on Your Mind?

How To Analyze This (Cryptography Random?) Permutation...?

Hi to all of you guys, I'm new here... May this thread fits on this section. A friend of mine gave me this enigma to do, written in excel. I attach the file below, name New.xls. Enigma: There are 10^20 possibilities of tables (Table1, Table 2, Table 3, Table 4, Table 5,...), with ten rows (row... (3 Replies)
Discussion started by: lucky7
3 Replies

9. Shell Programming and Scripting

Analyze the indexes and rebuild them

Hello UNIX and Oracle Gurus, After doing an intensive search from different websites, the UNIX forum I am posting this message seeking help.. I am trying to accomplish the following tasks through the shell script: 1. Rebuild indexes on a Table in Oracle 2. Analyze indexes and table... (0 Replies)
Discussion started by: madhunk
0 Replies
Login or Register to Ask a Question