Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Count of matched pattern occurences by time in a log file
Top Forums Shell Programming and Scripting Count of matched pattern occurences by time in a log file Post 302511983 by kurumi on Friday 8th of April 2011 04:53:16 AM
Old 04-08-2011
Ruby(1.9+)
Code:
h=Hash.new(0)
File.open("file").each do |line|
    date,time,conn,status = line.split
    str = sprintf("%s|%s|%s", date,time[0,2],status)
    h[ str ] += 1
end
final={}
h.each do|k,v|
    s =  k.split("|")
    (final[ s[0,2].join("|") ] ||= [] ) << s[2]+":"+v.to_s
end
final.each{|x,y| a=x.split("|") ; puts "#{a[0]} #{a[1]}:00-#{a[1]}:59 : #{y}" }

Experimentation
Code:
$ ruby test.rb
08/04/2011 05:00-05:59 : ["Success:3", "Fail:1"]
08/04/2011 06:00-06:59 : ["Success:1", "Fail:2"]
08/04/2011 07:00-07:59 : ["Success:2", "Fail:1"]

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

grep and count no of occurences in every line of a file

Hi Folks, I have a input file of the below format. ~~~OLKIT~OLKIT~1~~TBD~BEST PAGER & WIRELESS~4899 COMMON MARKET PLACE~~~DUBLIN~KS~43016~I~Y~DIRECT~D~~0 BPGRWRLS~~~OLKIT~OLKIT~1~~TBD~BEST PAGER & WIRELESS~4899 COMMON MARKET PLACE~~~DUBLIN~KS~43016~I~Y~DIRECT~D~~0... (12 Replies)
Discussion started by: srikanthgr1
12 Replies

2. HP-UX

count occurences of specific character in the file

For counting the occurences of specific character in the file I am issuing the command grep -o 'character' filename | wc -w It works in other shells but not in HP-UX as there is no option -o for grep. What do I do now? (9 Replies)
Discussion started by: superprogrammer
9 Replies

3. UNIX for Dummies Questions & Answers

Count of matched pattern occurance

In a file a pattern is occured many times randomly. Even it may appear more then once in the same line too. How i can get the number of times that pattern appeared in the file? let the file name is abc.txt and the pattern is "xyz". I used the following code: grep -ic "xyz" abc.txt but it is... (3 Replies)
Discussion started by: palash2k
3 Replies

4. Shell Programming and Scripting

How to count the number of occurences of this pattern?

Hi all, I have a pattern like this in a file: 123 4 56 789 234 5 67 789 121 3 56 789 222 4 65 789 321 6 90 100 478 8 40 789 243 7 80 789 How can I count the number of occurences of '789' (4th column) in this set...? Thanks for all your help! K (7 Replies)
Discussion started by: kripssmart
7 Replies

5. UNIX for Dummies Questions & Answers

Count pattern occurences

hi, I have a text..and i need to find a pattern in the text and count to the no of times the pattern occured. i have used grep command ..but the problem is , it shows the occurrences of the pattern but doesn't count no of times the pattern occuries. (5 Replies)
Discussion started by: nvnni
5 Replies

6. Shell Programming and Scripting

Count of matched pattern occurences by minute and date in a log file

Anyone knows how to use AWK to achieve the following Sun Feb 12 00:41:01-00:41:59 Success:2 Fail:2 Sun Feb 12 00:42:01-00:42:59 Success:1 Fail:2 Sun Feb 12 01:20:01-01:20:59 Success:1 Fail:2 Mon Feb 13 22:41:01-22:41:59 Success:1 Fail:1 log file: Success Success Fail Fail ... (9 Replies)
Discussion started by: timmywong
9 Replies

7. Shell Programming and Scripting

[solved]awk count occurences in time window

Input File Time, KeyStation 00:00:00,000;KS_1 00:00:01,000;KS_1 00:00:02,000;KS_1 00:00:03,000;KS_1 00:00:04,000;KS_1 00:00:05,000;KS_1 00:00:06,000;KS_1 00:01:01,000;KS_1 00:01:02,000;KS_1 00:01:03,000;KS_1 00:01:04,000;KS_1 00:01:05,000;KS_1 00:01:06,000;KS_1 01:00:01,000;KS_1... (0 Replies)
Discussion started by: Calypso
0 Replies

8. Shell Programming and Scripting

How to use sed to search a particular pattern in a file backward after a pattern is matched.?

Hi, I have two files file1.txt and file2.txt. Please see the attachments. In file2.txt (which actually is a diff output between two versions of file1.txt.), I extract the pattern corresponding to 1172c1172. Now ,In file1.txt I have to search for this pattern 1172c1172 and if found, I have to... (9 Replies)
Discussion started by: saurabh kumar
9 Replies

9. Shell Programming and Scripting

ksh : need to get the 4 th line above and 2 nd below the matched pattern in the log file

I have a log file as given below 012/01/21 10:29:02 (111111) Processing Job '23_369468343464564' 2012/01/21 10:29:02 (111111) Making Job '23_369468343464564.0'... 2012/01/21 10:29:04 (111111) Jobnumber '23_369468343464564' was successful 2012/01/21 10:29:04 ... (12 Replies)
Discussion started by: rpm120
12 Replies

10. Shell Programming and Scripting

Count occurences of a character in a file by sorting results

Hello, I try to sort results of occurences in an array by using awk but I can't find the right command. that's why I'm asking your help ! :) Please see below the command that I run: awk '{ for ( i=1; i<=length; i++ ) arr++ }END{ for ( i in arr ) { print i, arr } }' dictionnary.txt ... (3 Replies)
Discussion started by: destin45
3 Replies

LEARN ABOUT OPENSOLARIS

dat_psp_free

dat_psp_free(3DAT)				     Direct Access Transport Library Functions					dat_psp_free(3DAT)

NAME

       dat_psp_free - destroy an instance of the Public Service Point

SYNOPSIS

       cc [ flag... ] file... -ldat [ library... ]
       #include <dat/udat.h>

       DAT_RETURN
	   dat_psp_free (
	   IN	 DAT_PSP_HANDLE    psp_handle
	   )

PARAMETERS

       psp_handle    Handle for an instance of the Public Service Point.

DESCRIPTION

       The dat_psp_free() function destroys a specified instance of the Public Service Point.

       Any  incoming  Connection  Requests  for the Connection Qualifier on the destroyed Service Point it had been listening on are automatically
       rejected by the Provider with the return analogous to the no listening Service Point.

       The behavior of the Connection Requests in progress is undefined and left to an implementation. But it must be consistent. This means  that
       either  a  Connection Requested Event has been generated for the Event Dispatcher associated with the Service Point, including the creation
       of the Connection Request instance, or the Connection Request is rejected by the Provider without any local notification.

       This operation shall have no effect on previously generated Connection Requested Events. This includes Connection  Request  instances  and,
       potentially, Endpoint instances created by the Provider.

       The behavior of this operation with creation of a Service Point on the same Connection Qualifier at the same time is not defined. Consumers
       are advised to avoid this scenario.

       Use of the handle of the destroyed Public Service Point in any consequent operation fails.

RETURN VALUES

       DAT_SUCCESS	     The operation was successful.

       DAT_INVALID_HANDLE    The psp_handle parameter is invalid.

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Interface Stability	     |Standard: uDAPL, 1.1, 1.2    |
       +-----------------------------+-----------------------------+
       |MT-Level		     |Unsafe			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       libdat(3LIB), attributes(5)

SunOS 5.11							    16 Jul 2004 						dat_psp_free(3DAT)
All times are GMT -4. The time now is 01:15 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy