Awk counting lines with field match Post: 302314628

Sponsored Content

Top Forums UNIX for Dummies Questions & Answers Awk counting lines with field match Post 302314628 by ghostdog74 on Saturday 9th of May 2009 02:22:13 AM

05-09-2009

Registered User

if you have Python, here's an alternative solution

Code:

import sys
while 1:
    day = raw_input("Please enter a day(eg Mon): ").lower()
    choice= raw_input("Would you like to add a range(Y|N): ")
    if choice in ['Y','y']:
        starthr = int(raw_input("Please enter starting hour eg 01,10: "))
        endhr = int(raw_input("Please enter ending hr eg 02,24: "))
        d={}
        for line in open("file"):
            line=line.strip()
            s=line.split()
            if day == s[1].lower():
                hr = int(s[-3].split(":")[0])
                if hr >= starthr and hr <= endhr:
                    d.setdefault(s[0],0)
                    d[s[0]]+=1        
        o=0            
        for i,j in d.iteritems():
            print i,j
            if j==1: o+=1      
        print "%d lines match this" %(len(d.keys()))
        print "%d lines match this when containing identical ip address" %(o)
    elif choice in ['N','n']:    
        print "you are not adding a range...so what now?"
    else:
        print "Enter correct choice..exiting"
        sys.exit()

output:

Code:

# ./test.py
Please enter a day(eg Mon): fri
Would you like to add a range(Y|N): y
Please enter starting hour eg 01,10: 01
Please enter ending hr eg 02,24: 23
102.27.136.47 1
28.60.227.169 2
234.234.234.3 1
3 lines match this
2 lines match this when containing identical ip address
Please enter a day(eg Mon): fri
Would you like to add a range(Y|N): y
Please enter starting hour eg 01,10: 02
Please enter ending hr eg 02,24: 23
28.60.227.169 2
234.234.234.3 1
2 lines match this
1 lines match this when containing identical ip address
Please enter a day(eg Mon):

ghostdog74

View Public Profile for ghostdog74

Find all posts by ghostdog74

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

awk - Counting number of similar lines

Hi All I have the input file OMAK_11. OMAK 000002EXCLUDE 1341 OMAK 000002EXCLUDE 1341 OMAK 000002EXCLUDE 1341 OMAK 000003EXCLUDE 1341 OMAK 000003EXCLUDE 1341 OMAK 000003EXCLUDE ...

2. Shell Programming and Scripting

Counting lines of code in a directory with awk

I've never toyed with awk, but it seems every time I present an elegant 2- to 8-line script, someone comes back with an awk 1-liner. I just came up with this to count all the lines of source code in a directory. How would I do it in awk? LINES=0 for n in $(wc -l *.cpp *.h | cut -b-7); do ...

3. Shell Programming and Scripting

counting lines containing two column field values with awk

Hello everybody, I'm trying to count the number of consecutive lines in a text file which have two distinctive column field values. These lines may appear in several line blocks within the file, but I only want a single block to be counted. This was my first approach to tackle the problem (I'm...

4. Shell Programming and Scripting

AWK: Pattern match between 2 files, then compare a field in file1 as > or < field in file2

First, thanks for the help in previous posts... couldn't have gotten where I am now without it! So here is what I have, I use AWK to match $1 and $2 as 1 string in file1 to $1 and $2 as 1 string in file2. Now I'm wondering if I can extend this AWK command to incorporate the following: If $1...

5. UNIX for Dummies Questions & Answers

awk display the match and 2 lines after the match is found.

Hello, can someone help me how to find a word and 2 lines after it and then send the output to another file. For example, here is myfile1.txt. I want to search for "Error" and 2 lines below it and send it to myfile2.txt I tried with grep -A but it's not supported on my system. I tried with awk,...

6. Shell Programming and Scripting

counting lines that match pattern

I have a file of 1.3 millions lines. some are with the same word twice on the line, some line have two diffrent words. each line has two words, one in brackets. example: foo (foo) bar (bar) thae (awvd) beladf (vswvw) I am sure this can be done with one line of...

7. Shell Programming and Scripting

Counting lines in a file using awk

I want to count lines of a file using AWK (only) and not in the END part like this awk 'END{print FNR}' because I want to use it. Does anyone know of a way? Thanks a lot.

8. Shell Programming and Scripting

awk repeat one field at all lines and modify field repetitions

Hello experts I have a file with paragraphs begining with a keeping date and ending with "END": 20120301 num num John num num A keepnum1 num num kathrin num num A keepnum1 num num kathrin num num B keepnum2 num num Pete num num A keepnum1 num num Jacob num...

9. Shell Programming and Scripting

awk to match value to a field within +/- value

In the awk below I use $2 of filet to search filea for a match. If the values in $2 are exact match this works great. However, that is not always the case, so I need to perform the search using a range of + or - 2. That is if the value in filea $2 is within + or - 2 of filet $2 then it is matched....

10. Shell Programming and Scripting

awk to match field between two files and use conditions on match

I am trying to look for $2 of file1 (skipping the header) in $2 of file2 (skipping the header) and if they match and the value in $10 is > 30 and $11 is > 49, then print the line from file1 to a output file. If no match is foung the line is not printed. Both the input and output are tab-delimited....

LEARN ABOUT PHP

gmmktime

GMMKTIME(3)								 1							       GMMKTIME(3)

gmmktime - Get Unix timestamp for a GMT date

SYNOPSIS

       int  gmmktime  ([int   $hour  = gmdate("H")], [int  $minute = gmdate("i")], [int  $second = gmdate("s")], [int  $month = gmdate("n")], [int
       $day = gmdate("j")], [int  $year = gmdate("Y")], [int  $is_dst = -1])

DESCRIPTION

	Identical to mktime(3) except the passed parameters represents a GMT date. gmmktime(3) internally uses mktime(3) so only  times  valid	in
       derived local time can be used.

	Like  mktime(3),  arguments may be left out in order from right to left, with any omitted arguments being set to the current corresponding
       GMT value.

PARAMETERS

	      o $hour
		- The number of the hour relative to the start of the day determined by $month, $day and $year. Negative values reference the hour
		before midnight of the day in question. Values greater than 23 reference the appropriate hour in the following day(s).

	      o $minute
		-  The	number of the minute relative to the start of the $hour. Negative values reference the minute in the previous hour. Values
		greater than 59 reference the appropriate minute in the following hour(s).

	      o $second
		- The number of seconds relative to the start of the $minute. Negative values reference the second in the previous minute.  Values
		greater than 59 reference the appropriate second in the following minute(s).

	      o $month
		-  The	number	of  the month relative to the end of the previous year. Values 1 to 12 reference the normal calendar months of the
		year in question. Values less than 1 (including negative values) reference the months in the previous year in reverse order, so  0
		is December, -1 is November, etc. Values greater than 12 reference the appropriate month in the following year(s).

	      o $day
		-  The number of the day relative to the end of the previous month. Values 1 to 28, 29, 30 or 31 (depending upon the month) refer-
		ence the normal days in the relevant month. Values less than 1 (including negative values) reference  the  days  in  the  previous
		month,	so  0 is the last day of the previous month, -1 is the day before that, etc. Values greater than the number of days in the
		relevant month reference the appropriate day in the following month(s).

	      o $year
		- The year

	      o $is_dst
		- Parameters always represent a GMT date so $is_dst doesn't influence the result.

	      Note

		      This parameter has been removed in PHP 7.0.0.

RETURN VALUES

	Returns a integer Unix timestamp.

CHANGELOG

       +--------+---------------------------------------------------+
       |Version |						    |
       |	|						    |
       |	|		     Description		    |
       |	|						    |
       +--------+---------------------------------------------------+
       | 7.0.0	|						    |
       |	|						    |
       |	|	 $is_dst parameter has been removed.	    |
       |	|						    |
       | 5.1.0	|						    |
       |	|						    |
       |	|  As of PHP 5.1.0, the  $is_dst  parameter  became |
       |	| deprecated.  As  a  result, the new timezone han- |
       |	| dling features should be used instead.	    |
       |	|						    |
       +--------+---------------------------------------------------+
EXAMPLES

       Example #1

	      gmmktime(3) basic example

	      <?php
	      // Prints: July 1, 2000 is on a Saturday
	      echo "July 1, 2000 is on a " . date("l", gmmktime(0, 0, 0, 7, 1, 2000));
	      ?>

SEE ALSO

       mktime(3), date(3), time(3).

PHP Documentation Group 													       GMMKTIME(3)