How to grep on unique id which has request and response on different lines? Post: 302822361

Sponsored Content

Top Forums Shell Programming and Scripting How to grep on unique id which has request and response on different lines? Post 302822361 by Jotne on Tuesday 18th of June 2013 01:53:21 AM

06-18-2013

Registered User

This should do it, may for sure be shorten some.

Code:

awk -F "[;& ]" '
	/begin request/ {st[$13]=$1 " " $2} 
	/complete reponse/ {en[$13]=$1 " " $2} 
	END {
	for (i in st) {
		split(st[i],s1,"[- :,]")
		s2=s1[1] " " s1[2] " " s1[3] " " s1[4] " " s1[5] " " s1[6] " "
		s3=mktime(s2)
		split(en[i],e1,"[- :,]")
		e2=e1[1] " " e1[2] " " e1[3] " " e1[4] " " e1[5] " " e1[6] " "
		e3=mktime(e2)
		d=(e3*1000+e1[7])-(s3*1000-s1[7])
		print i,d }
	}' file

Code:

073104c-4e-4ce-bda-694344ee62 2706

Can you post your solution?

-F "[;& ]" sets how to split the line (filed separators)
/begin request/ {st[$13]=$1 " " $2} create an array and uses field 13 as index (UDI) and store time into it.
eks: st[073104c-4e-4ce-bda-694344ee62]="2013-04-03 10:51:01,808"

---------- Post updated 18-06-13 at 07:53 ---------- Previous update was 17-06-13 at 17:31 ----------

Cleaned code some

Code:

awk -F "[;& ]" '
	/begin request/ {st[$13]=$1 " " $2} 
	/complete reponse/ {en[$13]=$1 " " $2} 
	END {
	for (i in st) {
		split(st[i],s,"[- :,]")
		start=mktime(s[1] " " s[2] " " s[3] " " s[4] " " s[5] " " s[6])

		split(en[i],e,"[- :,]")
		end=mktime(e[1] " " e[2] " " e[3] " " e[4] " " e[5] " " e[6])

		diff=(end*1000+e[7])-(start*1000-s[7])
		print i,diff }
	}' file

Last edited by Jotne; 06-18-2013 at 02:55 AM.. Reason: Added missing {}

This User Gave Thanks to Jotne For This Post:

Jotne

View Public Profile for Jotne

Find all posts by Jotne

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

grep unique occurrences

Hi, How do i grep unique occurrences from a file. I have a log file with multiple occurrences of 'foo' for instance. When i do: grep foo, I get all the lines that contain foo. Is there any way to get only one line for foo? Example file: foo at 09.01am Fri 11 May 2007 foo at 09.13am...

2. Shell Programming and Scripting

grep for unique value

If i want to grep for a value in a file but display only unique value then which option can i use. ex: Values in the file IP <1.2.3.4> value <2> IP <1.2.3.4> value <2> IP <1.2.3.4> value <3> IP <1.2.3.5> value <1> i should get only the unique value

3. Shell Programming and Scripting

Remove All Lines Between Two Unique Lines

Hi all! Im wondering if its possible to remove all lines between two lines. Im working with a document like this: data1 data2 <Remove> data3 data4 </Remove> data5 data6 I need it to end up like this if that possible: data1 data2 data5 data6 There are multiple instances of...

4. UNIX for Dummies Questions & Answers

Grep Unique

Hello, I have a file with a list of car makes and specific information for each make. An example is: @Audi:Warranty @Audi:Pricing @Audi:Colors @Acura:Warranty @Acura:Pricing @Acura:Colors and so on through a bunch of makes. I need to make a list in a selection box of just one name of...

5. UNIX for Advanced & Expert Users

In a huge file, Delete duplicate lines leaving unique lines

Hi All, I have a very huge file (4GB) which has duplicate lines. I want to delete duplicate lines leaving unique lines. Sort, uniq, awk '!x++' are not working as its running out of buffer space. I dont know if this works : I want to read each line of the File in a For Loop, and want to...

6. Shell Programming and Scripting

[Request] Copying a file with cp except for the last one or two lines.

Hi folks! I'm new to the unix-side of the world! ;) and I'm trying to learn as much as possible the good stuff that's in it! So.. here comes the point.. as you can see in the title, I need to copy a file but truncating it so that last 1-2 lines are not copied... any suggests from the...

7. Shell Programming and Scripting

Transpose lines from individual blocks to unique lines

Hello to all, happy new year 2013! May somebody could help me, is about a very similar problem to the problem I've posted here where the member rdrtx1 and bipinajith helped me a lot. https://www.unix.com/shell-programming-scripting/211147-map-values-blocks-single-line-2.html It is very...

8. Shell Programming and Scripting

Regular expression for XML request and response

Hi Gents, I am having a xml request, I need to match the entire paragraph in unix regex. Can some one please provide me the regex for unix. I need to embed this in a shell script. Below is the XML. I am bit weak in regular expression. Regex *testameykamble* here testameykamble is my key...

9. UNIX for Dummies Questions & Answers

Print unique lines without sort or unique

I would like to print unique lines without sort or unique. Unfortunately the server I am working on does not have sort or unique. I have not been able to contact the administrator of the server to ask him to add it for several weeks.

LEARN ABOUT MINIX

grep

GREP(1) 						      General Commands Manual							   GREP(1)

NAME

       grep - search a file for lines containing a given pattern

SYNOPSIS

       grep [-elnsv] pattern [file] ...

OPTIONS

       -e     -e pattern is the same as pattern

       -c     Print a count of lines matched

       -i     Ignore case

       -l     Print file names, no lines

       -n     Print line numbers

       -s     Status only, no printed output

       -v     Select lines that do not match

EXAMPLES

       grep mouse file	   # Find lines in file containing mouse

       grep [0-9] file	   # Print lines containing a digit

DESCRIPTION

       Grep  searches  one  or	more  files (by default, stdin) and selects out all the lines that match the pattern.  All the regular expressions
       accepted by ed and mined are allowed.  In addition, + can be used instead of * to mean 1 or more occurrences, ? can be used to mean 0 or  1
       occurrences,  and  |  can  be used between two regular expressions to mean either one of them.  Parentheses can be used for grouping.  If a
       match is found, exit status 0 is returned.  If no match is found, exit status 1 is returned.  If an error is detected,  exit  status  2	is
       returned.

SEE ALSO

       cgrep(1), fgrep(1), sed(1), awk(9).

																	   GREP(1)

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

grep unique occurrences

Discussion started by: mz043

2. Shell Programming and Scripting

grep for unique value

Discussion started by: vls1210

3. Shell Programming and Scripting

Remove All Lines Between Two Unique Lines

Discussion started by: Grizzly

4. UNIX for Dummies Questions & Answers

Grep Unique

Discussion started by: macbb1117

5. UNIX for Advanced & Expert Users

In a huge file, Delete duplicate lines leaving unique lines

Discussion started by: krishnix

6. Shell Programming and Scripting

[Request] Copying a file with cp except for the last one or two lines.

Discussion started by: WideMind

7. Shell Programming and Scripting

Transpose lines from individual blocks to unique lines

Discussion started by: Ophiuchus

8. Shell Programming and Scripting

Regular expression for XML request and response

Discussion started by: ameyrk

9. UNIX for Dummies Questions & Answers

Print unique lines without sort or unique

Discussion started by: cokedude

LEARN ABOUT MINIX

grep