Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to grep on unique id which has request and response on different lines?
Top Forums Shell Programming and Scripting How to grep on unique id which has request and response on different lines? Post 302822361 by Jotne on Tuesday 18th of June 2013 01:53:21 AM
Old 06-18-2013
This should do it, may for sure be shorten some.
Code:
awk -F "[;& ]" '
	/begin request/ {st[$13]=$1 " " $2} 
	/complete reponse/ {en[$13]=$1 " " $2} 
	END {
	for (i in st) {
		split(st[i],s1,"[- :,]")
		s2=s1[1] " " s1[2] " " s1[3] " " s1[4] " " s1[5] " " s1[6] " "
		s3=mktime(s2)
		split(en[i],e1,"[- :,]")
		e2=e1[1] " " e1[2] " " e1[3] " " e1[4] " " e1[5] " " e1[6] " "
		e3=mktime(e2)
		d=(e3*1000+e1[7])-(s3*1000-s1[7])
		print i,d }
	}' file

Code:
073104c-4e-4ce-bda-694344ee62 2706

Can you post your solution?

-F "[;& ]" sets how to split the line (filed separators)
/begin request/ {st[$13]=$1 " " $2} create an array and uses field 13 as index (UDI) and store time into it.
eks: st[073104c-4e-4ce-bda-694344ee62]="2013-04-03 10:51:01,808"

---------- Post updated 18-06-13 at 07:53 ---------- Previous update was 17-06-13 at 17:31 ----------

Cleaned code some
Code:
awk -F "[;& ]" '
	/begin request/ {st[$13]=$1 " " $2} 
	/complete reponse/ {en[$13]=$1 " " $2} 
	END {
	for (i in st) {
		split(st[i],s,"[- :,]")
		start=mktime(s[1] " " s[2] " " s[3] " " s[4] " " s[5] " " s[6])

		split(en[i],e,"[- :,]")
		end=mktime(e[1] " " e[2] " " e[3] " " e[4] " " e[5] " " e[6])

		diff=(end*1000+e[7])-(start*1000-s[7])
		print i,diff }
	}' file

Last edited by Jotne; 06-18-2013 at 02:55 AM.. Reason: Added missing {}
This User Gave Thanks to Jotne For This Post:
random_thoughts
 

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

grep unique occurrences

Hi, How do i grep unique occurrences from a file. I have a log file with multiple occurrences of 'foo' for instance. When i do: grep foo, I get all the lines that contain foo. Is there any way to get only one line for foo? Example file: foo at 09.01am Fri 11 May 2007 foo at 09.13am... (6 Replies)
Discussion started by: mz043
6 Replies

2. Shell Programming and Scripting

grep for unique value

If i want to grep for a value in a file but display only unique value then which option can i use. ex: Values in the file IP <1.2.3.4> value <2> IP <1.2.3.4> value <2> IP <1.2.3.4> value <3> IP <1.2.3.5> value <1> i should get only the unique value (3 Replies)
Discussion started by: vls1210
3 Replies

3. Shell Programming and Scripting

Remove All Lines Between Two Unique Lines

Hi all! Im wondering if its possible to remove all lines between two lines. Im working with a document like this: data1 data2 <Remove> data3 data4 </Remove> data5 data6 I need it to end up like this if that possible: data1 data2 data5 data6 There are multiple instances of... (2 Replies)
Discussion started by: Grizzly
2 Replies

4. UNIX for Dummies Questions & Answers

Grep Unique

Hello, I have a file with a list of car makes and specific information for each make. An example is: @Audi:Warranty @Audi:Pricing @Audi:Colors @Acura:Warranty @Acura:Pricing @Acura:Colors and so on through a bunch of makes. I need to make a list in a selection box of just one name of... (4 Replies)
Discussion started by: macbb1117
4 Replies

5. UNIX for Advanced & Expert Users

In a huge file, Delete duplicate lines leaving unique lines

Hi All, I have a very huge file (4GB) which has duplicate lines. I want to delete duplicate lines leaving unique lines. Sort, uniq, awk '!x++' are not working as its running out of buffer space. I dont know if this works : I want to read each line of the File in a For Loop, and want to... (16 Replies)
Discussion started by: krishnix
16 Replies

6. Shell Programming and Scripting

[Request] Copying a file with cp except for the last one or two lines.

Hi folks! I'm new to the unix-side of the world! ;) and I'm trying to learn as much as possible the good stuff that's in it! So.. here comes the point.. as you can see in the title, I need to copy a file but truncating it so that last 1-2 lines are not copied... any suggests from the... (6 Replies)
Discussion started by: WideMind
6 Replies

7. Shell Programming and Scripting

Transpose lines from individual blocks to unique lines

Hello to all, happy new year 2013! May somebody could help me, is about a very similar problem to the problem I've posted here where the member rdrtx1 and bipinajith helped me a lot. https://www.unix.com/shell-programming-scripting/211147-map-values-blocks-single-line-2.html It is very... (3 Replies)
Discussion started by: Ophiuchus
3 Replies

8. Shell Programming and Scripting

Regular expression for XML request and response

Hi Gents, I am having a xml request, I need to match the entire paragraph in unix regex. Can some one please provide me the regex for unix. I need to embed this in a shell script. Below is the XML. I am bit weak in regular expression. Regex *testameykamble* here testameykamble is my key... (8 Replies)
Discussion started by: ameyrk
8 Replies

9. UNIX for Dummies Questions & Answers

Print unique lines without sort or unique

I would like to print unique lines without sort or unique. Unfortunately the server I am working on does not have sort or unique. I have not been able to contact the administrator of the server to ask him to add it for several weeks. (7 Replies)
Discussion started by: cokedude
7 Replies

LEARN ABOUT OPENSOLARIS

grablogs.conf

grablogs.conf(4)						   File Formats 						  grablogs.conf(4)

NAME

       grablogs.conf - grablogs configuration for libgrablogs.so of the plugins of
	gnome-system-log file

SYNOPSIS

       /usr/lib/gnome-system-log/plugins/grablogs.conf

DESCRIPTION

       The  libgrablogs.so  is	a plugin for gnome-system-log(1), it colloct the log files from the system as many as possible. grablogs.conf is a
       configuration file that contains a set of lines mixed with sh(1) syntax codes and individual
	log files. libgrablogs.so will read the file try to get a log files list for
	gnome-system-log(1). Users can copy the file into $HOME/.gnome2/gnome-system-log/plugins/`uname -p` to overwrite the system default one.

       The grablogs.conf file contains the following configuration categories:

	      [configs]
		     Each line under this category is interpreted as a config file of System. The plugin will open the config file and try to find
		     all system paths of the logs.

	      [commands]
		     Each line under this category is interpreted as a shell command and will be execute through a pipe. And each line of the out-
		     put of the command will be interpreted as a log path.

	      [logs] Each line under this category is interpreted as a log path.

FILES

       /usr/lib/gnome-system-log/plugins/grablogs.conf
	      The system default configuration file for the plugin libgrablogs.so

       $HOME/.gnome2/gnome-system-log/plugins/`uname -p`/grablogs.conf
	      The user specific configuration file for the plugin libgrablogs.so

EMAMPLE

       [configs]
       /etc/syslog.conf
       [commands]
       for i in `svcs -aH -o FMRI | grep -v lrc `; do svcprop -p restarter/logfile $i  2>/dev/null  ||	svcprop  -q  -p  restarter/alt_logfile	$i
       2>/dev/null ; done
       [logs]
       /var/log/messages
       /var/log/secure
       /var/log/maillog
       /var/log/cron
       /var/log/Xorg.0.log
       /var/log/XFree86.0.log
       /var/log/auth.log
       /var/log/cups/error_log

SEE ALSO

       gnome-system-log(1), pipelog.conf(1)

gnome-utils 2.16.0						    13 Oct 2006 						  grablogs.conf(4)
All times are GMT -4. The time now is 02:50 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy