Reverse lookup and sum also


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Reverse lookup and sum also
# 1  
Old 02-13-2011
Reverse lookup and sum also

Hi,
I have log file name that shows the view name and some SQL statement time
stamp. I want to summarize the SQL time with view. Here is the simple example

Here the seqence is first it prints EventContext and all the SQL statement time and again EventContext. Want to summarize the time for each EventContext.

some junk rows
Quote:
EventContext ABS Sales Order Screen Homepage View
SQL Statement Prepare Time for SQL Cursor with ID D118080: 0.001 seconds
SQL Statement Execute Time for SQL Cursor with ID D118080: 0.004 seconds
SQL Statement Initial Fetch Time for SQL Cursor with ID D118080: 0.001 seconds
EventContext ABS Sales Order List View
SQL Statement Prepare Time for SQL Cursor with ID 101AD370: 0.001 seconds
SQL Statement Execute Time for SQL Cursor with ID 101AD370: 0.004 seconds
SQL Statement Initial Fetch Time for SQL Cursor with ID 101AD370: 0.000
So output should be
Quote:
EventContext ABS Sales Order Screen Homepage View [Took 0.006 ]
EventContext ABS Sales Order List View [Took 0.005 ]
Basically look for all "SQL Statement" time(after : and before word seconds) and add them until you do not get the word EventContext.

As per my understanding its complex. So thanks in advance if some one can help resolve the problem
# 2  
Old 02-13-2011
Code:
 awk '/EventContext ABS/ {x=$0}/SQL Statement/{a[x]+=$(NF-1)}END{for (i in a) print i,"[ Took "a[i]" ]"}' file
EventContext ABS Sales Order Screen Homepage View [ Took 0.006 ]
EventContext ABS Sales Order List View [ Took 0.005 ]

or if you want keep the output in order:

Code:
awk '/EventContext ABS/ {x+=1;a[x]=$0}/SQL Statement/{b[x]+=$(NF-1)}END{for (i=1;i<=x;i++) print a[i],"[ Took "b[i]" ]"}' file


Last edited by yinyuemi; 02-13-2011 at 04:01 AM..
# 3  
Old 02-13-2011
Or...

Code:
 
awk -F: '{$0 ~ /^Even/?sql=$0:gsub("seconds",x,$2);sum[sql]=sum[sql] + $2}END{
 for(i in sum) print i,"Took[ "sum[i]" ]"
}' infile

# 4  
Old 02-13-2011
Code:
awk '/^Event/{print (p?t FS "[ Took " s "]":X);s=0;p=1;t=$0;next}{s+=$(NF-1)}END{print t FS "[ Took " s "]" }' infile

# 5  
Old 02-13-2011
little more help

Thank you, Thank you, Thank you, Thank you very much all of you to look into the problem and give me some suggestions.
All the solutions are going to be very useful. To simplify the problem I made sample test data above. Since my test file is bit more complicated then that I might have to edit a bit to get working. But the statement below works fine for me at this point.

awk '/EventContext/ {x+=1;a[x]=$0}/SQL Statement/{b[x]+=$(NF-1)}END{for (i=1;i<=x;i++) print a[i],"[ Took "b[i]" ]"}' /tmp/t1

Is there possible to add two more things to this problem
1. Print the count of "SQL Statement Execute Time" for each 'EventContext"
2. Print the largest "SQL Statement" time in there.
3. At the End of Report print the count of "SQL Statement Execute Time"
4. At the End of Report print the Larget "SQL Statement" time in there.

So in my above sample data it should look like
EventContext ABS Sales Order Screen Homepage View [TOTAL SQL: 1 Took 0.006 MAX time SQL :0.004 ]
EventContext ABS Sales Order List View [TOTAL SQL : 1 Took 0.005 MAX time SQL : 0.004 ]
Summary ; Total SQL : 2 Took 0.008 Max time SQL : 0.004

Thanks
# 6  
Old 02-18-2011
Need little more help

Even if some one has solution for any of point 1,2,3,4 then will be great help.

Is there possible to add two more things to this problem
1. Print the count of "SQL Statement Execute Time" for each 'EventContext"
2. Print the largest "SQL Statement" time in there.
3. At the End of Report print the count of "SQL Statement Execute Time"
4. At the End of Report print the Larget "SQL Statement" time in there.

Sample data in the first post.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Red Hat

DNS reverse lookup issue

Hi guys. Ok so let me lay out my configs. I can do a NSlookup from client to server BUT NOT a reverse lookup. DNS server: Optimus.jaydomain.com IP : 192.168.1.50 DNS Client: Megatron.jaydomain.com IP : 192.168.1.60 On Sever: # cat /etc/named.conf // // named.conf // // Provided... (4 Replies)
Discussion started by: Junaid Subhani
4 Replies

2. UNIX for Dummies Questions & Answers

Reverse lookup issue

I came back to my solaris 10 system after a week of being gone and xterm no longer work. I checked into it and the system doesn't reverse lookup my client system. There is a manual entry for my system in the /etc/hosts file and a forward lookup works fine, but I still can't get reverse lookup. Any... (0 Replies)
Discussion started by: clogan1981
0 Replies

3. UNIX for Advanced & Expert Users

[DNS] Reverse Lookup for 2 IP Addresses

Originally I had the server at home and on Comcast so I used dyndns.org for DNS. Once the server got a bit more popular, I leased a server at a colo facility. They set up the server name in their DNS so I didn't really have any reason to manage my own DNS. DynDNS was managing the domains and I... (7 Replies)
Discussion started by: BOFH
7 Replies

4. Shell Programming and Scripting

Reverse lookup

hey guys, can anybody help me out here on the following: grep '^\{1,3\}\.\{1,3\}\.\{1,3\}\.\{1,3\}$' ravi.txt mary.txt lisa.txt https://www.unix.com/images/misc/progress.gif i.e what i did was found ip addreses from different files and then i want... (1 Reply)
Discussion started by: ravis83
1 Replies

5. UNIX for Advanced & Expert Users

Clueless about how to lookup and reverse lookup IP addresses under a file!!.pls help

Write a quick shell snippet to find all of the IPV4 IP addresses in any and all of the files under /var/lib/output/*, ignoring whatever else may be in those files. Perform a reverse lookup on each, and format the output neatly, like "IP=192.168.0.1, ... (0 Replies)
Discussion started by: choco4202002
0 Replies

6. IP Networking

Reverse lookup

Help having problems accesing various sites that require me to be a registered .gov domain. My IP is a registered as an .gov but my nameserver record has changed on my DNS configurartion(I don't know why) from something.gov to somethingelse.gov. Same IP, though. When a reverse lookup is... (1 Reply)
Discussion started by: jpalmer320
1 Replies

7. UNIX for Dummies Questions & Answers

Unix 8.2 and reverse Lookup

We have Unix configured as our external DNS, forward DNS is working properly, however Reverse lookup is not working. Any idea what the problem is? I have checked the named.boot and .rev file and everything seems to be correctly. However it appears that the reverse zone file in the named.boot... (2 Replies)
Discussion started by: cassy
2 Replies

8. IP Networking

reverse lookup again

our server (solaris, bind v 8.1.2) is suppose to be the authoritive or the master and our isp's server is suppose be the secondary. i've created a reverse lookup zone file and added an entry for it in my named.conf file. i've restarted the dns daemon and i don't have any errors in... (1 Reply)
Discussion started by: Westy564
1 Replies

9. IP Networking

reverse lookup file problem

I'm trying to create a reverse lookup file. Below are the error messages I get in the messages file, when I start named. Below the error messages is a copy of the reverse lookup file I'm trying to use. I'm using Bind version 8.1.2. Would someone recommend the correct values and if you see any... (2 Replies)
Discussion started by: Westy564
2 Replies

10. IP Networking

reverse lookup for email

when we send email or try to telnet to a site that requires reverse lookup to be enabled the connection is refused. i have the O'Reilly book DNS and Bind and in it are examples of what the reverse zone file should look like. i don't see a line that defines an email server in the example. is... (1 Reply)
Discussion started by: Westy564
1 Replies
Login or Register to Ask a Question