Visit Our UNIX and Linux User Community


Need tune my command occupying 90% CPU


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Need tune my command occupying 90% CPU
# 8  
Old 01-06-2010
Quote:
Originally Posted by senthil.ak
Can some body tune the below command, its occupyinh more than 90% of CPU some times.
What OS are you running ?
Is the log file stored locally ?
On what filesystem type ?
Can you post a trace.log content sample ?
How long does the script takes in average ?
I would expect it to take at much in the 50 to 500 ms range so I'm surprised you wrote it takes 90% CPU.
# 9  
Old 01-06-2010
don't know how much faster this will be, but this is what everyone's talking about:

Code:
tail -1000 /logs/trace.log |

awk '{

if ( OOM == 0 ){
  if ( $0 ~ /OutOfMemoryException/){ OOM = 1;}
  }

if ( SCE == 0 ){
  if ($0 ~ /StaleConnectionException/){ ScE = 1;}
  }

if ( NaE == 0 ){
  if ($0 ~ /NamingException/){ NaE = 1;}
  }

if (Jms == 0 ){
  if ($0 ~ /JmsTimeOutException/){ Jms = 1;}
  }

}
END{printf " %-7s%-7s%-7s%-7s\n",OOM,ScE,NaE,Jms;}'


( tail -n didn't work on my sun system )
# 10  
Old 01-07-2010
Thanks to Both....


Answering the jlliagre Question

What OS are you running ? Linux 2.4.9-e.72enterprise
Is the log file stored locally ? yes
On what filesystem type ? vxfs
How long does the script takes in average ? less than min but some time it take more than half an hour.

I'm following a wrong logic in the script so this is taking more time. My correct logic is "In last 1000 line finding any exceptio, If found exit from counting and make the counter equal to 1 otherwise leave it zero."

quirkasaurus --> i'll try this one and let you know about the timings. anyway thank you.

Senthil.
# 11  
Old 01-07-2010
Quote:
Originally Posted by senthil.ak
How long does the script takes in average ? less than min but some time it take more than half an hour.
Huh !
You are investigating the wrong part of your script. As I wrote, the awk processing itself should take far less than one second so the problem is elsewhere.
# 12  
Old 01-07-2010
Your original script looks fine and should take sub seconds to finish. I do not think you need to change anything. I agree with jlliagre that the problem must lie somewhere else.
# 13  
Old 01-07-2010
But on that day ... in the CPU alarm show this awk script is taking more CPU... so i stopped.

My problem is i am searching all 1000 lines even i got the exception in first line. I need to have a exit logic where the script will exist for the first occurance.

CPU problem may be related to script or may nto be... but we can tune the logic. So i need help on that
# 14  
Old 01-07-2010
I'm afraid you are missing the point. Tuning the logic might save some milliseconds but won't help fixing the real issue.

Can you tell more about the script. What other commands are run beyond the awk part you posted ?
What is that CPU alarm you are referring to ?
Did you try tracing the script to see where time is actually spent ?
 

Previous Thread | Next Thread
Test Your Knowledge in Computers #163
Difficulty: Easy
MINIX was first released in 1987, with the complete source code available to universities for study in courses and research.
True or False?

8 More Discussions You Might Find Interesting

1. Red Hat

Files not getting deleted with rm & occupying space in filesystem

Hello, OS version is Red Hat Enterprise Linux Server release 6.5 (Santiago). In one of the filesystem some old files post clone are not getting removed even with 'rm' # ls -ltr | grep meagpd_62.dbf -rw-rw---- 1 oracle oinstall 34358697984 Sep 1 08:46 meagpd_62.dbf # rm... (7 Replies)
Discussion started by: saharookiedba
7 Replies

2. Shell Programming and Scripting

Tune my script

Hi ! My script read out data out of 144 files per day - every ten minutes a file with data. data-file WR030B 306.71 0 WR050B 315.13 0 WR120B 308.34 0 WV030B 3.52 0 WV050B 5.06 0 WV120B 6.65 0 TLUFT02B 8.60... (3 Replies)
Discussion started by: IMPe
3 Replies

3. Programming

SQL : Fine tune Insert by query

i would like to know how can i fine tune the following query since the cost of the query is too high .. insert into temp temp_1 select a,b,c,d from xxxx .. database used is IDS.. (1 Reply)
Discussion started by: expert
1 Replies

4. Shell Programming and Scripting

Command to find the Memory and CPU utilization using 'top' command

Hi all, I found like top command could be used to find the Memory and CPU utilization. But i want to know how to find the Memory and CPU utilization for a particular user using top command. Thanks in advance. Thanks, Ananthi.U (2 Replies)
Discussion started by: ananthi_ku
2 Replies

5. Solaris

Please tune my script for Solaris

I have very big log file around 2-3 GB in that it contians 24 hours log data. My work is extract only 5-5 data and count the patterns from them. I worte a script in linux and we're using that. sed -n "/2009 05:/,/2009 17:/p" trace.log | grep -f patterns.txt > temp.log while read string ;do... (5 Replies)
Discussion started by: senthil.ak
5 Replies

6. Shell Programming and Scripting

Tune my query

I have a requirement to separate only some numbers from the input file and produce it in a format. The input is ( i have took a sample, the actual file contains more than 50000 rows around 840 MB in size) $cat temp.txt 001 08 002 08 003 06 004 11 005 11 006 08 007 08 008 92* 009 92 010... (1 Reply)
Discussion started by: senthil.ak
1 Replies

7. UNIX for Dummies Questions & Answers

Tune my logic of script

I have big log file, which contains the netstat output from my application server to a particular DB server. I aim is to plot a daily graph for this. Please find the sample log file below. @ - ........................................................... @ - Total number of connection to the ... (3 Replies)
Discussion started by: senthilkumar_ak
3 Replies

8. Programming

Application occupying CPU resources

Dear all, I have a pro c application running in the unix environement. This pro c program actually trigger by a java application from sun workstation. Recently, when we released a new proc c application and notice that the application occupying the CPU resources even through we check that the... (1 Reply)
Discussion started by: ghho
1 Replies

Featured Tech Videos