Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: command utilizing high CPU
Top Forums Shell Programming and Scripting command utilizing high CPU Post 73968 by reborg on Tuesday 7th of June 2005 01:06:08 AM
Old 06-07-2005
Well, for a start get rid of all the seds and the egrep, since they are only changing the field seperators and searching, both of which can be done by awk, and it is writing everythig to the same ouput file.

That yields this...

Code:
tail -f $DIR3$DATE4.log |\
          while read line
          do echo $line |awk -F"[, ] '/Processing incoming SMS message/{print $2 ;print $1, $2, $6, $7, $8}' >> $DIR2/DATA1.$DATE4.log  && \
echo $line | awk -F"[ ,_]" '/Send_Deliver_Ack: - end/{print $1, $2, $6, $7}' >> $DIR2/DATA1.$DATE4.log && \
echo $line | awk -F"[ ,_]" '/Get_SMS_Data_From_Process_Block: Start/ {print $1, $2, $6, $11}' >> $DIR2/DATA1.$DATE4.log && \
echo $line | awk -F"[ ,]" '/end completed successfully/{print $1, $2, $8, $9}' >> $DIR2/DATA1.$DATE4.log

          done &
}

Now it becomes clear that all the processing can be done with awk, but there are still unecessary external calls, Which of course leads to the obvious conclusion that the wrong tools were being used, this should have been an awk script from the start.

like this:
Code:
#!/usr/bin/awk -f
#
# filter.awk
#
BEGIN {FS = "[ ,_]"; }


/Processing incoming SMS message/ {
  print $2;
  print $1, $2, $6, $7, $8;
}

/Send_Deliver_Ack: - end/ {
  print $1, $2, $6, $7;
}

/Get_SMS_Data_From_Process_Block: Start/ {
  print $1, $2, $6, $11;
}

/end completed successfully/ {
  print $1, $2, $8, $9;
}

and the command then becomes:
tail -f $DIR3$DATE4.log | filter.awk > DATA1.$DATE4.log
Last edited by reborg; 06-07-2005 at 02:52 AM..
 

10 More Discussions You Might Find Interesting

1. AIX

High CPU utilization

Hi am facing high cpu utilization on my sybase server. I have P550 Number Of Processors: 4 Processor Clock Speed: 1656 MHz CPU Type: 64-bit Kernel Type: 32-bit LPAR Info: 1 65-D837E Memory Size: 7840 MB in topas it shows Name PID CPU% PgSp Owner dataserv 565264 ... (1 Reply)
Discussion started by: vjm
1 Replies

2. UNIX for Advanced & Expert Users

high cpu utilization

good morning. just wanted to ask if there's a way to check what causes the high cpu utilization of a server for the past 2 months? My jffnms report resulted to high utilization for a specific server last month. is there a way to check via a command line? thanks (9 Replies)
Discussion started by: lhareigh890
9 Replies

3. UNIX for Dummies Questions & Answers

Unknown process utilizing CPU.

Hi i recently observed my cpu being used 100% due to which load average on machine get increased to < 5. I have no idea what the process is? Appreciate any help in this regard. root 15859 99.9 0.0 5668 1592 pts/4 R+ 12:28 660:06 \_ pvs root 7334 99.9 ... (2 Replies)
Discussion started by: pinga123
2 Replies

4. Red Hat

apache high cpu load on high traffic

i have a Intel Quad Core Xeon X3440 (4 x 2.53GHz, 8MB Cache, Hyper Threaded) with 16gig and 1tb harddrive with a 1gb port and my apache is causing my cpu to go up to 100% on all four cores heres my http.config <IfModule prefork.c> StartServers 10 MinSpareServers 10 MaxSpareServers 15... (4 Replies)
Discussion started by: awww
4 Replies

5. Shell Programming and Scripting

what would a script include to find CPU's %system time high and user time high?

Hi , I am trying to :wall: my head while scripting ..I am really new to this stuff , never did it before :( . how to find cpu's system high time and user time high in a script?? thanks , help would be appreciated ! :) (9 Replies)
Discussion started by: sushwey
9 Replies

6. Red Hat

High CPU Utilization

Hi Experts, I need to understand few basic things regarding top command result from one of the node i have collected: Cpu0 : 4.6%us, 2.0%sy, 0.0%ni, 91.4%id, 1.3%wa, 0.3%hi, 0.3%si, 0.0%st Cpu1 : 0.0%us, 0.3%sy, 0.0%ni, 99.7%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st Cpu2 : ... (5 Replies)
Discussion started by: mackjack87
5 Replies

7. Homework & Coursework Questions

Utilizing the Make Command

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: Compile cpp2html.c to produce cpp2html.o. ( Important: the source code in these files is C, not C++, and so... (8 Replies)
Discussion started by: lamentofking
8 Replies

8. Homework & Coursework Questions

Utilizing the Make Command

Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted! 1. The problem statement, all variables and given/known data: ]Compile cpp2html.c to produce cpp2html.o. ( Important: the source code in these files is C, not C++, and so... (1 Reply)
Discussion started by: bgnaranjo1
1 Replies

9. Red Hat

CPU is high

Hi , We found CPU is high due to python process .Is this something that Oracle team should look on or Unix team has to work on it ?Could you please advise use of python process ? top - 12:03:03 up 43 days, 15:11, 5 users, load average: 1.53, 1.33, 1.23 Tasks: 126 total, 3 running, 123... (12 Replies)
Discussion started by: Maddy123
12 Replies

10. HP-UX

NFSd command utilizing more cpu

Hi, I see following 'nfsd' command is using more CPU. Could someone please comment on it's pros and cons of it? CPU TTY PID USERNAME PRI NI SIZE RES STATE TIME %WCPU %CPU COMMAND 5 ? 16890 root 152 20 34696K 12036K run 57166:48 856.13 854.64 nfsd OS -- HP-UX One... (4 Replies)
Discussion started by: Maddy123
4 Replies

LEARN ABOUT DEBIAN

procmeter3-log

PROCMETER3-LOG(1)					      General Commands Manual						 PROCMETER3-LOG(1)

NAME

       procmeter3-log - A system monitoring / logging program.

SYNOPSIS

       procmeter3-log [-h|--help] [--rc=<filename>] [--...]  [...]

DESCRIPTION

       ProcMeter  Displays one or more pieces of information about the operating system and other resources.  Most of the information that is dis-
       played comes from the /proc filesystem.	The program is modular and very configurable.

OPTIONS

       The command line options are described below.

       -h     Provides a help message listing the available outputs.  This will be different for different computers depending on the Linux kernel
	      version that is being used and the hardware/software that is configured.

       --rc=<filename>
	      Load the specified .procmeterrc file in stead of the searching in the usual places.

       --...  A  list  of  configuration file options that will override the values in the .procmeterrc file.  The format of these options is (for
	      example) --library.path=/usr/local/procmeter3 which is equivalent to the entry in the .procmeterrc file of

	       [library]
	       path = /usr/local/procmeter3

	      All spaces around the equal sign must be removed and if spaces are required in the value on the right hand side then quotes must	be
	      used around the entire command line option.

       ...    A  list  of  names of outputs that are to be displayed.  This can include any of the outputs that are available (see the -h option).
	      For the CPU usage is in a module named Statistics with an output named CPU and there are graph (-g), text (-t) and bar (-b) options.
	      Since this version of the program does not display anything, but logs the data to a file it does not matter which one is chosen.	To
	      store the CPU usage data you would use the command line option Statistics.CPU-t

USAGE

       When started the program will log all of the requested information on the standard output (stdout).  The outputs  that  are  displayed  are
       those from the command line and those from the .procmeterrc configuration file.

MODULES

       The modules that are available for procmeter3-log are described in the procmeter3_modules(1) manual page.

SEE ALSO

       procmeterrc(5) procmeter3_modules(1)

AUTHOR

       Andrew M. Bishop 1998-2007

								   July 3, 2010 						 PROCMETER3-LOG(1)
All times are GMT -4. The time now is 01:03 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy