Sponsored Content
Full Discussion: Make script faster
Top Forums Shell Programming and Scripting Make script faster Post 302584097 by rbatte1 on Thursday 22nd of December 2011 06:40:35 AM
Old 12-22-2011
You spend lots of time looping round and demanding in cut again & again. Each time, you start a new process so the system spends effort there. The awk answer is probably the way to go if you are comfortable, however you can simplify you script by using the read statement better:-
Code:
cat $line | while read first second third rest; do  ## Reads each line into separate variables
   if [ "$third" == "27" ]; then  // ## If column == "27" prints column 2. 
        echo $second; 
   fi; 
done;

I did an "Ask Jeeves" search with +bash +read specified and got quite a few examples.

As for the time command, have a read of the man page. The main figure though is real as this will be the elapsed time you will experience.


I hope that this helps.



Robin
Liverpool/Blackburn
UK

Last edited by rbatte1; 12-22-2011 at 07:42 AM.. Reason: Added comments about the time command
These 2 Users Gave Thanks to rbatte1 For This Post:
 

10 More Discussions You Might Find Interesting

1. Solaris

looking for different debugger for Solaris or to make sunstudio faster

im using the sunstudio but it is very slow , is there ant other GUI debugger for sun Solaris or at list some ways to make it faster ? im using to debug throw telnet connection connected to remote server thanks (0 Replies)
Discussion started by: umen
0 Replies

2. Shell Programming and Scripting

Can anyone make this script run faster?

One of our servers runs Solaris 8 and does not have "ls -lh" as a valid command. I wrote the following script to make the ls output easier to read and emulate "ls -lh" functionality. The script works, but it is slow when executed on a directory that contains a large number of files. Can anyone make... (10 Replies)
Discussion started by: shew01
10 Replies

3. Shell Programming and Scripting

awk help to make my work faster

hii everyone , i have a file in which i have line numbers.. file name is file1.txt aa bb cc "12" qw xx yy zz "23" we bb qw we "123249" jh here 12,23,123249. is the line number now according to this line numbers we have to print lines from other file named... (11 Replies)
Discussion started by: kumar_amit
11 Replies

4. Red Hat

Re:How to make the linux pc faster

Hi, Can any one help me out in solving the problem i have a linux database server it is tooo slow that i am unable to open even the terminial is there any solution to get rid of this problem.How to make this server faster. Thanks & Regards Venky (0 Replies)
Discussion started by: venky_vemuri
0 Replies

5. Shell Programming and Scripting

How to make copy work faster

I am trying to copy a folder which contains a list of C executables. It takes 2 mins for completion,where as the entire script takes only 3 more minutes for other process. Is there a way to copy the folder faster so that the performance of the script will improve? (2 Replies)
Discussion started by: prasperl
2 Replies

6. Shell Programming and Scripting

Running rename command on large files and make it faster

Hi All, I have some 80,000 files in a directory which I need to rename. Below is the command which I am currently running and it seems, it is taking fore ever to run this command. This command seems too slow. Is there any way to speed up the command. I have have GNU Parallel installed on my... (6 Replies)
Discussion started by: shoaibjameel123
6 Replies

7. Shell Programming and Scripting

awk changes to make it faster

I have script like below, who is picking number from one file and and searching in another file, and printing output. Bu is is very slow to be run on huge file.can we modify it with awk #! /bin/ksh while read line1 do echo "$line1" a=`echo $line1` if then echo "$num" cat file1|nawk... (6 Replies)
Discussion started by: mirwasim
6 Replies

8. Shell Programming and Scripting

How to make awk command faster?

I have the below command which is referring a large file and it is taking 3 hours to run. Can something be done to make this command faster. awk -F ',' '{OFS=","}{ if ($13 == "9999") print $1,$2,$3,$4,$5,$6,$7,$8,$9,$10,$11,$12 }' ${NLAP_TEMP}/hist1.out|sort -T ${NLAP_TEMP} |uniq>... (13 Replies)
Discussion started by: Peu Mukherjee
13 Replies

9. Shell Programming and Scripting

How to make awk command faster for large amount of data?

I have nginx web server logs with all requests that were made and I'm filtering them by date and time. Each line has the following structure: 127.0.0.1 - xyz.com GET 123.ts HTTP/1.1 (200) 0.000 s 3182 CoreMedia/1.0.0.15F79 (iPhone; U; CPU OS 11_4 like Mac OS X; pt_br) These text files are... (21 Replies)
Discussion started by: brenoasrm
21 Replies

10. Shell Programming and Scripting

How to make faster loop in multiple directories?

Hello, I am under Ubuntu 18.04 Bionic. I have one shell script run.sh (which is out of my topic) to run files under multiple directories and one file to control all processes running under those directories (control.sh). I set a cronjob task to check each of them with two minutes of intervals.... (3 Replies)
Discussion started by: baris35
3 Replies
acctcom(8)						      System Manager's Manual							acctcom(8)

NAME
acctcom - Displays selected process accounting record summaries SYNOPSIS
/usr/bin/acctcom [-abfhikmqrtv] [-C seconds] [-e time] [-E time] [-g group] [-H factor] [-I number] [-l line] [select_flag -o file] [-n pattern] [-O seconds] [-s time] [-S time] [-u username] [file ...] FLAGS
Displays average statistics about the selected processes. Statistics are displayed at the end of the output records in the format var=# (for example, CMDS=439), where the value (#) is given to the nearest hundredth. The var specifies the following: Value Total number of commands listed in the specified file Average real time per process Average CPU time per process Average user CPU time per process Average system CPU time per process Average number of characters transferred Average number of blocks transferred Average CPU factor (average user time divided by total CPU time) Average hog factor (average CPU time divided by average elapsed time) Displays information about the most recently executed commands first. This flag has no effect when the acctcom command reads from the default input device or if more than one process accounting file is specified. The column heading format is the same as the default column heading format. Lists processes whose total CPU time (system time + user time) is greater than the value specified by seconds. The column heading format is the same as the default column heading format. Displays information only about processes that start at or before the specified time, which is specified as hh[:mm[:ss]]. The column heading format is as follows: ACCOUNTING RECORDS FROM: day mon date hh:mm:ss yy START BEFORE: day mon date hh:mm:ss yy COMMAND START END REAL CPU MEAN NAME USER TTYNAME TIME TIME (SECS) (SECS) SIZE(K) Displays information only about processes that end at or before the specified time, which is specified as hh[:mm[:ss]]. If you specify the same time for both the -E and -S flags, the acctcom command displays processes that existed at the specified time. The column heading format is as follows: ACCOUNTING RECORDS FROM: day mon date hh:mm:ss yy END BEFORE : day mon date hh:mm:ss yy COMMAND START END REAL CPU MEAN NAME USER TTYNAME TIME TIME (SECS) (SECS) SIZE(K) Displays information about the fork/exec flag (used to execute another process) in the F column and the system exit value STAT, which can be zero (0) or an error code, in the STAT column in addition to the default column heading format. The column heading format is as follows: ACCOUNTING RECORDS FROM: day mon date hh:mm:ss yy COMMAND START END REAL CPU MEAN NAME USER TTYNAME TIME TIME (SECS) (SECS) SIZE(K) F STAT Displays only the processes that belong to the specified group. You may specify either the group ID or the group name. The column heading format is the same as the default column heading format. Displays the hog factor instead of the mean memory size. The hog factor is the CPU time used by the process divided by the real time. The output is the same as the default column format output except the MEAN SIZE(K) column heading is replaced by the .HOG FACTOR heading. The column heading format is as follows: ACCOUNTING RECORDS FROM: day mon date hh:mm:ss yy COMMAND START END REAL CPU HOG NAME USER TTYNAME TIME TIME (SECS) (SECS) FACTOR Displays information about processes that exceed the value specified by the hogfactor variable. The output format is the same as the default column heading format. Displays the number of characters and blocks transferred during read or write I/O operations. The output is similar to the default column heading format, except the CHARS TRANSFD column replaces the MEAN SIZE(K) column, and the BLOCKS READ column is added to the output. The column heading format is as follows: ACCOUNTING RECORDS FROM: day mon date hh:mm:ss yy COMMAND START END REAL CPU CHARS BLOCKS NAME USER TTYNAME TIME TIME (SECS) (SECS) TRANSFD READ Displays information about the processes that transfer more than the number of characters specified by the number variable. The output format is the same as the default column heading format. Displays the total number of K-core min- utes, which is the number of kilobytes of memory used by the process multiplied by the buffer time used. The output format is the same as the default column heading format, except the KCORE MIN column heading replaces the MEAN SIZE(K) column heading. The column heading format is as follows: ACCOUNTING RECORDS FROM: day mon date hh:mm:ss yy COMMAND START END REAL CPU KCORE NAME USER TTYNAME TIME TIME (SECS) (SECS) MIN Displays information about the processes that belong to the workstation whose tty line is specified by the line variable (for example, ttyp0). The heading format is the same as the default column heading format. Displays the median amount of process memory used. If you also specify the -h or -k flag, the -m flag is ignored. The output format is the same as the default column heading format. Displays information only about the processes whose names include the regular expression specified by the pattern variable. The output format is the same as the default column heading format. Copies selected process records to the specified filename. The select_flag variable specifies the following process selection flags: -C, -e, -E, -g, -H, -I, -l, -n, -O, -s, -S, and -u. If you do not specify a selection flag with the select_flag variable, all process records are copied to filename. The output format includes only the date and time: ACCOUNTING RECORDS FROM: day mon date hh:mm:ss yy Displays information about the processes that have a CPU system time exceeding the time specified by the seconds variable. The output format is the same as the default column heading format. Displays only the average statistics, which are shown at the end of the command output when you use the -a flag. Displays the CPU factor, which is the user time divided by the total CPU time. The output format is the same as the default column heading format, except the CPU FACTOR column replaces the MEAN SIZE(K) column. The column heading format is as follows: ACCOUNTING RECORDS FROM: day mon date hh:mm:ss yy COMMAND START END REAL CPU CPU NAME USER TTYNAME TIME TIME (SECS) (SECS) FACTOR Displays information about the processes that existed on or after time, which is specified as hh[:mm[:ss]]. The column heading format is as follows: ACCOUNTING RECORDS FROM: day mon date hh:mm:ss yy END AFTER : day mon date hh:mm:ss yy COMMAND START END REAL CPU MEAN NAME USER TTYNAME TIME TIME (SECS) (SECS) SIZE(K) Displays information only about the processes that started at or after time, which is specified as hh[:mm[:ss]]. The column heading format is as follows: ACCOUNTING RECORDS FROM: day mon date hh:mm:ss yy START AFTER : day mon date hh:mm:ss yy COMMAND START END REAL CPU MEAN NAME USER TTYNAME TIME TIME (SECS) (SECS) SIZE(K) Displays system and user CPU times under separate column headings. The CPU SYS column heading, which shows the system CPU time, replaces the CPU (SECS) default column heading. The column heading format is as follows: ACCOUNTING RECORDS FROM: day mon date hh:mm:ss yy COMMAND START END REAL CPU (SECS) NAME USER TTYNAME TIME TIME (SECS) SYS USER Displays information about the processes that are owned by user username. You can specify a user identification number, a login name converted to a user identification number, a number sign (#) to specify root or a question mark (?), which selects pro- cesses associated with unknown user identification numbers. The output format is the same as the default column heading format. Removes column headings from the output; otherwise the output is the same as the default column heading format. DESCRIPTION
The acctcom command displays process accounting records from files specified by the file parameter, from standard input, or from the /var/adm/pacct file. If you do not specify a file and if standard input is assigned to a workstation or to /dev/null (for example, if a process runs in the background), the acctcom command reads the /var/adm/pacct file. You do not have to be root to use the acctcom command, which is located in the /usr/bin directory. If you specify more than one filename, the acctcom process reads each file chronologically in time-descending order according to process completion time. Usually, the /var/adm/pacct file is used, but you can have several /var/adm/pacct/*Vn files, which are created by the ckpacct command. Each record specifies the execution times for a completed process. The default output format includes the command name, user name, tty name, process start time, process end time, real seconds, CPU seconds, and mean memory size (in kilobytes). The process summary output has the following default column heading format: ACCOUNTING RECORDS FROM: day mon date hh:mm:ss yyyy COMMAND START END REAL CPU MEAN NAME USER TTYNAME TIME TIME (SECS) (SECS) SIZE(K) If a specified time is later than the current time, it is interpreted as occurring on the previous day. You can use flags to display the state of the fork/exec flag, F column; the system exit value, STAT column; the ratio of total CPU time to elapsed time, HOG FACTOR column; the product of memory used and elapsed time, KCORE MIN column; the ratio of user time to total (system plus user) time, CPU FACTOR column; the number of characters transferred during I/O operations, CHARS TRNSFD column; and the total number of blocks read or written, BLOCKS READ column. If a process is run under root or su authority, the command name is prefixed with a number sign (#). If a process is not assigned to a known tty (for example, if the cron daemon runs the process), a question mark (?) is displayed in the TTYNAME column. The acctcom command reports only on processes that have completed. Use the ps command to examine the status of active processes. For any flag value that produces a timestamp in an output heading, the order of date and time information is locale dependent. The time- stamps shown in the examples use the default format for date and time values. EXAMPLES
The following command displays information about processes that exceed 2.0 seconds of CPU time: /usr/sbin/acct/acctcom -O 2 < /var/adm/pacct The following command displays information about processes belonging to the Finance group: /usr/sbin/acct/acctcom -g Finance < /var/adm/pacct The following command displays information about processes belonging to tty /dev/console that run after 5:00 p.m.: /usr/sbin/acct/acctcom -l /dev/console -s 17:00 FILES
Specifies the command path. The active process accounting database file. User and group database files. Accounting header files that define formats for writing accounting files. RELATED INFORMATION
Commands: ed(1), ps(1), su(1), acct(8), cron(8), runacct(8) Functions: acct(2) delim off acctcom(8)
All times are GMT -4. The time now is 03:17 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy