Visit Our UNIX and Linux User Community


A Question Regarding Timers and Output


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting A Question Regarding Timers and Output
# 1  
Old 04-04-2012
Java A Question Regarding Timers and Output

Hi there. I am fairly new to scripting in BASH so please forgive my clumsy syntax and analogy as I try to explain what I am trying to accomplish.

I have a list of mundane functions that I currently call from a script file. What I wish to do is to accurately record into a log file the times that each step is taking to allow for some analysis and planning of resources as I utilize the script for more activity on more machines. I have been directed to look at the time function but find that it's usefulness is very limited if I wish to contain all of my data to one output file. Please see the example below of my understanding of how to utilize it.
Code:
/usr/bin/time -o 'output file path' 'command to execute'

However, what I wish to see is something more like the result from what code I was able to cobble together below.
Code:
LOGFILE=completed_work_`date +%F`.log
my_run_start_date=`date +%F`
my_run_start_time=`date +%H:%M`
    echo Run began on $my_run_start_date at $my_run_start_time >> $LOGFILE
master_start=`date +%s`
# do the work here
step_start=`date +%s` #timer start
    echo 1 Do some work here.;echo 1 This is what we did here. >> $LOGFILE
step_end=`date +%s` #timer end
    step_diff=`expr $step_end - $step_start`
    echo How long it took to do it : $step_start - $step_end = $step_diff >> $LOGFILE
# we can do this as many times as we need to
step_start=`date +%s` #timer start
    echo 2 Do some work here.;echo 2 This is what we did here. >> $LOGFILE
step_end=`date +%s` #timer end
    step_diff=`expr $step_end - $step_start`
    echo How long it took to do it : $step_start - $step_end = $step_diff >> $LOGFILE
# end of the work section
master_end=`date +%s`
master_diff=`expr $master_end - $master_start`
my_run_end_date=`date +%F`
my_run_end_time=`date +%H:%M`
    echo Run ended on $my_run_end_date at $my_run_end_time >> $LOGFILE
    echo Start=$master_start : End=$master_end >> $LOGFILE
master_time_elapsed=`expr $master_diff / 3600`
    echo Elapsed time = $master_time_elapsed hours >> $LOGFILE

Can anyone please assist me with a more concise and/or elegant approach to accomplishing this within a mixed Unix/Linux environment?

Last edited by Tenuous; 04-04-2012 at 05:00 PM.. Reason: Modified the script to be an entirely functional example.
# 2  
Old 04-04-2012
Could you show what you actually want, instead of code you don't want?
# 3  
Old 04-04-2012
The script relies heavily on date +%s which is not valid in unix. Please describe what value you expect from this command.

Writing totally portable code for unix and Linux is extremely difficult and nigh on impossible if you start with bash on a random Linux computer with extensions to the "date" command. Please be a bit more specific about what Operating Systems and versions are involved here and what is the preferred Bourne-type Shell on each Operating System.

You have to find the lowest common denominator and work with that. If they are ALL modern computers, the current Posix standard is recommended by many posters here.
# 4  
Old 04-04-2012
Quote:
Originally Posted by Corona688
Could you show what you actually want, instead of code you don't want?
Thanks for your reply. I didn't say, "I don't want the code." The code actually works quite well. I want to know if there is a better or more elegant way to go about doing what I did in the code I listed. I've made a quick edit so it runs as it stands and gives you the example output you requested...
Code:
$ cat completed_work_2012-04-04.log

Run began on 2012-04-04 at 15:53
1 This is what we did here.
How long it took to do it : 1333569215 - 1333569215 = 0
2 This is what we did here.
How long it took to do it : 1333569215 - 1333569215 = 0
Run ended on 2012-04-04 at 15:53
Start=1333569215 : End=1333569215
Elapsed time = 0 hours

---------- Post updated at 04:19 PM ---------- Previous update was at 03:58 PM ----------

Quote:
Originally Posted by methyl
The script relies heavily on date +%s which is not valid in unix. Please describe what value you expect from this command.
Please see the above post.

Quote:
Originally Posted by methyl
Writing totally portable code for unix and Linux is extremely difficult and nigh on impossible if you start with bash on a random Linux computer with extensions to the "date" command. Please be a bit more specific about what Operating Systems and versions are involved here and what is the preferred Bourne-type Shell on each Operating System.
After reviewing the requirements to answer your question, the heavy lifting is all being done from Red Hat machines.
Quote:
Originally Posted by methyl
You have to find the lowest common denominator and work with that. If they are ALL modern computers, the current Posix standard is recommended by many posters here.
Except for not being sure of what your definition of 'modern' is, I understand what your saying and am already working from that approach.
# 5  
Old 04-04-2012
Alright, I had a bit of a go and here are a couple of ideas you could try..

As others have noted: date '%s' is a GNU extension and does not function on many platform. Your best bet may be to use perl :
Code:
perl -e 'print time'

of which a basic version is available on many platforms these days
You could put that into a function, since you are using it a lot:
Code:
stamp(){
  perl -e 'print time'
}

The nice thing about this is, that you only need to replace the content of the function if you wish to use another method to obtain epoch time, for example with date '%s'

The other thing that you can change is to use a general redirection that also includes stderr (Or maybe at a later stage you wish to only use std err):
Code:
exec >> "$LOGFILE" 2>&1

Further I replaced backticks everywhere with $(..) and expr statement with $(( ... ))
This leads to this script:
Code:
LOGFILE=completed_work_$(date +%F).log
stamp(){
  perl -e 'print time'
}
exec >> "$LOGFILE" 2>&1
my_run_start_date=$(date +%F)
my_run_start_time=$(date +%H:%M)

echo "Run began on $my_run_start_date at $my_run_start_time"
master_start=$(stamp)
# do the work here

step_start=$(stamp) #timer start
echo 1 Do some work here.;echo 1 This is what we did here.
step_end=$(stamp)   #timer end
step_diff=$((step_end - step_start))
echo How long it took to do it : $step_start - $step_end = $step_diff

# we can do this as many times as we need to
step_start=$(stamp) #timer start
echo 2 Do some work here.;echo 2 This is what we did here.
step_end=$(stamp)   #timer end
step_diff=$((step_end - step_start))
echo How long it took to do it : $step_start - $step_end = $step_diff

# end of the work section
master_end=$(stamp)
master_diff=$((master_end - master_start))
my_run_end_date=`date +%F`
my_run_end_time=`date +%H:%M`
echo "Run ended on $my_run_end_date at $my_run_end_time"
echo "Start=$master_start : End=$master_end"
master_time_elapsed=$((master_diff / 3600))
echo "Elapsed time = $master_time_elapsed hours"

There is a bit of repetition for every step. You could reduce that for example like this:
Code:
stamp(){
  perl -e 'print time'
}

timer(){
  case $1 in
    start) TS=$(stamp) ;;
    stop)  echo "How long it took to do it : $(( $(stamp) - TS )) seconds" ;;
  esac
}

LOGFILE=completed_work_$(date +%F).log

exec >> "$LOGFILE" 2>&1

echo "Run began on $(date '+%F at %H:%M')"
master_start=$(stamp)
# do the work here

timer start
echo "1 Do some work here." ;echo "1 This is what we did here."
timer stop

# we can do this as many times as we need to
timer start
echo "2 Do some work here.";echo "2 This is what we did here."
timer stop

# end of the work section
master_end=$(stamp)
master_diff=$((master_end - master_start))
master_time_elapsed=$((master_diff / 3600))
echo "Run ended on $(date '+%F at %H:%M')"
echo "Start=$master_start : End=$master_end"
echo "Elapsed time = $master_time_elapsed hours"

And so forth... Apart from the call to perl this is all POSIX shell code...
This User Gave Thanks to Scrutinizer For This Post:
# 6  
Old 04-04-2012
@Tenuous
If all the systems are Red Hat Linux, shell script compatibility with unix is academic.
The date command is not part of bash but is key to your original script.
Scrutinizer's approch with Perl is much better because of modern Perl's support for date manipulation.
# 7  
Old 04-04-2012
Beautiful! I will be diving in deeper tomorrow and will incoporate your suggestions.

---------- Post updated at 05:55 PM ---------- Previous update was at 05:53 PM ----------

@methyl it's a mish mash of alot of systems. More than 90% are Red Hat or Solaris. It's a new job for me and I am learning alot of stuff as I go. Thanks for your input though. It is invaluable to fellows such as myself.

Previous Thread | Next Thread
Test Your Knowledge in Computers #639
Difficulty: Easy
NeXTSTEP was based on UNIX.
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

INPUT/OUTPUT question

Hi All, Is it wrong to do something like this: ssh -T $PROXY_USER@$PROXY_SERVER < script.txt > ssh_output.log I ran and it works fine and does what I need. I wanted to pass a set of commands to the ssh session and store an output in the log file. Thanks (4 Replies)
Discussion started by: rdogadin
4 Replies

2. Programming

pthread_mutex_timedlock and Timers option

in its man-page pthread_mutex_timedlock documents that the absolute timeout parameter should be based on the CLOCK_REALTIME clock or in the system clock. All this depending on whether the 'Timers option' is supported or not. What do they mean by 'Timers option'? How could I tell for sure what... (8 Replies)
Discussion started by: ramestica
8 Replies

3. Shell Programming and Scripting

Command Output Question

Hi everyone-- I'm new to these forums and shell scripting, and I'm trying to write a script that checks if a particular ip is pingable My idea was to check if the output of the command ping <some ip> -c 1 -w 1 had the string: "1 packet transmitted, 1 received"How would I go about doing this?... (2 Replies)
Discussion started by: Prodiga1
2 Replies

4. Solaris

Question on kstat output

I'm having a little trouble understanding the output I'm seeing from kstat for the "net" class. I'm seeing a lot of entries with "mac" as the name, like this. module: bge instance: 3 name: mac class: net ... (3 Replies)
Discussion started by: Midcain
3 Replies

5. Programming

Doubts about timers in linux kernel

Hi , I am trying to learn timers in linux kernel. I am trying to write a program where I can configure a timer to tick in every 5 seconds and a function should thus exicute in every five seconds. I tried one program with the help of linux/timer.h headerfile but I couldnt get the... (4 Replies)
Discussion started by: iamjayanth
4 Replies

6. Shell Programming and Scripting

Question about output to file

Hi, I am try to setup a FOR loop script to find out all the existing linux workstations in the network w/ ip address, hostname and linux version. I created a basic FOR loop script: for i in $(seq 1 254) do echo 10.72.169.$i >> result ssh -o ConnectTimeout=3 root@10.72.169.$i "hostname"... (1 Reply)
Discussion started by: beeloo
1 Replies

7. Shell Programming and Scripting

display and output...question

Hi, I have a small question about the value cannot display correctly: MSG=log fruit=apple print "No $fruit in the store" > "$MSG/fruit_message.txt" output: No $fruit in the store should be: No apple in the store AND $MSG/fruit_message.txt ----------> cannot find the... (5 Replies)
Discussion started by: happyv
5 Replies

8. UNIX for Dummies Questions & Answers

Question on prtdiag output ...

Hello all , This is the output of my prtdiag command ...The speed of each of the CPUs is listed below (1281 MHz ) ..That's fine ..I'm confused about the (System clock frequency: 183 MHZ ) ..What is the difference between System Clock freq and CPU freq ...THanks.. System Configuration: Sun... (5 Replies)
Discussion started by: luft
5 Replies

9. Programming

A question about output.

I am learning output the data to a file using "ofstream". I need to read data from a file and output the result to the other file in 2 different ways. To do that I have to provoke two functions, and they have to output the result to the same text file. My problem is: they are correct on the screen... (2 Replies)
Discussion started by: HOUSCOUS
2 Replies

10. Programming

unix and timers

Hello there.. I need to know when i start indipendant timers how can i recognize which of the active timers have made timeout alarm. The number of started timers depends on the running app I'd appreciate your help Thanks in advance (0 Replies)
Discussion started by: nightcat
0 Replies

Featured Tech Videos