I am a beginner in scripting and need some advise .
I have a log file which has following
Now I have a directory which has all these files as well and if you do "zcat a.zip|wc -l you will find the number of rows" .
I need to plot no of rows on y axis and time taken to process and if possible with hourly range.on x axis.
Wondering if I can automate this with a shell script and the output would be name value pair like follwing so it is easier to plot or some other ide you have
Last edited by Scott; 12-17-2009 at 04:06 PM..
Reason: Added code tags for readability
It may be a good idea to use a scripting language like Perl or Python if the date arithmetic is complex (e.g. change of dates/months/years etc.)
Given below is a solution in Perl. CPAN is the repository of all Perl modules and Date::Calc is a small and elegant module for performing blazingly fast date arithmetic.
Thanks for the tips both are working but need a little help as this is my first perl program
a) In the perl script instead of specifying test.log how can we change itto go to say /logs directory and pick up all server.log.<date> files instead ?
b) Can you please explain line 7,9,10,11?
Last edited by Scott; 01-02-2010 at 10:47 PM..
Reason: Code tags, please!
Thanks for the tips both are working but need a little help as this is my first perl program
You are always welcome..
And good that you have started to try to understand the program.
Quote:
Originally Posted by gubbu
a) In the perl script instead of specifying test.log how can we change itto go to say /logs directory and pick up all server.log.<date> files instead ?
Perl is TMTOWTDI language. Let me show you one way for achieving that.
It prints the following output:
Quote:
Originally Posted by gubbu
7 if (/((\d{4})-(\d{2})-(\d{2}) (\d{2})\d{2})\d{2})),\d+ Beginning (.*)$/) {
8 # set the START date and time components, and the zip file name
9 $y1=$2; $mon1=$3; $d1=$4;
10 $h1=$5; $min1=$6; $s1=$7;
11 $zfile1 = $8;
Line 7: That is a regular expression,
() - capture it in variables ( $1, $2, $3... )
\d - match a digit
{4} - match previous item 4 times, ( i.e 4 digits here )
Line 8: assign the captured things to variables,
$1 is the value captured in first set of parenthesis, $2 -- second set of parenthesis value .. and so on.
Hope you understand. Also there are a lot of places where you can learn perl. Perl is really very simple to learn and understand. Just google and learn.
Thanks folks. I promise to read REGEX and more Perl stuff and contribute as I learn more to this awesome forum. I have one last question to complete my other script .
Per the example and explanation the below code works fine
Then what modification do I need if the logfile is say
Hi,
I am totally a newbie to any programming languages and I just started an entry level job in an IT company. One of my recent tasks is to create a script that is able to show the log file of linux service (i.e. ntpd service)
lets say, if I run my script ./test.sh, the output should be... (3 Replies)
Dear Friends,
Please help me on this
my script name is send.csh
In this i have written the statement like this
set args = ( city state country price )
I want to pass this array to another c shell called receiver.csh. and i want to use it in this c shell
or
how to pass to... (2 Replies)
Dear Unix gurus,
We have a config shell script file which has 30 variables which needs to be passed to master unix shell script that invokes oracle database sessions. So those 30 variables need to go through the database sessions (They are inputs) via a shell script. one of the variable name... (1 Reply)
Dear Unix gurus,
We have a config shell script file which has 30 variables which needs to be passed to master unix shell script that invokes oracle database sessions. So those 30 variables need to go through the database sessions (They are inputs) via a shell script. one of the variable name... (1 Reply)
I have a shell script (.sh) and I want to pass a parameter value to the awk command but I am getting exception, please assist.
diff=$1$2.diff
id=$2 new=new_$diff
echo "My id is $1"
echo "I want to sync for user account $id"
##awk command I am using is as below
cat $diff | awk... (2 Replies)
Hi All,
I have new for shell scripting.
Problem : I have one scrip at serv1 and path of server is /apps/dev/provimage/scripts and script name:extract_ancillary.bat.
I need to call this script at server2(my working server) and execute at server2 .
Please let me know how to build the... (5 Replies)
Hi,
I basically have 2 shell scripts.
One is a shell script will get the variable value from the user. The variable is nothing but the IP of the remote system.
Another shell script is a script that does the job of connecting to the remote system using ssh. This uses a expect utility in turn.
... (2 Replies)
i want use ssh on the host01 to execute autoexec.sh on the host02 like following :
host01> ssh host02 autoexec.sh
autoexec.sh include nohup command like follwing :
nohup /home/jack/deletedata.sh &
after i execute ssh host02 autoexec.sh one the host01. i can't found deletedata.sh... (1 Reply)
Hi,
I have an HTML form through which I get some text as input. i need to run a shell script say script.sh inside a perl-cgi script named main_cgi.sh on the form input.
I want to write the contents of the form in a file and then perform some command line operations like grep, cat on the text... (2 Replies)
Hi Perl/UNIX experts,
I have a problem in running a shell script from my perl script (auto.pl).
I run the perl script using
perl auto.pl
from the shell prompt
The shell script picks the files in "input" folder and procesess it.
The shell script blue.sh has this code.
export... (16 Replies)