Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Help With shell script

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help With shell script
# 8  
Old 03-18-2010
I don't understand.

What I >>think<< you are saying is:

1) Here is the results of the awk script on three different files,

2) I want to graph the results from the awk script on all three files.

Correct?

Assuming that is correct: What tools? What OS? What output?

Excel will do obviously (windows, OS X)

Open Office (most os's)

gnuplot homepage

Your question is too general for a quick answer. You need to do some preparation for what you want.
# 9  
Old 03-18-2010
Hello,

What i meant is that i have an single output from a single file. Now i want to have 3 outputs from single file so that i can chart those 3 outputs seperately on Cacti.

And i have pasted my DESIRED 3 outputs in my previous posts. The details you asked for as follows:

OS: Ubuntu 9.10 (karmic server)
Tool Running : Cacti 0.8.7d
I am going to chart these graphs on cacti which is a network monitoring tool. I am *not* going to use for excel or open office.

Thanks for your help again,

Choco
# 10  
Old 03-18-2010
Quote:
Originally Posted by choco420
Hello,

What i meant is that i have an single output from a single file. Now i want to have 3 outputs from single file so that i can chart those 3 outputs seperately on Cacti.

And i have pasted my DESIRED 3 outputs in my previous posts. The details you asked for as follows:

OS: Ubuntu 9.10 (karmic server)
Tool Running : Cacti 0.8.7d
I am going to chart these graphs on cacti which is a network monitoring tool. I am *not* going to use for excel or open office.

Thanks for your help again,

Choco
So how/why are the numbers changing in the second two examples? Different times? Different files? Different fields?

I still do not understand the question...
# 11  
Old 03-18-2010
starting again for you so that we can be on the same page:

Here is my original data:

Code:
WINDOW |TODAY |YESTERDAY |Y_CHANGE 
|2010-03-12|2010-03-11|03/12 - 03/11 (%)
00:00:00 - 08:00:00| | | 
AD_REQUESTS |76,712,939|77,664,044|-1.22 
PAID_REVENUE |24257.70 |21092.30 |15.01 
ABC_REVENUE |23007.95 |19876.68 |15.75 
PAGE_VIEWS |1608304 |1683381 |-4.46 
PAID_IMPRESSIONS |43567950 |47472365 |-8.22 
PAID_CLICKS |117688 |113747 |3.46 
PAID_ECPM |0.5568 |0.4443 |25.32 
PAID_CTR |0.0027 |0.0024 |12.50 
PAID_FILL_RATE |0.5792 |0.6238 |-7.15 
07:00:00 - 08:00:00| | | 
AD_REQUESTS |9,309,473 |9,621,876 |-3.25 
PAID_REVENUE |3183.77 |2660.34 |19.68 
ABC_REVENUE |3020.16 |2509.90 |20.33 
PAGE_VIEWS |255484 |270772 |-5.65 
PAID_IMPRESSIONS |4555517 |4951013 |-7.99 
PAID_CLICKS |14085 |13390 |5.19 
PAID_ECPM |0.6989 |0.5373 |30.08 
PAID_CTR |0.0031 |0.0027 |14.81 
PAID_FILL_RATE |0.4981 |0.5233 |-4.82 
06:00:00 - 07:00:00| | | 
AD_REQUESTS |7,917,841 |8,214,757 |-3.61 
PAID_REVENUE |2487.94 |2238.26 |11.16 
ABC_REVENUE |2345.53 |2096.60 |11.87 
PAGE_VIEWS |183887 |194846 |-5.62 
PAID_IMPRESSIONS |3902349 |4216501 |-7.45 
PAID_CLICKS |11363 |11198 |1.47 
PAID_ECPM |0.6376 |0.5308 |20.12 
PAID_CTR |0.0029 |0.0027 |7.41 
PAID_FILL_RATE |0.5013 |0.5218 |-3.93

And here is the script which i wrote

Code:
awk -F"|" '{gsub(/\ /,"", $1); if ($1~/\_/) printf "%s:%-3.2f ", $1, $4} ' /etc/cacti/scripts/data/network_health*

and gives me the following output:

Code:
AD_REQUESTS:-1.22 PAID_REVENUE:15.01 ABC_REVENUE:15.75 PAGE_VIEWS:-4.46 PAID_IMPRESSIONS:-8.22 PAID_CLICKS:3.46 PAID_ECPM:25.32 PAID_CTR:12.50 PAID_FILL_RATE:-7.15 AD_REQUESTS:-3.25 PAID_REVENUE:19.68 ABC_REVENUE:20.33 PAGE_VIEWS:-5.65 PAID_IMPRESSIONS:-7.99 PAID_CLICKS:5.19 PAID_ECPM:30.08 PAID_CTR:14.81 PAID_FILL_RATE:-4.82 AD_REQUESTS:-3.61 PAID_REVENUE:11.16 ABC_REVENUE:11.87 PAGE_VIEWS:-5.62 PAID_IMPRESSIONS:-7.45 PAID_CLICKS:1.47 PAID_ECPM:20.12 PAID_CTR:7.41 PAID_FILL_RATE:-3.93

Now comes the part where i am facing some trouble.

I want to now write 3 different scripts each giving me the different output from the orignal data(my script is not providing me the result i now want)

Script #1 should pull the following data:
Code:
AD_REQUESTS:-1.22 PAID_REVENUE:15.01 ABC_REVENUE:15.75 PAGE_VIEWS:-4.46 PAID_IMPRESSIONS:-8.22 PAID_CLICKS:3.46 PAID_ECPM:25.32 PAID_CTR:12.50 PAID_FILL_RATE:-7.15

Script #2 should pull the following data:
Code:
AD_REQUESTS:-3.25 PAID_REVENUE:19.68 ABC_REVENUE:20.33 PAGE_VIEWS:-5.65 PAID_IMPRESSIONS:-7.99 PAID_CLICKS:5.19 PAID_ECPM:30.08 PAID_CTR:14.81 PAID_FILL_RATE:-4.82

Script#3 should pull the following data:
Code:
AD_REQUESTS:-3.61 PAID_REVENUE:11.16 ABC_REVENUE:11.87 PAGE_VIEWS:-5.62 PAID_IMPRESSIONS:-7.45 PAID_CLICKS:1.47 PAID_ECPM:20.12 PAID_CTR:7.41 PAID_FILL_RATE:-3.93

Notice that i want these 3 scripts to pull up the data from the 1st & 4th column in the original data but in different sections as you must have noticed from above.

Let me know if you have any ideas.

Thanks
choco
# 12  
Old 03-18-2010
Ahhhh --- I did not see the later reoccurrence...

This does what you want:

Code:
$ perl -0777 -nle 'BEGIN {$section=shift;} while (/(AD_REQUESTS(.*\s){8}.*)/g) {$t=$1; $i++ if($t=~/AD_REQUEST/); if($i==$section){ $t=~s/^([a-zA-Z_]+).*?\|.*?\|.*?\|([0-9\.-]+)/\1:\2 /gm;$t=~s/\n//g;; print $t} } ' 1 data.txt
AD_REQUESTS:-1.22  PAID_REVENUE:15.01  ABC_REVENUE:15.75  PAGE_VIEWS:-4.46  PAID_IMPRESSIONS:-8.22  PAID_CLICKS:3.46  PAID_ECPM:25.32  PAID_CTR:12.50  PAID_FILL_RATE:-7.15  

$ perl -0777 -nle 'BEGIN {$section=shift;} while (/(AD_REQUESTS(.*\s){8}.*)/g) {$t=$1; $i++ if($t=~/AD_REQUEST/); if($i==$section){ $t=~s/^([a-zA-Z_]+).*?\|.*?\|.*?\|([0-9\.-]+)/\1:\2 /gm;$t=~s/\n//g;; print $t} } ' 2 data.txt
AD_REQUESTS:-3.25  PAID_REVENUE:19.68  ABC_REVENUE:20.33  PAGE_VIEWS:-5.65  PAID_IMPRESSIONS:-7.99  PAID_CLICKS:5.19  PAID_ECPM:30.08  PAID_CTR:14.81  PAID_FILL_RATE:-4.82  

$ perl -0777 -nle 'BEGIN {$section=shift;} while (/(AD_REQUESTS(.*\s){8}.*)/g) {$t=$1; $i++ if($t=~/AD_REQUEST/); if($i==$section){ $t=~s/^([a-zA-Z_]+).*?\|.*?\|.*?\|([0-9\.-]+)/\1:\2 /gm;$t=~s/\n//g;; print $t} } ' 3 data.txt
AD_REQUESTS:-3.61  PAID_REVENUE:11.16  ABC_REVENUE:11.87  PAGE_VIEWS:-5.62  PAID_IMPRESSIONS:-7.45  PAID_CLICKS:1.47  PAID_ECPM:20.12  PAID_CTR:7.41  PAID_FILL_RATE:-3.93

Just use an integer 1-n as the first argument for the section that you want.
# 13  
Old 03-19-2010
What about a tab-delimited output ?
I thought that because you told about charting. This can be transformed in comma-separated or anything else
Code:
#!/bin/bash
IFS="|"
echo -e "AD_REQ\tPD_REV\tAB_REV\tPG_VWS\tPD_IMP\tPD_CLK\tPD_ECP\tPD_CTR\tPD_FIL"
while read VAR D D VAL
do
     VAR=${VAR% *}
     eval "$VAR=$VAL" 2>/dev/null
     [ "$VAR" = "PAID_FILL_RATE" ] || continue
     echo -e "$AD_REQUESTS\t$PAID_REVENUE\t$ABC_REVENUE\t$PAGE_VIEWS\t$PAID_IMPRESSIONS\t$PAID_CLICKS\t$PAID_ECPM\t$PAID_CTR\t$PAID_FILL_RATE"
done < infile
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Shell script newbie- how to generate service log from shell script

Hi, I am totally a newbie to any programming languages and I just started an entry level job in an IT company. One of my recent tasks is to create a script that is able to show the log file of linux service (i.e. ntpd service) lets say, if I run my script ./test.sh, the output should be... (3 Replies)
Discussion started by: xiaogeji
3 Replies

2. Shell Programming and Scripting

Pass C shell array to another C shell script(csh) and shell(sh)

Dear Friends, Please help me on this my script name is send.csh In this i have written the statement like this set args = ( city state country price ) I want to pass this array to another c shell called receiver.csh. and i want to use it in this c shell or how to pass to... (2 Replies)
Discussion started by: SA_Palani
2 Replies

3. Shell Programming and Scripting

How to write config shell script to pass variables in master shell script?

Dear Unix gurus, We have a config shell script file which has 30 variables which needs to be passed to master unix shell script that invokes oracle database sessions. So those 30 variables need to go through the database sessions (They are inputs) via a shell script. one of the variable name... (1 Reply)
Discussion started by: dba1981
1 Replies

4. UNIX for Dummies Questions & Answers

How to write Config shell script to pass variables in master shell script?

Dear Unix gurus, We have a config shell script file which has 30 variables which needs to be passed to master unix shell script that invokes oracle database sessions. So those 30 variables need to go through the database sessions (They are inputs) via a shell script. one of the variable name... (1 Reply)
Discussion started by: dba1981
1 Replies

5. Shell Programming and Scripting

Unable to pass shell script variable to awk command in same shell script

I have a shell script (.sh) and I want to pass a parameter value to the awk command but I am getting exception, please assist. diff=$1$2.diff id=$2 new=new_$diff echo "My id is $1" echo "I want to sync for user account $id" ##awk command I am using is as below cat $diff | awk... (2 Replies)
Discussion started by: Ashunayak
2 Replies

6. Shell Programming and Scripting

Correct shell script to Call One shell script from another shell script

Hi All, I have new for shell scripting. Problem : I have one scrip at serv1 and path of server is /apps/dev/provimage/scripts and script name:extract_ancillary.bat. I need to call this script at server2(my working server) and execute at server2 . Please let me know how to build the... (5 Replies)
Discussion started by: Vineeta Nigam
5 Replies

7. Shell Programming and Scripting

call another shell script and pass parameters to that shell script

Hi, I basically have 2 shell scripts. One is a shell script will get the variable value from the user. The variable is nothing but the IP of the remote system. Another shell script is a script that does the job of connecting to the remote system using ssh. This uses a expect utility in turn. ... (2 Replies)
Discussion started by: sunrexstar
2 Replies

8. Shell Programming and Scripting

How to use ssh execute other shell script on other host (shell script include nohup)?

i want use ssh on the host01 to execute autoexec.sh on the host02 like following : host01> ssh host02 autoexec.sh autoexec.sh include nohup command like follwing : nohup /home/jack/deletedata.sh & after i execute ssh host02 autoexec.sh one the host01. i can't found deletedata.sh... (1 Reply)
Discussion started by: orablue
1 Replies

9. Shell Programming and Scripting

invoking a shell script inside cgi shell script

Hi, I have an HTML form through which I get some text as input. i need to run a shell script say script.sh inside a perl-cgi script named main_cgi.sh on the form input. I want to write the contents of the form in a file and then perform some command line operations like grep, cat on the text... (2 Replies)
Discussion started by: smriti_shridhar
2 Replies

10. Shell Programming and Scripting

How to Run a shell script from Perl script in Parent shell?

Hi Perl/UNIX experts, I have a problem in running a shell script from my perl script (auto.pl). I run the perl script using perl auto.pl from the shell prompt The shell script picks the files in "input" folder and procesess it. The shell script blue.sh has this code. export... (16 Replies)
Discussion started by: hifake
16 Replies
Login or Register to Ask a Question