HELP !! script not working..


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting HELP !! script not working..
# 1  
Old 11-27-2011
HELP !! script not working..

Hi all,
I have a piece of code which cork perfect. It copy the no of lines from some files (*.log) into finalLog file.
It read the lines after the line have text "ntot".
Here it is :
Code:
#!/bin/bash                                                                                                                                                            

awk '/ntot/{p=lines;next}                                                                                                                                             
p>0{                                                                                                                                                                   
       split($0,arr,"=")                                                                                                                                               
       if(!h[arr[1]"HDR"])h[arr[1]"HDR"]=arr[1]                                                                                                                        
       a[arr[1]]=a[arr[1]]" "$NF                                                                                                                                       
       if(j<lines) b[++j]=arr[1]                                                                                                                                       
       sum[arr[1]]+=$NF                                                                                                                                                
       p--                                                                                                                                                             
}                                                                                                                                                                      
END{                                                                                                                                                                   
       for(i=1;i<=j;i++)                                                                                                                                               
               print h[b[i]"HDR"]"="a[b[i]]" "sum[b[i]]                                                                                                                
}' lines=1 *.log > finallOG

I modified the script to make it more flexible and so could provide the information of
1.) lines
2.) TEXT
3.) finalLOg file

through terminal. but it is not working. Can anybody suggest what wrong in the new script. Find the new script here:
Code:
#!/bin/bash                                                                                                                                                            
TEXT=$1
LINES=$2
FINAL=$3

awk '/$TEXT/{p=$LINES;next}                                                                                                                                            
p>0{                                                                                                                                                                   
echo 'working'                                                                                                                                                         
     split($0,arr,"=")                                                                                                                                                 
       if(!h[arr[1]"HDR"])h[arr[1]"HDR"]=arr[1]                                                                                                                        
       a[arr[1]]=a[arr[1]]" "$NF                                                                                                                                       
       if(j<lines) b[++j]=arr[1]                                                                                                                                       
       sum[arr[1]]+=$NF                                                                                                                                                
       p--                                                                                                                                                             
}                                                                                                                                                                      
END{                                                                                                                                                                   
       for(i=1;i<=j;i++)                                                                                                                                               
               print h[b[i]"HDR"]"="a[b[i]]" "sum[b[i]]                                                                                                                
}' *.log > $FINAL

thanks in advance
pooja..
# 2  
Old 11-27-2011
Your outer shells vars (TEXT, LINES & FINAL) won't be substituted inside the hard quotes around the awk argument string.
# 3  
Old 11-27-2011
hi,
thanks for the reply.
Actually, I am not good with the shell scripting.
could you please elaborate your point?

Thanks
pooja..
# 4  
Old 11-27-2011
You should learn how to pass variables to awk
Code:
#!/bin/bash
TEXT=$1
LINES=$2
FINAL=$3

awk '{if($0~TEXT){p=LINES;next}}
p>0{
  split($0,arr,"=")
  if(!h[arr[1]"HDR"])h[arr[1]"HDR"]=arr[1]
  a[arr[1]]=a[arr[1]]" "$NF
  if(j<lines) b[++j]=arr[1]
  sum[arr[1]]+=$NF
  p--
}
END{
  for(i=1;i<=j;i++)
  print h[b[i]"HDR"]"="a[b[i]]" "sum[b[i]]
}' LINES=$LINES TEXT=$TEXT *.log > $FINAL

You can also use -v option to pass the variables.
Code:
awk -v arg1="hello" -v arg2="how are you" 'BEGIN{print arg1,arg2}'

HTH
--ahamed
# 5  
Old 11-27-2011
hi ahamed,
THANKS again...Smilie Smilie

pooja..

---------- Post updated at 09:10 AM ---------- Previous update was at 09:06 AM ----------

Hi ahamed,
I am afraid it is not working..Smilie

I provided :
Code:
./MakeFile.sh ntot 3 finalLOG

but finalLOG is blank file.

Pooja..
# 6  
Old 11-27-2011
Please past the sample input file...

--ahamed
# 7  
Old 11-27-2011
Hi,
Here is the section of one of the input file:
Code:
Error in <TTree::SetBranchStatus>: unknown branch -> genndau
Error in <TTree::SetBranchStatus>: unknown branch -> gennmoth
ntot = 208190
ev_passjson = 208190
ev_goodvtx = 208189
wp85ev = 6021
phoidev= 15
invev = 14
hltev = 14
=======using photon counter ======
tot pho is                 = 12680
nomatch pho is             = 595
phoeta pho is              = 539
nospike_counter is         = 539
et cut passed pho          = 0
ecal cut passed pho        = 0
hcal cut passed pho        = 282
trk cut passed pho         = 106
sieie cut passed pho       = 155

thnaks
pooja.

---------- Post updated at 09:29 AM ---------- Previous update was at 09:21 AM ----------

Hi,
I just faced a problem, I found that finalLOG is having some column showing 0 entries. Which means that log file has the 0 entries.
As there are 60 input files, will it be possible that input file information be written in the top column of finalLOG file.
So that I can trace which log file is having null entries.

If possible? please do the necessary changes.
** using working script.

thanks
pooja.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help with speeding up my working script to take less time - how to use more CPU usage for a script

Hello experts, we have input files with 700K lines each (one generated for every hour). and we need to convert them as below and move them to another directory once. Sample INPUT:- # cat test1 1559205600000,8474,NormalizedPortInfo,PctDiscards,0.0,Interface,BG-CTA-AX1.test.com,Vl111... (7 Replies)
Discussion started by: prvnrk
7 Replies

2. UNIX for Beginners Questions & Answers

Why is this script not working?

for file in $(find /home/p611568/*.rpt -mtime -2 | grep -v ftplog) do awk '$1 == "XifPages," {PAGE = $5} $1 == "XifEndOfDocuments," {LINE = $5} index($0,"Value") && index($1,"Info") {sevGTI = 1} END {if (sevGTI) printf "%7s%10s%s",PAGE,LINE ... (4 Replies)
Discussion started by: bcarosi
4 Replies

3. Shell Programming and Scripting

Script not working

Hi i have write the one scripts and the scripts is error. The scripts purpose select one directory to check the file is there or not. i will give the two format of file to search the mention the path one file is there to select the file one copy the another location.please check the my script give... (1 Reply)
Discussion started by: rajivgandhi
1 Replies

4. UNIX for Dummies Questions & Answers

My script is not working

Hi All, I am trying to calculate the total_amount based on two key fields. Here is the script. I am new to unix. So please help me to find out the error in this script. I'm getting error like "command not found" and ]; is missing.. PRE_LBNO=0 PRE_DATE=0 TOT_PAY=0 for line in `cat... (4 Replies)
Discussion started by: lathanandhini
4 Replies

5. Shell Programming and Scripting

expect script inside shell script not working.

Shell Scipt: temp.sh su - <$username> expect pass.exp Expect script: pass.exp #!/usr/bin/expect -f # Login ####################### expect "Password: " send "<$password>\r" it comes up with Password: but doesnt take password passed throguh file. (2 Replies)
Discussion started by: bhavesh.sapra
2 Replies

6. Shell Programming and Scripting

Script not working in cron but working fine manually

Help. My script is working fine when executed manually but the cron seems not to catch up the command when registered. The script is as follow: #!/bin/sh for file in file_1.txt file_2.txt file_3.txt do awk '{ print "0" }' $file > tmp.tmp mv tmp.tmp $file done And the cron... (2 Replies)
Discussion started by: jasperux
2 Replies

7. Shell Programming and Scripting

Script is not working from cron while working manually

Hello, I am facing a very strange problem when I run my script manuallu ./Fetchcode which is using to connect with MKS integrity from linux end it workks fine but when I run it from cron it doesn't work.Can someone help me 1) How could I check my script when it is running from cron like... (3 Replies)
Discussion started by: anuragpgtgerman
3 Replies

8. UNIX for Dummies Questions & Answers

script not working

hi guys im new to unix and what to get this script working the scripts purpose its purpose is to move files i copy it from a HP UX pdf just for practice but when i execute it comes up wit this error command not found on the line if plz help me and thank in advance to those who do ps im... (3 Replies)
Discussion started by: ShinTec
3 Replies

9. Shell Programming and Scripting

Perl script 'system' linking to local shell script not working

Trying to figure out why this works: printpwd.pl #!/usr/bin/perl use CGI::Carp qw( fatalsToBrowser ); print "Content-type: text/html\n\n"; $A = system("pwd"); $A = `pwd`; print "$A\n"; ^^actually that works/breaks if that makes any sense.. i get the working directory twice but when... (5 Replies)
Discussion started by: phpfreak
5 Replies

10. Shell Programming and Scripting

Script not working..."sort" not working properly....

Hello all, I have a file - 12.txt cat 12.txt =============================================== Number of executions = 2 Total execution time (sec.ms) = 0.009883 Number of executions = 8 Total execution time (sec.ms) = 0.001270 Number of... (23 Replies)
Discussion started by: Rahulpict
23 Replies
Login or Register to Ask a Question