awk not working correctly


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk not working correctly
# 1  
Old 11-07-2012
awk not working correctly

Hi

I am attempting to right a script which will read a table and extract specfic information.

Code:
LASTFAILEDJOB=/usr/openv/netbackup/scripts/GB-LDN/Junaid/temp_files/lastfailedjob
cat /usr/openv/netbackup/scripts/GB-LDN/Junaid/temp_files/lastfailedjob
237308646



If i run the following command via CLI i get all the errors which meet the following cretia - $4=="150" || $4=="156", it seems that the syntax is ignorning "$1 >= "237308648" &&" and if written like this "$1 >= "$LASTFAILEDJOB" && " in the script


$1 = Checks for all failed job
$4 = If column $4 equals either 150 or 156

Code:
# bpdbjobs -most_columns | grep -i  | awk -F, '{if($1 >= "237308648" && $4=="150" || $4=="156") print $1, $4, $5, $7, $8, $12}'
237322668 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237322411 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237322357 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237322356 156 WAT_NT_PRD sv077839.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237322217 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237321586 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237320477 156 WAT_NT_PRD sv077900.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237320253 156 WAT_NT_PRD sv077839.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237320222 156 WAT_NT_PRD sv077900.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237318659 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237316578 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237315203 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237315129 150 WAT_NT_PRD_SQL_LRG sv191260.xx.com ln2p1001infxxcom ln2p1001inf-hcart3-robot-acs-24
237312932 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237312070 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237309124 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237308801 156 WAT_NT_PRD_SQL_LRG sv180411.xx.com ln2p1001infxxcom ln2p1001inf-hcart3-robot-acs-24
237308645 156 WAT_NT_PRD_SQL_LRG sv191260.xx.com ln2p1001infxxcom ln2p1001inf-hcart3-robot-acs-24


I have even tried

Code:
bpdbjobs -most_columns | grep -i  | awk -F, '{if($1 > "237308646") print $0}' | awk -F, '{if($4=="150" || $4="=156")


Can you please help me rewrite the command, so all 18 lines appear and are greater than $LASTFAILEDJOB.

What i am noticing via the script is only the error codes with status 156 lines are being captured (11 lines out of potential 18)


Thanks
# 2  
Old 11-07-2012
The 'grep -i' does nothing by itself.

You should bracket your statements so the order of operators doesn't get taken wrong. It might be grouping them differently than you think.

I would rewrite this as this:

Code:
bpdbjobs -most_columns |
        awk -F, 'NR==FNR { LF=$1; next }
        ($1>LF)&&(($4=="150")||($4=="156")) { print $1, $4, $5, $7, $8, $12 }' /usr/openv/netbackup/scripts/GB-LDN/Junaid/temp_files/lastfailedjob -


Last edited by Corona688; 11-07-2012 at 12:17 PM..
# 3  
Old 11-07-2012
Typo by me.
Code:
bpdbjobs -most_columns | grep -i  LDN_ | awk -F, '{if($1 > "237308646") print $0}' | awk -F, '{if($4=="150" || $4="=156")


The folowing worked, the guidance provided was very helpful..

Code:
bpdbjobs -most_columns | grep -i LDN_ | awk -F, '($1>LASTFAILEDJOB)&&(($4=="150")||($4=="156"))

---------- Post updated at 04:38 PM ---------- Previous update was at 04:26 PM ----------

I have noticed if i run the script again, then the lastfailed statement is not taking affect


Code:
cat /usr/openv/netbackup/scripts/GB-LDN/Junaid/temp_files/lastfailedjob
237322668

Code:
awk -F, '($1>LASTFAILEDJOB)&&(($4=="150")||($4=="156"))

So it should check for any Jobs greater than 237322668, but it is picking up everything with status 150 and 156. So the errors are being repeated.

Do i need a if statement and if so how do i implement this.

---------- Post updated at 04:39 PM ---------- Previous update was at 04:38 PM ----------

Sorry still does not work even when in quotes

Code:
bpdbjobs -most_columns | grep -i LDN_ | awk -F, '($1>"$LASTFAILEDJOB")&&(($4=="150")||($4=="156")) { print $8 }' | wc -l

Any advice please.


Code:
 cat /usr/openv/netbackup/scripts/GB-LDN/Junaid/temp_files/lastfailedjob
237322668


Code:
237322668 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237322411 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237322357 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237322356 156 WAT_NT_PRD sv077839.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237322217 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237321586 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237320477 156 WAT_NT_PRD sv077900.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237320253 156 WAT_NT_PRD sv077839.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237320222 156 WAT_NT_PRD sv077900.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237318659 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237316578 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237315203 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237315129 150 WAT_NT_PRD_SQL_LRG sv191260.xx.com ln2p1001infxxcom ln2p1001inf-hcart3-robot-acs-24
237312932 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237312070 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237309124 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237308801 156 WAT_NT_PRD_SQL_LRG sv180411.xx.com ln2p1001infxxcom ln2p1001inf-hcart3-robot-acs-24
237308645 156 WAT_NT_PRD_SQL_LRG sv191260.xx.com ln2p1001infxxcom ln2p1001inf-hcart3-robot-acs-24

# 4  
Old 11-07-2012
Have you tried the command I gave you at all?

If you have awk | grep | cut | kitchen | sink | wc -l, you can probably replace that all with awk. It's just a tiny change to what I gave you to do it all.

Code:
bpdbjobs -most_columns |
        awk -F, 'NR==FNR { LF=$1; next }
        /[lL][dD][nN]_/ && ($1>LF)&&(($4=="150")||($4=="156")) { print $1, $4, $5, $7, $8, $12 }' /usr/openv/netbackup/scripts/GB-LDN/Junaid/temp_files/lastfailedjob -

# 5  
Old 11-08-2012
I have tried it and here is the following message i get, which still not working..

I am expecting 18 rows not 0

The lastfailed bit is not working..


Script


Code:
LASTFAILEDJOB=/usr/openv/netbackup/scripts/GB-LDN/Junaid/temp_files/lastfailedjob
#

cat $LASTFAILEDJOB

RUN=`sudo $ADM_CMD/bpdbjobs -most_columns | grep -i LDN_ | awk -F, 'NR==FNR { $LASTFAILEDJOB=$1; next } /[lL][dD][nN]_/ && ($1>$LASTFAILEDJOB)&&(($4=="150")||($4=="156")) { print $8 }'| wc -l `


Script Output
Code:
+ cat /usr/openv/netbackup/scripts/GB-LDN/Junaid/temp_files/lastfailedjob
237308642
+ sudo /usr/openv/netbackup/bin/admincmd/bpdbjobs -most_columns
+ grep -i LDN_
+ wc -l
+ awk -F, NR='=FNR { $LASTFAILEDJOB=$1; next } /[lL][dD][nN]_/ && ($1>$LASTFAILEDJOB)&&(($4=="150")||($4=="156")) { print $8 }'
+ RUN=0


Output i am expecting - 18 rows
Code:
237322668 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237322411 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237322357 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237322356 156 WAT_NT_PRD sv077839.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237322217 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237321586 156 CAM_NT_PRD_SQL sv157594.xx.com nmegbp61xxcom W_NMEGBP61_VTL11
237320477 156 WAT_NT_PRD sv077900.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237320253 156 WAT_NT_PRD sv077839.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237320222 156 WAT_NT_PRD sv077900.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237318659 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237316578 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237315203 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237315129 150 WAT_NT_PRD_SQL_LRG sv191260.xx.com ln2p1001infxxcom ln2p1001inf-hcart3-robot-acs-24
237312932 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237312070 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237309124 150 WAT_NT_PRD_SQL sv160720.xx.com nmegbp11.ipe.commerzbank.com C_NMEGBP11_VTL61
237308801 156 WAT_NT_PRD_SQL_LRG sv180411.xx.com ln2p1001infxxcom ln2p1001inf-hcart3-robot-acs-24
237308645 156 WAT_NT_PRD_SQL_LRG sv191260.xx.com ln2p1001infxxcom ln2p1001inf-hcart3-robot-acs-24

# 6  
Old 11-09-2012
Can someone please help with this query
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Are the brains of the UNIXoid working correctly?

Today I saw the topic. sum-even-numbers-1-100 At that time, it was already closed but not the point. Other thoughts came to mind. All newcomers to Haskell are afraid that when they study it, their brains will turn inside out. I did not notice anything like that. And all because the brains of all... (4 Replies)
Discussion started by: nezabudka
4 Replies

2. UNIX for Dummies Questions & Answers

vnc No Longer Working Correctly

Hello All, Yesterday, all day, I was using x11vnc and vncviewer to connect to a server. But today for some reason it is not working. I don't remember changing any settings or anything like that, but because it stopped working correctly I guess something has...? I'm issuing the exact same... (0 Replies)
Discussion started by: mrm5102
0 Replies

3. UNIX for Dummies Questions & Answers

Grep Regexp not working correctly

Consider the following code: grep -o -e '^STEAM_::\d+$' workfile3.tmp A sample format of a valid string for the regexp would be: STEAM_0:1:12345678 Here is an example line from the workfile3.tmp file: 465:L 01/02/2012 - 00:05:33: "Spartan1-1-7<8><STEAM_0:1:47539638><>" connected No... (2 Replies)
Discussion started by: spinner0205
2 Replies

4. Shell Programming and Scripting

rsync is not correctly working

We are using Red Hat linux system. I am transferring my rman backup files to another server. Here is the command i am using to transfer the files. /usr/bin/rsync -avpP --delete /xyz/xyz/ 99.99.999.99::db110bkp Here is the rsync version. >rsync --version rsync version 3.0.6 ... (1 Reply)
Discussion started by: govindts
1 Replies

5. Shell Programming and Scripting

Find cmd not working correctly in script

I am trying to copy 2 types of files so I can archive them. I tested with a set of commands: touch -t $(date -d "-60 day" +%Y%m%d) WORKDIR/REF find TARGETDIR/ -type f -maxdepth 1 -iname \*.out\* -or -iname \*.log\* ! -newer WORKDIR/REF -exec ls -l {} \; This correctly lists any files in the... (2 Replies)
Discussion started by: prismtx
2 Replies

6. UNIX for Dummies Questions & Answers

grep -A switch not working correctly with -m

egrep -A 7 -m 2 -h 'Date:|Time:' *.html this is showing only 2 line after the context of the 2nd found match. Is this a bug in grep? egrep -A 7 -m 2 -h 'Time:' *.html - this works correctly (2 Replies)
Discussion started by: zer0
2 Replies

7. Programming

Shell Implementation not working correctly

//save in/out int tmpin = dup(0); int tmpout = dup(1); //set initial input int fdin; if(_inputFile) { fdin = open(_inputFile, O_RDONLY | O_CREAT, S_IREAD | S_IWRITE); } else { //use default input fdin = dup(tmpin); } int ret; int fdout; for(int i = 0; i... (14 Replies)
Discussion started by: AirBronto
14 Replies

8. Shell Programming and Scripting

Variable not working correctly.

Hi, I have a script where I am trying to set a local variable using the following, MYVAR="$NAME"_"$NAME2".txt where say, NAME = one NAME2 = two so I want the output one_two.txt but what I am getting is, two.txt basically the $NAME2 is overwriting, what am I doing wrong? ... (3 Replies)
Discussion started by: walsh_j
3 Replies

9. Shell Programming and Scripting

if not working correctly

Anyone have an idea why this if statement does not work correctly? "test2.sh" 18 lines, 386 characters #!/usr/bin/sh WARNING=80 CRITICAL=95 check_it() { if ] || ];then echo "YES ] || ]" else echo "NO ] || ]" fi } check_it 80.1 check_it 81.1 (3 Replies)
Discussion started by: 2dumb
3 Replies

10. UNIX for Dummies Questions & Answers

Script not working correctly

I have a simple script that I want to run every 30 minutes but only when I execute it. I don't want it to be a crontab job. so i have for example date ls -l who sleep 1800 The first time it executes correctly but after the first time it nevers execute back again. It should execute after... (2 Replies)
Discussion started by: elchalateco
2 Replies
Login or Register to Ask a Question