Stuck with awk !!!


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users Stuck with awk !!!
# 8  
Old 09-14-2013
Quote:
Originally Posted by Scott
Code:
awk '
  NR == FNR { if( !$2 ) { B++; next }
              BANK[B]+= $1
              next
            }
  ! $2 { T = BANK[++C]; print $0 " (total " T ")"; next }
  {
    printf( "%.2f ", $1 / T * 100 )
  } 1
' file file

Code:
Bank1.sss (total 69)
91.30      63  Result code [0] 
2.90       2  Result code [106] 
5.80       4  Result code [108] 
Bank2.sss (total 482)
98.34     474  Result code [0] 
0.21       1  Result code [103] 
0.83       4  Result code [106] 
0.41       2  Result code [187] 
0.21       1  Result code [580]

Wow, this is what I needed, but I doubt that I would have been able to create a awk script like that...

Any training material that will help me to code like you did?
# 9  
Old 09-14-2013
Quote:
Originally Posted by zsycho
Any training material that will help me to code like you did?
I wouldn't wish that on you Smilie I've taken a somewhat lazy approach by reading the same file twice, so if the file is very large, you might want to rewrite that to do everything in a single pass. An exercise for the reader!

The web has a ton of handy awk tutorials. Just search for "awk tutorial" and you'll find a whole bunch of 'em.

The first one on the list is as good as any:

Awk - A Tutorial and Introduction - by Bruce Barnett
# 10  
Old 09-20-2013
THanks for the suggestion..

I came up with the following script and iit is working fine on my local Ubuntu system. But when i tried to execute this script on one of the old debian server, it prompted me with the error message indicating readarray not found. or something similar.

Seems that the bash version is older than required on the sever. What change should I do that will simulate readarray command.

I am trying the following but it ain't working. Help me..
Code:
count=$(wc $file | awk {'print $1 -1'})

for i in `seq 0 $count`;
do
        for z in `cat $file`;
        do
        array[$i]= $z
        done   
        echo "$array[@]"
done

$file contents :
Code:
38.33% accounts for bank1.scr script failed with error code [130]
27.37% accounts for bank2.scr script failed with error code [102]
25.00% accounts for bank3.scr script failed with error code [101]
28.57% accounts for bank4.scr script failed with error code [102]
100.00% accounts for bank5.scr script failed with error code [185]



Actual script:
Code:
#!/bin/bash
#
# Nagios plugin to monitor 

###--Nagios Exit Status--###
STATE_OK=0
STATE_CRITICAL=1


#cc_scrape_log=/CustomerCentral/logs/.....
export cc_scrape_log=/home/zshaikh/Documents/CCScrape13091111.log
#export cc_scrape_log=/home/zshaikh/Documents/CCScrape130903.log
export fi_list=/home/zshaikh/Documents/FI_list
export fi_error_details_file=/tmp/fi_error_details
export final_op_file=/tmp/final_result

if [ -f $fi_error_details_file ] ; then
        cat /dev/null > $fi_error_details_file
fi

if [ ! -f $fi_error_details_file ] ; then
        touch $fi_error_details_file
fi

###--Start initial Checks--###
if [ ! -f $cc_scrape_log ] ; then
        echo "CRITICAL - Scraper logs not found for today's date."
        exit $STATE_CRITICAL
fi


#Generate error report for each FI

for i in `cat $fi_list`; do echo $i >> $fi_error_details_file; grep $i $cc_scrape_log | grep "Result code"| cut -d~ -f2 | sort | uniq -c >> $fi_error_details_file; done


#Generate failure rate (in %) for each FI

Output=$(awk 'NR == FNR { if( !$2 ) { B++; next } BANK[B]+= $1;next} ! $2 { T = BANK[++C]; print $0 " (total " T ")"; next } {  printf( "%.2f ", $1 / T * 100 )} 1' $fi_error_details_file $fi_error_details_file | awk '$1 > 20' | grep -v "Result code \[0\]" | grep -B 1 "Result code")

check_op=$(echo $Output | grep -c [0-9])

if [ $check_op -lt 1 ]; then

echo "OK - No New error found"
        STATE=$STATE_OK
else

        echo $Output | awk 'BEGIN {RS="--"} {print $4 "% accounts for "$1" script failed with error code " $8}' > $final_op_file

        COUNT=$(grep -c scr $final_op_file)
        if [ $COUNT -gt 0 ] ; then

                readarray -t testarray < <(cat $final_op_file)
                for i in "${testarray[@]}"; 
                do
                        echo "CRITICAL ::: $i"; done
                        echo "Total $COUNT scripts failed ";
                        STATE=$STATE_CRITICAL
        fi
fi

# 11  
Old 09-20-2013
I guess you could try to simulate that bash 4 command with something like this:

Code:
readarray() {
  local i
  if [ "$1" = "-t" ] && [ $# = 2 ]
  then
    while read "$2[$((i++))]";
    do
      :
    done
  fi
}

Or just
Code:
oldIFS=$IFS
IFS=$'\n'
testarray=( $(<"$final_op_file") )
IFS=$oldIFS


But what is the use of reading a file into an array, if it is only used for enumeration.
Try something like:

Code:
COUNT=0
while read i
do
  echo "CRITICAL ::: $i"
  ((COUNT++))
done < "$final_op_file"

echo "Total $COUNT scripts failed ";
STATE=$STATE_CRITICAL


Last edited by Scrutinizer; 10-14-2013 at 07:08 PM.. Reason: changed wrong single to double parentheses
# 12  
Old 09-20-2013
Quote:
Originally Posted by Scrutinizer
I guess you could try to simulate that bash 4 command with something like this:

Code:
readarray() {
  local i
  if [ "$1" = "-t" ] && [ $# = 2 ]
  then
    while read "$2[$((i++))]";
    do
      :
    done
  fi
}

But what is the use of reading a file into an array, if it is only used for enumeration.
Try something like:

Code:
COUNT=0
while read i
do
  echo "CRITICAL ::: $i"
  (COUNT++)
done < "$final_op_file"

echo "Total $COUNT scripts failed ";
STATE=$STATE_CRITICAL

thanks... I will try that and will let know...


I want to read a file into an array because when printing the variable contents directly does not results in expected output.

I get the following output if I dont use array.

Code:
38.33% accounts for bank1.scr script failed with error code [130] 27.37% accounts for bank2.scr script failed with error code [102] 25.00% accounts for bank3.scr script failed with error code [101] 28.57% accounts for bank4.scr script failed with error code [102] 100.00% accounts for bank5.scr script failed with error code [185]

# 13  
Old 10-14-2013
Quote:
Originally Posted by zsycho
thanks... I will try that and will let know...


I want to read a file into an array because when printing the variable contents directly does not results in expected output.

I get the following output if I dont use array.

Code:
38.33% accounts for bank1.scr script failed with error code [130] 27.37% accounts for bank2.scr script failed with error code [102] 25.00% accounts for bank3.scr script failed with error code [101] 28.57% accounts for bank4.scr script failed with error code [102] 100.00% accounts for bank5.scr script failed with error code [185]

Yes there was a mistake with single parentheses where they should be double. I corrected it in my post.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Homework & Coursework Questions

stuck on assignment

I was given this to do, Write a Shell script to automatically check that a specified user is logged in to the computer. The program should allow the person running the script to specify the name of the user to be checked, the frequency in seconds at which the script should check. If a... (1 Reply)
Discussion started by: operator
1 Replies

2. Linux

Stuck in pthread_cond_signal()

I am developing a multi-threaded library that helps the transformation of messages between threads in different processes using shared memory. I am using the pthreads condition facility in order to synchronize access to the shared memory slots through which the messages are passed. My test... (2 Replies)
Discussion started by: dhzdh
2 Replies

3. Shell Programming and Scripting

awk getting stuck after BEGIN

I am beginner in awk awk 'BEGIN{for(i=1;(getline<"opnoise")>0;i++) arr=$1}{print arr}' In the above script, opnoise is a file, I am reading it into an array and then printing the value corresponding to index 20. Well this is not my real objective, but I have posted this example to describe... (1 Reply)
Discussion started by: akshaykr2
1 Replies

4. Shell Programming and Scripting

I am stuck in my script

Hi All I have script that find 777 dir with specific extension like .php .Now after finding all 777 directory i will place in httpd.conf using a directory directive ,Now i was not do that,if directory entry exitst in httpd.conf then script ignor it dont show me at stdout else if it dont find... (2 Replies)
Discussion started by: aliahsan81
2 Replies

5. Shell Programming and Scripting

help! im stuck..

I want to search for the line with the group name and add the user into the group. The file format is the same as /etc/group The code i wrote is egrep "^$newGID" $group >/dev/null FS=":" oldData=awk -F: '{print $3}' newData= "$oldData,$newUser" sed -n $4/$newData $group but a friend... (1 Reply)
Discussion started by: cherrywinter
1 Replies

6. AIX

really stuck- need to get a variable within a variable- AWK

Hi all, I have been struggling with this all day, and it is key to a conversion database I have to write. The data converts the information out of an array using AWK, and basically all I have to do is figure out how to get the value of a variable inside a variable. Right now at its... (11 Replies)
Discussion started by: jeffpas
11 Replies

7. Programming

I'm stuck :(

Suppose that I have some data: 12,30 12,45 2,3 7,8 3,9 30, 8 45,54 56,65 Where (a,b) indicates that a is connected to b. I want to get all connected nodes to one point. For instance, the output of the above example should be something like: Group 1 2,3 3,9 Group 2 12,30 12,45... (4 Replies)
Discussion started by: Legend986
4 Replies

8. UNIX for Dummies Questions & Answers

stuck and confused

#!/bin/bash echo $1 | cat - $2 >> /tmp/$$ && mv /tmp/$$ $2 im trying to get the first argument to go in the middle of the second argument which is a file, anyone any ideas. i have only managed to get it to go on the end or the front. been fiddling about with wc -l, i get the number of lines... (5 Replies)
Discussion started by: iago
5 Replies

9. Shell Programming and Scripting

Got stuck so plz help

I'm having problem writing a shell script using bash that takes a file as an argument. The script should be able to determine what permissions the owner, group and everybody has for the file passed in. could anyone plz help me out. (3 Replies)
Discussion started by: boris
3 Replies

10. UNIX for Advanced & Expert Users

stuck....!

I have been busy reading away on devices and filesystems and I am stuck on a particular subject matter.. I'm not understanding the concept behind mknod mkfifo makedev or related commands.. can anyone shed some light on the subject.! any feedback welcome! moxxx68 (0 Replies)
Discussion started by: moxxx68
0 Replies
Login or Register to Ask a Question