Sorting awk array output?


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Sorting awk array output?
# 8  
Old 08-11-2011
If you're using gawk there is an asort function. If you're piping a command in awk you'd quote it. like:

Code:
print "stuff" | "sort -k4"

but it's usually done as so if used repetitively:

Code:
cmd = "sort -k4"
print "stuff" | cmd
....
close(cmd)

But the pipes are unidirectional. I wouldn't expect it to print to screen. You'd have to use file redirection.

Code:
cmd = "sort -k4 > output.txt"

Remember to close() it or it wouldn't receive the end of input signal and produce results until awk exits. Then maybe a

Code:
print "header"
while ((getline < "output.txt") > 0) {
    print;
}
print "footer"

If it's already a large stand-alone script invoked with a '#!/usr/bin/awk -f' I'd personally add a sort function, or try gawk's if you're OK with being dependent on it.

Edit: I guess it will print to screen seeing yazu's example. I was just reading the forums on lunch and didn't have a terminal to play with. :\
# 9  
Old 08-11-2011
Quote:
Originally Posted by yazu
Add double quotes:
Code:
printf ( format,usersize, u_count[i], i);break } } } | "sort -k4"

Try this example with and without quotes:
Code:
echo 'a
d
b' | awk '{print | "sort"}'
a
b
d

That did not work.. it generates an error on the pipe..
# 10  
Old 08-11-2011
Can you show us how are you calling the script?
# 11  
Old 08-11-2011
Oh... yes. Sorry:
Code:
printf ( format,usersize, u_count[i], i)  | "sort -k4";break } } }

This User Gave Thanks to yazu For This Post:
# 12  
Old 08-11-2011
Quote:
Originally Posted by bartus11
Can you show us how are you calling the script?
Code:
#!/usr/bin/env bash
#
# 
# Bash Script written by R. Blaas
#
# This script will find files of a specific type and displays the full path and size
# Also a total of found files and size is displayed per Department and an overal total found files and size
# 
# if nothing is passed to the script, show usage and exit
[[ -n "$1" ]] || { echo “Usage: usage.sh [Variable]“; exit 0 ; }

# Make sure only root can run our script
if [ "$(id -u)" != "0" ]; then
    echo "This script must be run as root" 1>&2
    exit 1
fi

# Variables
POSTMASTER="My email"

DATE=`date +"%d%m%Y"` 
DATIME=`date +"%Y%m%d%H%M"`
DAGNAAM=`date +"%A"`

# Set current directory to variable $CURRENT
CURRENT=/opt/local/COMPANY/usage

# Set the log directory
DIR_LOG=$CURRENT"/log"

# Catch search variable
SEARCH=`echo $1 | sed 's/*//' | sed 's/.//'`

# Check if directory exists
if test ! -d "$DIR_LOG"
 then
    mkdir "$DIR_LOG"
fi

# Create temporary file for log messages
POSTMLOG=$DIR_LOG"/"$SEARCH"-usage.log"

# BEGIN
logger "Script start (usage.sh)"
echo `date` start of script usage.sh > $POSTMLOG
echo "" >> $POSTMLOG
echo Search variable = $SEARCH >> $POSTMLOG
echo "" >> $POSTMLOG

# Search Command where $1 is the type to find. Search will start at current location.
find . -iname $1 -exec ls -l {} \; | awk 'BEGIN { 

# Initialize all Arrays
    size = "0"; 
    u_count[""]=0;
    all_count[""]=0;
} 
{
# Assign field names
    sizes=$5
    split($9,a,"/")
    dept=a[2]

# Count of number of files
    u_count[dept]++;
    all_count["* *"]++;

# Count disc space used
    u_size[dept]+=sizes;
    all_size["* *"]+=sizes;
}
{
    for (I=9 ; I<=NF ; I++) { x++ } { size=size+$5 } 
}
END { hum[1024**4]="Tb"; hum[1024**3]="Gb"; hum[1024**2]="Mb"; hum[1024]="Kb"; 
    for (x=1024**4; x>=1024; x/=1024) { if (size>=x) { { printf "Total Size = ",NR } 
    printf "%.2f %s\n\n",size/x,hum[x];break } 
    }
}

# Output
{
        for (I=9 ; I<=NF ; I++) { x++ } { size=size+$5 }
}
END    { { FS = ":";
    format = "%11s %6s %-16s\n";
    prinft "\n"
    printf ( format, "Size","Count","Who" ) }

    for (i in u_count) {
        if (i != "") {
        { hum[1024**4]="Tb"; hum[1024**3]="Gb"; hum[1024**2]="Mb"; hum[1024]="Kb";
        for (x=1024**4; x>=1024; x/=1024) { if (u_size[i]>=x) {
    usersize = sprintf ( "%.2f %s", u_size[i]/x,hum[x] )
        printf ( format,usersize, u_count[i], i);break } } } 
              } 
        }
}  
{
        for (I=9 ; I<=NF ; I++) { x++ } { size=size+$5 }
}
END     { for (i in all_count) {
        if (i != "") {
        { hum[1024**4]="Tb"; hum[1024**3]="Gb"; hum[1024**2]="Mb"; hum[1024]="Kb";
        for (x=1024**4; x>=1024; x/=1024) { if (all_size[i]>=x) {
    allsize = sprintf ( "%.2f %s", all_size[i]/x,hum[x] )
        printf ( format,allsize, all_count[i], "Total");break } } } 
            } 
    } 
}' >> $POSTMLOG

echo "" >> $POSTMLOG
echo `date` end of search >> $POSTMLOG

echo `date` send report to POSTMASTER >> $POSTMLOG

# Mail report to POSTMASTER
mail -s " usage.sh REPORT `date`" $POSTMASTER < $POSTMLOG
 if [ "$?" == "0" ]; then
  echo Mail sent successful! >> $POSTMLOG
 else echo Mail sent unsuccesful! >> $POSTMLOG
 fi

echo "" >> $POSTMLOG
echo `date` end of script usage.sh >> $POSTMLOG
echo "" >> $POSTMLOG

# Preserving logfile
mv "$POSTMLOG" "$DIR_LOG/$DATIME-$SEARCH-usage.log"

logger "Script end (usage.sh)"

This is the complete script
# 13  
Old 08-11-2011
So try doing this modification:
Code:
END     { for (i in all_count) {
        if (i != "") {
        { hum[1024**4]="Tb"; hum[1024**3]="Gb"; hum[1024**2]="Mb"; hum[1024]="Kb";
        for (x=1024**4; x>=1024; x/=1024) { if (all_size[i]>=x) {
    allsize = sprintf ( "%.2f %s", all_size[i]/x,hum[x] )
        printf ( format,allsize, all_count[i], "Total");break } } } 
            } 
    } 
}' | sort -rk3 >> $POSTMLOG

# 14  
Old 08-11-2011
Quote:
Originally Posted by yazu
Oh... yes. Sorry:
Code:
printf ( format,usersize, u_count[i], i)  | "sort -k4";break } } }

Ok, one step further...

The sort works but now the last line is added above the sort instead of below:
(See bold Text)
Code:
    Size  Count Who             
   6.16 Gb    308 Total           
  63.02 Mb     56 Automatisering  
   3.64 Mb      1 Karaoke         
  45.79 Mb      2 Muziekfeesten   
   4.95 Gb    175 Opgelicht       
  72.67 Mb     12 Radar           
 493.33 Mb     24 RegelRecht      
 410.69 Mb     10 Vermist         
 146.40 Mb     28 Zappsport

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

ksh : need to store the output of a awk command to a array

I have awk command : awk -F ' ' '{ print $NF }' log filename And it gives the output as below: 06:00:00 parameters: SDS (2) no no no no doc=4000000000). information: (6 Replies)
Discussion started by: ramprabhum
6 Replies

2. Shell Programming and Scripting

Sorting output of AWK array

I need help to sort the output of an awk array Example datadata="1 blue 2 green 3 blue 4 yellow 5 blue 6 red 7 yellow 8 red 9 yellow 10 yellow 11 green 12 orange 13 black" My awk line to get output in one lineecho "$data" | awk ' {arr++; next} END { for (i in arr) { if(arr>1 )... (2 Replies)
Discussion started by: Jotne
2 Replies

3. Shell Programming and Scripting

Need to have output of AWK array in one line

I have this code echo $logfile | awk ' {arr++; next} END { for (i in arr) {print i} }' that gives me this output result1 result2 result3 I try to figure out how to get it like this result1 result2 result3 (4 Replies)
Discussion started by: Jotne
4 Replies

4. Shell Programming and Scripting

awk assign output of array to specific field-number

With this script i want to print the output to a specific field-number . Can anybody help? awk 'NR=FNR{split(FILENAME,fn,"_");nr=$2;f = $1} END{for (i=1;i<=f;i++) print i,$fn=nr}' input_5.csv input_6.csvinput_5.csv 4 135 5 185 6 85 11 30input_6.csv 1 90 3 58 4 135 7 60 8 55 10... (1 Reply)
Discussion started by: sdf
1 Replies

5. Shell Programming and Scripting

awk output error while loop through array

Have built this script, the output is what I needed, but NR 6 is omitted. Why? Is it an error? I am using Gawk. '{nr=$2;f = $1} END{for (i=1;i<=f;i++) if (nr != i) print i, nr }' input1.csv >output1.csvinput1.csv 1 9 3 5 4 1 7 6 8 5 10 6 output1.csv > with the missing line number 6. 6 is... (5 Replies)
Discussion started by: sdf
5 Replies

6. Shell Programming and Scripting

awk - Pre-populating an array from system command output

So, here's a scenario that requires the same logic as what I'm working on: Suppose that you have a directory containing files named after users. For awk's purposes, the filename is a single field-- something parse-friendly, like john_smith. Now, let's say that I'd like to populate an array in... (2 Replies)
Discussion started by: treesloth
2 Replies

7. Shell Programming and Scripting

perl array sorting

Hi All, I have an array in perl as @match = (201001,201002,201001,201002); I am trying to sort this array as @match = sort(@match); print "@match"; I dont see the output sorted any answers I also tried another way, but still the results are not sorted foreach my $match (sort { $a... (2 Replies)
Discussion started by: bsdeepu
2 Replies

8. Shell Programming and Scripting

Sorting Awk generalized array

Generalized arrays take any type of variable(s) as subscripts, but the subscript(s) are treated as one long string expression. The use of for(a in x) on a generalized array will return all of the valid subscripts in some order, not necessarily the one you wished. How can I make it so that i... (2 Replies)
Discussion started by: gio001
2 Replies

9. Shell Programming and Scripting

bash:awk output into an array

Hi, I have a file 1:apple orange:one 2:banana:two 3:cherry:3 When I do awk -F: ' { print $2 } ' file apple orange banana cherry Now, when i redirect awk output to the file it has issue with strings #!/bin/bash FILEA=file A=(`awk -F: ' { print $2 } ' $FILEA `) echo ${A} (2 Replies)
Discussion started by: phamp008
2 Replies

10. Shell Programming and Scripting

move output of awk to array

Hi experts, I have a the following awk command, awk '{print $1}' /users/jon/list4.txt. The output is 123 787 888 ... ... I want to move the output to array using shell programming. My shell is tcsh. Is it possible to move to array using shell porg? I know its possible in... (14 Replies)
Discussion started by: amitrajvarma
14 Replies
Login or Register to Ask a Question