Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

awk array problem

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk array problem
# 1  
Old 12-26-2008
awk array problem
hi i am trying to perform some calculations with awk and arrays. i have this so far:

Code:
awk 'NR==FNR{ for(i=1; i<=NF; i++) {array[i]+=$i} tot++;next}
{for(i=1; i<=NF; i++) {avg[i]=array[i]/tot} {diff[i]=(array[i] - avg[i])}} {for(i=1; i<=NF; i++) {printf("%5.8f\n",diff[i])}}' "$count".txt "$count".ttt > "$count".rrr

i am using two files to extract data and perform calculations..

problem i get all zeroes in $count.rrr file..

if i remove the diff[i] array it works till the avg[i]..
appreciate any help.
# 2  
Old 12-26-2008
I'm not sure of the objective of the calculations.
Could you provide a sample input files and a desired output with the terse description of the 'objectives', please!
# 3  
Old 12-26-2008
ok i have a file named "$count".txt which has multiple columns..here is a sample from that file:

Code:
Column1  Column2
-0.7136 -0.6172 
-0.7132 -0.6153 
-0.7124 -0.6145 
-0.7125 -0.6153 
-0.7132 -0.6152

"$count".ttt contains the names of the columns as follows:

Code:
Column1
Column2
.
.
.

What I want is this:

Code:
Name of column     Average    Difference
Column1                 X1            Y1
Column2                 X2            Y2 
.
.
.

Average is mean of all the values in all the columns and difference is the difference of each value in a column (for e.g.-0.7136 - mean of all 5 values in the example above) i have succeeded in getting the first two columns but i cannot get the difference right..
# 4  
Old 12-26-2008
Quote:
Originally Posted by npatwardhan
ok i have a file named "$count".txt which has multiple columns..here is a sample from that file:

Code:
Column1  Column2
-0.7136 -0.6172 
-0.7132 -0.6153 
-0.7124 -0.6145 
-0.7125 -0.6153 
-0.7132 -0.6152

"$count".ttt contains the names of the columns as follows:

Code:
Column1
Column2
.
.
.

What I want is this:

Code:
Name of column     Average    Difference
Column1                 X1            Y1
Column2                 X2            Y2 
.
.
.

Average is mean of all the values in all the columns
Hmmm.. Don't quite get this. Do you mean 'the average of all the values in a given column'?
Quote:
Originally Posted by npatwardhan
and difference is the difference of each value in a column (for e.g.-0.7136 - mean of all 5 values in the example above)
Hm.. not clear here either. Are you to subtract all the values for a given column?

It would definetely help if you could provide the ACTUAL output given your sample input - not just 'X1 and Y1....'
Quote:
Originally Posted by npatwardhan
i have succeeded in getting the first two columns but i cannot get the difference right..
# 5  
Old 12-26-2008
something along these lines:
nawk -f count.awk count.txt count.ttt > count.rrr

count.awk:
Code:
FNR==NR {
   if (FNR==1) {
     colN=split($0, colA, FS)
     next
   }
   for(i=1; i<=NF; i++) {
     sum[colA[i]] += $i
     diff[colA[i]] -=  $i
   }
   rows++
   next
}
{
  colList[FNR]=$0
}
END {
  printf("%-12s\t%10s\t%10s\n", "Names of columns", "Average", "Difference")
  for(i=1; i in colList; i++)
     printf("%-12s\t\%10s\t%10s\n", colList[i], sum[colList[i]]/rows, diff[colList[i]])
}

Last edited by vgersh99; 12-26-2008 at 01:13 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Index problem in associate array in awk

I am trying to reformat the table by filling any missing rows. The final table will have consecutive IDs in the first column. My problem is the index of the associate array in the awk script. infile: S01 36407 53706 88540 S02 69343 87098 87316 S03 50133 59721 107923... (4 Replies)
Discussion started by: yifangt
4 Replies

2. Shell Programming and Scripting

How to Assign an shell array to awk array?

Hello All, Can you please help me with the below. #!/bin/bash ARR="No Differences In Stage Between HASH_TOTALS & HASH_TOTALS_COMP For UNINUM:0722075 PROVIDER:5 EXTRACT_DT:30-SEP-12 VER_NUM:1" ARR="No Differences In Stage Between HASH_TOTALS & HASH_TOTALS_COMP For UNINUM:0722075 PROVIDER:5... (14 Replies)
Discussion started by: Ariean
14 Replies

3. Shell Programming and Scripting

Problem with awk array when loading from shell variable

Hi, I have a problem with awk array when iam trying to use awk in solaris box as below..Iam unable to figure out the problem.. Need your help. is there any alternative to make it in arrays from variable values nawk 'BEGIN {SUBSEP=" "; split("101880|110045 101887|110045 101896|110045... (9 Replies)
Discussion started by: cskumar
9 Replies

4. Shell Programming and Scripting

HELP with AWK one-liner. Need to employ an If condition inside AWK to check for array variable ?

Hello experts, I'm stuck with this script for three days now. Here's what i need. I need to split a large delimited (,) file into 2 files based on the value present in the last field. Samp: Something.csv bca,adc,asdf,123,12C bca,adc,asdf,123,13C def,adc,asdf,123,12A I need this split... (6 Replies)
Discussion started by: shell_boy23
6 Replies

5. Shell Programming and Scripting

Using awk array problem

I am trying to map values in the input file, where 2nd column depends on the specific value in the 1st column. When 1st column is A place 1 into 2nd column, when it is B, place 2, when C place 3, otherwise no change. My input: U |100|MAIN ST |CLMN1|1 A |200|GREEN LN |CLMN2|2 1 |12... (4 Replies)
Discussion started by: migurus
4 Replies

6. Shell Programming and Scripting

awk array problem

Hi, Im trying to count bats flying through an infrared beam array. One of the experts here helped me a few months ago but now I am having a problem that is stumping me. here is the original code that works (with two differnt patterns in array): # this has been changed to operate under the... (15 Replies)
Discussion started by: cmp260
15 Replies

7. Shell Programming and Scripting

Challenging Awk array problem

Hi, I rather have a very complicated awk problem here, at least to me. I have two files. File 1: 607 687 174 0 0 chr1 3000001 3000156 -194195276 - L1_Mur2 LINE L1 -4310 1567 1413 1 607 917 214 114 45 chr1 3000237 ... (19 Replies)
Discussion started by: polsum
19 Replies

8. Shell Programming and Scripting

AWK help. how to compare a variable with a data array in AWK?

Hi all, i have a data array as follows. array=ertfgj2345 array=456ttygkd . . . array=errdjt3235 so number or elements in the array can varies depending on how big the data input is. now i have a variable, and it is $1 (there are $2, $3 and so on, i am only interested in $1). ... (9 Replies)
Discussion started by: usustarr
9 Replies

9. Shell Programming and Scripting

AWK Array problem

Dear All, I am facing problem to get right output through awk program I have file in which “B” value is appearing multiple time and I need to capture all these values. My script is BEGIN { FS=" " } { if ( substr($1,1,5) == "START" ) { i =... (2 Replies)
Discussion started by: arvindng
2 Replies

10. Shell Programming and Scripting

Problem with lookup values on AWK associative array

I'm at wits end with this issue and my troubleshooting leads me to believe it is a problem with the file formatting of the array referenced by my script: awk -F, '{if (NR==FNR) {a=$4","$3","$2}\ else {print a "," $0}}' WBTSassignments1.txt RNCalarms.tmp On the WBTSassignments1.txt file... (2 Replies)
Discussion started by: JasonHamm
2 Replies
Login or Register to Ask a Question