awk program


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk program
# 1  
Old 08-11-2011
awk program

I have a csv file as below :

Code:
NAME,5a-6a,6a-7a,7a-8a,8a-9a,9a-10a,10a-11a,11a-12n,12n-1p,13p-14p,14p-15p,15p-16p,16p-17p,17p-18p,18p-19p,19p-20p,20p-21p,21p-22p,22p-23p,11p-12m,  TOTALS
,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,       Num/Avg
---------------,--------,--------,--------,--------,--------,--------,--------,--------,--------,--------,--------,--------,--------,--------,--------,--------,--------,--------,--------,     -------
Env00,0/0.00,3/0.69,45/2.61,42/2.07,65/2.52,32/2.79,37/2.50,53/1.13,68/3.46,19/2.28,5/0.38,6/7.36,3/3.95,2/0.44,3/9.66,2/5.24,1/0.43,1/11.03,1/0.46,  388/2.58

I need to find out the columns where value before "/" is > 25 && value after "/" > 1

So as per above file, the o/p should be

Code:
NAME,7a-8a,8a-9a,9a-10a,10a-11a,11a-12n,12n-1p,13p-14p,   TOTALS
,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg,Num/Avg ,Num/Avg
---------------,--------,--------,--------,--------,--------,--------, --------
Env00,45/2.61,42/2.07,65/2.52,32/2.79,37/2.50,53/1.13,68/3.46, 388/2.58

# 2  
Old 08-11-2011
Try this:
Code:
#!/bin/bash
cols=$(awk -F, '
  /^Env00/{for(i=1;i<=NF;i++){
       split($i,a,"/"); 
       if(a[1]>25 && a[2]>1) 
         printf "%d,", i
     }
}' input | sed 's/,$//')  #get the column numbers
cut -d, -f1,$cols input  #extract the first column and the ones stored in $cols

# 3  
Old 08-11-2011
Code:
gawk -F, '{
    for(i=1;i<=NF;i++)
        {if(i==1||i==NF){a[NR,i]=$i;c[i]=i}
            else{
                if(NR!=4){a[NR,i]=$i}
                else{split($i,b,"/");if(b[1]>25&&b[2]>1){a[NR,i]=$i;c[i]=i}
                }
            }
        }
    }
    END{
        for(i=1;i<=NR;i++){
            for(j=1;j<=asort(c,d);j++)printf a[i,d[j]] FS
            print ""
        }
    }' urfile

# 4  
Old 09-05-2011
Thanks. but function asort doesn't seem to be working for me
# 5  
Old 09-05-2011
Maybe this:

Code:
#!/bin/sh

gawk '
BEGIN {

   FS = OFS = ","

   NumHead = 3   # Assume:  3-header lines
   NumRead = 0   

   # read the three header lines into a 2-D Array ...

   while ( getline > 0 )
   {
      NumRead ++ 

      for ( i = 1 ; i <= NF ; i ++ )
      {
         HeadAry[ NumRead,i ] = Trim( $i )
      }
      if ( NumRead >= NumHead )
      {
         break
      }
   }
   NumMatch = 0
   delete MatchAry       # GLOBAL
}
function DumpData( NumMatch, NumFld,   i, j, D )
{
   if ( NumMatch == 0 )
   {
      delete MatchAry    # GLOBAL
      return( 0 )
   }

   # Dump the three header lines

   for ( i = 1 ; i <= NumHead ; i ++ )
   {
      D = ""
      printf( "%s%s", D, HeadAry[i,1] )
      D = ","

      for ( j = 2 ; j <= NumFld ; j ++ )
      {
         if ( j in MatchAry )
         {
            printf( "%s%s", D, HeadAry[i,j] )
         }
      }
      print ""
   }

   # Dump the Fields from the Current Data Record

   D = ""
   printf( "%s%s", D, $1 )
   D = ","

   for ( j = 2 ; j <= NumFld ; j ++ )
   {
      if ( j in MatchAry )
      {
         printf( "%s%s", D, MatchAry[ j ])
      }
   }
   print ""

   delete MatchAry       # GLOBAL

   return( 0 )
}
function Trim( InStr )
{
   gsub( /^[\t\n\r ]*/, "", InStr )
   gsub( /[\t\n\r ]*$/, "", InStr )

   return( InStr )
}
# main
{
   # check for qualifying fields, insert indices into MatchAry[]

   for ( i = 2 ; i <= NF ; i ++ )
   {
      if (( N = split( $i, SplitAry, "/" )) == 2 )
      {
         if (( SplitAry[1] +0 > 25 ) && ( SplitAry[2] +0 > 1 ))
         {
            NumMatch ++
            MatchAry[ i ] = $i ""
         }
      }
   }
   NumMatch = DumpData( NumMatch, NF )

}' "$@"

# 6  
Old 09-05-2011
Thanks.. I quite didn't understand how do I pass the input file as an argument ??
# 7  
Old 09-05-2011
deo_kaustubh --

Assume your Data is in data.txt ...

1. Save the CODE as a file, say foo.sh
2. chmod 755 foo.sh
3. ./foo.sh data.txt

The "$@" at the end of foo.sh will accept any number of files as input.

-- kjh
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

If else in awk program

Hi All , I have set of input files with one of the fields as below File 1 -Field 1=BUDGET_CURR_FX File 2 -Field 1=BUDGET_MTH_AVGFX File 3 -Field 1=BUDGET_PREV Now i need to include one extra field in the new file as below Output File 1 -Field 1= BUDGET Field2=CURRENT_FX Output File... (2 Replies)
Discussion started by: Hypesslearner
2 Replies

2. Shell Programming and Scripting

awk program in perl

Hi All, I have an AWK code snippet which I want to use in Perl. How can I achieve the same thing in perl? Here I am searching for a pattern in a file and from that matching line, I am extracting the 3rd column value and storing it in a variable which I later on use this value in a if condition. ... (2 Replies)
Discussion started by: sanzee007
2 Replies

3. Shell Programming and Scripting

Help with awk program

i have two files, one looks like this (file1): novelMiR_892 novelMiR_891, novelMiR_852 novelMiR_893 novelMiR_1661 novelMiR_854 novelMiR_1210 novelMiR_1251 novelMiR_855 novelMiR_1252 novelMiR_897 novelMiR_2336,novelMiR_2335,and the second like this... (5 Replies)
Discussion started by: dietmar13
5 Replies

4. Shell Programming and Scripting

AWK program....

Dear All, facing problem to get data in different fields. SO i am using # to get the data.. please refer my code below... BEGIN { FS=" " } { if ( $1 == "START" ) { i = i+1; SFILENAME = FILENAME } if ( substr($1,2,8) == "filename" ) ... (1 Reply)
Discussion started by: arvindng
1 Replies

5. Shell Programming and Scripting

Problem with awk awk: program limit exceeded: sprintf buffer size=1020

Hi I have many problems with a script. I have a script that formats a text file but always prints the same error when i try to execute it The code is that: { if (NF==17){ print $0 }else{ fields=NF; all=$0; while... (2 Replies)
Discussion started by: fate
2 Replies

6. Shell Programming and Scripting

AWK program

Hi all, I have the following problem and hope someone could help me. I have 184 files, each with 5 columns (c1, c2, c3, c4, c5). I am only interrested in column 5, and would like to paste column 5 from all the 184 files into one file. I have tried the following with two files awk... (20 Replies)
Discussion started by: awkliker
20 Replies

7. UNIX for Dummies Questions & Answers

AWK Program

:(Hi all, I have a doubt in AWK program. I am writing an awk program which accepts a parameter as input and it should display the corresponding details. if the country as "US" it should be displayed as "United States of America" and the country as "IN" India should be displayed. How can I... (2 Replies)
Discussion started by: sivakumar.rj
2 Replies

8. UNIX for Dummies Questions & Answers

AWK program

Hi all, I need to grep the 3 characters from a file, and to fetch the corresponding words to that character. My file is in the following format.. The below text will be in the separate file....say file2.txt ABC This is the first text. DEF This is the second text. GH1 9.8.7890 AB1... (1 Reply)
Discussion started by: sivakumar.rj
1 Replies

9. Shell Programming and Scripting

Error in AWK Program

Hi Friends, I need your help. I am not able to execute one awk program .If you can solve the following small program then i can solve other one. $ vi prg #!/bin/awk -f BEGIN { # Print the squares from 1 to 10 the first way i=1; while (i <= 10) { ... (3 Replies)
Discussion started by: bikas_jena
3 Replies

10. UNIX for Dummies Questions & Answers

AWK Program File Help

I have some .dat files that I cannot open and read the data. It is an awk program file, and my question would be to you all is there a way to convert this awk file to ascii text? Thanks (10 Replies)
Discussion started by: ryangfm
10 Replies
Login or Register to Ask a Question