awk , conditional involving line and column


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk , conditional involving line and column
# 1  
Old 02-25-2012
awk , conditional involving line and column

Dear All,

I indeed your help for managing resarch data file.

for example I have,

data1.txt :

type of atoms z vz
Si 34 54
O 20 56
H 14 13
Si 40 17
O 65 18
H 70 19
Si 24 20
H 85 21
O 90 12
Si 12 34

I want to extract O and H data using awk where its z value is bigger than maximum z value of Si (40).
that I hope I can data file, say data2.text:
type of atoms z vz
O 65 18
H 70 19
H 85 21
O 90 12

thank you in advance
with best regards,

---------- Post updated at 08:19 PM ---------- Previous update was at 08:13 PM ----------

sorry, once more, I also need the opposite one.
data3.test

Si 34 54
O 20 56
H 14 13
Si 40 17
Si 12 34
# 2  
Old 02-25-2012
Hello ariesto ,

Can you try the below command line .
Code:
 
 
maxSi=`awk '$1 ~/Si/{if(max < $2){max = $2}}END{print max}' data1.txt`;awk -v val=$maxSi '$1 ~ /O/ || $1 ~ /H/{if ($2 > val){print $0}}' data1.txt

# 3  
Old 02-25-2012
I think this will do what you want. Reads data1.txt and generates data2.txt and data3.txt. I was a bit confused with your example of data3 -- I assumed you meant that it should have anything not written to data2.txt.

Code:
awk '
    NR == 1 { print >"data2.txt"; print >"data3.txt"; next; }   # needed if there is a header line
    {
        if( $1 == "Si"  &&  $2+0 > simax )
            simax = $2 + 0      # take note of max value 

        capture[++idx] = $0;   # capture for output lines
        type[idx] = $1;            # save type and value for easy check at end
        value[idx] = $2+0;
    }

    END {
        for( i = 1; i <= idx; i++ )     # for each input line we saw put it someplace based on the z value 
        {
            dest = ((type[i] == "O" || type[i] == "H") && value[i] > simax ) ? "data2.txt" : "data3.txt";
            print capture[i] >dest;
        }
    }
' data1.txt


Last edited by agama; 02-26-2012 at 03:33 PM.. Reason: Realised your input has a header, didn't deal with that initially; consistency change on assignment of value.
# 4  
Old 02-25-2012
A shorter version

Code:
 
awk '$1 ~/Si/{if(max < $2){max = $2}} $1 ~ /O/ || $1 ~ /H/{if ($2 > max){print $0}}'

# 5  
Old 02-25-2012
Quote:
Originally Posted by codemaniac
A shorter version

Code:
 
awk '$1 ~/Si/{if(max < $2){max = $2}} $1 ~ /O/ || $1 ~ /H/{if ($2 > max){print $0}}'

@codemaniac: your shorter version doesn't work for the case below:

Code:
type of atoms z vz
Si 34 54
O 35 56
H 14 13
Si 40 17
O 65 18
H 70 19
Si 24 20
H 85 21
O 90 12
Si 12 34

The first O value is larger than the previous Si, but not larger than the maximum Si value in the file; your script will print it because it's larger than the previously observed Si value.
This User Gave Thanks to agama For This Post:
# 6  
Old 02-25-2012
Thanks Agama for pointing this out , I was in the illusion that if there are two body {}
blocks in an awk , then second will start only if first one parses all the records of a file .

Can you give some more enlightment on how awk processes multiple body blocks . {}
# 7  
Old 02-26-2012
Quote:
Originally Posted by codemaniac
Thanks Agama for pointing this out , I was in the illusion that if there are two body {}
blocks in an awk , then second will start only if first one parses all the records of a file .

Can you give some more enlightment on how awk processes multiple body blocks . {}
I don't want to hijack this thread, so I'll just post a link to a pretty decent on-line overview of awk. If you still have questions, create a thread in shell programming and someone will be eager to expand further.

Awk - A Tutorial and Introduction - by Bruce Barnett
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Conditional Column Value

Hi Folks, I'm trying tog ain further experience with shell programming and have set my a small goal of writing a little filesystem monitoring script. So far my output is as follows: PACMYDB03 Filesystem Size Used Avail Use% Status /usr/local/mysql/data ... (5 Replies)
Discussion started by: Axleuk
5 Replies

2. Shell Programming and Scripting

Filter on one column and then perform conditional calculations on another column with a Linux script

Hi, I have a file (stats.txt) with columns like in the example below. Destination IP address, timestamp, TCP packet sequence number and packet length. destIP time seqNo packetLength 1.2.3.4 0.01 123 500 1.2.3.5 0.03 44 1500 1.3.2.5 0.08 44 1500 1.2.3.4 0.44... (12 Replies)
Discussion started by: Zooma
12 Replies

3. UNIX for Dummies Questions & Answers

awk help: how to pull phrase and one column from line above?

Hi everyone, Here's my awk statement so far: awk '/TOTAL TYPE:/{print x;print};{x=$0}' file1 >file2 'file1' has too much proprietary data in it to include here, so let's go with the output from code above. It looks like this: 123456 JAMES T KIRK D ... (2 Replies)
Discussion started by: Scottie1954
2 Replies

4. Shell Programming and Scripting

Awk next line as column

Hi, This forum rocks. I think this might be an easy thing, but since I am new to awk, please help me. input: x y z 1 a b c 2 d e f 3 g h i 7 output: x y z 1 a b c 2 d e f 3 (8 Replies)
Discussion started by: jacobs.smith
8 Replies

5. Shell Programming and Scripting

Counting rows line by line from a specific column using Awk

Dear UNIX community, I would like to to count characters from a specific row and have them displayed line-by-line. I have a file called testAwk2.csv which contain the following data: rabbit penguin goat giraffe emu ostrich I would like to count in the middle row individually... (4 Replies)
Discussion started by: vnayak
4 Replies

6. Shell Programming and Scripting

awk search column, print line

Hello. I've been banging my head against walls trying to search a comma delimited file, using awk. I'm trying to search a "column" for a specific parameter, if it matches, then I'd like to print the whole line. I've read in multiple texts: awk -F, '{ if ($4 == "string") print $0 }'... (2 Replies)
Discussion started by: Matthias03
2 Replies

7. Shell Programming and Scripting

Replace a column with a value conditional on a value in col1

Hi, Perhaps a rather simple problem...? I have data that looks like this. BPC0013 ANNUL_49610 0 0 1 1 BPC0014 ANNUL_49642 0 0 2 1 BPC0015 ANNUL_49580 0 0 1 1 BPC0016 ANNUL_49596 0 0 2 1 BPC0017 VULGO_49612 0 0 1 1 BPC0018 ANNUL_49628 0 0 1 1 BPC0019 ANNUL_49692 0 0 2 1 170291_HMG... (4 Replies)
Discussion started by: genehunter
4 Replies

8. Shell Programming and Scripting

Conditional aggregation and print of a column in file

Hi My input file looks like field1 field2 field3 field4 field5 field1 field2 field3 field4 field5 field1 field2 field3 field4 field5 :::::::::::: :::::::::::: There may be one space of multiple spaces between fields and no fields contains spaces in them. If field 1 to 4 are equal for... (3 Replies)
Discussion started by: bittoo
3 Replies

9. Shell Programming and Scripting

awk convert from line to column

i have an output like this : 012008 25760883 022008 12273095 032007 10103 032008 10115642 042007 20952798 but i would like to have it like this 012008,25760883 022008,12273095 032007,10103 032008,10115642 042007,20952798 (4 Replies)
Discussion started by: jarmouda
4 Replies

10. Shell Programming and Scripting

line to column using awk

hi, i'm a newbie and this is my first post here. 'hope all of you fellow members are doing fine. so here is my first thread to ask for help on how to use awk language to do this task. i have a file to process and after a series of other awk commands and shell scripts i managed to convert the... (11 Replies)
Discussion started by: genix2008
11 Replies
Login or Register to Ask a Question