Visit Our UNIX and Linux User Community


awk to split one field and print the last two fields within the split part.


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk to split one field and print the last two fields within the split part.
# 1  
Old 04-16-2012
awk to split one field and print the last two fields within the split part.

Hello;
I have a file consists of 4 columns separated by tab. The problem is the third fields. Some of the them are very long but can be split by the vertical bar "|". Also some of them do not contain the string "UniProt", but I could ignore it at this moment, and sort the file afterwards. Here is the input file like (>100k rows!!!):
Code:
B_1019927    ES904790    Unknown    Unknown protein
B_1065532    JCVI_27855   JCVI_27855|gb|DW997385|gb|CD815403|gb|EV204160|gb|CD813268|gb|EX038736|UniProt|Q8RWM2    Putative uncharacterized protein At4g36940
B_1065533    JCVI_27856   JCVI_27856|gb|CD826551|gb|DY030639|gb|CX272767|gb|EV056662|gb|EX022554|gb|EX038271|UniProt|Q3E9T4    Protein At4g31430
B_1065534    JCVI_27857   JCVI_27857|gb|DY023794|gb|EE530065|gb|CX280035|UniProt|Q84WF5    Probable VAMP-like protein At1g33475
B_1065535    JCVI_27858   JCVI_27858|gb|ES941909|gb|ES940913|gb|EE514812|UniProt|Q8LBM4    Iron-sulfur assembly protein IscA-like 1, mitochondrial precursor

I want the output file with the truncated field-3, which is like following:
Code:
B_1019927    ES904790    Unknown    Unknown protein
B_1065532    JCVI_27855    UniProt    Q8RWM2     Putative uncharacterized protein At4g36940
B_1065533    JCVI_27856    UniProt    Q3E9T4     Protein At4g31430
B_1065534    JCVI_27857    UniProt    Q84WF5     Probable VAMP-like protein At1g33475
B_1065535    JCVI_27858    Uniprot    Q8LBM4     Iron-sulfur assembly protein IscA-like 1, mitochondrial precursor

What I did is by matching the "UniProt" string in the third field, split this field and only print the last two columns of the split fields, the original 3 fields ($1, $2, $4) need to be printed untouched.

Here is my code:
Code:
awk 'FS="\t" {for(i=1;i<=NF;i++) if(match($i,"UniProt")) split($i, a, "|"); {print $1, "\t", $2, "\t", $a[-2],"\t", $a[-1],"\t",$NF}}' infile.csv

Have struggled for a while, but did not work out. Appreciate your expertise to help me out. Thanks a lot! Yifang
# 2  
Old 04-16-2012
Based on your sample I think this works. My assumption was that any row with pipe separated elements in the thrid field would have UniProt as the next to last in the series. If not, use a[n-1] if you want to capture that data, or add an if to test if a[n-1] is UniProt.

Code:
awk -F "\t" '
    {
        n = split( $3, a, "|" );
        if( n < 2 )
            data = sprintf( "%s\t", a[1] );
        else
            data = sprintf( "%s\t%s", "UniProt", a[n] );  #assumption that all pipe separated data contains UniProt at a[n-1]

        printf( "%s\t%s\t%s\t%s\n", $1, $2, data, $4 );
    }
' input-file >output-file


Last edited by agama; 04-17-2012 at 10:02 PM.. Reason: typo
# 3  
Old 04-17-2012
Awesome!
I made the simple thing complicate. Your script is much simpler than mine. Lots to learn! Thanks a lot!
Yifang
# 4  
Old 04-17-2012
Through Sed..
Code:
sed "/UniProt/s/\(.*\) [^|]*  *\([^ ]*\)|\([^|]*\)|\([^ ]*\)  */\1 \3 \t \4\t/" inputfile > outfile

If \t gets printed as just 't' instead of tab space, remove all the \t and give required number of spaces.
# 5  
Old 04-17-2012
or enter enter an actual <TAB> instead of \t by using CTRL-V <TAB>
This User Gave Thanks to Scrutinizer For This Post:
# 6  
Old 04-17-2012
To only print the UniProt lines:
Code:
awk 'sub(/.*UniProt\|/,"UniProt" OFS,$3)' FS='\t' OFS='\t' infile


Previous Thread | Next Thread
Test Your Knowledge in Computers #873
Difficulty: Medium
Self-modifying code is easier to read and maintain because the instructions in the source program listing are always the instructions that will be executed.
True or False?

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

awk to split field twice using two deliminators

In the awk I am splitting on the : into array a, then splitting on the - into element b. I can not seem to duplicate b if there is no - after it. Lines 1,2,4 are examples. If there is a - after the number in b then the value to the right of it is $3 in the ouput. Thank you :). awk... (2 Replies)
Discussion started by: cmccabe
2 Replies

2. Shell Programming and Scripting

awk to add plus or minus to fields and split another field

In the tab-delimited input below I am trying to use awk to -10 from $2 and +10 to $3. Something like awk -F'\t' -v OFS='\t' -v s=10 '{split($4,a,":"); print $1,$2-s,$3+s,a,$5,$6} | awk {split(a,b,"-"); print $1,$2-s,$3+s,b-s,b+s,$5,$6}' input should do that. I also need to -10 from $4... (2 Replies)
Discussion started by: cmccabe
2 Replies

3. Shell Programming and Scripting

awk split after second underscore in field

I am trying to split a tab-delimeted file using awk after the second _ in bold. The awk below is close but splits on the first _, and I am not sure how to use the second _. Thank you :). file chr1 92145889 92149424 NM_001195684_exon_0_10_chr1_92145900_r 0 - chr1 92161218 ... (4 Replies)
Discussion started by: cmccabe
4 Replies

4. Shell Programming and Scripting

How to print 1st field and last 2 fields together and the rest of the fields after it using awk?

Hi experts, I need to print the first field first then last two fields should come next and then i need to print rest of the fields. Input : a1,abc,jsd,fhf,fkk,b1,b2 a2,acb,dfg,ghj,b3,c4 a3,djf,wdjg,fkg,dff,ggk,d4,d5 Expected output: a1,b1,b2,abc,jsd,fhf,fkk... (6 Replies)
Discussion started by: 100bees
6 Replies

5. Shell Programming and Scripting

awk split lines without knowing the number of fields a-priori

I want to use awk to split fields and put them into a file but I don't know the number of fields for example, in the following line Ports: 22/filtered/tcp//ssh///, 53/open/tcp//tcpwrapped///, 111/filtered/tcp//rpcbind///, 543/filtered/tcp//klogin///, 544/filtered/tcp//kshell///,... (3 Replies)
Discussion started by: esolvepolito
3 Replies

6. Shell Programming and Scripting

AWK:Split fields separated by semicolon

Hi all, I have a .vcf file which contains 8 coulmns and the data under each column as shown below, CHROM POS ID REF ALT QUAL FILTER INFO 1 3000012 . A G 126 ... (6 Replies)
Discussion started by: mehar
6 Replies

7. Shell Programming and Scripting

Split field with awk

Hi there I have a text file with several fields separated by ";" as follow : 5466-43;5466;JOAN;LIGA;LIGA ESPANOLA;43;DEP LA CORUNA - OSASUNA;10/01/10 17:00 5466-44;5466;CARLES;LIGA;LIGA ESPANOLA;44;MALAGA - ATHL BILBAO;10/01/10 17:00 5466-45;5466;FAB;LIGA;LIGA ESPANOLA;45;REAL MADRID -... (4 Replies)
Discussion started by: capnino
4 Replies

8. Shell Programming and Scripting

How to split a field into two fields?

Hi, I have a comma delimited text file where character fields (as opposed to numeric and date fields) are always enclosed with double quotes. Records are separated by the newline character. In a shell script I would like to split a particular field into two separate fields (enclosed with double... (4 Replies)
Discussion started by: vbrown
4 Replies

9. Shell Programming and Scripting

can Awk split my field on the .

I am trying to pull data out of a file to execute a series of repetitive commands. One of the fields is a {hex number}.{hex number} pattern. I need the first part of that structure to pass into the command. The file structure is like this: A 2007/10/20 09:50:00 li text ef6da.1 name ... (6 Replies)
Discussion started by: oly_r
6 Replies

10. Shell Programming and Scripting

Split a field in awk script

Hi all, I have a field in the line, let's say argument $6, which is in the format 00.00 If i want to split the field to get rid of the "." in between of the amount, how can i do that i awk script? I have it like this split($6,a,".") but it will get rid of the last 2 digits after the... (4 Replies)
Discussion started by: CamTu
4 Replies

Featured Tech Videos