Extract columns based on the first line of each column Post: 302924846

Sponsored Content

Top Forums UNIX for Dummies Questions & Answers Extract columns based on the first line of each column Post 302924846 by MadeInGermany on Wednesday 12th of November 2014 04:00:27 PM

11-12-2014

Registered User

A nice brain teaser!
The following keeps the order of columns in file1:

Code:

awk '
BEGIN {FS="\t"}
FNR==NR {Ctext[$1]; next}
FNR==1 {
  for (i=NF;i>=1;i--) if ($i in Ctext) {C[i]}
}
{
  for (i=1;i<=NF;i++) if (i in C) {printf "%s", sep$i; sep=FS}
  print sep=""
}
' file2 file1

While the following remaps the order according to file2, like Rudi's solution:

Code:

awk '
BEGIN {FS="\t"}
FNR==NR {Ctext[$1]=NR; next}
FNR==1 {
  for (i=NF;i>=1;i--) if ($i in Ctext) {C[Ctext[$i]]=i}
}
{
  for (i=1;(i in C);i++) {printf "%s", sep$C[i]; sep=FS}
  print sep=""
}
' file2 file1

Last edited by MadeInGermany; 11-12-2014 at 05:21 PM.. Reason: simplified solution1

This User Gave Thanks to MadeInGermany For This Post:

MadeInGermany

View Public Profile for MadeInGermany

Find all posts by MadeInGermany

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

extract column based on name

I need to extract a column from a tab delimited text file based on the string in the first row. (i.e. extract the column labeled "reaction_time"). I know that this can be done with awk by determining the column #, but I want to do it based on a search for the string b/c the column number changes...

2. UNIX for Advanced & Expert Users

Grep all the columns based on a particular column

This is the data file that I have 21879, 0, 22, 58, 388 0, -1, 300, 1219172589765, 1708, 0, 200, 21891, 0, 0, 33, 309 0, -1, 300, 1219172591478, 1768, 0, 200, 22505, 0, 0, 33, 339 0, -1, 300, 1219172593251, 1738, 0, 200, 21888, 0, 1, 33, 308 0, -1, 300, 1219172594995, 633, 0, 200, 24878,...

3. Shell Programming and Scripting

extract csv based on column value

Hi I have a csv file which is below A,5 B,6 C,10 D,7 I want the values who's second column is greater than 7 say C,10 D,7 Help me please... Thanks, Maruth

4. Shell Programming and Scripting

sum multiple columns based on column value

i have a file - it will be in sorted order on column 1 abc 0 1 abc 2 3 abc 3 5 def 1 7 def 0 1 -------- i'd like (awk maybe?) to get the results (any ideas)??? abc 5 9 def 1 8

5. Emergency UNIX and Linux Support

[Solved] Extract records based on a repeated column value

Hi guys, I need help in making a command to find some data. I have multiple files in which multiple records are present.. Each record is separated with a carriage return and in each record there are multiple fields with each field separated by "|" what i want is that I want to extract...

6. Shell Programming and Scripting

displaying columns based on column name

Hello, I have a huge file with many columns . I want to use the names of the columns to print columns to another file. for example file.txt COLA COLB COLC COLD 1 2 3 5 3 5 6 9 If I give name for multiple columns to the code:...

7. Shell Programming and Scripting

HELP: Shell Script to read a Log file line by line and extract Info based on KEYWORDS matching

I have a LOG file which looks like this Import started at: Mon Jul 23 02:13:01 EDT 2012 Initialization completed in 2.146 seconds. -------------------------------------------------------------------------------- -- Import summary for Import item: PolicyInformation...

8. Shell Programming and Scripting

Merging columns based on one or more column in two files

I have two files. FileA.txt 30910 rs7468327 36587 rs10814410 91857 rs9408752 105797 rs1133715 146659 rs2262038 152695 rs2810979 181843 rs3008128 182129 rs3008131 192118 rs3008170 FileB.txt 30910 1.9415219673 0 36431 1.3351312477 0.0107191428 36587 1.3169171182...

9. Shell Programming and Scripting

Extract columns based on header

Hi to all, I have two files. File1 has no header, two columns: sample1 A sample2 B sample3 B sample4 C sample5 A sample6 D sample7 D File2 has a header, except for the first 3 columns (chr,start,end). "sample1" is the header for the 4th ,5th ,6th columns, "sample2" is the header...

10. Shell Programming and Scripting

Insert Columns before the last Column based on the Count of Delimiters

Hi, I have a requirement where in I need to insert delimiters before the last column of the total delimiters is less than a specified number. Say if the delimiters is less than 139, I need to insert 2 columns ( with blanks) before the last field awk -F '�' '{ if (NF-1 < 139)} END { "Insert 2...

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

extract column based on name

Discussion started by: t27

2. UNIX for Advanced & Expert Users

Grep all the columns based on a particular column

Discussion started by: pmallur

3. Shell Programming and Scripting

extract csv based on column value

Discussion started by: maruthavanan

4. Shell Programming and Scripting

sum multiple columns based on column value

Discussion started by: jjoe

5. Emergency UNIX and Linux Support

[Solved] Extract records based on a repeated column value

Discussion started by: m_usmanayub

6. Shell Programming and Scripting

displaying columns based on column name

Discussion started by: ryan9011

7. Shell Programming and Scripting

HELP: Shell Script to read a Log file line by line and extract Info based on KEYWORDS matching

Discussion started by: biztank

8. Shell Programming and Scripting

Merging columns based on one or more column in two files

Discussion started by: genehunter

9. Shell Programming and Scripting

Extract columns based on header

Discussion started by: aec

10. Shell Programming and Scripting

Insert Columns before the last Column based on the Count of Delimiters

Discussion started by: arunkesi