compare columns from seven files and print the output Post: 302202584

Sponsored Content

Top Forums Shell Programming and Scripting compare columns from seven files and print the output Post 302202584 by radoulov on Thursday 5th of June 2008 07:46:51 AM

06-05-2008

Registered User

Use nawk or /usr/xpg4/bin/awk on Solaris.

Code:

awk '{
if (!_[$1]++) id[++n] = $1
fid[FILENAME,$1] = $2
if (FNR == 1) fn[++c] = FILENAME
} END {
  printf "id\t"
  for (i=1; i<=c; i++)
    printf "%s\t", fn[i]
  print
  for (j=1; j<=n; j++) {
    printf "%s\t", id[j]
    for (i=1; i<=c; i++)
      printf "%s\t", (fn[i] SUBSEP id[j]) in fid ? fid[fn[i] SUBSEP id[j]] : "00"  
    print  
    }
}' file*

With your files:

Code:

$ head file*
==> filea <==
a5 20
a8 16

==> fileb <==
a3 42
a7 14

==> filec <==
a5 23
a3 07
$ nawk '{
if (!_[$1]++) id[++n] = $1
> if (!_[$1]++) id[++n] = $1
> fid[FILENAME,$1] = $2
> if (FNR == 1) fn[++c] = FILENAME
> } END {
    printf "%s\t", id[j]
>   printf "id\t"
>   for (i=1; i<=c; i++)
>     printf "%s\t", fn[i]
>   print
>   for (j=1; j<=n; j++) {
>     printf "%s\t", id[j]
>     for (i=1; i<=c; i++)
>   printf "%s\t", (fn[i] SUBSEP id[j]) in fid ? fid[fn[i] SUBSEP id[j]] : "00"
> print
> }
> }' file*
id      filea   fileb   filec
a5      20      00      23
a8      16      00      00
a3      00      42      07
a7      00      14      00

radoulov

View Public Profile for radoulov

Find all posts by radoulov

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

compare two columns of different files and print the matching second file..

Hi, I have two tab separated files; file1: S.No ddi fi cu o/l t+ t- 1 0.5 0.6 o 0.1 0.2 2 0.2 0.3 l 0.3 0.4 3 0.5 0.8 l 0.1 0.6 ...

2. Shell Programming and Scripting

Compare two columns in two files and print the difference

one file . . importing table employee 119 . . importing table jobs 1 2nd file . . importing table employee 120 . . importing table jobs 1 and would like...

3. Shell Programming and Scripting

Compare selected columns of two files and print whole line with mismatch

hi! i researched about comparing two columns here and got an answer. but after examining my two files, i found out that the first columns of the two files are not unique with each other. all i want to compare is the 2nd and 3rd column. FILE 1: ABS 456 315 EBS 923 163 JYQ3 654 237 FILE 2:...

4. Shell Programming and Scripting

Compare columns 2 files and print

File 1 has 16 columns so does File 2 I want to remove all records from File 2 that column 1 and column 16 match between file 1 and file 2 delimter of files is ~

5. Shell Programming and Scripting

awk compare 2 columns, 2 files, output whole line

Hello, I have not been able to find what I'm looking for via searching the forum. I could use some help with an awk script or one-liner to solve this simple problem. I have two files. If $1 and $2 from file1 match $1 and $2 from file2, print the whole line from file2. Example file1 ...

6. Shell Programming and Scripting

awk compare specific columns from 2 files, print new file

Hello. I have two files. FILE1 was extracted from FILE2 and modified thanks to help from this post. Now I need to replace the extracted, modified lines into the original file (FILE2) to produce the FILE3. FILE1 1466 55.27433 14.72050 -2.52E+03 3.00E-01 1.05E+04 2.57E+04 1467 55.27433...

7. Shell Programming and Scripting

Match two columns from two files and print output

Hello, I have two files which are of the following format File 1 which has two columns Protein_ID Substitution NP_997239 T53R NP_060668 V267M NP_058515 P856A NP_001206 T55M NP_006601 D371Y ...

8. Shell Programming and Scripting

Compare columns of multiple files and print those unique string from File1 in an output file.

Hi, I have multiple files that each contain one column of strings: File1: 123abc 456def 789ghi File2: 123abc 456def 891jkl File3: 234mno 123abc 456def In total I have 25 of these type of file.

9. Shell Programming and Scripting

[Solved] awk compare two different columns of two files and print all from both file

Hi, I want to compare two columns from file1 with another two column of file2 and print matched and unmatched column like this File1 1 rs1 abc 3 rs4 xyz 1 rs3 stu File2 1 kkk rs1 AA 10 1 aaa rs2 DD 20 1 ccc ...

10. UNIX for Beginners Questions & Answers

Compare two files and print output

Hi All, i am trying to compare two files in Centos 6. F1: /tmp/d21 NAME="xvda" TYPE="disk" SIZE="40G" OWNER="root" GROUP="disk" MODE="brw-rw----" MOUNTPOINT="" NAME="xvda1" TYPE="part" SIZE="500M" OWNER="root" GROUP="disk" MODE="brw-rw----" MOUNTPOINT="/boot" NAME="xvda2" TYPE="part"...

LEARN ABOUT LINUX

idt

IDT(4)                                                     BSD Kernel Interfaces Manual                                                     IDT(4)

NAME

     idt -- device driver for IDT NICStAR-based ATM interfaces

SYNOPSIS

     device idt
     device atm

DESCRIPTION

     The idt device driver supports ATM network interfaces based on the IDT NICStAR 77211 controller, including the FORE Systems ForeRunner LE25
     and LE155.  For configuring the card for IP see natmip(4).

     ATM CBR connections are supported, and bandwidth is allocated in slots of 64k each.  Three VBR queues handle traffic for VBR and UBR.  Two
     UBR queues prioritize UBR traffic.  ILMI and signalling get the higher priority queue, as well as UBR traffic that specifies a peak cell
     rate.  All other UBR traffic goes into the lower queue.

     The following sysctls are recognized by the driver:

     hw.idt.log_bufstat
             Print statistics about buffer use to the system log periodically.

     hw.idt.log_vcs
             Print information about VC opens, closes, and other events to the system log.

     hw.idt.bufs_large
             Set or print the maximum size of the 2KB buffer queue.

     hw.idt.bufs_small
             Set or print the maximum size of the mbuf queue.

     hw.idt.cur_large
             Print the current size of the 2KB buffer queue.

     hw.idt.cur_small
             Print the current size of the mbuf queue.

     hw.idt.qptr_hold
             Optimize the TX queue buffer for lowest overhead.

SEE ALSO

     natm(4), natmip(4), ifconfig(8), route(8)

AUTHORS

     Richard Hodges, based on the original driver for FreeBSD 2.2 by Mark Tinguely.  Bruce M. Simpson wrote this manual page and backported the
     driver to FreeBSD 4.9.

BSD                                                                June 3, 2003                                                                BSD