Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Help on writing data from 2 different files to one based on a common factor

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help on writing data from 2 different files to one based on a common factor
# 8  
Old 02-07-2013
Quote:
Originally Posted by RudiC
Why then is it B A B C D E F G and not B B A C D E F G? Why move the second group's B up front, but not the first one's?
I need the original order (in the first 2 files) as it is

---------- Post updated at 06:55 AM ---------- Previous update was at 06:53 AM ----------

Pamu - I am a bit naive when it comes to shell scripting, so thanks for your patience... I changed to nawk and this is the result
Code:
couldn't set locale correctly
couldn't set locale correctly
nawk: illegal primary in regular expression ****NEXT**** at ***NEXT****
 source line number 1
 context is
        NR==FNR{if($0 ~ >>>  /****NEXT****/ <<< ){a++}else{A[$0]++;X[a]=X[a]?X[a] FS $0 : $0}next}{

---------- Post updated at 06:59 AM ---------- Previous update was at 06:55 AM ----------

And when I use /usr/xpg4/bin/awk


Code:
couldn't set locale correctly
couldn't set locale correctly
/usr/xpg4/bin/awk: /****NEXT****/: ?, *, +, or { } not preceded by valid regular expression  Context is:
>>>     11NR==FNR{if($0 ~ /****NEXT****/        <<<

# 9  
Old 02-07-2013
Try with removing those *

Code:
 
$ nawk -v a=1 -v b=1 'NR==FNR{if($0 ~ /NEXT/){a++}else{A[$0]++;X[a]=X[a]?X[a] FS $0 : $0}next}{
if($0 ~ /NEXT/){b++}else{Y[b]=Y[b]?Y[b] FS $0 : $0}}END{
for(i in X){n=split(X[i],P)
for(j in Y){
for(t=1;t<=n;t++){
if(Y[j] ~ P[t]){gsub(P[t],"",Y[j]);print P[t],X[i],Y[j]}}}}}' file1 file2
 
B A B C D E F G
X X Y Z P Q
L L M N J K

This User Gave Thanks to pamu For This Post:
vat1kor
# 10  
Old 02-07-2013
Awesome, it worked... you are a rock star.. thanks a lot
# 11  
Old 02-07-2013
Code:
awk '
  /NEXT/||!NF{
    next
  }
  {
    $1=$1
    for(i=1;i<=NF;i++) {
      if(NR==FNR){
        p=$0
        sub($i " *",x,p)
        A[$i]=p
      } 
      else if($i in A) print $i,$0,A[$i]
    }
  }
' RS=\* file2 file1

# 12  
Old 02-18-2013
Quote:
Originally Posted by pamu
Try with removing those *

Code:
 
$ nawk -v a=1 -v b=1 'NR==FNR{if($0 ~ /NEXT/){a++}else{A[$0]++;X[a]=X[a]?X[a] FS $0 : $0}next}{
if($0 ~ /NEXT/){b++}else{Y[b]=Y[b]?Y[b] FS $0 : $0}}END{
for(i in X){n=split(X[i],P)
for(j in Y){
for(t=1;t<=n;t++){
if(Y[j] ~ P[t]){gsub(P[t],"",Y[j]);print P[t],X[i],Y[j]}}}}}' file1 file2
 
B A B C D E F G
X X Y Z P Q
L L M N J K

Thanks for this help a week back, now I need ',' instead of spaces.. any help would be greatful

# 13  
Old 02-18-2013
Try

Code:
awk -v a=1 -v b=1 'NR==FNR{if($0 ~ /NEXT/){a++}else{A[$0]++;X[a]=X[a]?X[a] FS $0 : $0}next}{
if($0 ~ /NEXT/){b++}else{Y[b]=Y[b]?Y[b] OFS $0 : $0}}END{
for(i in X){n=split(X[i],P)
for(j in Y){
for(t=1;t<=n;t++){
if(Y[j] ~ P[t]){gsub(P[t],"",Y[j]);gsub(" ",",",X[i]);print P[t],X[i],Y[j]}}}}}' OFS="," file1 file2

This User Gave Thanks to pamu For This Post:
vat1kor
# 14  
Old 02-18-2013
Try with /usr/xpg4/bin/awk if on Solaris

Code:
awk '
  /NEXT/||!NF{
    next
  }
  {
    $1=$1
    for(i=1;i<=NF;i++) {
      if(NR==FNR){
        p=$0
        sub($i " *",x,p)
        A[$i]=p
      } 
      else if($i in A) print $i,$0,A[$i]
    }
  }
' RS=\* OFS=, file file1
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Compare two files and print based on common variable value.

Hi All, i have below two files. FILE: NAME="/dev/sda" TYPE="disk" SIZE="60G" OWNER="root" GROUP="disk" MODE="brw-rw----" PKNAME="" MOUNTPOINT="" NAME="/dev/sda1" TYPE="part" SIZE="500M" OWNER="root" GROUP="disk" MODE="brw-rw----" PKNAME="/dev/sda" MOUNTPOINT="/boot" NAME="/dev/sda2"... (3 Replies)
Discussion started by: balu1234
3 Replies

2. UNIX for Dummies Questions & Answers

How to join 2 .txt files based on a common column?

Hi all, I'm trying to join two .txt file tab delimitated based on a common column. File 1 transcript_id gene_id length effective_length expected_count TPM FPKM IsoPct comp1000201_c0_seq1 comp1000201_c0 337 183.51 0.00 0.00 0.00 0.00 comp1000297_c0_seq1 ... (1 Reply)
Discussion started by: alisrpp
1 Replies

3. Shell Programming and Scripting

common entries between files based on 1st column

Hi, I am trying to get the common entries from 2 files based on 1st field.. However when I try to do in perl I am getting blank output.. How can I do this in awk? open(BUFF1, "my_genes"); open(BUFF3, "rawcounts"); #open(WRBUFF,">result_rawcounts"); while($line =<BUFF1>) { ... (3 Replies)
Discussion started by: Diya123
3 Replies

4. Shell Programming and Scripting

Matching and Merging csv data fields based on a common field

Dear List, I have a file of csv data which has a different line per compliance check per host. I do not want any omissions from this csv data file which looks like this: date,hostname,status,color,check 02-03-2012,COMP1,FAIL,Yellow,auth_pass_change... (3 Replies)
Discussion started by: landossa
3 Replies

5. UNIX for Dummies Questions & Answers

compare two files based on common field in unix

I have two files in UNIX. 1st file is Entity and Second File is References. 1st File has only one column named Entity ID and 2nd file has two columns Entity ID | Person ID. I want to produce a output file where entity id's are matching in both the files. Entity File 624197 624252 624264... (4 Replies)
Discussion started by: PRS
4 Replies

6. UNIX for Dummies Questions & Answers

Writing a loop to merge multiple files by common column

I have 100 data files labelled 250.1.txt through 250.100.txt. The second column of the data files partially match (there is about %90 overlap). Each data file has 4 columns. I want the merge all these text files by the matching values in the second column. In the output, the first column should... (1 Reply)
Discussion started by: evelibertine
1 Replies

7. Shell Programming and Scripting

join files based on a common field

Hi experts, Would you please help me with this? I have several files and I need to join the forth field of them based on the common first field. here's an example... first file: 280346 39.88 -75.08 547.8 280690 39.23 -74.83 538.7 280729 40.83 -75.08 499.2 280907 40.9 -74.4 507.8... (5 Replies)
Discussion started by: GoldenFire
5 Replies

8. Shell Programming and Scripting

Join multiple files based on 1 common column

I have n files (for ex:64 files) with one similar column. Is it possible to combine them all based on that column ? file1 ax100 20 30 40 ax200 22 33 44 file2 ax100 10 20 40 ax200 12 13 44 file2 ax100 0 0 4 ax200 2 3 4 (9 Replies)
Discussion started by: quincyjones
9 Replies

9. Shell Programming and Scripting

Merging 2 files based on a common column

Hi All, I do have 2 files file 1 has 4 tab delimited columns 234 a c dfgyu 294 b g fih 302 c h jzh 328 z c san 597 f g son File 2 has 2 tab delimted columns 234 23 302 24 597 24 I want to merge file 2 with file 1 based on the data common in both files which is the first column so... (6 Replies)
Discussion started by: Lucky Ali
6 Replies

10. UNIX for Dummies Questions & Answers

Writing data onto new lines based on terminator

I have a requirement, where based on a particular character on a single line, the data has to be written to new lines... Ex: abccd$xyzll$bacc$kkklkjl$albc My output should be abccd$ xyzll$ bacc$ kkklkjl$ albc Can someone help on this. (1 Reply)
Discussion started by: thanuman
1 Replies
Login or Register to Ask a Question