Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Merging files with common IDs without JOIN
Top Forums Shell Programming and Scripting Merging files with common IDs without JOIN Post 302824593 by hubleo on Friday 21st of June 2013 06:51:16 AM
Old 06-21-2013
Merging files with common IDs without JOIN
Hi, I am trying to merge information across 2 files. The first file is a "master" file, with all IDS. File 2 contains a subset of IDs of those in File 1.

I would like to match up individuals in File 1 and File 2, and add information in File 2 to that of File 1 if they appear. However, if an individual doesn't appear in File 2, I want to keep the data they have in File 1.

FILE 1
Code:
ID INFO1 INFO 2
PERSON1 A 3
PERSON2 B 2
PERSON3 C 11
PERSON4 D 10
PERSON5 E 6

FILE 2
Code:
ID INFO3
PERSON1 PPP
PERSON2 NNN
PERSON3 LLL

Desired output
Code:
ID INFO1 INFO2 INFO3 
PERSON1 A 3 PPP
PERSON2 B 2 NNN
PERSON3 C 11 LLL
PERSON4 D 10 0
PERSON5 E 6 0

If the data for INFO 3 doesn't exist, this should be replaced with a 0 in place of a value. Would anyone have any ideas? Unless I'm missing something obvious a simple join command won't work. An awk solution would be perfect but I'm currently drawing blanks. Any help would be very much appreciated!
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merging two files with a common column

Hi, I have two files file1 and file2. I have to merge the columns of those two files into file3 based on common column of two files. To be simple. file1: Row-id name1 13456 Rahul 16789 Vishal 18901 Karan file2 : Row-id place 18901 Mumbai ... (2 Replies)
Discussion started by: manneni prakash
2 Replies

2. Shell Programming and Scripting

Merging 2 files based on a common column

Hi All, I do have 2 files file 1 has 4 tab delimited columns 234 a c dfgyu 294 b g fih 302 c h jzh 328 z c san 597 f g son File 2 has 2 tab delimted columns 234 23 302 24 597 24 I want to merge file 2 with file 1 based on the data common in both files which is the first column so... (6 Replies)
Discussion started by: Lucky Ali
6 Replies

3. Shell Programming and Scripting

join files based on a common field

Hi experts, Would you please help me with this? I have several files and I need to join the forth field of them based on the common first field. here's an example... first file: 280346 39.88 -75.08 547.8 280690 39.23 -74.83 538.7 280729 40.83 -75.08 499.2 280907 40.9 -74.4 507.8... (5 Replies)
Discussion started by: GoldenFire
5 Replies

4. UNIX for Dummies Questions & Answers

Merge two files with common IDs but unequal number of rows

Hi, I have two files that I would like to merge and think that there should be a solution using awk. The files look something like this: file 1 IDX1 IDY1 IDX2 IDY2 IDX3 IDY3 file 2 IDY1 dataA data1 IDY2 dataB data2 IDY3 dataC data3 Desired output IDX1 IDY1 dataA data1 IDX2 ... (5 Replies)
Discussion started by: katie8856
5 Replies

5. UNIX for Dummies Questions & Answers

how to join two files using "Join" command with one common field in this problem?

file1: Toronto:12439755:1076359:July 1, 1867:6 Quebec City:7560592:1542056:July 1, 1867:5 Halifax:938134:55284:July 1, 1867:4 Fredericton:751400:72908:July 1, 1867:3 Winnipeg:1170300:647797:July 15, 1870:7 Victoria:4168123:944735:July 20, 1871:10 Charlottetown:137900:5660:July 1, 1873:2... (2 Replies)
Discussion started by: mindfreak
2 Replies

6. UNIX for Dummies Questions & Answers

How to use the the join command to join multiple files by a common column

Hi, I have 20 tab delimited text files that have a common column (column 1). The files are named GSM1.txt through GSM20.txt. Each file has 3 columns (2 other columns in addition to the first common column). I want to write a script to join the files by the first common column so that in the... (5 Replies)
Discussion started by: evelibertine
5 Replies

7. Shell Programming and Scripting

Join two files with common and range identifiers

I have a problem joining two files. The first file abc.txt has 10k lines and has lots of fields but two fields fff1 and ppp1 to merge by. The second file xyz.txt is a master file with 1k lines and lots of fields but three fields to merge by fff1; rrr1 and qqq1. The two files need to be merged... (9 Replies)
Discussion started by: cfiles2012
9 Replies

8. Shell Programming and Scripting

Merging 2 text files when there is a common time stamp column in them

Dear Unix experts and users I have 2 kinds of files like below, of which I need to merge them in the order of time. File1: Date_Time Context D1 D2 04/19/2013_23:48:54.819 ABCD x x 04/19/2013_23:48:55.307 ABCD x x 04/19/2013_23:48:55.823 ABCD x ... (7 Replies)
Discussion started by: ks_reddy
7 Replies

9. UNIX for Dummies Questions & Answers

How to join 2 .txt files based on a common column?

Hi all, I'm trying to join two .txt file tab delimitated based on a common column. File 1 transcript_id gene_id length effective_length expected_count TPM FPKM IsoPct comp1000201_c0_seq1 comp1000201_c0 337 183.51 0.00 0.00 0.00 0.00 comp1000297_c0_seq1 ... (1 Reply)
Discussion started by: alisrpp
1 Replies

10. Shell Programming and Scripting

Merging two files without any common pattern

Hi I have file1 as IJU_NSOMOW; SOWWOD_TWUIQ; and file2 as how are you?; fine there; Now my problem is i need the output file as IJU_NSOMOW; how are you?; SOWWOD_TWUIQ; fine there; (2 Replies)
Discussion started by: Priya Amaresh
2 Replies

LEARN ABOUT MOJAVE

file::spec::functions5.18

File::Spec::Functions(3pm)				 Perl Programmers Reference Guide				File::Spec::Functions(3pm)

NAME

       File::Spec::Functions - portably perform operations on file names

SYNOPSIS

	       use File::Spec::Functions;
	       $x = catfile('a','b');

DESCRIPTION

       This module exports convenience functions for all of the class methods provided by File::Spec.

       For a reference of available functions, please consult File::Spec::Unix, which contains the entire set, and which is inherited by the
       modules for other platforms. For further information, please see File::Spec::Mac, File::Spec::OS2, File::Spec::Win32, or File::Spec::VMS.

   Exports
       The following functions are exported by default.

	       canonpath
	       catdir
	       catfile
	       curdir
	       rootdir
	       updir
	       no_upwards
	       file_name_is_absolute
	       path

       The following functions are exported only by request.

	       devnull
	       tmpdir
	       splitpath
	       splitdir
	       catpath
	       abs2rel
	       rel2abs
	       case_tolerant

       All the functions may be imported using the ":ALL" tag.

COPYRIGHT

       Copyright (c) 2004 by the Perl 5 Porters.  All rights reserved.

       This program is free software; you can redistribute it and/or modify it under the same terms as Perl itself.

SEE ALSO

       File::Spec, File::Spec::Unix, File::Spec::Mac, File::Spec::OS2, File::Spec::Win32, File::Spec::VMS, ExtUtils::MakeMaker

perl v5.18.2							    2014-01-06						File::Spec::Functions(3pm)
All times are GMT -4. The time now is 11:13 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy