Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Problem with Join Command
Top Forums Shell Programming and Scripting Problem with Join Command Post 302979434 by Varshha on Monday 15th of August 2016 02:21:10 AM
Old 08-15-2016
I posted the reply yesterday but I am not sure why it is not reflecting. So here it is again :

The files were originally tab delimited but I made them comma delimited to help me with the join command. I am now trying again with tab delimited files. I also tried some additions in my join command and this is what I gave :

Code:
join -t"  "  -a 2 -a 1 -e 'NULL' -o '0,1.1,1.2,2.1,2.2' File1 File2 | head -100

I am getting a result out of this which unfortunately means that UNIX is not finding a common key for the files to join and it is surprising because there ARE common values between the files. This is how the sample of the result looks like :

Code:
01635158332	09/09/2016 01635158332	09/09/2016 NULL NULL NULL
01635163349	11/24/2009 01635163349	11/24/2009 NULL NULL NULL
16.11	01635163339 NULL NULL 16.11	01635163339 NULL
16.11	01635163349 NULL NULL 16.11	01635163349 NULL


As you can see above, 01635163349 is a common key between File 1 that has dates and file 2 that has the cost. So ideally the result should be

Code:
01635163349  11/24/2009  16.11

The command
Code:
join -1 1 -2 1 File 1 File 2

does not give me any result as in no output on the console at all.

This is how file 1 looks:

Code:
00033492482     04/11/2006
00033492682     07/14/2009
00033492702     02/09/2010
00076848302     08/10/2010
00881123792     11/07/2000
01130162424     06/12/2007
01130164254     01/29/2008
01130165543     05/16/2011
01130168864     07/14/2009
01635163349     11/24/2009

File 2:

Code:
0.00    03139822826
0.00    49246820001
0.00    7621830148
0.00    822004599003
0.11    73379268872
0.64    67119603398
0.65    67261704102
16.11   01635163349


Can there be any other way to achieve an inner join between these files?
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

A join problem?

Hi everybody, I am hoping somebody here will be either be able to solve my troubles or at least give me a push in the right direction :) . I am developing a shell script to read in 4 different files worth of data that each contain a list of: username firstname secondname group score I... (2 Replies)
Discussion started by: jamjamjammie
2 Replies

2. Shell Programming and Scripting

join (pls help on join command)

Hi, I am a new learner of join command. Some result really make me confused. Please kindly help me. input: file1: LEO oracle engineer 210375 P.Jones Office Runner ID897 L.Clip Personl Chief ID982 S.Round UNIX admin ID6 file2: Dept2C ID897 6 years Dept5Z ID982 1 year Dept3S ID6 2... (1 Reply)
Discussion started by: summer_cherry
1 Replies

3. Shell Programming and Scripting

Problem with Join command

Hi guyz Excuse me for posting simple question I tried join and sort and other perl commands but failed I have 2 files. 1st file contain single column with around 6000 values (rows). Second file contain 2 columns 1st column is the same column (in 1st file) but randomly ordered and second... (5 Replies)
Discussion started by: repinementer
5 Replies

4. Shell Programming and Scripting

awk command for simple join command but based on 2 columns

input1 a_a a/a 10 100 a1 a_a 20 200 b1 b_b 30 300 input2 a_a a/a xxx yyy a1 a1 lll ppp b1 b_b kkk ooo output a_a a/a 10 100 xxx yyy (2 Replies)
Discussion started by: ruby_sgp
2 Replies

5. UNIX for Dummies Questions & Answers

SOLVED: Join problem

Hello, Going through book, "Guide to UNIX Using Linux". I am doing one of the projects that has me writing scripts to join files. Here is my pnumname script and I am extracting the programmers names and numbers from the program file and redirecting the output to the file pnn. I then created a... (0 Replies)
Discussion started by: thebeav
0 Replies

6. UNIX for Dummies Questions & Answers

problem with join

So I want to join two files that have a lot of rows The file named gen1 has 2 columns: head gen1 1008567 0.4026931012 1119535 0.7088912314 1120590 0.7093805634 1145994 0.7287952590 1148140 0.7313924434 1155173 0.7359550430 1188481 0.7598914553 1201155 0.7663406553 1206921... (2 Replies)
Discussion started by: peanuts48
2 Replies

7. UNIX for Dummies Questions & Answers

Problem when using join command

Dear all, I have two files (each only contains 1 column) as attached. I want to combined the two files and only show the common records in both files. But when I use join command only the last row was combined. Anyone know what is the problem? I don't know how to write the correct code to only... (2 Replies)
Discussion started by: forevertl
2 Replies

8. UNIX for Dummies Questions & Answers

how to join two files using "Join" command with one common field in this problem?

file1: Toronto:12439755:1076359:July 1, 1867:6 Quebec City:7560592:1542056:July 1, 1867:5 Halifax:938134:55284:July 1, 1867:4 Fredericton:751400:72908:July 1, 1867:3 Winnipeg:1170300:647797:July 15, 1870:7 Victoria:4168123:944735:July 20, 1871:10 Charlottetown:137900:5660:July 1, 1873:2... (2 Replies)
Discussion started by: mindfreak
2 Replies

9. UNIX for Dummies Questions & Answers

How to use the the join command to join multiple files by a common column

Hi, I have 20 tab delimited text files that have a common column (column 1). The files are named GSM1.txt through GSM20.txt. Each file has 3 columns (2 other columns in addition to the first common column). I want to write a script to join the files by the first common column so that in the... (5 Replies)
Discussion started by: evelibertine
5 Replies

10. UNIX for Dummies Questions & Answers

Weird problem with join command

I have a weird issue going on with the join command... I have two files I am trying to join...here is a line from each file with the important parts marked in red: file1: /groupspace/ccops/cmis/bauwkrcn/commsamp_20140315.txt,1 file2:... (3 Replies)
Discussion started by: dbiggied
3 Replies

LEARN ABOUT CENTOS

extutils::command

ExtUtils::Command(3pm)					 Perl Programmers Reference Guide				    ExtUtils::Command(3pm)

NAME

       ExtUtils::Command - utilities to replace common UNIX commands in Makefiles etc.

SYNOPSIS

	 perl -MExtUtils::Command -e cat files... > destination
	 perl -MExtUtils::Command -e mv source... destination
	 perl -MExtUtils::Command -e cp source... destination
	 perl -MExtUtils::Command -e touch files...
	 perl -MExtUtils::Command -e rm_f files...
	 perl -MExtUtils::Command -e rm_rf directories...
	 perl -MExtUtils::Command -e mkpath directories...
	 perl -MExtUtils::Command -e eqtime source destination
	 perl -MExtUtils::Command -e test_f file
	 perl -MExtUtils::Command -e test_d directory
	 perl -MExtUtils::Command -e chmod mode files...
	 ...

DESCRIPTION

       The module is used to replace common UNIX commands.  In all cases the functions work from @ARGV rather than taking arguments.  This makes
       them easier to deal with in Makefiles.  Call them like this:

	 perl -MExtUtils::Command -e some_command some files to work on

       and NOT like this:

	 perl -MExtUtils::Command -e 'some_command qw(some files to work on)'

       For that use Shell::Command.

       Filenames with * and ? will be glob expanded.

   FUNCTIONS
       cat
	       cat file ...

	   Concatenates all files mentioned on command line to STDOUT.

       eqtime
	       eqtime source destination

	   Sets modified time of destination to that of source.

       rm_rf
	       rm_rf files or directories ...

	   Removes files and directories - recursively (even if readonly)

       rm_f
	       rm_f file ...

	   Removes files (even if readonly)

       touch
	       touch file ...

	   Makes files exist, with current timestamp

       mv
	       mv source_file destination_file
	       mv source_file source_file destination_dir

	   Moves source to destination.  Multiple sources are allowed if destination is an existing directory.

	   Returns true if all moves succeeded, false otherwise.

       cp
	       cp source_file destination_file
	       cp source_file source_file destination_dir

	   Copies sources to the destination.  Multiple sources are allowed if destination is an existing directory.

	   Returns true if all copies succeeded, false otherwise.

       chmod
	       chmod mode files ...

	   Sets UNIX like permissions 'mode' on all the files.	e.g. 0666

       mkpath
	       mkpath directory ...

	   Creates directories, including any parent directories.

       test_f
	       test_f file

	   Tests if a file exists.  Exits with 0 if it does, 1 if it does not (ie.  shell's idea of true and false).

       test_d
	       test_d directory

	   Tests if a directory exists.  Exits with 0 if it does, 1 if it does not (ie. shell's idea of true and false).

       dos2unix
	       dos2unix files or dirs ...

	   Converts DOS and OS/2 linefeeds to Unix style recursively.

SEE ALSO

       Shell::Command which is these same functions but take arguments normally.

AUTHOR

       Nick Ing-Simmons "ni-s@cpan.org"

       Maintained by Michael G Schwern "schwern@pobox.com" within the ExtUtils-MakeMaker package and, as a separate CPAN package, by Randy Kobes
       "r.kobes@uwinnipeg.ca".

perl v5.16.3							    2013-03-04						    ExtUtils::Command(3pm)
All times are GMT -4. The time now is 02:16 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy