Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Comparing two files in UNIX and create a new file similar to equi join
Top Forums Shell Programming and Scripting Comparing two files in UNIX and create a new file similar to equi join Post 302925770 by RudiC on Wednesday 19th of November 2014 09:11:04 AM
Old 11-19-2014
Please use code tags as required by forum rules!

Code:
awk -F,                         # run awk and set field separator char
'                               # quote the entire script
NR==FNR {A[$1]=$3; next}        # for the first file, i.e. the file's line no. equals the overall line no., keep field 3 in array A indexed by field 1, stop processing this line, jump to next line
 $1 in A {$1=A[$1];             #  if field 1 points to an entry in A, replace it by that A entry's  contents
          print}                # and print this line
'                               # quote the entire script
FS=,                            # set field sep. again (pointless)
OFS=,                           # set output field sep.
file2                           #read and process file 2 first
file1                           # process file2

This User Gave Thanks to RudiC For This Post:
ni2
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to join flat files together under unix

Hi, I have 7 big flat files, each contains 24 million records which have been sorted by the first field delimitered by Ctrl B (002). I want to join them together side by side, eg. File A: 1^Ba^Bb 2^Bx^By .... File B: 1^Bc^Bd 2^Bm^Bn .... After merged, it should look like :... (7 Replies)
Discussion started by: xli
7 Replies

2. Shell Programming and Scripting

Find duplicate value comparing 2 files and create an output

I need a perl script which will create an output file after comparing two diff file in a directory path: /export/home/abc/file1 /export/home/abc/file2 File Format: <IP>TAB<DeviceName><TAB>DESCRIPTIONS file1: 10.1.2.1.3<tab>abc123def<tab>xyz.mm1.ppp.... (2 Replies)
Discussion started by: ricky007
2 Replies

3. Shell Programming and Scripting

Comparing similar columns in two different files

Hi, I have two text files.The first and the 2nd file have data in the same format For e.g. The first file has table_name1 column1 sum(column1) max(column1) min(column1) table_name1 column2 sum(column2) max(column2) min(column2) table_name1 coulmn3 sum(column3) max(column3) min(column3) ... (13 Replies)
Discussion started by: ragavhere
13 Replies

4. Shell Programming and Scripting

Help in unix script to join similar lines of input

Hi, I have been thinking of how to script this but i have no clue at all.. Could someone please help me out or give me some idea on this? I would like to group those lines with the same first variable in each line, joining the 2nd variables with commas. Let's say i have the following input. ... (3 Replies)
Discussion started by: rei125
3 Replies

5. Shell Programming and Scripting

Create SQL DML insert statements from file using AWK or similar

Hi all. This is my first post on this forum. I've previously found great help in the huge knowledgebase that is here, but this time I have not been able to find a solution to my problem. I have a large text file that looks like this: typedef struct ABC_struct_nbr1_ { char attr1; /*... (0 Replies)
Discussion started by: Yagi Uda
0 Replies

6. Shell Programming and Scripting

Join all the lines matching similar pattern

I am trying to Join all the lines matching similar pattern. Example ; I wanted to join all the lines which has sam to a single line. In next line, i wanted to have all the lines with jones to a single line....etc > cat sample.txt sam 2012/11/23 sam 2012/12/5 sam 2012/12/5 jones... (2 Replies)
Discussion started by: evrurs
2 Replies

7. Shell Programming and Scripting

Comparing Select Columns from two CSV files in UNIX and create a third file based on comparision

Hi , I want to compare first 3 columns of File A and File B and create a new file File C which will have all rows from File B and will include rows that are present in File A and not in File B based on First 3 column comparison. Thanks in advance for your help. File A A,B,C,45,46... (2 Replies)
Discussion started by: ady_koolz
2 Replies

8. Shell Programming and Scripting

How to join one file with multiple files in a directory in UNIX?

Dear folks Hello I have a one file called (file1) which the structure looks like this 1 gi|358484521|ref|NW_003764373.1| 1 gi|358484520|ref|NW_003764374.1| 1 gi|358484519|ref|NW_003764375.1| . . . 30 gi|368484519|ref|NW_00449375.1| In addition, I have around 300... (19 Replies)
Discussion started by: sajmar
19 Replies

9. Shell Programming and Scripting

Alignment tool to join text files in 2 directories to create a parallel corpus

I have two directories called English and Hindi. Each directory contains the same number of files with the only difference being that in the case of the English Directory the tag is .english and in the Hindi one the tag is .Hindi The file may contain either a single text or more than one text... (7 Replies)
Discussion started by: gimley
7 Replies

10. UNIX for Beginners Questions & Answers

How to compare two files in UNIX using similar to vlookup?

Hi, I want to compare same column in two files, if values match then display the column or display "NA". Ex : File 1 : 123 abc xyz pqr File 2: 122 aab fdf pqr fff qqq rrr (1 Reply)
Discussion started by: hkoshekay
1 Replies

LEARN ABOUT DEBIAN

shtool-table

SHTOOL-TABLE.TMP(1)					      GNU Portable Shell Tool					       SHTOOL-TABLE.TMP(1)

NAME

       shtool-table - GNU shtool pretty-print a field-separated list

SYNOPSIS

       shtool table [-F|--field-sep sep] [-w|--width width] [-c|--columns cols] [-s|--strip strip] strsepstr...

DESCRIPTION

       This pretty-prints a list of strings as a table.

OPTIONS

       The following command line options are available.

       -F, --field-sep sep
	   Separate columns using sep. Default is ":".

       -w, --width width
	   Width of each column. Default is 15 characters.

       -c, --columns cols
	   Number of columns. Default is 3.

       -s, --strip strip
	   Strip off any characters past strip. Default is 79.

EXAMPLE

	#   shell script
	shtool table -F , -w 5 -c 4 "1,2,3,4,5,6,7,8,9,10,11,12"

HISTORY

       The GNU shtool table command was originally written by Ralf S.  Engelschall <rse@engelschall.com> in 1999 for GNU shtool.

SEE ALSO

       shtool(1), tr(1), fmt(1), sh(1), awk(1), sed(1).

18-Jul-2008							   shtool 2.0.8 					       SHTOOL-TABLE.TMP(1)
All times are GMT -4. The time now is 02:45 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy