Matching by key fields Post: 302282654

Sponsored Content

Top Forums Shell Programming and Scripting Matching by key fields Post 302282654 by drl on Sunday 1st of February 2009 08:16:21 AM

02-01-2009

Registered User

Hi.

For the case posted, a modern fixed-string grep, fgrep, suffices:

Code:

#!/usr/bin/env bash

# @(#) s1       Demonstrate special case of join, grep used to extract.

echo
set +o nounset
LC_ALL=C ; LANG=C ; export LC_ALL LANG
echo "Environment: LC_ALL = $LC_ALL, LANG = $LANG"
echo "(Versions displayed with local utility \"version\")"
version >/dev/null 2>&1 && version "=o" $(_eat $0 $1) fgrep
set -o nounset
echo

FILE1=data1
FILE2=data2

echo " Data file $FILE1:"
cat $FILE1

echo
echo " Data file $FILE2:"
cat $FILE2

echo
echo " Results:"
fgrep -f $FILE1 $FILE2

exit 0

Producing:

Code:

% ./s1

Environment: LC_ALL = C, LANG = C
(Versions displayed with local utility "version")
OS, ker|rel, machine: Linux, 2.6.11-x1, i686
Distribution        : Xandros Desktop 3.0.3 Business
GNU bash 2.05b.0
fgrep (GNU grep) 2.5.1

 Data file data1:
AA|1234|
BB|567|
CC|8910|

 Data file data2:
SD|458|John|Smith|
AA|3345|Frank|Williams|
AA|1234|Bill|Garner|
BD|0098|Yu|Lin|
BB|567|Gail|Hansen|
CC|8910|Ken|Nielsen|

 Results:
AA|1234|Bill|Garner|
BB|567|Gail|Hansen|
CC|8910|Ken|Nielsen|

See man fgrep for details ... cheers, drl

drl

View Public Profile for drl

Find all posts by drl

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Fill the Key fields : Please help us

Hi .... we are having the below file .Column 1, Column 2 ,column 3 are key fields... In the below ...for 2 nd , 3 rd row the repeated key column is missing .... i want the new file to be populated with all missing key columns. ...

2. Shell Programming and Scripting

matching 2 exact fields

Dear experts, I have a file1 that looks like 60127930928 2091 60129382039 2092 60126382937 2091 60128937928 2061 60127329389 2062 60123748730 2061 60128730293 2061 and file 2 that looks like 60127930928 2091 60129382039 2092 60126382937 2093 60128937928 2061 60127329389...

3. Shell Programming and Scripting

Perl function to sort a file based on key fields

Hi, I am new to PERL.I want to sort all the lines in a file based on 1,2 and 4th filelds. Can U suggest me a command/function in perl for this operation..

4. Shell Programming and Scripting

awk should output if one input file doesnt have matching key

nawk -F, 'FNR==NR{a= $3 ;next} $2 in a{print $1, 'Person',$2, a}' OFS=, filea fileb Input filea Input fileb output i am getting :

5. Linux

matching two fields

Hi I am having 2 fields and if f1=f2 i wanna print that line eg 1 2 1 3 1 9 2 2 3 5 9 9 In the abov eg. the highlighted lines shud be printed 2 2 9 9 Thanking u

6. Shell Programming and Scripting

Compare Fields from two text files using key columns

Hi All, I have two files to compare. Each has 10 columns with first 4 columns being key index together. The rest of the columns have monetary values. Using Perl, I want to read one file into hash; check for the key value availability in file 2; then compare the values in the rest of 6...

7. Shell Programming and Scripting

Rsa public private key matching

Hi All, I have a requirement where i need to check if an rsa public key corresponds to a private key and hence return success or failure. Currently i am using the command diff <( ssh-keygen -y -e -f "$PRIVKEY" ) <( ssh-keygen -y -e -f "$PUBLICKEY" ) and its solving my purpose. This is in...

8. UNIX for Dummies Questions & Answers

awk - Print lines if only matching key is found

I am looking to move matching lines (01 - 07) from File1 and 77 tab the matching string from File2, to File3.txt. I am almost done but - Currently, script is not printing lines to File3.txt in order. Thanks a lot. Any help is appreciated. Script I am using: awk 'FNR == NR && ! /^]*$/ {...

9. UNIX for Dummies Questions & Answers

File updation on matching key

I have input file like Input.dat with below content RRD 0Z91YUn000000Lk 9000100001 103020151117 STMT151117155527001 0000 2 000000 000004 RRD 0Z91YUn00000ysj 9000100001 103020151117 STMT151117155527001 0000 3 000000 000003 RRD 0Z91YUn00001vGh 9000100002...

10. UNIX for Beginners Questions & Answers

Matching 2 files based on key

Hi all I have two files I need to match record from first file and second file on column 1,8 and and output only match records on file1 File1: 020059801803180116130926800002090000800231000245204003160000000002000461OUNCE000000350000100152500BM01007W0000 ...

LEARN ABOUT REDHAT

bzgrep

BZGREP(1)						      General Commands Manual							 BZGREP(1)

NAME

       bzgrep, bzfgrep, bzegrep - search possibly bzip2 compressed files for a regular expression

SYNOPSIS

       bzgrep [ grep_options ] [ -e ] pattern filename...
       bzegrep [ egrep_options ] [ -e ] pattern filename...
       bzfgrep [ fgrep_options ] [ -e ] pattern filename...

DESCRIPTION

       Bzgrep  is  used to invoke the grep on bzip2-compressed files. All options specified are passed directly to grep.  If no file is specified,
       then the standard input is decompressed if necessary and fed to grep.  Otherwise the given files are uncompressed if necessary and  fed	to
       grep.

       If  bzgrep  is  invoked as bzegrep or bzfgrep then egrep or fgrep is used instead of grep.  If the GREP environment variable is set, bzgrep
       uses it as the grep program to be invoked. For example:

	   for sh:  GREP=fgrep	bzgrep string files
	   for csh: (setenv GREP fgrep; bzgrep string files)

AUTHOR

       Charles Levert (charles@comm.polymtl.ca). Adapted to bzip2 by Philippe Troin <phil@fifi.org> for Debian GNU/Linux.

SEE ALSO

       grep(1), egrep(1), fgrep(1), bzdiff(1), bzmore(1), bzless(1), bzip2(1)

																	 BZGREP(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Fill the Key fields : Please help us

Discussion started by: charandevu

2. Shell Programming and Scripting

matching 2 exact fields

Discussion started by: aismann

3. Shell Programming and Scripting

Perl function to sort a file based on key fields

Discussion started by: karthikd214

4. Shell Programming and Scripting

awk should output if one input file doesnt have matching key

Discussion started by: pinnacle