07-15-2008
Help with complex merg of files with common field
Please help, I am new to shell Programming. I have three files each containg a unique text (key) field (e.g. ABCDEF, XCDUD as shown below), line return followed by some data of which there can be more then one instance. In addition, in some cases there may be no data but only a key field. Please see example below:
File A contains:
ABCDEF ----> Key
DataA-1 ---> Data
DataA-2 ---> Data
DataA-3 ---> Data
XCDUD -----> Key
DataA-1 ------> Data
UUUUA -----> Key
DataA-1 ------> Data
File B contains:
ABCDEF
DataB-1
DataC-1
XCDUD
DataB-1
UUUUA
File C contains:
ABCDEF
DataC-1
XCDUD
UUUUA
DataC-1
I want to merge these files by the unique key; I am only interested in the merged data separated by line return as shown below:
ABCDEF
DataA-1
DataB-1
DataC-1
DataA-2
DataA-3
XCDUD
Data A-1
Data B-1
UUUUA
Data A-1
Data C-1
Is it possible to script this? Please indicate how?
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
i have:
file1 contains: 123abc
file2 contains: 123 abc
i used:
paste file1 file2 > file3, and the output looks like this:
123abc 123 abc
i used:
cat file3 | awk '{print $1, $2}' > file4, result: 123abc 123
my intention is to get file looks like this:
123abc123 abc
when i... (9 Replies)
Discussion started by: tjmannonline
9 Replies
2. Shell Programming and Scripting
hi,
i am facing a problem in merging two files using awk,
the problem is as stated below,
file1:
A|B|C|D|E|F|G|H|I|1
M|N|O|P|Q|R|S|T|U|2
AA|BB|CC|DD|EE|FF|GG|HH|II|1
....
....
....
file2 :
1|Mn|op|qr (2 Replies)
Discussion started by: shashi1982
2 Replies
3. Shell Programming and Scripting
I have two files like
File1 : will get this file from "who" command. It is a unix file.
user val1 Jul 29 13:15 (IP Address1)
user val3 Jul 30 03:21 (IP Address2)
user val2 Jul 29 13:16 (IP Address3)
user val4 Jul 29 13:17 (IP Address4)
... (4 Replies)
Discussion started by: manneni prakash
4 Replies
4. Shell Programming and Scripting
Hi experts,
Would you please help me with this?
I have several files and I need to join the forth field of them based on the common first field.
here's an example...
first file:
280346 39.88 -75.08 547.8
280690 39.23 -74.83 538.7
280729 40.83 -75.08 499.2
280907 40.9 -74.4 507.8... (5 Replies)
Discussion started by: GoldenFire
5 Replies
5. UNIX for Dummies Questions & Answers
I have two files in UNIX.
1st file is Entity and Second File is References. 1st File has only one column named Entity ID and 2nd file has two columns Entity ID | Person ID.
I want to produce a output file where entity id's are matching in both the files.
Entity File
624197
624252
624264... (4 Replies)
Discussion started by: PRS
4 Replies
6. UNIX for Dummies Questions & Answers
file1:
Toronto:12439755:1076359:July 1, 1867:6
Quebec City:7560592:1542056:July 1, 1867:5
Halifax:938134:55284:July 1, 1867:4
Fredericton:751400:72908:July 1, 1867:3
Winnipeg:1170300:647797:July 15, 1870:7
Victoria:4168123:944735:July 20, 1871:10
Charlottetown:137900:5660:July 1, 1873:2... (2 Replies)
Discussion started by: mindfreak
2 Replies
7. Shell Programming and Scripting
Hi Friends,
I am new to Shell Scripting and need your help in the below situation.
- I have two files (File 1 and File 2) and the contents of the files are mentioned below.
- "Application handle" is the common field in both the files.
(NOTE :- PLEASE REFER TO THE ATTACHMENT "Compare files... (2 Replies)
Discussion started by: Santoshbn
2 Replies
8. Shell Programming and Scripting
i have 3 files which contains as below (example):
yy-mm-dd hh:mm:sec lat lon depth mag
2006-01-01 23:17:26.80 39.8405 41.8795 2.0 3.3
2006-01-06 00:10:26.80 39.9570 41.2130 5.0 3.3
2006-01-06 06:59:02.10 39.4099 44.6065 10.0 3.7
2006-01-06 13:49:52.70... (4 Replies)
Discussion started by: oreka18
4 Replies
9. UNIX for Dummies Questions & Answers
Hi all !
I almost did it but got a small problem.
input:
cars red
cars blue
cars green
truck black
Wanted:
cars red-blue-green
truck black
Attempt:
gawk 'BEGIN{FS="\t"}{a = a (a?"-":"")$2; $2=a; print $1 FS $2}' input
But I also got the intermediate records... (2 Replies)
Discussion started by: beca123456
2 Replies
10. UNIX for Beginners Questions & Answers
Hi,
A beginner one.
my input.tab (tab-separated):
h1 h2 h3 h4 h5
item1 grpA 2 3 customer1
item2 grpB 4 6 customer1
item3 grpA 5 9 customer1
item4 grpA 0 0 customer2
item5 grpA 9 1 customer2
objective:
output a file for each customer ($5) with the item number ($1) only if $2 matches... (2 Replies)
Discussion started by: beca123456
2 Replies
LEARN ABOUT CENTOS
ldns_calc_keytag
ldns(3) Library Functions Manual ldns(3)
NAME
ldns_verify_rrsig_dsa, ldns_verify_rrsig_rsasha1, ldns_verify_rrsig_rsamd5
SYNOPSIS
#include <stdint.h>
#include <stdbool.h>
#include <ldns/ldns.h>
ldns_status ldns_verify_rrsig_dsa(ldns_buffer *sig, ldns_buffer *rrset, ldns_buffer *key);
ldns_status ldns_verify_rrsig_rsasha1(ldns_buffer *sig, ldns_buffer *rrset, ldns_buffer *key);
ldns_status ldns_verify_rrsig_rsamd5(ldns_buffer *sig, ldns_buffer *rrset, ldns_buffer *key);
DESCRIPTION
ldns_verify_rrsig_dsa() verifies a buffer with signature data (DSA) for a buffer with rrset data with a buffer with key data.
sig: the signature data
rrset: the rrset data, sorted and processed for verification
key: the key data
ldns_verify_rrsig_rsasha1() verifies a buffer with signature data (RSASHA1) for a buffer with rrset data with a buffer with key data.
sig: the signature data
rrset: the rrset data, sorted and processed for verification
key: the key data
ldns_verify_rrsig_rsamd5() verifies a buffer with signature data (RSAMD5) for a buffer with rrset data with a buffer with key data.
sig: the signature data
rrset: the rrset data, sorted and processed for verification
key: the key data
AUTHOR
The ldns team at NLnet Labs. Which consists out of Jelte Jansen and Miek Gieben.
REPORTING BUGS
Please report bugs to ldns-team@nlnetlabs.nl or in our bugzilla at http://www.nlnetlabs.nl/bugs/index.html
COPYRIGHT
Copyright (c) 2004 - 2006 NLnet Labs.
Licensed under the BSD License. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
SEE ALSO
ldns_key, ldns_sign_public, ldns_zone_sign, ldns_verify, ldns_verify_rrsig. And perldoc Net::DNS, RFC1034, RFC1035, RFC4033, RFC4034 and
RFC4035.
REMARKS
This manpage was automaticly generated from the ldns source code by use of Doxygen and some perl.
30 May 2006 ldns(3)