Sponsored Content
Top Forums UNIX for Dummies Questions & Answers Merge selective columns from files based on common key Post 302959582 by dovah on Wednesday 4th of November 2015 04:27:22 PM
Old 11-04-2015
Awesome, worked like a charm! Smilie
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Merge files based on key

Hi Friends, Can any one help me with merging these file based on two columns : File1: A|123|99|SAMS B|456|95|GEORGE D|789|85|HOVARD File2: S|123|99|NANcY|6357 S|123|99|GREGRO|83748 A|456|95|HARRY|827|somers S|456|95|ANTONY|546841|RUDOLPH|7263 B|456|95|SMITH|827|BOISE STATE|834... (3 Replies)
Discussion started by: sbasetty
3 Replies

2. Shell Programming and Scripting

"Join" or "Merge" more than 2 files into single output based on common key (column)

Hi All, I have working (Perl) code to combine 2 input files into a single output file using the join function that works to a point, but has the following limitations: 1. I am restrained to 2 input files only. 2. Only the "matched" fields are written out to the "matched" output file and... (1 Reply)
Discussion started by: Katabatic
1 Replies

3. Shell Programming and Scripting

Merge two files based on a 3rd key file

Hi, I want to merge the two files based on the key file's columns. The key file: DATE~DATE HOUSE~IN_HOUSE CUST~IN_CUST PRODUCT~PRODUCT ADDRESS~CUST_ADDR BASIS_POINTS~BASIS_POINTS ... The other 2 files are From_file & To_file - The From_file: DATE|date/time|29|9 ... (9 Replies)
Discussion started by: dips_ag
9 Replies

4. Shell Programming and Scripting

file merge based on common columns

I have two files 1.txt 34, ABC, 7, 8, 0.9 35, CDE, 6.5, -2, 0.01 2.txt 34, ABC, 9, 6, -1.9 35, CDE, 8.5, -2.3, 5.01 So in both files common columns are 1 and 2 so final o/p should look like 34, ABC, 7, 8, 0.9, 9, 6, -1.9 35, CDE, 6.5, -2, 0.01, 8.5, -2.3, 5.01 I tried using... (3 Replies)
Discussion started by: manas_ranjan
3 Replies

5. Shell Programming and Scripting

Merge multiple lines in same file with common key using awk

I've been a Unix admin for nearly 30 years and never learned AWK. I've seen several similar posts here, but haven't been able to adapt the answers to my situation. AWK is so damn cryptic! ;) I have a single file with ~900 lines (CSV list). Each line starts with an ID, but with different stuff... (6 Replies)
Discussion started by: protosd
6 Replies

6. Shell Programming and Scripting

Merge files based on both common and uncommon rows

Hi, I have two files A (2190 rows) and file B (1100 rows). I want to merge the contents of two files based on common field, also I need the unmatched rows from file A file A: ABC XYZ PQR file B: >LMN|chr1:11000-12456: >ABC|chr15:176578-187678: >PQR|chr3:14567-15866: output... (3 Replies)
Discussion started by: Diya123
3 Replies

7. Shell Programming and Scripting

Merge files based on columns

011111123444 1234 1 20000 011111123444 1235 1 30000 011111123446 1234 3 40000 011111123447 1234 4 50000 011111123448 1234 3 50000 File2: 011111123444,Rsttponrfgtrgtrkrfrgtrgrer 011111123446,Rsttponrfgtrgtr 011111123447,Rsttponrfgtrguii 011111123448,Rsttponrfgtrgtjiiu I have 2 files... (4 Replies)
Discussion started by: vinus
4 Replies

8. Shell Programming and Scripting

awk - Merge two files based on one key

Hi, I am struggling with the an awk command to merge two files based on a common key. I want to append the value from File2 ($2) onto the end of File1 where $1 from each file matches - If no match then nothing is apended File1 COL1|COL2|COL3|COL4|COL5|COL6|COL7... (3 Replies)
Discussion started by: Ads89
3 Replies

9. Shell Programming and Scripting

Paste columns based on common column: multiple files

Hi all, I've multiple files. In this case 5. Space separated columns. Each file has 12 columns. Each file has 300-400K lines. I want to get the output such that if a value in column 2 is present in all the files then get all the columns of that value and print it side by side. Desired output... (15 Replies)
Discussion started by: genome
15 Replies

10. Shell Programming and Scripting

Join and merge multiple files with duplicate key and fill void columns

Join and merge multiple files with duplicate key and fill void columns Hi guys, I have many files that I want to merge: file1.csv: 1|abc 1|def 2|ghi 2|jkl 3|mno 3|pqr file2.csv: (5 Replies)
Discussion started by: yjacknewton
5 Replies
Dist::Zilla::Plugin::MakeMaker::Custom(3pm)		User Contributed Perl Documentation	       Dist::Zilla::Plugin::MakeMaker::Custom(3pm)

NAME
Dist::Zilla::Plugin::MakeMaker::Custom - Allow a dist to have a custom Makefile.PL VERSION
This document describes version 4.08 of Dist::Zilla::Plugin::MakeMaker::Custom, released June 4, 2012 as part of Dist-Zilla-Plugins-CJM version 4.09. SYNOPSIS
In dist.ini: [MakeMaker::Custom] eumm_version = 0.34 ; the default comes from the MakeMaker plugin In your Makefile.PL: use ExtUtils::MakeMaker; ##{ $share_dir_code{preamble} || '' ##} WriteMakefile( NAME => "My::Module", ##{ $plugin->get_prereqs ##} ); ##{ $share_dir_code{postamble} || '' ##} Of course, your Makefile.PL should be more complex than that, or you don't need this plugin. DESCRIPTION
This plugin is for people who need something more complex than the auto-generated Makefile.PL or Build.PL generated by the MakeMaker or ModuleBuild plugins. It is a subclass of the MakeMaker plugin, but it does not write a Makefile.PL for you. Instead, you write your own Makefile.PL, which may do anything ExtUtils::MakeMaker is capable of. This plugin will process Makefile.PL as a template (using Text::Template), which allows you to add data from Dist::Zilla to the version you distribute (if you want). The template delimiters are "##{" and "##}", because that makes them look like comments. That makes it easier to have a Makefile.PL that works both before and after it is processed as a template. This is particularly useful for XS-based modules, because it can allow you to build and test the module without the overhead of "dzil build" after every small change. The template may use the following variables: %default_args The hash of arguments for WriteMakefile generated by the normal MakeMaker plugin. $dist The name of the distribution. $eumm_version The minimum version of ExtUtils::MakeMaker required (from the "eumm_version" attribute of this plugin). %meta The hash of metadata (in META 2 format) that will be stored in META.json. $perl_prereq The minimum version of Perl required (from the prerequisites in the metadata). May be "undef". Equivalent to $default_args{MIN_PERL_VERSION}. $plugin The MakeMaker::Custom object that is processing the template. %share_dir_code A hash of strings containing the code for loading "File::ShareDir::Install" (if it's used by this dist). Put "##{ $share_dir_code{preamble} || '' ##}" after the "use ExtUtils::MakeMaker" line, and put "##{ $share_dir_code{postamble} || '' ##}" after the "WriteMakefile" call. (You can omit the "|| ''" if you're sure the dist is using File::ShareDir. For backwards compatibility, this code is also available in the array @share_dir_block, but you should update your templates to use %share_dir_code instead. $version The distribution's version number. $zilla The Dist::Zilla object that is creating the distribution. METHODS
get_default $plugin->get_default(qw(key1 key2 ...)) A template can call this method to extract the specified key(s) from the default WriteMakefile arguments created by the normal MakeMaker plugin and have them formatted into a comma-separated list suitable for a hash constructor or a function's parameter list. If any key has no value (or its value is an empty hash or array ref) it will be omitted from the list. If all keys are omitted, the empty string is returned. Otherwise, the result always ends with a comma. get_prereqs $plugin->get_prereqs This is equivalent to $plugin->get_default(qw(BUILD_REQUIRES CONFIGURE_REQUIRES PREREQ_PM)) In other words, it returns all the keys that describe the distribution's prerequisites. SEE ALSO
The ModuleBuild::Custom plugin does basically the same thing as this plugin, but for Build.PL (if you prefer Module::Build). The MakeMaker::Awesome plugin allows you to do similar things to your Makefile.PL, but it works in a very different way. With MakeMaker::Awesome, you subclass the plugin and override the methods that generate Makefile.PL. In my opinion, MakeMaker::Awesome has two disadvantages: it's unnecessarily complex, and it doesn't allow you to build your module without doing "dzil build". The only advantage of MakeMaker::Awesome that I can see is that if you had several dists with very similar Makefile.PLs, you could write one subclass of MakeMaker::Awesome and use it in each dist. DEPENDENCIES
MakeMaker::Custom requires Dist::Zilla (4.300009 or later) and Text::Template. I also recommend applying Template_strict.patch to Text::Template. This will add support for the STRICT option, which will help catch errors in your templates. INCOMPATIBILITIES
You must not use this in conjunction with the MakeMaker or MakeMaker::Awesome plugins. BUGS AND LIMITATIONS
No bugs have been reported. AUTHOR
Christopher J. Madsen "<perl AT cjmweb.net>" Please report any bugs or feature requests to "<bug-Dist-Zilla-Plugins-CJM AT rt.cpan.org>" or through the web interface at http://rt.cpan.org/Public/Bug/Report.html?Queue=Dist-Zilla-Plugins-CJM <http://rt.cpan.org/Public/Bug/Report.html?Queue=Dist-Zilla-Plugins- CJM>. You can follow or contribute to Dist-Zilla-Plugins-CJM's development at http://github.com/madsen/dist-zilla-plugins-cjm <http://github.com/madsen/dist-zilla-plugins-cjm>. COPYRIGHT AND LICENSE
This software is copyright (c) 2012 by Christopher J. Madsen. This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself. DISCLAIMER OF WARRANTY
BECAUSE THIS SOFTWARE IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY FOR THE SOFTWARE, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES PROVIDE THE SOFTWARE "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE SOFTWARE IS WITH YOU. SHOULD THE SOFTWARE PROVE DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING, REPAIR, OR CORRECTION. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR REDISTRIBUTE THE SOFTWARE AS PERMITTED BY THE ABOVE LICENSE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR INABILITY TO USE THE SOFTWARE (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A FAILURE OF THE SOFTWARE TO OPERATE WITH ANY OTHER SOFTWARE), EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. perl v5.14.2 2012-06-04 Dist::Zilla::Plugin::MakeMaker::Custom(3pm)
All times are GMT -4. The time now is 01:30 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy