12-04-2008
Identify matching data in a file and output to original line, in perl
Hi,
I haven't done this for awhile, and further, I've never done it in perl so I appreciate any help you can give me.
I have a file of lines, each with 5 data points that look like this:
AB,N,ALLIANCEBERNSTEIN HLDNG L.P,AB,N
ALD,N,ALLIED CAPITAL CORPORATION,ALD,N
AFC,N,ALLIED CAPITAL CORPORATION,ALD,N
Let's call it: a,b,c,d,e
Every time a == d and b == e, I want to then search every other line in the file and find where a == d(newline) and a == e(newline). Whenever this is the case, I want to append the a,b data from the newline to the original line such that it reads: a,b,c,d,e,a(newline),b(newline).
Using the data above, we would output something like this:
AB,N,ALLIANCEBERNSTEIN HLDNG L.P,AB,N
ALD,N,ALLIED CAPITAL CORPORATION,ALD,N,AFC,N
AFC,N,ALLIED CAPITAL CORPORATION,ALD,N
I'm also not sure how many total matches there might be in the file so I could end up with ~100 matching lines for any original line such that the final result for the original line would look like: a,b,c,d,e,a(newline0),b(newline0)...,a(newline100),b(newline100)
Does that make sense?
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi All,
I have a huge unix flat file delimted by @ at the end of the line. I need to find out if there is any line/s containing @ in between the line so that I can remove that and put the file for processing.
Thanks in advance for your help. (4 Replies)
Discussion started by: b.paramanatti
4 Replies
2. UNIX for Dummies Questions & Answers
Hi all,
I am trying to zgrep / grep list of files so that it displays only the matching filename:line number and does not display the whole line, like:
(echo "1.txt";echo "2.txt") | xargs zgrep -no STRING
If I use -o option, it displays the matching STRING and if not used, displays the... (3 Replies)
Discussion started by: vvaidyan
3 Replies
3. Shell Programming and Scripting
Hi,
Need awk help to group and print lines to format the output as shown below
INPUT FORMAT
set echo on
set heading on
set spool on
/* SCHEMA1 */ CREATE TABLE T1;
/* SCHEMA1 */ CREATE TABLE T2;
/* SCHEMA1 */ CREATE TABLE T3;
/* SCHEMA1 */ CREATE TABLE T4;
/* SCHEMA1 */ CREATE TABLE T5;... (5 Replies)
Discussion started by: rajan_san
5 Replies
4. Shell Programming and Scripting
One file is
fileA
0.0246*0.0068*0.0013*0.0023*0.0182*0.0028*0.0019*0.4750*0.0028*0.0812*0.0123*0.0018*0.0039*0.0020*0.0028*0.0047*0.0139*0.3330*0.0017*0.0072*0.4789... (4 Replies)
Discussion started by: cdfd123
4 Replies
5. Programming
Hi friends,,
i have find the matching data between 2files.
My file1 have a data like
rs3001336
rs3984736
rs2840532
File2 have a data like
rs3736330 1 2359237 A G 0.28 1.099 0.010
rs2840532 1 2359977 G A 0.363 0.3373 1.123
rs3001336 1 2365193 G A 0.0812 0.07319 1.12 ... (1 Reply)
Discussion started by: sureshraj
1 Replies
6. Shell Programming and Scripting
Hi friends,,
i have find the matching data between 2files.
My file1 have a data like
rs3001336
rs3984736
rs2840532
File2 have a data like
rs3736330 1 2359237 A G 0.28 1.099 0.010
rs2840532 1 2359977 G A 0.363 0.3373 1.123
rs3001336 1 ... (4 Replies)
Discussion started by: sureshraj
4 Replies
7. Shell Programming and Scripting
Hi Folks,
I have an html file which contains the below line in the body tagI am trying the replace hello with Hello Giridhar programatically.
<body>
<P><STRONG><FONT face="comic sans ms,cursive,sans-serif"><EM>Hello</EM></FONT></STRONG></P>
</body>
I have written the below code to... (3 Replies)
Discussion started by: giridhar276
3 Replies
8. Shell Programming and Scripting
Hello,
I'm pretty stumped, and I don't know why I am not able to redirect the output to the 'graphme' file with the command below in Fedora 18.
tcpdump -l -n -t "tcp == 18" | perl -ane '($s,$j)=split(/,/,$F,2); print "$s\n";' > graphme
In case you're wondering, I was following the example... (2 Replies)
Discussion started by: ConcealedKnight
2 Replies
9. Shell Programming and Scripting
Hi,
I want to achieve something similar to what described in another post:
The difference is I want to add the line if the pattern is not found.
File 1:
A123, valueA, valueB
B234, valueA, valueB
C345, valueA, valueB
D456, valueA, valueB
E567, valueA, valueB
F678, valueA, valueB
... (11 Replies)
Discussion started by: jyu3
11 Replies
10. Shell Programming and Scripting
I have multiple (~80) files (some can be as big as 30GB of >1 billion of lines!) to grep on a pattern, and piped the match to a single file. I have a 96-core machine so that each grep job was sent to the background to speed up the search:
file1.tab
chr1A_part1 123241847 123241848... (6 Replies)
Discussion started by: yifangt
6 Replies
LEARN ABOUT DEBIAN
dh_perl
DH_PERL(1) Debhelper DH_PERL(1)
NAME
dh_perl - calculates Perl dependencies and cleans up after MakeMaker
SYNOPSIS
dh_perl [debhelperoptions] [-d] [librarydirs...]
DESCRIPTION
dh_perl is a debhelper program that is responsible for generating the ${perl:Depends} substitutions and adding them to substvars files.
The program will look at Perl scripts and modules in your package, and will use this information to generate a dependency on perl or
perlapi. The dependency will be substituted into your package's control file wherever you place the token ${perl:Depends}.
dh_perl also cleans up empty directories that MakeMaker can generate when installing Perl modules.
OPTIONS
-d In some specific cases you may want to depend on perl-base rather than the full perl package. If so, you can pass the -d option to make
dh_perl generate a dependency on the correct base package. This is only necessary for some packages that are included in the base
system.
Note that this flag may cause no dependency on perl-base to be generated at all. perl-base is Essential, so its dependency can be left
out, unless a versioned dependency is needed.
-V By default, scripts and architecture independent modules don't depend on any specific version of perl. The -V option causes the current
version of the perl (or perl-base with -d) package to be specified.
library dirs
If your package installs Perl modules in non-standard directories, you can make dh_perl check those directories by passing their names
on the command line. It will only check the vendorlib and vendorarch directories by default.
CONFORMS TO
Debian policy, version 3.8.3
Perl policy, version 1.20
SEE ALSO
debhelper(7)
This program is a part of debhelper.
AUTHOR
Brendan O'Dea <bod@debian.org>
9.20120909 2011-09-12 DH_PERL(1)