Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: If string matches within 2 files, delete one file.
Top Forums Shell Programming and Scripting If string matches within 2 files, delete one file. Post 302349398 by FlyingSquirrel on Tuesday 1st of September 2009 12:53:08 AM
Old 09-01-2009
Sitney,

Here is something to try...
Assumptions are:
- The first line in each file contains the comparison string
- only one instance of a specific string is allowed, regardless of the number of files.

Test files are:
Code:
# ls -l ???.txt
-rw-r--r-- 1 root root 7 2009-08-31 22:54 aaa.txt
-rw-r--r-- 1 root root 7 2009-08-31 22:54 bbb.txt
-rw-r--r-- 1 root root 7 2009-08-31 22:54 ccc.txt
-rw-r--r-- 1 root root 7 2009-08-31 22:55 ddd.txt
-rw-r--r-- 1 root root 7 2009-08-31 22:55 eee.txt
-rw-r--r-- 1 root root 7 2009-08-31 22:55 fff.txt
-rw-r--r-- 1 root root 7 2009-08-31 22:56 ggg.txt

Contents of files:
Code:
# cat ???.txt
aabbcc
aabbcc
aabbcc
abcabc
abcabc
abc123
aabbcc

Script to run:
Code:
for i in ???.txt
do 
   c=$(head -1 $i)
   echo "$c|$i"
done | perl -e '{my %s; while(<>){chomp;($st,$fn) = split(/\|/);if (! defined($s{$st})) {$s{$st} = $fn; print "$s{$st}\n";}}}' | xargs ls -l

Description:
For each file,
echo the string, followed by pipe symbol, followed by the filename
end of for loop, pass this into perl script via standard in
the perl script splits output on the pipe symbol,
checks if the string name is defined in the hash, if not, store the filename value, with the string as the key to the hash, then print the filename
Send this output as standard input to the xargs which passes each filename to the "ls -l" command.

Output is:
Code:
-rw-r--r-- 1 root root 7 2009-08-31 22:54 aaa.txt
-rw-r--r-- 1 root root 7 2009-08-31 22:55 ddd.txt
-rw-r--r-- 1 root root 7 2009-08-31 22:55 fff.txt

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Looking for a string in files and reporting matches

Can someone please help me figure out what the command syntax I need to use is? Here is what I am wanting to do. I have hundreds of thousands of files I need to look for a specific search string in. These files are spread across multiple subdirectories from one main directory. I would like... (4 Replies)
Discussion started by: btrotter
4 Replies

2. Shell Programming and Scripting

script to delete lines from a txt file if pattern matches

File 6 dbnawldb010-b office Memphis_Corp_SQL_Diff Memphis-Corp-SQL-Inc-Application-Backup 03/09/11 03:24:04 42 luigi-b IPNRemitDB Memphis_Corp_SQL_Diff Memphis-Corp-SQL-Inc-Application-Backup 03/10/11 00:41:36 6 ebs-sqldev1-b IPNTracking Memphis_Corp_SQL_Diff... (4 Replies)
Discussion started by: ajiwww
4 Replies

3. Shell Programming and Scripting

Grep a string from input file and delete next three lines including the line contains string in xml

Hi, 1_strings file contains $ cat 1_strings /home/$USER/Src /home/Valid /home/Review$ cat myxml <projected value="some string" path="/home/$USER/Src"> <input 1/> <estimate value/> <somestring/> </projected> <few more lines > <projected value="some string" path="/home/$USER/check">... (4 Replies)
Discussion started by: greet_sed
4 Replies

4. Shell Programming and Scripting

String replacement when particular pattern matches in a file

I have a file file123.xml which looks like this xmlEntry="username"="josh" <property="never_back_down"> phone="<178652>" apn=property:address="wonderland" xmlEntry="username"="jessica" <property="never_back_down"> phone="<178653>" apn=property:address="wonderland"... (5 Replies)
Discussion started by: poga
5 Replies

5. Shell Programming and Scripting

Compare 2 files and print matches and non-matches in separate files

Hi all, I have two files, chap.txt and complex.txt. chap.txt looks like this: a d l m r k complex.txt looks like this: a c d e l m n j a d l p q r c p r m ......... (7 Replies)
Discussion started by: AshwaniSharma09
7 Replies

6. Shell Programming and Scripting

Help in printing n number of lines if a search string matches in a file

Hi I have below script which is used to grep specific errors and if error string matches send an email alert. Script is working fine , however , i wish to print next 10 lines of the string match to get the details of error in the email alert Current code:- #!/bin/bash tail -Fn0 --retry... (2 Replies)
Discussion started by: neha0785
2 Replies

7. UNIX for Dummies Questions & Answers

Print only '+' or '-' if string matches (two files)

I would like to add two additional conditions to the actual code I have: print '+' if in File2 field 5 is greater than 35 and also field 7 is grater than 90. while read -r line do grep -q "$line" File2.txt && echo "$line +" || echo "$line -" done < File1.txt ' Input file 1: ... (5 Replies)
Discussion started by: bernardo.bello
5 Replies

8. Shell Programming and Scripting

Required 3 lines above the file and below file when string matches

i had requirement like i need to get "error" line of above 3 and below 3 from a file .I tried with the below script.But it's not working. y='grep -n -i error /home/file.txt|cut -c1' echo $y head -$y /home/file.txt| tail -3 >tmp.txt tail -$y /home/file.txt head -3 >>tmp.txt (4 Replies)
Discussion started by: bhas85
4 Replies

9. Shell Programming and Scripting

Replace all string matches in file with unique random number

Hello Take this file... Test01 Ref test Version 01 Test02 Ref test Version 02 Test66 Ref test Version 66 Test99 Ref test Version 99 I want to substitute every occurrence of Test{2} with a unique random number, so for example, if I was using sed, substitution would be something... (1 Reply)
Discussion started by: funkman
1 Replies

10. Shell Programming and Scripting

Replace string of a file with a string of another file for matches using grep,sed,awk

I have a file comp.pkglist which mention package version and release . In 'version change' and 'release change' line there are two versions 'old' and 'new' Version Change: --> Release Change: --> cat comp.pkglist Package list: nss-util-devel-3.28.4-1.el6_9.x86_64 Version Change: 3.28.4 -->... (1 Reply)
Discussion started by: Paras Pandey
1 Replies

LEARN ABOUT DEBIAN

cgi::formbuilder::template::fast

CGI::FormBuilder::Template::Fast(3pm)			User Contributed Perl Documentation		     CGI::FormBuilder::Template::Fast(3pm)

NAME

       CGI::FormBuilder::Template::Fast - FormBuilder interface to CGI::FastTemplate

SYNOPSIS

	   my $form = CGI::FormBuilder->new(
	       fields	=> @whatever,
	       template => {
		   type => 'Fast',
		   root => '/path/to/templates',
		   # use external files
		   define => {
		       form	      => 'form.txt',
		       field	      => 'field.txt',
		       invalid_field  => 'invalid_field.txt',
		   },
		   # or define inline
		   define_nofile => {
		       form => '<html><head></head><body>$START_FORM
				<table>$FIELDS</table>$SUBMIT $END_FORM</body></html>',
		       # etc.
		   },
	       },
	  );

DESCRIPTION

       This engine adapts FormBuilder to use "CGI::FastTemplate". Please read these docs carefully, as the usage differs from other template
       adapters in several important ways.

       You will need to define three templates: "form", "field", and "invalid_field". You can use "define" to point to external files (which is
       the recommended "CGI::FastTemplate" style), or "define_nofile"/ "define_raw" to define them inline. The templates in "define_nofile" take
       precedence over "define_raw", and both of these take precedence over "define".

	   my $form = CGI::FormBuilder->new(
	       # ...
	       template => {
		   type => 'FastTemplate',
		   root => '/path/to/templates',
		   define => {
		       form	      => 'form.txt',
		       field	      => 'field.txt',
		       invalid_field  => 'invalid_field.txt',
		   },
		   # or, you can define templates directly
		   define_nofile => {
		       form => '<html><head></head><body>$START_FORM<table>'
			       '$FIELDS</table>$SUBMIT $END_FORM</body></html>',
		       # etc.
		   },
	       },
	       # ...
	   );

       If you use "define" with external templates, you will probably also want to define your template root directory with the "root" parameter.

       Within each of the field templates, the following variables are available:

	   $NAME	 # $field->name
	   $FIELD	 # $field->tag	 (HTML input tag)
	   $VALUE	 # $field->value (first value only!)
	   $LABEL	 # $field->label
	   $COMMENT	 # $field->comment
	   $ERROR	 # $field->error
	   $REQUIRED	 # $field->required ? 'required' : 'optional'

       All the fields are processed in sequence; valid fields use the "field" template, and invalid fields the "invalid_field" template.  The
       result from each of these is appended into the $FIELDS variable, which you should use in your "form" template. In the "form" template, you
       also have access to these variables:

	   $TITLE	 # title of the form
	   $START_FORM	 # opening form tag
	   $SUBMIT	 # the submit button
	   $RESET	 # the reset button
	   $END_FORM	 # closing form tag
	   $JS_HEAD	 # validation JavaScript

       Note that since "CGI::FastTemplate" doesn't use anything other than simple scalar variables, there are no variables corrosponding to the
       lists that other engines have (e.g. "fields" or "options" lists in "TT2" or "Text::Template").

SEE ALSO

       CGI::FormBuilder, CGI::FormBuilder::Template, CGI::FastTemplate

AUTHOR

       Copyright (c) 2005-2006 Peter Eichman <peichman@cpan.org>. All Rights Reserved.

       Maintained as part of "CGI::FormBuilder" by Nate Wiger <nate@wiger.org>.

       This module is free software; you may copy this under the terms of the GNU General Public License, or the Artistic License, copies of which
       should have accompanied your Perl kit.

perl v5.14.2							    2011-09-16				     CGI::FormBuilder::Template::Fast(3pm)
All times are GMT -4. The time now is 10:49 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy