If string matches within 2 files, delete one file. Post: 302349096

Sponsored Content

Top Forums Shell Programming and Scripting If string matches within 2 files, delete one file. Post 302349096 by sitney on Monday 31st of August 2009 05:40:22 AM

08-31-2009

Registered User

If string matches within 2 files, delete one file.

I have a directory with a large # of files and in each file I am looking to match a string in one file with a string in the subsequent n file(s). If there is a match between a string in one file and a string in the next n file(s) then delete the subsequent duplicate file(s). Here is sample input:

Code:

blake [ ~/scratch ]$ ls -l ???.txt
-rw-r--r--  1 blake  staff  7 Aug 31 16:23 aaa.txt
-rw-r--r--  1 blake  staff  7 Aug 31 16:23 bbb.txt
-rw-r--r--  1 blake  staff  7 Aug 31 16:23 ccc.txt
-rw-r--r--  1 blake  staff  7 Aug 31 16:23 ddd.txt
-rw-r--r--  1 blake  staff  7 Aug 31 16:24 eee.txt
-rw-r--r--  1 blake  staff  7 Aug 31 16:24 fff.txt
-rw-r--r--  1 blake  staff  7 Aug 31 16:24 ggg.txt

blake [ ~/scratch ]$ cat ???.txt
aabbcc
aabbcc
aabbcc
abcabc
abcabc
abc123
aabbcc

And the desired output is as follows (assuming that I set n to look at 7 files or more)

Code:

blake [ ~/scratch ]$ ls -l ???.txt
-rw-r--r--  1 blake  staff  7 Aug 31 16:23 aaa.txt
-rw-r--r--  1 blake  staff  7 Aug 31 16:23 ddd.txt
-rw-r--r--  1 blake  staff  7 Aug 31 16:24 fff.txt

Many thanks.

sitney

View Public Profile for sitney

Find all posts by sitney

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Looking for a string in files and reporting matches

Can someone please help me figure out what the command syntax I need to use is? Here is what I am wanting to do. I have hundreds of thousands of files I need to look for a specific search string in. These files are spread across multiple subdirectories from one main directory. I would like...

2. Shell Programming and Scripting

script to delete lines from a txt file if pattern matches

File 6 dbnawldb010-b office Memphis_Corp_SQL_Diff Memphis-Corp-SQL-Inc-Application-Backup 03/09/11 03:24:04 42 luigi-b IPNRemitDB Memphis_Corp_SQL_Diff Memphis-Corp-SQL-Inc-Application-Backup 03/10/11 00:41:36 6 ebs-sqldev1-b IPNTracking Memphis_Corp_SQL_Diff...

3. Shell Programming and Scripting

Grep a string from input file and delete next three lines including the line contains string in xml

Hi, 1_strings file contains $ cat 1_strings /home/$USER/Src /home/Valid /home/Review$ cat myxml <projected value="some string" path="/home/$USER/Src"> <input 1/> <estimate value/> <somestring/> </projected> <few more lines > <projected value="some string" path="/home/$USER/check">...

4. Shell Programming and Scripting

String replacement when particular pattern matches in a file

I have a file file123.xml which looks like this xmlEntry="username"="josh" <property="never_back_down"> phone="<178652>" apn=property:address="wonderland" xmlEntry="username"="jessica" <property="never_back_down"> phone="<178653>" apn=property:address="wonderland"...

5. Shell Programming and Scripting

Compare 2 files and print matches and non-matches in separate files

Hi all, I have two files, chap.txt and complex.txt. chap.txt looks like this: a d l m r k complex.txt looks like this: a c d e l m n j a d l p q r c p r m .........

6. Shell Programming and Scripting

Help in printing n number of lines if a search string matches in a file

Hi I have below script which is used to grep specific errors and if error string matches send an email alert. Script is working fine , however , i wish to print next 10 lines of the string match to get the details of error in the email alert Current code:- #!/bin/bash tail -Fn0 --retry...

7. UNIX for Dummies Questions & Answers

Print only '+' or '-' if string matches (two files)

I would like to add two additional conditions to the actual code I have: print '+' if in File2 field 5 is greater than 35 and also field 7 is grater than 90. while read -r line do grep -q "$line" File2.txt && echo "$line +" || echo "$line -" done < File1.txt ' Input file 1: ...

8. Shell Programming and Scripting

Required 3 lines above the file and below file when string matches

i had requirement like i need to get "error" line of above 3 and below 3 from a file .I tried with the below script.But it's not working. y='grep -n -i error /home/file.txt|cut -c1' echo $y head -$y /home/file.txt| tail -3 >tmp.txt tail -$y /home/file.txt head -3 >>tmp.txt

9. Shell Programming and Scripting

Replace all string matches in file with unique random number

Hello Take this file... Test01 Ref test Version 01 Test02 Ref test Version 02 Test66 Ref test Version 66 Test99 Ref test Version 99 I want to substitute every occurrence of Test{2} with a unique random number, so for example, if I was using sed, substitution would be something...

10. Shell Programming and Scripting

Replace string of a file with a string of another file for matches using grep,sed,awk

I have a file comp.pkglist which mention package version and release . In 'version change' and 'release change' line there are two versions 'old' and 'new' Version Change: --> Release Change: --> cat comp.pkglist Package list: nss-util-devel-3.28.4-1.el6_9.x86_64 Version Change: 3.28.4 -->...

LEARN ABOUT OPENSOLARIS

groups

groups(1)							   User Commands							 groups(1)

NAME

       groups - print group membership of user

SYNOPSIS

       groups [user]...

DESCRIPTION

       The  command groups prints on standard output the groups to which you or the optionally specified user belong. Each user belongs to a group
       specified in  /etc/passwd and possibly to other groups as specified in  /etc/group. Note that  /etc/passwd specifies the numerical ID (gid)
       of the group. The groups command converts gid to the group name in the output.

EXAMPLES

       The output takes the following form:

	 example% groups tester01 tester02
	 tester01 : staff
	 tester02 : staff
	 example%

FILES

       /etc/passwd

       /etc/group

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWcsu			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       group(4), passwd(4), attributes(5)

SunOS 5.11							    14 Sep 1992 							 groups(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Looking for a string in files and reporting matches

Discussion started by: btrotter

2. Shell Programming and Scripting

script to delete lines from a txt file if pattern matches

Discussion started by: ajiwww

3. Shell Programming and Scripting

Grep a string from input file and delete next three lines including the line contains string in xml

Discussion started by: greet_sed

4. Shell Programming and Scripting

String replacement when particular pattern matches in a file

Discussion started by: poga