Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Compare two files when pattern matched
Top Forums UNIX for Beginners Questions & Answers Compare two files when pattern matched Post 302979829 by Don Cragun on Friday 19th of August 2016 09:40:01 AM
Old 08-19-2016
Each call to system() in awk will invoke a shell which will then invoke cp. If there are 6000 files to be copied, invoking one shell for the copies instead of 6000 should be considerably faster. Consider this small change to RudiC's suggestion:
Code:
awk '
NR == FNR       {T[$1]
                 next
                }
                {FN = $0 
                 gsub (/^.*\/|.txt$/, _)
                }
$0 in T         {print "cp", FN, "/some/where"
                }
' file2 file1 | sh

And, if the cp utility on your system has a -t destination_directory option (which is an extension not covered by the standards), you could make even more gains greatly reducing the number of times cp is invoked by using xargs:
Code:
awk '
NR == FNR       {T[$1]
                 next
                }
                {FN = $0 
                 gsub (/^.*\/|.txt$/, _)
                }
$0 in T         {print FN
                }
' file2 file1 | xargs cp -t "/some/where"

These 2 Users Gave Thanks to Don Cragun For This Post:
imranrasheedamu RavinderSingh13
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Count of matched pattern occurance

In a file a pattern is occured many times randomly. Even it may appear more then once in the same line too. How i can get the number of times that pattern appeared in the file? let the file name is abc.txt and the pattern is "xyz". I used the following code: grep -ic "xyz" abc.txt but it is... (3 Replies)
Discussion started by: palash2k
3 Replies

2. Shell Programming and Scripting

Shell Scripting: Compare pattern in two files and merge the o/p in one.

one.txt ONS.1287677000.820.log 20Oct2010 ONS.1287677000.123.log 21Oct2010 ONS.1287677000.456.log 22Oct2010 two.txt ONS.1287677000.820.log:V AC CC EN ONS.1287677000.123.log:V AC CC EN ONS.1287677000.820.log:V AC CC EN In file two.txt i have to look for pattern which column one... (17 Replies)
Discussion started by: saluja.deepak
17 Replies

3. Shell Programming and Scripting

removing lines around a matched pattern

I have an ugly conf file that has the string I'm interested in searching for in the middle of a block of code that's relevant, and I'm trying to find a way to remove that entire block based on the matched line. I've googled for this problem, and most people helping are only interested in... (9 Replies)
Discussion started by: tamale
9 Replies

4. Shell Programming and Scripting

Grep word between matched pattern

would like to print word between matched patterns using sed for example : create INDEX SCOTT.OR_PK ON table_name(....) would like to print between SCOTT. and ON which is OR_PK Please help me out Thanks (4 Replies)
Discussion started by: jhonnyrip
4 Replies

5. Shell Programming and Scripting

Print only matched pattern in perl

Hi, I have script like below: #!/usr/local/bin/perl use strict; use warnings; while (<DATA>) { ( my ($s_id) = /^\d+\|(\d+?)\|/ ) ; if ( $s_id == 1 ){ s/^(.*\|)*.*ABC\.pi=(+|+)*.*ABC\.id=(\d+|+).*$/$1$2|$3/s; print "$1$2|$3\n"; (2 Replies)
Discussion started by: sol_nov
2 Replies

6. Shell Programming and Scripting

Insert certain field of matched pattern line above pattern

Hello every, I am stuck in a problem. I have file like this. I want to add the fifth field of the match pattern line above the lines starting with "# @D". The delimiter is "|" eg > # @D0.00016870300|0.05501020000|12876|12934|3||Qp||Pleistocene||"3 Qp Pleistocene"|Q # @P... (5 Replies)
Discussion started by: jyu3
5 Replies

7. Shell Programming and Scripting

How to use sed to search a particular pattern in a file backward after a pattern is matched.?

Hi, I have two files file1.txt and file2.txt. Please see the attachments. In file2.txt (which actually is a diff output between two versions of file1.txt.), I extract the pattern corresponding to 1172c1172. Now ,In file1.txt I have to search for this pattern 1172c1172 and if found, I have to... (9 Replies)
Discussion started by: saurabh kumar
9 Replies

8. Shell Programming and Scripting

Matched a pattern from multiple columns

Hi, I need to extract an info in $1 based on a matched pattern in $2,$3,$4, and $5. The sample input file as follows:- ID Pat1 Pat2 Pro1 use1 add41 M M M add87 M M M M add32 ... (16 Replies)
Discussion started by: redse171
16 Replies

9. Shell Programming and Scripting

Putting together substrings if pattern is matched

What I would like to do is if the lines with % have the same name, then combine the last 9 letters of the string underneath the last occurrence of that ID with the first 9 letters of the string underneath the first occurrence of that ID. I have a file that looks like this: %GOGG... (12 Replies)
Discussion started by: verse123
12 Replies

10. UNIX for Advanced & Expert Users

To print from the first line until pattern is matched

Hi I want to print the line until pattern is matched. I am using below code: sed -n '1,/pattern / p' file It is working fine for me , but its not working for exact match. sed -n '1,/^LAC$/ p' file Input: LACC FEGHRA 0 LACC FACAF 0 LACC DARA 0 LACC TALAC 0 LAC ILACTC 0... (8 Replies)
Discussion started by: Abhisrajput
8 Replies

LEARN ABOUT OSX

cmp

CMP(1)								   User Commands							    CMP(1)

NAME

       cmp - compare two files byte by byte

SYNOPSIS

       cmp [OPTION]... FILE1 [FILE2 [SKIP1 [SKIP2]]]

DESCRIPTION

       Compare two files byte by byte.

       -b  --print-bytes
	      Print differing bytes.

       -i SKIP	--ignore-initial=SKIP
	      Skip the first SKIP bytes of input.

       -i SKIP1:SKIP2  --ignore-initial=SKIP1:SKIP2

	      Skip the first SKIP1 bytes of FILE1 and the first SKIP2 bytes of FILE2.

       -l  --verbose
	      Output byte numbers and values of all differing bytes.

       -n LIMIT  --bytes=LIMIT
	      Compare at most LIMIT bytes.

       -s  --quiet  --silent
	      Output nothing; yield exit status only.

       -v  --version
	      Output version info.

       --help Output this help.

       SKIP1  and  SKIP2  are  the number of bytes to skip in each file.  SKIP values may be followed by the following multiplicative suffixes: kB
       1000, K 1024, MB 1,000,000, M 1,048,576, GB 1,000,000,000, G 1,073,741,824, and so on for T, P, E, Z, Y.

       If a FILE is `-' or missing, read standard input.

AUTHOR

       Written by Torbjorn Granlund and David MacKenzie.

REPORTING BUGS

       Report bugs to <bug-gnu-utils@gnu.org>.

COPYRIGHT

       Copyright (C) 2002 Free Software Foundation, Inc.

       This program comes with NO WARRANTY, to the extent permitted by law.  You may redistribute copies of this program under the  terms  of  the
       GNU General Public License.  For more information about these matters, see the file named COPYING.

SEE ALSO

       The  full  documentation  for cmp is maintained as a Texinfo manual.  If the info and cmp programs are properly installed at your site, the
       command

	      info diff

       should give you access to the complete manual.

diffutils 2.8.1 						    April 2002								    CMP(1)
All times are GMT -4. The time now is 05:58 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy