05-24-2004
One performance refinement to google's method when the number of files is large is to do something like this:
find . -type f | xargs egrep '1234567|1223574|5243673|2356464'
There are three features to this:[list=1][*]Use "-type f" to not grep directories as files, etc.[*]Pipe the result through xargs to get as many files per grep as your OS/shell allows[*]Use egrep to search multiple patterns[/list=1]
ISTR there are versions of grep that will read a pattern list from a file --- consult your man pages.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have a list of urls for example:
Google
Google Base
Yahoo!
Yahoo!
Yahoo! Video - It's On
Google
The problem is that Google and Google are duplicates as are Yahoo! and Yahoo!.
I'm needing to find these conical www duplicates and append the text "DUP#" in from of both Google and... (3 Replies)
Discussion started by: totus
3 Replies
2. Shell Programming and Scripting
This is regarding using awk tool to find lines matching between 2 patterns.
cat file | awk '/pat1/,/pat2/'
But it's not working as expected in the following case.
If pat1 also comes after pat2 then it's matching whole file after pat1.
e.g.
# > cat -n file
1 First line... (3 Replies)
Discussion started by: anand_bh
3 Replies
3. Shell Programming and Scripting
Hi,
I have a file with 3 columns and I want to find when the average number of rows on column 3 is a certain value. The output will be put into another file indicating the range.
Here is what I mean (file is tab separated):
hhm1 2 0
hhm1 4 0.5
hhm1 6 0.3
hhm1 8 -1.4... (2 Replies)
Discussion started by: kylle345
2 Replies
4. Shell Programming and Scripting
I an trying to parse a file looking for pattern1, or pattern2, or pattern3 and when found print that line and the next 4 lines after it. I am using korn shell script on AIX and grep -A isn't available. (1 Reply)
Discussion started by: daveisme
1 Replies
5. Shell Programming and Scripting
Hey,
How can I copy files from subdirectories without copy the subdir
and copy it to a higher dir
For example:
/home/test/subdir/file1
copy file1 to /home or another dir
thanx (11 Replies)
Discussion started by: Eclecticaa
11 Replies
6. Shell Programming and Scripting
Hi All,
I need help as i am not able to create shell script for a scenario.
i have 3000 numbers and want to search all the files which contain anyone of the above pattern.
the files are in folder structure.
Thanks and Regards
Rishi Dhawan (14 Replies)
Discussion started by: Rishi26
14 Replies
7. Shell Programming and Scripting
I have a script that runs from this:
for i in * ; do (cd $i && echo $i && /test1/execute/testb);done
this is testb:
for file in `ls *.txt`
do
if && && && &&
&& ; then echo "NO"; break 1;
else
echo "it is there"
fi
done
What is happening is that I can get it to run a... (19 Replies)
Discussion started by: newbie2010
19 Replies
8. Shell Programming and Scripting
Hi,
I am trying to extract some patterns from a line. The input file is space delimited and i could not use column to get value after "IN" or "OUT" patterns as there could be multiple white spaces before the next digits that i need to print in the output file . I need to print 3 patterns in a... (3 Replies)
Discussion started by: redse171
3 Replies
9. Shell Programming and Scripting
Hi,
I have requirement to find the matching patterns of two files in Unix. One file is the log file and the other is the error list file. If any pattern in the log file matches the list of errors in the error list file, then I would need to find the counts of the match.
For example,
... (5 Replies)
Discussion started by: Bobby_2000
5 Replies
10. Shell Programming and Scripting
Hello.
For a given folder, I want to select any files find $PATH1 -f \( -name "*" but omit any files like pattern name ! -iname "*.jpg" ! -iname "*.xsession*" ..... \) and also omit any subfolder like pattern name -type d \( -name "/etc/gconf/gconf.*" -o -name "*cache*" -o -name "*Cache*" -o... (2 Replies)
Discussion started by: jcdole
2 Replies
LEARN ABOUT DEBIAN
bzegrep
BZGREP(1) General Commands Manual BZGREP(1)
NAME
bzgrep, bzfgrep, bzegrep - search possibly bzip2 compressed files for a regular expression
SYNOPSIS
bzgrep [ grep_options ] [ -e ] pattern filename...
bzegrep [ egrep_options ] [ -e ] pattern filename...
bzfgrep [ fgrep_options ] [ -e ] pattern filename...
DESCRIPTION
Bzgrep is used to invoke the grep on bzip2-compressed files. All options specified are passed directly to grep. If no file is specified,
then the standard input is decompressed if necessary and fed to grep. Otherwise the given files are uncompressed if necessary and fed to
grep.
If bzgrep is invoked as bzegrep or bzfgrep then egrep or fgrep is used instead of grep. If the GREP environment variable is set, bzgrep
uses it as the grep program to be invoked. For example:
for sh: GREP=fgrep bzgrep string files
for csh: (setenv GREP fgrep; bzgrep string files)
AUTHOR
Charles Levert (charles@comm.polymtl.ca). Adapted to bzip2 by Philippe Troin <phil@fifi.org> for Debian GNU/Linux.
SEE ALSO
grep(1), egrep(1), fgrep(1), bzdiff(1), bzmore(1), bzless(1), bzip2(1)
BZGREP(1)