12-15-2005
Put all 1000 strings to find in a file called targets. Then do:
grep -Ff targets /big/data/file
That's about the best you can do quickly. It will be just one pass through the big file. I'm not sure if grep can handle 1000 strings, this could be the only problem. Use the -F as I show, it is faster since no regular expressions are involved. Do a practice run with small files to be sure you have the syntax right.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
When I type a command at the command line it supplies one result and the exact same command in a script
egrep '^01|^02|^03|^04' file > fileout
count = 29353
same count in the script yields a count of 23492
is there any reason this could be happening. (1 Reply)
Discussion started by: r1500
1 Replies
2. UNIX for Dummies Questions & Answers
Hi,
Can anyone translate in words what this line command does:
ls *.fits | grep -v "Zero\|zero" > objlist
Obviously ls *.fits means to list all the fits file, grep looks for a certain word, Zero is a certain fits file, and > objlist , created a list with certain items, but I am not sure what... (3 Replies)
Discussion started by: cosmologist
3 Replies
3. UNIX for Dummies Questions & Answers
Hi
Is there any way GREP command can return word and not complete line.
My file has following data:
Hello Everyone I am NitinrajSrivastava
Hi Friends Welcome VrajSrivastava
I am using grep 'raj' which is returning me complete line.However I want only the word having keyword 'raj'.
Required... (11 Replies)
Discussion started by: dashing201
11 Replies
4. Shell Programming and Scripting
Hi
i have a file which have a pattern like this
Nov 10 session closed
Nov 10 Nov 9 08:14:27 EST5EDT 2010 on tty .
Nov 10 Oct 19 02:14:21 EST5EDT 2010 on pts/tk .
Nov 10 afrtetryytr
Nov 10 session closed
Nov 10 Nov 10 03:21:04 EST5EDT 2010
Dec 8 Nov 10 05:03:02 EST5EDT 2010
... (13 Replies)
Discussion started by: Himanshu_soni
13 Replies
5. UNIX for Dummies Questions & Answers
Dear forum,
Please excuse my ignorance. I have looked through various forum posts and tried various solutions but have not been able to solve my problem.
File1.txt consist of a list of 100 names (one per line). File2.txt contains details for 1000 people (one per line), with the first field... (7 Replies)
Discussion started by: beginner0302
7 Replies
6. Shell Programming and Scripting
Hi,
I need to search a word in the java file.
Assume the line in the java file is, (the line was splitted into 3 lines)
1.operationContext.sendFeedback(2.FeedbackType.ERROR, null, "Input is empty.", "Input Details: pr
3.ovide Valid pair(s): "+pairType);
When i grep for the word... (6 Replies)
Discussion started by: tulasiram
6 Replies
7. Shell Programming and Scripting
Hello Dear Friends I have a question about grep command
when I type the command grep 'energy' mydata.txt it gives me
energy= 5001
energy= 8500
energy= 5505
energy= 5506
however I only want to see the last line. How can I use the grep command to pick the last line of grep output.
... (9 Replies)
Discussion started by: rpf
9 Replies
8. Shell Programming and Scripting
here is what i want to achieve.. i have a file with below contents
cat fileName
blah blah blah
.
.DROP this
REJECT that
.
--sport 7800 -j REJECT --reject-with icmp-port-unreachable
--dport 7800 -j REJECT --reject-with icmp-port-unreachable
.
.
.
more blah blah blah
--dport 3306... (14 Replies)
Discussion started by: vivek d r
14 Replies
9. Shell Programming and Scripting
Hi,
I want to read a file line by line and exclude the lines that are beginning with special characters. The below code is working fine except when the line starts with hyphen (-) in the file.
for TEST in `cat $FILE | grep -E -v '#|/+' | awk '{FS=":"}NF > 0{print $1}'`
do
.
.
done
How... (4 Replies)
Discussion started by: Srinraj Rao
4 Replies
10. UNIX for Beginners Questions & Answers
Hi All,
I have some xml files and I need to find out all xml where one specific type of pattern is available..
Pattern 1
==========
<MAP TIMEOUT="" MODE="STANDALONE">
<COMMENT>without Any Mapping</COMMENT>
</MAP>
Pattern 2
==========
<MAP TIMEOUT="" MODE="STANDALONE">
... (4 Replies)
Discussion started by: Baharul
4 Replies