Shell Programming and Scripting


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Shell Programming and Scripting
# 1  
Old 02-13-2008
Shell Programming and Scripting

Hi

Iam using grep command as follows in my script

read_file1()
{
cat file1.txt | while read line
do
grep $line file2.txt >> out.txt
done
}
read_file1

This way the performance is very slow. We are having lacks of records in file1 and file2

how can i improve the performance.
nivas
# 2  
Old 02-13-2008
You can use the '-f' feature of the grep command to do this. I don't know how much faster it will be.

For example, if you have files named file1.txt and file2.txt (as in your example), then

grep -f file1.txt file2.txt >> out.txt

should do the job. Note that each line is a pattern.
# 3  
Old 02-13-2008
No this command is not working.


what is pattern. hope my file is not a pattern
nivas
# 4  
Old 02-13-2008
Quote:
Originally Posted by nivas
Hi

Iam using grep command as follows in my script

read_file1()
{
cat file1.txt | while read line
do
grep $line file2.txt >> out.txt
done
}
read_file1

This way the performance is very slow. We are having lacks of records in file1 and file2

how can i improve the performance.
I'm not going to write the code for you, but what I think you want is to take advantage of "egrep" (or "grep -E" if gnu).

For example,

grep -E "one|two|three" yourfile

will find any of "one" "two" or "three" in "yourfile"

By the way, GNU grep has a lot of neat stuff: grep in depth
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Shell script to read lines in a text file and filter user data Shell Programming and Scripting

sxsaaas (3 Replies)
Discussion started by: VikrantD
3 Replies

2. Shell Programming and Scripting

shell programming and scripting

hi, i am trying this while loop and i only want that it should only read food as pizza....no other entry should be taken here. #!/usr/bin/perl -w $food = " "; while ( $food ne 'pizza' ) { print 'enter what you had last night: '; chomp ($food = <STDIN>); #print $food ; } ... (2 Replies)
Discussion started by: kullu
2 Replies

3. Shell Programming and Scripting

shell programming and scripting

I was trying out some new series to get it print 1 1 2 1 2 3 1 2 3 4 1 2 3 4 5 and the seond one is 1 2 2 3 3 3 4 4 4 4 5 5 5 5 5 but was unable to get the result. (5 Replies)
Discussion started by: harjinder
5 Replies

4. Shell Programming and Scripting

shell scripting and programming

RCS file: /home/rcap/.APCVS/regs/rc/power/analysis/pow_rtl/renes_setup.g,v Working file: ./power/analysis/pow_rtl/renes_setup.g head: 1.14 branch: locks: strict access list: symbolic names: br_2010_101_200: 1.13.0.12 br_2010_101_100: 1.13.0.10 br_2009_91_200:... (3 Replies)
Discussion started by: harjinder
3 Replies

5. Infrastructure Monitoring

Shell Programming and Scripting

# set date to your spec: this is month/day/yr/hr/min/sec: sysdate=`date '+%m/%d/%Y-%H:%M:%S'` # get the last line before the history file is modified tail -1 /tmp/hosthistory.txt |while read lastdate mydevices do echo $lastdate echo $mydevices done LIST = 'ypcat hosts|| sort... (11 Replies)
Discussion started by: lemseffert
11 Replies

6. Shell Programming and Scripting

Shell Programming and Scripting

Hi, Iam having the files as follows: file1 aa aa aa aa ab ac ad ae file2 aa aa ab Outputfile: (20 Replies)
Discussion started by: nivas
20 Replies

7. Shell Programming and Scripting

Shell Programming and Scripting

Hi, Iam having file1 as follows: ERTYUIOU|1234567689089767688 FDHJHKJH|6817738971783893499 JFKDKLLUI|9080986766433498444 FILE2 ERTYUIOU|1234567689089767688 resh@abc_com 767637218328322332 893589893499 asdsddssd ... (21 Replies)
Discussion started by: nivas
21 Replies

8. Shell Programming and Scripting

Shell Programming and Scripting

I want to compare some files. say iam having 2 sets of files ,each is having some 10 files. ie, file1 1a.txt 1b.txt 1c.txt ... file2 2a.txt 2b.txt 2c.txt ... i need to read line by line of this files parralley.. ie.. i want to read file1 first line that is 1a.txt and file2... (2 Replies)
Discussion started by: nivas
2 Replies

9. Shell Programming and Scripting

Shell Programming and Scripting

Hi, iam having the file as follows: ABCDEFGH|0987654321234567 ABCDEFGH|0987654321234523 ABCDEFGH|0987654321234556 ABCDEFGH|0987654321234545 POIUYTRE|1234567890890678 POIUYTRE|1209867757352567 POIUYTRE|5463879088797131 POIUYTRE|5468980091344456 pls provide me the split command ... (14 Replies)
Discussion started by: nivas
14 Replies
Login or Register to Ask a Question