Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Shell Programming and Scripting

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Shell Programming and Scripting
# 1  
Old 02-13-2008
Shell Programming and Scripting
Hi

Iam using grep command as follows in my script

read_file1()
{
cat file1.txt | while read line
do
grep $line file2.txt >> out.txt
done
}
read_file1

This way the performance is very slow. We are having lacks of records in file1 and file2

how can i improve the performance.
nivas
# 2  
Old 02-13-2008
You can use the '-f' feature of the grep command to do this. I don't know how much faster it will be.

For example, if you have files named file1.txt and file2.txt (as in your example), then

grep -f file1.txt file2.txt >> out.txt

should do the job. Note that each line is a pattern.
# 3  
Old 02-13-2008
No this command is not working.


what is pattern. hope my file is not a pattern
nivas
# 4  
Old 02-13-2008
Quote:
Originally Posted by nivas
Hi

Iam using grep command as follows in my script

read_file1()
{
cat file1.txt | while read line
do
grep $line file2.txt >> out.txt
done
}
read_file1

This way the performance is very slow. We are having lacks of records in file1 and file2

how can i improve the performance.
I'm not going to write the code for you, but what I think you want is to take advantage of "egrep" (or "grep -E" if gnu).

For example,

grep -E "one|two|three" yourfile

will find any of "one" "two" or "three" in "yourfile"

By the way, GNU grep has a lot of neat stuff: grep in depth
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Shell script to read lines in a text file and filter user data Shell Programming and Scripting

sxsaaas (3 Replies)
Discussion started by: VikrantD
3 Replies

2. Shell Programming and Scripting

shell programming and scripting

hi, i am trying this while loop and i only want that it should only read food as pizza....no other entry should be taken here. #!/usr/bin/perl -w $food = " "; while ( $food ne 'pizza' ) { print 'enter what you had last night: '; chomp ($food = <STDIN>); #print $food ; } ... (2 Replies)
Discussion started by: kullu
2 Replies

3. Shell Programming and Scripting

shell programming and scripting

I was trying out some new series to get it print 1 1 2 1 2 3 1 2 3 4 1 2 3 4 5 and the seond one is 1 2 2 3 3 3 4 4 4 4 5 5 5 5 5 but was unable to get the result. (5 Replies)
Discussion started by: harjinder
5 Replies

4. Shell Programming and Scripting

shell scripting and programming

RCS file: /home/rcap/.APCVS/regs/rc/power/analysis/pow_rtl/renes_setup.g,v Working file: ./power/analysis/pow_rtl/renes_setup.g head: 1.14 branch: locks: strict access list: symbolic names: br_2010_101_200: 1.13.0.12 br_2010_101_100: 1.13.0.10 br_2009_91_200:... (3 Replies)
Discussion started by: harjinder
3 Replies

5. Infrastructure Monitoring

Shell Programming and Scripting

# set date to your spec: this is month/day/yr/hr/min/sec: sysdate=`date '+%m/%d/%Y-%H:%M:%S'` # get the last line before the history file is modified tail -1 /tmp/hosthistory.txt |while read lastdate mydevices do echo $lastdate echo $mydevices done LIST = 'ypcat hosts|| sort... (11 Replies)
Discussion started by: lemseffert
11 Replies

6. Shell Programming and Scripting

Shell Programming and Scripting

Hi, Iam having the files as follows: file1 aa aa aa aa ab ac ad ae file2 aa aa ab Outputfile: (20 Replies)
Discussion started by: nivas
20 Replies

7. Shell Programming and Scripting

Shell Programming and Scripting

Hi, Iam having file1 as follows: ERTYUIOU|1234567689089767688 FDHJHKJH|6817738971783893499 JFKDKLLUI|9080986766433498444 FILE2 ERTYUIOU|1234567689089767688 resh@abc_com 767637218328322332 893589893499 asdsddssd ... (21 Replies)
Discussion started by: nivas
21 Replies

8. Shell Programming and Scripting

Shell Programming and Scripting

I want to compare some files. say iam having 2 sets of files ,each is having some 10 files. ie, file1 1a.txt 1b.txt 1c.txt ... file2 2a.txt 2b.txt 2c.txt ... i need to read line by line of this files parralley.. ie.. i want to read file1 first line that is 1a.txt and file2... (2 Replies)
Discussion started by: nivas
2 Replies

9. Shell Programming and Scripting

Shell Programming and Scripting

Hi, iam having the file as follows: ABCDEFGH|0987654321234567 ABCDEFGH|0987654321234523 ABCDEFGH|0987654321234556 ABCDEFGH|0987654321234545 POIUYTRE|1234567890890678 POIUYTRE|1209867757352567 POIUYTRE|5463879088797131 POIUYTRE|5468980091344456 pls provide me the split command ... (14 Replies)
Discussion started by: nivas
14 Replies
Login or Register to Ask a Question