What is the faster way to grep from huge file? Post: 302960828

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Which is faster? Reading from file or 'ps'

Hi There... I have an application which starts up many different processes under different names and I'm creating a script to tell me which processes are running (approx 30 different processes). To do this, I parse the results of a ps -u $USER. My question is, will my script be faster if I run...

2. UNIX for Dummies Questions & Answers

How to grep faster ?

Hi I have to grep for 2000 strings in a file one after the other.Say the file name is Snxx.out which has these strings. I have to search for all the strings in the file Snxx.out one after the other. What is the fastest way to do it ?? Note:The current grep process is taking lot of time per...

3. Shell Programming and Scripting

Grep matched records from huge file

111111111100000000001111111111 123232323200000010001114545454 232435424200000000001232131212 342354234301000000002323423443 232435424200000000001232131212 2390898994200000000001238908092 This is the record format. From 11th position to 20th position in a record there are 0's occuring,and...

4. UNIX for Dummies Questions & Answers

Faster way to multiply a file Nth times?

Basically, my problem is to multiply my file to $c times. Is there a faster way to do this? c=100 while ]; do cat file1.txt ((c=$c-1)) done > file2.txt I appreciate your help!

5. Shell Programming and Scripting

Script to parse a file faster

My example file is as given below: conn=1 uid=oracle conn=2 uid=db2 conn=3 uid=oracle conn=4 uid=hash conn=5 uid=skher conn=6 uid=oracle conn=7 uid=mpalkar conn=8 uid=anarke conn=1 op=-1 msgId=-1 - fd=104 slot=104 LDAPS connection from 10.10.5.6 to 10.18.6.5 conn=2 op=-1 msgId=-1 -...

6. Shell Programming and Scripting

Optimised way for search & replace a value on one line in a very huge file (File Size is 24 GB).

Hi Experts, I had to edit (a particular value) in header line of a very huge file so for that i wanted to search & replace a particular value on a file which was of 24 GB in Size. I managed to do it but it took long time to complete. Can anyone please tell me how can we do it in a optimised...

7. HP-UX

Performance issue with 'grep' command for huge file size

I have 2 files; one file (say, details.txt) contains the details of employees and another file (say, emp.txt) has some selected employee names. I am extracting employee details from details.txt by using emp.txt and the corresponding code is: while read line do emp_name=`echo $line` grep -e...

8. HP-UX

Faster command for file copy than cp ?

we have 30 GB files on our filesystem which we need to copy daily to 25 location on the same machine (but different filesystem). cp is taking 20 min to do the copy and we have 5 different thread doing the copy. so in all its taking around 2 hr and we need to reduce it. Is there any...

9. Shell Programming and Scripting

Grep -v -f and sort|diff which way is faster

Hi Gurus, I have two big files. I need to compare the different. currently, I am using sort file1 > file1_temp; sort file2 > file2_tmp diff file1_tmp file2_tmp I can use command grep -v -f file1 file2 just wondering which way is fast to compare two big files. Thanks...

10. UNIX for Advanced & Expert Users

Need help for faster file read and grep in big files

I have a very big input file <inputFile1.txt> which has list of mobile no inputFile1.txt 3434343 3434323 0970978 85233 ... around 1 million records i have another file as inputFile2.txt which has some log detail big file inputFile2.txt afjhjdhfkjdhfkd df h8983 3434343 | 3483 | myout1 |...

LEARN ABOUT NETBSD

zfgrep

ZGREP(1)						    BSD General Commands Manual 						  ZGREP(1)

NAME

     zgrep, zegrep, zfgrep -- print lines matching a pattern in gzip-compressed files

SYNOPSIS

     zgrep [grep-flags] [--] pattern [files ...]

     zegrep [grep-flags] [--] pattern [file ...]

     zfgrep [grep-flags] [--] pattern [file ...]

DESCRIPTION

     zgrep runs grep(1) on files or stdin, if no files argument is given, after decompressing them with zcat(1).

     The grep-flags and pattern arguments are passed on to grep(1).  If an -e flag is found in the grep-flags, zgrep will not look for a pattern
     argument.

     zegrep calls egrep(1), while zfgrep calls fgrep(1).

EXIT STATUS

     In case of missing arguments or missing pattern, 1 will be returned, otherwise 0.

SEE ALSO

     egrep(1), fgrep(1), grep(1), gzip(1), zcat(1)

AUTHORS

     Thomas Klausner <wiz@NetBSD.org>

BSD
								 December 28, 2003							       BSD

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Which is faster? Reading from file or 'ps'

Discussion started by: orno

2. UNIX for Dummies Questions & Answers

How to grep faster ?

Discussion started by: preethgideon

3. Shell Programming and Scripting

Grep matched records from huge file

Discussion started by: mjkreddy

4. UNIX for Dummies Questions & Answers

Faster way to multiply a file Nth times?

Discussion started by: chstr_14