06-20-2007
Quote:
Originally Posted by
preethgideon
I have a new file which has 30k lines.
And when I used the above command it gives the error as
grep -f 30k_strings_file Sndxx.out
grep : regular expression too big
I suspect this becuase of the file size. What is the max number of lines grep can take at once ??
Also when I try egrep it works.What is the diff b/w grep and egrep ?
Thanks and Regards,
Gideon.
I'm guessing when you grep using the 30k_strings_file, the grep is taking all strings as one search term. grep finds only what you specify, or in the case of "grep something file | grep somethingelse" it acts as an AND (find this and that..) egrep is an OR.. egrep "something|somethingelse" file (find this OR that..)
9 More Discussions You Might Find Interesting
1. IP Networking
For some reason 8.1 Mandrake Linux seems much slower than Windows 2000 with my cable modem. DSL reports test says they conferable speed with Windows2 though.
This is consistant slow with both of my boxes, at the same time. Linux used to be faster, but not with Mandrake. Any way to fix this? (17 Replies)
Discussion started by: lancest
17 Replies
2. UNIX for Advanced & Expert Users
Sample Log file
IP.address Date&TimeStamp GET/POST URL ETC
123.45.67.89 MMDDYYYYHHMM GET myURL http://ABC.com
123.45.67.90 MMDDYYYYHHMM GET myURL http://XYZ.com
I have a very huge web server log file (about 1.3GB) that contains entries like the one above. I need to get the last entries of... (9 Replies)
Discussion started by: tads98
9 Replies
3. Shell Programming and Scripting
Hi ,
I need to copy every day about 35GB of files from one file system to another.
Im using the cp command and its toke me about 25 min.
I also tried to use dd command but its toke much more.
Is there better option ?
Regards. (6 Replies)
Discussion started by: yoavbe
6 Replies
4. UNIX for Dummies Questions & Answers
i)wc -c/etc/passwd|awk'{print $1}'
ii)ls -al/etc/passwd|awk'{print $5}' (4 Replies)
Discussion started by: karthi_g
4 Replies
5. UNIX for Dummies Questions & Answers
I have read anecdotes about people installing RAID0 (RAID - Wikipedia, the free encyclopedia) on some of their machines because it gives a performance boost. Because bandwidth on the motherboard is limited, can someone explain exactly why it should be faster? (7 Replies)
Discussion started by: figaro
7 Replies
6. UNIX for Dummies Questions & Answers
i'm trying to decide if to move operations from one of these hosts to the other. but i cant decide which one of them is the most powerful.
each host has 8 cpus.
HOSTA
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 44
model name : Intel(R) Xeon(R) CPU ... (6 Replies)
Discussion started by: SkySmart
6 Replies
7. Shell Programming and Scripting
Hi Gurus,
I have two big files. I need to compare the different. currently, I am using
sort file1 > file1_temp;
sort file2 > file2_tmp
diff file1_tmp file2_tmp
I can use command
grep -v -f file1 file2
just wondering which way is fast to compare two big files.
Thanks... (4 Replies)
Discussion started by: ken6503
4 Replies
8. UNIX for Dummies Questions & Answers
Hi All,
I am new to this forum and this is my first post.
My requirement is like to optimize the time taken to grep the file with 40000 lines.
There are two files FILEA(40000 lines) FILEB(40000 lines).
The requirement is like this, both the file will be in the format below... (11 Replies)
Discussion started by: mad man
11 Replies
9. UNIX for Advanced & Expert Users
I have a very big input file <inputFile1.txt> which has list of mobile no
inputFile1.txt
3434343
3434323
0970978
85233
... around 1 million records
i have another file as inputFile2.txt which has some log detail big file
inputFile2.txt
afjhjdhfkjdhfkd df h8983 3434343 | 3483 | myout1 |... (3 Replies)
Discussion started by: reldb
3 Replies
XZGREP(1) XZ Utils XZGREP(1)
NAME
xzgrep - search compressed files for a regular expression
SYNOPSIS
xzgrep [grep_options] [-e] pattern file...
xzegrep ...
xzfgrep ...
lzgrep ...
lzegrep ...
lzfgrep ...
DESCRIPTION
xzgrep invokes grep(1) on files which may be either uncompressed or compressed with xz(1), lzma(1), gzip(1), or bzip2(1). All options
specified are passed directly to grep(1).
If no file is specified, then standard input is decompressed if necessary and fed to grep(1). When reading from standard input, gzip(1)
and bzip2(1) compressed files are not supported.
If xzgrep is invoked as xzegrep or xzfgrep then egrep(1) or fgrep(1) is used instead of grep(1). The same applies to names lzgrep, lze-
grep, and lzfgrep, which are provided for backward compatibility with LZMA Utils.
ENVIRONMENT
GREP If the GREP environment variable is set, xzgrep uses it instead of grep(1), egrep(1), or fgrep(1).
SEE ALSO
grep(1), xz(1), gzip(1), bzip2(1), zgrep(1)
Tukaani 2010-09-27 XZGREP(1)