05-30-2019
Grep -f for big files
ok guys.
this isnt homework or anything.
i have been using grep -f all my life but i am trying this for a huge file and it doesnt work.
can someone give me a replacement for grep -f pattern file for big files?
thanks
8 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hello All.
I have problem archiving files.
The problem is:)
I have about 10000 files in one directory, all this file aproximately the same size, i need to gzip them and write on DVD. But all this files take about 15 GB of space (already gzipped). So i need DVD Blue-Ray :p or i need to split... (3 Replies)
Discussion started by: Maxeg
3 Replies
2. Shell Programming and Scripting
Morning guys. Another day another question. :rolleyes:
I am knocking up a script to pull some data from a file. The problem is the file is very big (up to 1 gig in size), so this solution:
for results in `grep "^\
... works, but takes ages (we're talking minutes) to run. The data is held... (8 Replies)
Discussion started by: dlam
8 Replies
3. Shell Programming and Scripting
hi friends,
i have to cut a large html file between tag " <!-- DEFACEMENTS ROWS -->"
"<!-- DISCLAIMER FOOTER -->"
and store cut data in other file
please help me!!!! (2 Replies)
Discussion started by: praneshbmishra
2 Replies
4. Shell Programming and Scripting
Hi,
I have a text file that is around 7Gb which is basically a matrix of numbers (FS is a space and RS is \n). I need the most efficient way of plucking out a number from a specified row and column in the file.
For example, for the value at row 15983, col 26332, I'm currently I'm using:
... (1 Reply)
Discussion started by: Jonny2Vests
1 Replies
5. Linux
I was trying to calculate DBID of oracle database according to the topic Oracle in World: How to Discover find DBID and following number 2) mechanism specified there that is using of strings keyword.
My unfortunately my oracle database datafile is so big that I could not use strings keyword for... (1 Reply)
Discussion started by: synthea
1 Replies
6. UNIX for Advanced & Expert Users
Hello,
i have a very big file that has more then 80 MBytes (100MBytes). So with my CVS Application I cannot commit this file (too Big) because it must have < 80 MBytes.
How can I split this file into two others files, i think the AIX Unix command :
split -b can do that, buit how is the right... (2 Replies)
Discussion started by: steiner
2 Replies
7. UNIX for Dummies Questions & Answers
Requirement:
When I do ls -ltr /home/data/orders I get a huge list of files, I need to copy that last 50 to another directory say /home/work/ later, I will do my ETL process and then again I need to copy from 51 to 100 and so on.
What is the command to copy files specifying 1 to 50... (5 Replies)
Discussion started by: eskay
5 Replies
8. UNIX for Advanced & Expert Users
I have a very big input file <inputFile1.txt> which has list of mobile no
inputFile1.txt
3434343
3434323
0970978
85233
... around 1 million records
i have another file as inputFile2.txt which has some log detail big file
inputFile2.txt
afjhjdhfkjdhfkd df h8983 3434343 | 3483 | myout1 |... (3 Replies)
Discussion started by: reldb
3 Replies
ZGREP(1) General Commands Manual ZGREP(1)
NAME
zgrep - search possibly compressed files for a regular expression
SYNOPSIS
zgrep [ grep_options ] [ -e ] pattern filename...
DESCRIPTION
Zgrep invokes grep on compressed or gzipped files. These grep options will cause zgrep to terminate with an error code:
(-[drRzZ]|--di*|--exc*|--inc*|--rec*|--nu*). All other options specified are passed directly to grep. If no file is specified, then the
standard input is decompressed if necessary and fed to grep. Otherwise the given files are uncompressed if necessary and fed to grep.
If the GREP environment variable is set, zgrep uses it as the grep program to be invoked.
EXIT CODE
2 - An option that is not supported was specified.
AUTHOR
Charles Levert (charles@comm.polymtl.ca)
SEE ALSO
grep(1), gzexe(1), gzip(1), zdiff(1), zforce(1), zmore(1), znew(1)
ZGREP(1)