07-09-2010
Reading compressed files during a grep search
All,
The bottom line is that im reading a file, storing it as variables, recursively grep searching it, and then piping it to allow word counts as well. I am unsure on how to open any .zip .tar and .gzip, search for keywords and return results.
Any help would be much appreciated!
Thanks
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
I want to read a directory full of compressed files and move the file to another directory if it meets certain criteria. I only want to look at the first line of the compressed file and if I find the string, do the move. I am currently using the following:
zgrep -R -L... (1 Reply)
Discussion started by: cbreiner
1 Replies
2. UNIX for Advanced & Expert Users
I was wondering if there's a way to search within a file that's been compressed. i.e. if file a is inside file a.zip or a.gz, is there a a command that will retrieve the string of data I'm looking for in file a, and list which compressed file it found it in?
Please help!
Thanks. (8 Replies)
Discussion started by: HLee1981
8 Replies
3. Shell Programming and Scripting
After pouring over my LTKS and Unix in a nutshell, I'm stuck!
I have a large (BMC Report File) that has breaks on DM (district managers).
After a report header, there is a DM header like:
DM: DBP AARON ROBERTS
At the end of each DM break, there is:
** END OF REPORT **
... (6 Replies)
Discussion started by: Jodyman
6 Replies
4. UNIX for Dummies Questions & Answers
Hi,
At my company, we have custom web sites that we create for different clients. The folder structure is something like:
<project name>/html/web/custom/
The custom folder contains a file called "category.html"
Every project has the same folder structure, and same file names but, the data... (2 Replies)
Discussion started by: miklo
2 Replies
5. UNIX for Advanced & Expert Users
Hi all,
I would like to ask whether in Unix shell/perl have any functions or command to allow grep/cat/read a file inside compressed .tgz without extract it?
I know we can tar tvf a compressed tgz but this only allow we read the path/filename contained inside the tarball. If we want to read... (3 Replies)
Discussion started by: mayshy
3 Replies
6. Shell Programming and Scripting
Hi,
I have a folder which contains multiple config.xml files and one input file, Please see the below format.
Config Files format looks like :-
Code:
<application name="SAMPLE-ARCHIVE">
<NVPairs name="Global Variables">
<NameValuePair>
... (0 Replies)
Discussion started by: haiksuresh
0 Replies
7. Red Hat
I was following this tutorial on How install the rpmfusion nvidia drivers in Fedora 13:
F13, F12 & F11 Nvidia driver guides - FedoraForum.org
Here's the tutorial:
And this is what I did:
First I executed the following commands:
su
rpm -Uvh ... (0 Replies)
Discussion started by: skyxn3t
0 Replies
8. Shell Programming and Scripting
I am trying to read a file line by line and then search that line in another file and get a particular column from the second file.
I have written this code.but its not working properly
#!/bin/sh
while read keyword in duplicate.txt
do
echo $keyword
while read line
do
... (7 Replies)
Discussion started by: Prachi Gupta
7 Replies
9. Shell Programming and Scripting
I have many compressed files I want to search using awk and want to print some file contents along with the filename it came from on each output record (I simplified awk command).
Here are the results with the files uncompressed:
awk '{print FILENAME, $0}' test*.txt
test1.txt from test1... (3 Replies)
Discussion started by: mjf
3 Replies
10. Shell Programming and Scripting
I have a environment property file which contains:
Input file:
value1 = url1
value2 = url2
value3 = url3 and so on.
I need to search all *.xml files under directory for value1 and replace it with url1.
Same thing I have to do for all values mentioned in input file. I need script in unix bash... (7 Replies)
Discussion started by: Shamkamde
7 Replies
FUNZIP(1L) FUNZIP(1L)
NAME
funzip - filter for extracting from a ZIP archive in a pipe
SYNOPSIS
funzip [-password] [input[.zip|.gz]]
ARGUMENTS
[-password]
Optional password to be used if ZIP archive is encrypted. Decryption may not be supported at some sites. See DESCRIPTION for more
details.
[input[.zip|.gz]]
Optional input archive file specification. See DESCRIPTION for details.
DESCRIPTION
funzip without a file argument acts as a filter; that is, it assumes that a ZIP archive (or a gzip'd(1) file) is being piped into standard
input, and it extracts the first member from the archive to stdout. When stdin comes from a tty device, funzip assumes that this cannot be
a stream of (binary) compressed data and shows a short help text, instead. If there is a file argument, then input is read from the speci-
fied file instead of from stdin.
A password for encrypted zip files can be specified on the command line (preceding the file name, if any) by prefixing the password with a
dash. Note that this constitutes a security risk on many systems; currently running processes are often visible via simple commands (e.g.,
ps(1) under Unix), and command-line histories can be read. If the first entry of the zip file is encrypted and no password is specified on
the command line, then the user is prompted for a password and the password is not echoed on the console.
Given the limitation on single-member extraction, funzip is most useful in conjunction with a secondary archiver program such as tar(1).
The following section includes an example illustrating this usage in the case of disk backups to tape.
EXAMPLES
To use funzip to extract the first member file of the archive test.zip and to pipe it into more(1):
funzip test.zip | more
To use funzip to test the first member file of test.zip (any errors will be reported on standard error):
funzip test.zip > /dev/null
To use zip and funzip in place of compress(1) and zcat(1) (or gzip(1L) and gzcat(1L)) for tape backups:
tar cf - . | zip -7 | dd of=/dev/nrst0 obs=8k
dd if=/dev/nrst0 ibs=8k | funzip | tar xf -
(where, for example, nrst0 is a SCSI tape drive).
BUGS
When piping an encrypted file into more and allowing funzip to prompt for password, the terminal may sometimes be reset to a non-echo mode.
This is apparently due to a race condition between the two programs; funzip changes the terminal mode to non-echo before more reads its
state, and more then ``restores'' the terminal to this mode before exiting. To recover, run funzip on the same file but redirect to
/dev/null rather than piping into more; after prompting again for the password, funzip will reset the terminal properly.
There is presently no way to extract any member but the first from a ZIP archive. This would be useful in the case where a ZIP archive is
included within another archive. In the case where the first member is a directory, funzip simply creates the directory and exits.
The functionality of funzip should be incorporated into unzip itself (future release).
SEE ALSO
gzip(1L), unzip(1L), unzipsfx(1L), zip(1L), zipcloak(1L), zipinfo(1L), zipnote(1L), zipsplit(1L)
URL
The Info-ZIP home page is currently at
http://www.info-zip.org/pub/infozip/
or
ftp://ftp.info-zip.org/pub/infozip/ .
AUTHOR
Mark Adler (Info-ZIP)
Info-ZIP 28 February 2005 (v3.94) FUNZIP(1L)