gzcat (or gunzip -c)


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers gzcat (or gunzip -c)
# 1  
Old 06-23-2006
gzcat (or gunzip -c)

Does anyone know what kind of impact gunzip -c or gzcat has on a system? I am using gunzip -c on files that around 30 Mb compressed and 300Mb uncompressed. How much memory or disk space gets used? Also does anyone know how gunzip -c actually works? The system I am running on is AIX Version 5.

Here is the line that I am using:

gunzip -c <filename> | grep -ic <search_terms>

Thanks
# 2  
Old 06-26-2006
I highly doubt anyone knows this answer off the top of their head. Why don't you open top or topas in another window and monitor the gunzip command to see for yourself? The following is output from running topas. This isn't the best way to measure but since noone has replied I thought I would give you a place to start.

Topas Monitor for host: xsa00831
Mon Jun 26 10:31:16 2006 Interval: 2

Kernel 1.5 |# |
User 0.4 |# |
Wait 0.0 | |
Idle 98.1 |############################|

Network KBPS I-Pack O-Pack KB-In KB-Out
en0 0.7 3.5 2.0 0.2 0.5
en3 0.4 4.0 1.0 0.3 0.1
en2 0.1 3.0 0.0 0.1 0.0
lo0 0.1 1.0 1.0 0.0 0.0

Disk Busy% KBPS TPS KB-Read KB-Writ
hdisk2 0.0 0.0 0.0 0.0 0.0
hdisk0 0.0 0.0 0.0 0.0 0.0
hdisk1 0.0 0.0 0.0 0.0 0.0
hdisk98 0.0 0.0 0.0 0.0 0.0
hdisk106 0.0 0.0 0.0 0.0 0.0
hdisk113 0.0 0.0 0.0 0.0 0.0
hdisk37 0.0 0.0 0.0 0.0 0.0
hdisk102 0.0 0.0 0.0 0.0 0.0
hdisk103 0.0 0.0 0.0 0.0 0.0
hdisk120 0.0 0.0 0.0 0.0 0.0
hdisk122 0.0 0.0 0.0 0.0 0.0
hdisk104 0.0 0.0 0.0 0.0 0.0
hdisk119 0.0 0.0 0.0 0.0 0.0
hdisk108 0.0 0.0 0.0 0.0 0.0
hdisk101 0.0 0.0 0.0 0.0 0.0
hdisk99 0.0 0.0 0.0 0.0 0.0
hdisk110 0.0 0.0 0.0 0.0 0.0
hdisk111 0.0 0.0 0.0 0.0 0.0
hdisk114 0.0 0.0 0.0 0.0 0.0
hdisk109 0.0 0.0 0.0 0.0 0.0

Name PID CPU% PgSp Owner
batchman 43242 0.1 1.4 maestro
pdosaudi 39476 0.1 3.1 root
mstragen 49096 0.1 1.9 root
getty 24944 0.1 0.5 root
iravcol 21708 0.1 3.0 root
mstragen 36460 0.1 1.0 root
syncd 14110 0.0 0.6 root
irmultic 26840 0.0 5.4 root
tecad_lo 34066 0.0 1.4 root
IBM.Host 27870 0.0 1.5 root
dtgreet 19698 0.0 1.7 root
pdosd 38216 0.0 8.7 root
irmultic 23024 0.0 2.6 root
hatsd 26188 0.0 6.3 root
dsmc 27166 0.0 13.3 root
hats_rs2 35094 0.0 1.0 root
maragent 47302 0.0 9.0 root
gil 10320 0.0 0.1 root
hats_nim 35616 0.0 1.0 root
hats_nim 32552 0.0 1.0 root
IBM.CSMA 30724 0.0 1.7 root
clstrmgr 37686 0.0 2.4 root
PD2 16028 0.0 0.0 root
irnetrtr 25824 0.0 18.1 root
clcomd 34334 0.0 1.3 root

EVENTS/QUEUES FILE/TTY
Cswitch 510 Readch 1476.5K
Syscall 4393 Writech 280
Reads 394 Rawin 0
Writes 1 Ttyout 231
Forks 0 Igets 0
Execs 0 Namei 5
Runqueue 0.0 Dirblk 0
Waitqueue 0.0

PAGING MEMORY
Faults 0 Real,MB 8191
Steals 0 % Comp 8.2
PgspIn 0 % Noncomp 8.9
PgspOut 0 % Client 0.5
PageIn 0
PageOut 16 PAGING SPACE
Sios 16 Size,MB 9216
% Used 0.5
NFS (calls/sec) % Free 99.4
ServerV2 0
ClientV2 0 Press:
ServerV3 0 "h" for help
ClientV3 0 "q" to quit



-X
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

gzcat number of records

Hey guys, I want to do something quite simple but I just can't no matter what I try. I have a large file and i usually just: gzcat test.gz | nohup /test/this-script-does-things-to-the-records.pl -> /testdir/tmp_test.txt But now I need to do it only for the first 100k records. I sure... (7 Replies)
Discussion started by: sg3
7 Replies

2. UNIX for Dummies Questions & Answers

gzcat help

Hi, I am using under-noted script and getting the error as under. Please help. Executing each individual cat / gzcat gives correct answer. gzcat /logs/1205* gzcat /logs/12052* cat /logs/12052 | egrep -v "XYZ|PQR"|wc -l gzcat: gzcat.gz: No such file or directory gzcat: cat.gz: No such... (2 Replies)
Discussion started by: vanand420
2 Replies

3. Shell Programming and Scripting

[Solved] Read a .gz file line by line without using gzcat

Hi all Is there a way to read and process a gzip file line by line similar to a text file without using gzcat.. while processing a text file we will usually use the logic exec<sample.txt while read line do echo $line done Is there a similar way to process the gz file in the same... (4 Replies)
Discussion started by: aikhaman
4 Replies

4. Shell Programming and Scripting

Help with gunzip

Hi All, I have a file "HOTEL_INFO.zip" and getting the below errors: server1:/home/arun# gunzip -S .zip HOTEL_INFO.zip gunzip: HOTEL_INFO.zip: first entry not deflated or stored -- use unzip server1:/home/arun#unzip HOTEL_INFO.zip ksh: unzip: not found. ... (11 Replies)
Discussion started by: Arunprasad
11 Replies

5. UNIX for Dummies Questions & Answers

gunzip

I have a zip file as a.zip and it contains 1m xml files. like a1.xml, a2.xml.... The size is also very big nearly 1GB. I want to extract only a123.xml. Can any one help how can I do this? (1 Reply)
Discussion started by: siba.s.nayak
1 Replies

6. UNIX for Dummies Questions & Answers

How to list file names instead of lines when grep a gzcat command?

Hi, I want to list filenames instead of lines when i search in compresed files for a string. #gzcat *.gz | grep -l 12345 gives me: <stdin> Anyone got a solution on this problem? (2 Replies)
Discussion started by: HugoH
2 Replies

7. Shell Programming and Scripting

gzcat/grep

Hi!!! I am trying to grep a number in more then 1000 files which are .gz. Below is the code :- for i in `ls 20090618yz*_07.znf.gz` do a=`gzcat 20090618yz*_07.znf.gz | grep 9814843011` if then echo $i fi done My objective is to echo the file name also with the data. ... (3 Replies)
Discussion started by: tushar_tus
3 Replies

8. Shell Programming and Scripting

performance issue using gzcat, awk and sort

hi all, I was able to do a script to gather a few files and sort them. here it is: #!/usr/bin/ksh ls *mainFile* |cut -c20-21 | sort > temp set -A line_array i=0 file_name='temp' while read file_line do line_array=${file_line} let i=${i}+1 (5 Replies)
Discussion started by: naoseionome
5 Replies

9. Shell Programming and Scripting

gzcat into awk and then change FILENAME and process new FILENAME

I am trying to write a script that prompts users for date and time, then process the gzip file into awk. During the ksh part of the script another file is created and needs to be processed with a different set of pattern matches then I need to combine the two in the end. I'm stuck at the part... (6 Replies)
Discussion started by: timj123
6 Replies

10. UNIX for Dummies Questions & Answers

Gunzip

Hi can't unzip a gz file in TurboLinux 7.0 when i'm trying this gunzip filename.tar.gz it always says not in gzip format what should I do...please help me (4 Replies)
Discussion started by: CreamHarry
4 Replies
Login or Register to Ask a Question