awk & zcat not working together Post: 302793667

Sponsored Content

Top Forums Shell Programming and Scripting awk & zcat not working together Post 302793667 by siramitsharma on Saturday 13th of April 2013 03:07:40 AM

04-13-2013

Registered User

awk & zcat not working together

I have a tar file which i want to read and check some specific fields basis on which i want to get output.
Code

Code:

 
zcat samplefile.tar.gz | awk 'FNR==1 {++counter}
counter ==2 {BB[$1]=1;next}
substr($0,26,2) =="01") {next}
(substr($0,28,12) ~ "^[A-Z,a-z]") {next}
(substr($0,184,3) in BB) {next}
1
' bb.txt

bb.txt

Code:

1234
5678

samplefile.tar.gz:

Code:

000000000000003255816850602YD-MTSBAL 519131689141165735 1120120901213655201209032136550000000001132005060000000001 405891364839056 2377 00000000000004294967040405899136999995
 
000000000000005255817273002919875129904 119132018104840216 1120120901213658201209032136580000000000033000160000000000405891742168097 161A 12283000032014294967040405899136999995

Need output as

Code:

000000000000005255817273002919875129904 119132018104840216 1120120901213658201209032136580000000000033000160000000000405891742168097 161A 12283000032014294967040405899136999995

Last edited by Scrutinizer; 04-13-2013 at 05:18 AM.. Reason: Additional code tags for data files

siramitsharma

View Public Profile for siramitsharma

Find all posts by siramitsharma

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Awk: Version && nextfile

How can I find which version of Awk is installed? OpSystem is HPUX 11.x I am getting an error when trying to use the keyword nextfile and I dont know why! (Well, I can only assume that I have am using a version of Awk that does not support nextfile. However, according to O'Reilly, nextfile is...

2. UNIX for Dummies Questions & Answers

zcat --> Arg list too long

Hi all I have more than 1000 files in a folder and when ever i use a "compress" or "zcat" command it give error /bin/zcat: Arg list too long. . any solution for this :o

3. Linux

zcat on Linux

Hi I am trying to extract a <filename>.tar.Z on a SLES machine using zcat. The command I am using is zcat <filename>.tar.Z | tar xf - When I use the above I get the following message tar: Read 7168 bytes from - I think the message is benign because I see that my files where...

4. UNIX for Advanced & Expert Users

Awk expressions working & not working

Hi, Putting across a few awk expressions. Apart from the last, all of them are working. echo a/b/c | awk -F'/b/c$' '{print $1}' a echo a/b/c++ | awk -F'/b/c++' '{print $1}' a echo a/b/c++ | awk -F'/b/c++$' '{print $1}' a/b/c++ Request thoughts on why putting a '$' post double ++...

5. Shell Programming and Scripting

zcat two files

Hi, Like cat file1 file2 > file Can I do zcat file1.gz file2.gz > file.gz

6. Shell Programming and Scripting

BASH ZCAT EGREP Shell Script

I created a backup script that emails all the admins when the backup is complete and attaches a log file of what what backed up. On occasion, something happens in which the backups stop working, I started "grep"ing around /var/log/syslog and I usually find the smoking gun. My goal is to zcat...

7. UNIX for Dummies Questions & Answers

How zcat works?

Hi, just i would like to know, how will be the response if you try to read a 40GB compressed file using zcat. a)Uncompress the 40GB file and have it in the disk. use cat to view the steps. b)Use zcat directly to view the compressed file? What are the steps being occurred in step (b)? Where...

8. Shell Programming and Scripting

awk Help: quick and easy question may be: How to use &&

Hi Guru's. I am trying to use to check if $5 is greater than 80 & if not 100, then to print $0 : awk '{ if ($5>80) && if ($5 != 100) print $0} But getting error: >bdf1|sed 's/%//g'|awk '{ if ($5>80) && if ($5 != 100) print $0}' syntax error The source line is 1. The error...

9. Shell Programming and Scripting

[zcat] [gunzip -c] header

Hello, When i lauches this command ssh -n server_name gunzip -c "/REP/xxxx.gz" > server.logThere are a few stray characters like NULNULNULNUL100644 NUL000000NUL000000NUL00024002704 12135060747 012607NUL at the beginning of server.log. In the xxxx.gz there is a tar file I'm not sure but it...

10. Solaris

ZCAT xxx.Z|tar -xvf - decompression slow ?

I have recently built a new server and patched Soalris 10 up tp latest bundle etc... When I run a decompress using the format zcat fred.Z |tar -xvf - it runs at a very slow rate. A similiar server which is less powerful runs over twice as quick. Is there any work arounds to configure decompress...

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Awk: Version && nextfile

Discussion started by: google

2. UNIX for Dummies Questions & Answers

zcat --> Arg list too long

Discussion started by: muneebr

3. Linux

zcat on Linux

Discussion started by: felixmat1

4. UNIX for Advanced & Expert Users

Awk expressions working & not working

Discussion started by: vibhor_agarwali

5. Shell Programming and Scripting

zcat two files

Discussion started by: jacobs.smith

6. Shell Programming and Scripting

BASH ZCAT EGREP Shell Script

Discussion started by: metallica1973

7. UNIX for Dummies Questions & Answers

How zcat works?

Discussion started by: pandeesh

8. Shell Programming and Scripting

awk Help: quick and easy question may be: How to use &&

Discussion started by: rveri

9. Shell Programming and Scripting

[zcat] [gunzip -c] header

Discussion started by: amazigh42

10. Solaris

ZCAT xxx.Z|tar -xvf - decompression slow ?

Discussion started by: smcart