Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: AWK - Parse a big file
Top Forums Shell Programming and Scripting AWK - Parse a big file Post 302508818 by greycells on Tuesday 29th of March 2011 06:59:30 AM
Old 03-29-2011
Thanks pravin ,the second case i mentioned is an example , there are more records like that ..with diff fields , so can't hardcode the port field .There is only one Symmetrix Id field ...the very first one
thx
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to view a big file(143M big)

1 . Thanks everyone who read the post first. 2 . I have a log file which size is 143M , I can not use vi open it .I can not use xedit open it too. How to view it ? If I want to view 200-300 ,how can I implement it 3 . Thanks (3 Replies)
Discussion started by: chenhao_no1
3 Replies

2. Shell Programming and Scripting

filter parts of a big file using awk or sed script

I need an assistance in file generation using awk, sed or anything... I have a big file that i need to filter desired parts only. The objective is to select (and print) the report # having the string "apple" on 2 consecutive lines in every report. Please note that the "apple" line has a HEX... (1 Reply)
Discussion started by: apalex
1 Replies

3. Shell Programming and Scripting

Big data file - sed/grep/awk?

Morning guys. Another day another question. :rolleyes: I am knocking up a script to pull some data from a file. The problem is the file is very big (up to 1 gig in size), so this solution: for results in `grep "^\ ... works, but takes ages (we're talking minutes) to run. The data is held... (8 Replies)
Discussion started by: dlam
8 Replies

4. Shell Programming and Scripting

Parse file using awk and work in awk output

hi guys, i want to parse a file using public function, the file contain raw data in the below format i want to get the output like this to load it to Oracle DB MARWA1,BSS:26,1,3,0,0,0,0,0.00,22,22,22.00 MARWA2,BSS:26,1,3,0,0,0,0,0.00,22,22,22.00 this the file raw format: Number of... (6 Replies)
Discussion started by: dagigg
6 Replies

5. Shell Programming and Scripting

big xml file with nested loop parse

I have an xml file with the structure: <tag1> <value1>xyx</value1> <value2>123</value2> </tag1> <tag1> <value1>568</value1> <value2>zzzzz</value2> </tag1> where I want to parse each data pair in the this single file, so something like: find first tag1 data pair... (1 Reply)
Discussion started by: unclecameron
1 Replies

6. Shell Programming and Scripting

awk column comparison big file

Hi all, I would like to compare a column in one file to a column in another file and when there is a match it prints the first column and the corresponding second column. Example File1 ABA ABC ABE ABF File 2 ABA 123 ABB 124 ABD 125 ABC 126 So what I would like printed to a... (6 Replies)
Discussion started by: pcg
6 Replies

7. Shell Programming and Scripting

Parse a file with awk?

Hi guys (and gals). I need some help. I'm running an IVR purely on Asterisk where I capture the DTMFs. After pulsing each DTMF I have Asterisk write to a file with whatever was dialed (mostly used for record-keeping) and at the end of the survey I write all variables in a single line to a... (2 Replies)
Discussion started by: tulf210
2 Replies

8. Shell Programming and Scripting

Parse a file using awk

Hi Experts, I am trying to parse the following file; FILEA a|b|c|c|c|c a|b|d|d|d|d e|f|a|a|a|a e|f|b|b|b|boutput expected: a<TAB>b <TAB><TAB>c<TAB>c<TAB>c<TAB>c<TAB> <TAB><TAB>d<TAB>d<TAB>d<TAB>d<TAB> e<TAB>f <TAB><TAB>a<TAB>a<TAB>a<TAB>a<TAB> <TAB><TAB>b<TAB>b<TAB>b<TAB>b<TAB>*... (7 Replies)
Discussion started by: rajangupta2387
7 Replies

9. Shell Programming and Scripting

Using awk to Parse File

Hi all, I have a file that contains a good hundred of these job definitions below: Job Name Last Start Last End ST Run Pri/Xit ________________________________________________________________ ____________________... (7 Replies)
Discussion started by: atticuss
7 Replies

10. Shell Programming and Scripting

Split a big file into multiple files using awk

this thread is a continuation from previous thread https://www.unix.com/shell-programming-and-scripting/223901-split-big-file-into-multiple-files-based-first-four-characters.html ..I am using awk to split file and I have a syntax error while executing the below code I am using AIX 7.2... (4 Replies)
Discussion started by: etldev
4 Replies

LEARN ABOUT DEBIAN

oggz-diff

oggz-diff(1)						      General Commands Manual						      oggz-diff(1)

NAME

       oggz-diff -- Hexdump the packets of two Ogg files and output differences

SYNOPSIS

       oggz-diff [options]  [OGGZDUMP_OPTIONS]	[DIFF_OPTIONS] file1.ogg file2.ogg

       options: [--verbose ]  [-v  | --version ]  [-h  | --help ]

       OGGZDUMP_OPTIONS:  [-b  | --binary ]  [-x  | --hexadecimal ]  [-c content-type  | --content-type content-type ]	[-s serialno  | --serialno
       serialno ]  [-O	| --hide-offset ]  [-S	| --hide-serialno ]  [-G  | --hide-granulepos ]  [-P  | --hide-packetno ]

       DIFF_OPTIONS: [-q  | --brief ]  [-C NUM	| --context[=NUM] ]  [-u  | -U NUM  | --unified[=NUM] ]  [-e  | --ed ]	[--normal ]  [--rcs ]  [-y
       | --side-by-side ]  [-l	| --paginate ]

Description
       oggz-diff  is a sh script which uses oggz-dump to generate hexadecimal packet dumps of each input file, then outputs the difference between
       these dumps using diff.

Options
       oggz-diff forwards a subset of options accepted by oggz-dump and diff.  See oggz-dump(1) and diff(1) for more detail.

   oggz-dump format options
       -b, --binary
		 Generate a binary dump of each packet

       -x, --hexadeciaml
		 Generate a hexadecimal dump of each packet

   oggz-dump filtering options
       -c content-type, --content-type content-type
		 Dump only the logical bitstreams for a specific content-type.	Run oggz-known-codecs(1) for a full list of codecs  known  by  the
		 installed version of oggz.

       -s serialno, --serialno serialno
		 Dump only the logical bitstream with specified serialno.

       -O, --hide-offset
		 Hide the byte offset field of the preamble for each packet dumped. This is particularly useful when comparing Ogg bitstreams that
		 differ only in page structure.

       -S, --hide-serialno
		 Hide the serialno field of the preamble for each packet dumped. This is particularly useful when comparing  Ogg  bitstreams  that
		 differ only in serialno assignment.

       -G, --hide-granulepos
		 Hide the granulepos field of the preamble for each packet dumped.

       -P, --hide-packetno
		 Hide the packetno field of the preamble for each packet dumped.

   diff options
       The -w (--ignore-all-space) option to diff   is always implied.

       -q, --brief
		 Output only whether files differ.

       -C NUM, --context[=NUM]
		 Output NUM lines of copied context.

       -u, -U NUM, --unified[=NUM]
		 Output NUM (default 3) lines of unified context.

       -e, --ed  Output an ed script.

       --normal  Output a normal diff.

       --rcs	 Output an RCS format diff.

       -y, --side-by-side
		 Output in two columns.

       -l, --paginate
		 Pass the output through pr to paginate it.

   Miscellaneous options
       --verbose Display verbose messages.

       -v, --version
		 Display version information and exit.

       -h, --help
		 Display usage information and exit.

AUTHOR

       Conrad Parker

COPYRIGHT

       Copyright (C) 2003 CSIRO Australia

SEE ALSO

       oggz-dump(1), diff(1), patch(1)

																      oggz-diff(1)
All times are GMT -4. The time now is 05:00 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy