AWK File Traversal Post: 302279722

Sponsored Content

Top Forums Shell Programming and Scripting AWK File Traversal Post 302279722 by beefeater267 on Friday 23rd of January 2009 04:25:24 PM

01-23-2009

Registered User

AWK File Traversal

Hey,

I'm working on a file traversal and extraction function and am having problems.

So, my script is finding all files in a directory. Each file has the same format. I need to extract a field from the 4th line of each file..... hence why I am using the substring on NR == 4. So, I am extracting some names and I need to print out a list of unique names..... so, I was thinking of storing the names in an array list called Names. Then, at the end of my for loop, I want to invoke another awk script to print back the names in sorted order. But, everything I have tried hasn't worked. I'm not sure if there is a scope issue.... (by redeclaring another awk block, I can't read from the variables in the 1st block).

Am I approaching this script incorrectly? As you can tell, I'm new to AWK, and am having difficulties.

Code:

ARCHIVE=/home/directory
 
        for file in `find $ARCHIVE -type f`
            do
                awk 'BEGIN { RS = "\n" } ;
                {
                        if (NR == 4)
                        {
                           Names[substr($0,14)] = substr($0,14)
                        }
                }' $file
            done

beefeater267

View Public Profile for beefeater267

Find all posts by beefeater267

7 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Command line traversal

What is a key, if on command line I have to trverse left & right word by word, instead of character by character?

2. Shell Programming and Scripting

Creating breadth traversal binary tree

I almost have the entire script written. however the problem is how would i assign the global variable to terminate the process from the bottom up to ensure the child terminates so the parent can. ex. I am proccess 1 I am proccess 2 etc Here is the code $ cat tree.c ...

3. UNIX for Advanced & Expert Users

need help in file traversal via FTS(3)

Hi friends, I was trying to traverse a file using FTS(3) . this is the code below.. but I am getting segmentation error in the line fts_read(...) , anybody have any idea , why it is? Please, help me. Thanks in advance....

4. Shell Programming and Scripting

Parse file using awk and work in awk output

hi guys, i want to parse a file using public function, the file contain raw data in the below format i want to get the output like this to load it to Oracle DB MARWA1,BSS:26,1,3,0,0,0,0,0.00,22,22,22.00 MARWA2,BSS:26,1,3,0,0,0,0,0.00,22,22,22.00 this the file raw format: Number of...

5. Shell Programming and Scripting

awk command to compare a file with set of files in a directory using 'awk'

Hi, I have a situation to compare one file, say file1.txt with a set of files in directory.The directory contains more than 100 files. To be more precise, the requirement is to compare the first field of file1.txt with the first field in all the files in the directory.The files in the...

6. Shell Programming and Scripting

file traversal

Hi, I have to get some value of the from a flat file and my file format is like this. ABC DEF HIJ=1 XYZ xyz HIJ=2 So i need to make sure i get all the value of HIJ under XYZ and not ABC.

7. Shell Programming and Scripting

Awk: Print count for column in a file using awk

Hi, I have the following input in a file & need output as mentioned below(need counter of every occurance of field which is to be increased by 1). Input: 919143110065 919143110065 919143110052 918648846132 919143110012 918648873782 919143110152 919143110152 919143110152...

LEARN ABOUT DEBIAN

nomarch

nomarch(1)							Archive Extraction							nomarch(1)

NAME

       nomarch - extract `.arc' archives

SYNOPSIS

       nomarch [-hlptUv] [archive.arc] [match1 [match2 ... ]]
DESCRIPTION

       nomarch	lists, extracts, or tests `.arc' archives. (An alternate extension sometimes used was `.ark'; these work too.) This is a very out-
       dated file format which should certainly not be used for anything new, but you may still need an extraction utility, and here it is. :-)

       The default action is to extract all files in the specified archive; see OPTIONS below for how to do other things instead.

OPTIONS

       -h     give terse usage help.

       -l     list files in archive. If verbose listings are enabled, it shows the filename,  compression  method,  compressed/uncompressed  size,
	      date/time, and CRC; but by default, it just shows the filename, uncompressed size, and date/time.

       -p     extract to standard output, rather than to separate files.

       -t     test files in archive (more precisely, check file CRCs).

       -U     use uppercase filenames; more precisely, preserve original case from archive.

       -v     give verbose output (when used with `-l').

       archive.arc
	      the archive to operate on.

       match1 etc.
	      optionally  specify  which  archive  members to list/extract/test. Those which match any of these filenames/wildcards are processed.
	      Wildcard operators supported are shell-like `*' and `?', but don't forget to quote arguments which use these (e.g.  `nomarch foo.arc
	      '*.bar'').

EXTRACTING MULTIPLE ARCHIVES

       nomarch	follows the `unzip'-like practice of working on only one archive per run, with further `filenames' given on the command-line actu-
       ally specifying files to extract (or whatever). The easiest way to work on multiple files with nomarch is simply to run it  multiple  times
       using for; for example:

       for i in *.arc; do nomarch $i; done

       The above would extract all archives in the current directory.

USING THE PROGRAM FROM EMACS

       Emacs's	arc-mode  facility lets you work with various kinds of archive file directly from the editor. Making it use nomarch for extracting
       `.arc' files isn't too hard. Just add the following to your ~/.emacs file:

       (setq archive-arc-extract '("nomarch" "-U"))

BUGS

       The CRC used by the format is only 16-bit, so `-t' is a less-than-perfect test.

       One compression method, obsolete even by `.arc' standards :-), isn't supported yet. This is partly because I've yet to find a  single  file
       which uses it, despite testing an awful lot of files.

       Subdirectories in Spark archives are extracted as the `.arc'-format files they really are, which may not be terribly convenient.

SEE ALSO

       tar(1), gzip(1), bzip2(1), lbrate(1)

AUTHOR

       Russell Marks (rus@svgalib.org).

Version 1.4							  18th June, 2006							nomarch(1)