Reading a file several times with awk

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Issues in reading file using 'awk'

Dear all, I am using following function of some script to assign variable "JobNo" some value form file $SAMPLE"_status.log" ( generated using the red color command ) crab ntuplize_crab -status -c $SAMPLE >& $SAMPLE"_status.log" & echo $SAMPLE"_status.log" "=====" jobNo=$(awk...

2. Shell Programming and Scripting

Reading data from file using awk

I have a file as below. It contains two data sets separated by >. I want to pipe each data set to another program called psxy. How can I get the different records Have started doing as follows but it only passes the first data set awk 'BEGIN {RS=">"};{print $0}' p.dat cat p.dat...

3. Shell Programming and Scripting

awk issue while reading from file in while do

Hi Friends, I am trying to scan line by line using awk and pull the values and pass it in variables and then will use the variables but doesn't work. Please see below for details. #more dbtest.sh ---------------------------------- #!/bin/bash . $HOME/.bash_profile while read line do...

4. Shell Programming and Scripting

reading file awk or while

While read line query !!! Folks, I am working on a file which has entries as follows. I am using while read line to generate desired output as follows. filename1: Name : sdt2156157_ID NOS : 4567 NOS : 2348 Name : sdt2156158_ID NOS : 4987 NOS :...

5. Shell Programming and Scripting

awk file reading doubt

Hi, Using this trivial code, I am trying to insert/paste the single column data of a file into the second column (field 2) of a multi-column text file. awk 'FNR==NR {a=$0; next} {$1=$1 OFS a}1' single-column-file multi-column-file Lets consider the single-column-file as 'f2' and multi-column...

6. Shell Programming and Scripting

awk- reading input file twice

Hello, I've been trying to come up with a solution for the following problem; I have an input file with two columns and I want to print as an output the first column without any changes but for the second column, I want to divide it by its last value. Example input: 1 9 2 10 3 11 4 12 5...

7. Shell Programming and Scripting

Reading passwd and need to use it multple times when script asks

Hi Gurus, I have one requirment.. I have written a script and it asks a registry passwd while performing some clearcase command. Now we are giving it manually. It's for one time run. We want to perform this for multiple times on multiple files throguh for loop.. means we need to pass the same...

8. Shell Programming and Scripting

How to make AWK process an input file many many times?

By "many many times" I mean the times the input file is to be processed is unknown beforehand, it will be known when awk finishes processing the input file for the first time. So my question is: how to start over again from the first record of the input file when AWK finishes processing the...

9. Shell Programming and Scripting

Using awk to when reading a file to search and output to file

Hi, I am not sure if this will work or not. I am getting a syntax error. I am reading fileA, using an acct number field trying to see if it exists in fileB and output to new file. Can anyone tell me if what I am doing will work or should I attempt it another way? Thanks. exec < "${fileA}...

10. Shell Programming and Scripting

Reading large file, awk and cut

Hello all, I have 2 files, the first (indexFile1) contains start offset and length for each record inside the second file. The second file can be very large, each actual record start offset and length is defined by the entry in indexFile1. Since there are no records separators wc-l returns 0 for...

LEARN ABOUT BSD

diff3

DIFF3(1)						      General Commands Manual							  DIFF3(1)

NAME

       diff3 - 3-way differential file comparison

SYNOPSIS

       diff3 [ -exEX3 ] file1 file2 file3

DESCRIPTION

       Diff3 compares three versions of a file, and publishes disagreeing ranges of text flagged with these codes:

       ====	       all three files differ

       ====1	       file1 is different

       ====2	       file2 is different

       ====3	       file3 is different

       The type of change suffered in converting a given range of a given file to some other is indicated in one of these ways:

       f : n1 a        Text is to be appended after line number n1 in file f, where f = 1, 2, or 3.

       f : n1 , n2 c   Text is to be changed in the range line n1 to line n2.  If n1 = n2, the range may be abbreviated to n1.

       The original contents of the range follows immediately after a c indication.  When the contents of two files are identical, the contents of
       the lower-numbered file is suppressed.

       Under the -e option, diff3 publishes a script for the editor ed that will incorporate into file1 all changes between file2 and file3,  i.e.
       the  changes  that  normally  would  be	flagged ==== and ====3.  Option -x (-3) produces a script to incorporate only changes flagged ====
       (====3).  The following command will apply the resulting script to `file1'.

		(cat script; echo '1,$p') | ed - file1

       The -E and -X are similar to -e and -x, respectively, but treat overlapping changes (i.e., changes that would be flagged with ====  in  the
       normal listing) differently.  The overlapping lines from both files will be inserted by the edit script, bracketed by "<<<<<<" and ">>>>>>"
       lines.

       For example, suppose lines 7-8 are changed in both file1 and file2.  Applying the edit script generated by the command
							      "diff3 -E file1 file2 file3"
       to file1 results in the file:

	      lines 1-6
	      of file1
	      <<<<<<< file1
	      lines 7-8
	      of file1
	      =======
	      lines 7-8
	      of file3
	      >>>>>>> file3
	      rest of file1

       The -E option is used by RCS merge(1) to insure that overlapping changes in the merged files are preserved and brought to someone's  atten-
       tion.

FILES

       /tmp/d3?????
       /usr/libexec/diff3

SEE ALSO

       diff(1)

BUGS

       Text lines that consist of a single `.' will defeat -e.

7th Edition							 October 21, 1996							  DIFF3(1)

Shell Programming and Scripting