Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: awk help
Top Forums Shell Programming and Scripting awk help Post 302539758 by spl on Monday 18th of July 2011 02:53:45 PM
Old 07-18-2011
Code:
#!/usr/bin/perl
print "Enter file1 (with path): "; my $file1 = <stdin>;
print "Enter file2 (with path): "; my $file2 = <stdin>;
print "Enter record delimiter : "; my $delim = <stdin>;
print "Enter output file      : "; my $ofile = <stdin>;
chomp($file1); chomp($file2); chomp($delim); chomp($ofile);
die "2 different files are required to compare.\n"
if ($file1 eq '' or $file2 eq '' or $file1 eq $file2);
die "Record delimiter must be specified.\n" if ($delim eq '');
die "Output file must be specified.\n" if ($ofile eq '');
print "\nFile1: " . $file1 . "\nFile2: " . $file2 . "\n";
print "Output: " . $ofile . "\n";
open (f1, $file1) || die ("Failed to open $file1 - $!\n");
open (f2, $file2) || die ("Failed to open $file2 - $!\n");
my @f1c = <f1>; my @f2c = <f2>;
my $f1l = scalar(@f1c); my $f2l = scalar(@f2c);
my $fml = ($f1l >= $f2l) ? $f1l : $f2l;
print ("Total records to compare: " . $fml . "\n");
my %diff_records;
for (my $i = 0; $i < $fml; $i++) {
    my $f1r = $f1c[$i]; my $f2r = $f2c[$i];
    chomp($f1r); chomp($f2r);
    my @f1e = split($delim,$f1r); my @f2e = split($delim,$f2r);
    my $f1el = scalar(@f1e); my $f2el = scalar(@f2e);
    my $fel = ($f1el >= $f2el) ? $f1el : $f2el;
    my @diff_cols;
    for (my $j = 0; $j < $fel; $j++) {
        if ($f1e[$j] ne $f2e[$j]) {
            push (@diff_cols, $j+1);
            $diff_records{$i+1} = \@diff_cols;
        }
    }
}
open (OF, ">>$ofile") || die ("Failed to open $ofile for writing - $!\n");
my @diff_rec = sort(keys(%diff_records));
if (scalar(@diff_rec) >=1) {
    print OF "Mismatch found in records:\n\n";
    foreach my $diff_record (@diff_rec) {
        print OF "Record# $diff_record \n";
        chomp($f1c[$diff_record-1]); chomp($f2c[$diff_record-1]);
        my @diff_col = @{$diff_records{$diff_record}};
        foreach my $col (@diff_col) {
            my @f1el = split($delim,$f1c[$diff_record-1]);
            my @f2el = split($delim,$f2c[$diff_record-1]);
            print OF "  Column# $col \n";
            print OF "  File1: " . $f1el[$col-1] . "\n";
            print OF "  File2: " . $f2el[$col-1] . "\n\n";
        }
    }
} else { print OF "\nAll records match.\n"; }
print "Output recorded in file $ofile \n";
close OF;

Last edited by Franklin52; 07-19-2011 at 05:08 AM.. Reason: Please use code tags for code and data samples, thank you
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Awk problem: How to express the single quote(') by using awk print function

Actually I got a list of file end with *.txt I want to use the same command apply to all the *.txt Thus I try to find out the fastest way to write those same command in a script and then want to let them run automatics. For example: I got the file below: file1.txt file2.txt file3.txt... (4 Replies)
Discussion started by: patrick87
4 Replies

2. Shell Programming and Scripting

scripting/awk help : awk sum output is not comming in regular format. Pls advise.

Hi Experts, I am adding a column of numbers with awk , however not getting correct output: # awk '{sum+=$1} END {print sum}' datafile 2.15291e+06 How can I getthe output like : 2152910 Thank you.. # awk '{sum+=$1} END {print sum}' datafile 2.15079e+06 (3 Replies)
Discussion started by: rveri
3 Replies

3. Shell Programming and Scripting

awk: assign variable with -v didn't work in awk filter

I want to filter 2nd column = 2 using awk $ cat t 1 2 2 4 $ VAR=2 #variable worked in print $ cat t | awk -v ID=$VAR ' { print ID}' 2 2 # but variable didn't work in awk filter $ cat t | awk -v ID=$VAR '$2~/ID/ { print $0}' (2 Replies)
Discussion started by: honglus
2 Replies

4. Shell Programming and Scripting

Problem with awk awk: program limit exceeded: sprintf buffer size=1020

Hi I have many problems with a script. I have a script that formats a text file but always prints the same error when i try to execute it The code is that: { if (NF==17){ print $0 }else{ fields=NF; all=$0; while... (2 Replies)
Discussion started by: fate
2 Replies

5. Shell Programming and Scripting

Comparison and editing of files using awk.(And also a possible bug in awk for loop?)

I have two files which I would like to compare and then manipulate in a way. File1: pictures.txt 1.1 1.3 dance.txt 1.2 1.4 treehouse.txt 1.3 1.5 File2: pictures.txt 1.5 ref2313 1.4 ref2345 1.3 ref5432 1.2 ref4244 dance.txt 1.6 ref2342 1.5 ref2352 1.4 ref0695 1.3 ref5738 1.2... (1 Reply)
Discussion started by: linuxkid
1 Replies

6. Shell Programming and Scripting

awk command to compare a file with set of files in a directory using 'awk'

Hi, I have a situation to compare one file, say file1.txt with a set of files in directory.The directory contains more than 100 files. To be more precise, the requirement is to compare the first field of file1.txt with the first field in all the files in the directory.The files in the... (10 Replies)
Discussion started by: anandek
10 Replies

7. Shell Programming and Scripting

HELP with AWK one-liner. Need to employ an If condition inside AWK to check for array variable ?

Hello experts, I'm stuck with this script for three days now. Here's what i need. I need to split a large delimited (,) file into 2 files based on the value present in the last field. Samp: Something.csv bca,adc,asdf,123,12C bca,adc,asdf,123,13C def,adc,asdf,123,12A I need this split... (6 Replies)
Discussion started by: shell_boy23
6 Replies

8. Shell Programming and Scripting

Passing awk variable argument to a script which is being called inside awk

consider the script below sh /opt/hqe/hqapi1-client-5.0.0/bin/hqapi.sh alert list --host=localhost --port=7443 --user=hqadmin --password=hqadmin --secure=true >/tmp/alerts.xml awk -F'' '{for(i=1;i<=NF;i++){ if($i=="Alert id") { if(id!="") if(dt!=""){ cmd="sh someScript.sh... (2 Replies)
Discussion started by: vivek d r
2 Replies

9. Shell Programming and Scripting

Pass awk field to a command line executed within awk

Hi, I am trying to pass awk field to a command line executed within awk (need to convert a timestamp into formatted date). All my attempts failed this far. Here's an example. It works fine with timestamp hard-codded into the command echo "1381653229 something" |awk 'BEGIN{cmd="date -d... (4 Replies)
Discussion started by: tuxer
4 Replies

10. Shell Programming and Scripting

awk output yields error: awk:can't open job_name (Autosys)

Good evening, Im newbie at unix specially with awk From an scheduler program called Autosys i want to extract some data reading an inputfile that comprises jobs names, then formating the output to columns for example 1. This is the inputfile: $ more MapaRep.txt ds_extra_nikira_usuarios... (18 Replies)
Discussion started by: alexcol
18 Replies

LEARN ABOUT OPENSOLARIS

comm

comm(1) 							   User Commands							   comm(1)

NAME

       comm - select or reject lines common to two files

SYNOPSIS

       comm [-123] file1 file2

DESCRIPTION

       The comm utility reads file1 and file2, which must be ordered in the current collating sequence, and produces three text columns as output:
       lines only in file1; lines only in file2; and lines in both files.

       If the input files were ordered according to the collating sequence of the current locale, the lines  written  will  be	in  the  collating
       sequence of the original lines. If not, the results are unspecified.

OPTIONS

       The following options are supported:

       -1    Suppresses the output column of lines unique to file1.

       -2    Suppresses the output column of lines unique to file2.

       -3    Suppresses the output column of lines duplicated in file1 and file2.

OPERANDS

       The following operands are supported:

       file1	A path name of the first file to be compared. If file1 is -, the standard input is used.

       file2	A path name of the second file to be compared. If file2 is -, the standard input is used.

USAGE

       See largefile(5) for the description of the behavior of comm when encountering files greater than or equal to 2 Gbyte ( 2^31 bytes).

EXAMPLES

       Example 1 Printing a list of utilities specified by files

       If file1, file2, and file3 each contain a sorted list of utilities, the command

	 example% comm -23 file1 file2	| comm -23 - file3

       prints a list of utilities in file1 not specified by either of the other files. The entry:

	 example% comm -12 file1 file2 | comm -12 - file3

       prints a list of utilities specified by all three files. And the entry:

	 example% comm -12  file2 file3 | comm -23 -file1

       prints a list of utilities specified by both file2 and file3, but not specified in file1.

ENVIRONMENT VARIABLES

       See  environ(5)	for  descriptions  of  the  following  environment  variables that affect the execution of comm: LANG, LC_ALL, LC_COLLATE,
       LC_CTYPE, LC_MESSAGES, and NLSPATH.

EXIT STATUS

       The following exit values are returned:

       0     All input files were successfully output as specified.

       >0    An error occurred.

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWesu			   |
       +-----------------------------+-----------------------------+
       |CSI			     |enabled			   |
       +-----------------------------+-----------------------------+
       |Interface Stability	     |Standard			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       cmp(1), diff(1), sort(1), uniq(1), attributes(5), environ(5), largefile(5), standards(5)

SunOS 5.11							    3 Mar 2004								   comm(1)
All times are GMT -4. The time now is 09:55 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy