Shell Programming and Scripting

Hi everyone,
currently I writing a script for comparing 2 variable in 2 line then output the line with equal value to new file. However, the new file only contain last line only, the earlier line was delete. I do google my problem but still not find the way out. Sorry for my English.
Thank you very much in advance .

Here is my script somehow look like:

Code:

for(tmp1=1; tmp1<=cnt1; tmp1++){
$line1= `head -tmp1 file1| tail -1`;
@str1=split(/\s/,$line1);
       for(tmp2=1; tmp2<=cnt2; tmp2++){
           $line2= `head -tmp2 file2| tail -1`;
           @str2=split(/\s/,$line2);
           open (OUT, ">out");
           if ($str1[3] eq $str2[3]){
              print OUT "$line1";
           }
       }
}

You are open (OUT, ">out"); in a for loop, which means every single time that the loop iterates, the out file gets recreated anew.

Open the file to write outside the for loop and close it when the loop is finished.

Showing us the work that you have done is good. But, just showing us a script that is not working without also showing us sample input and expected output makes it hard to guess at all of the things that might be wrong in your script. The script you have shown us seems to be a strange mix of shell and awk statements.

Please tell us what operating system you're using, tell us what shell you're using, show us some sample input, and show us the exact output you want to produce from that sample input.

By the way, perl has an special variable `$.' (that's $ and period) which might help you read the specific line of a file without resorting to making calls to the external head and tail.

So instead of $line1= `head -tmp1 file1| tail -1`;

maybe something like:

Code:

open my $fh, '<', $file1 or die "$file1: $!";

my $cntl = 1; # or whatever you want
my $line;
while( <$fh> ) {
    if( $. == $ctl ) { 
        $line = $_;
        last;
    }
}
close $fh

# now you can use $line here

@Don Cragun, thank you for remind me about the manner .
my job is rarely relate to scripting and I just make this script due to my colleague request on yesterday so I just try to use what I know and google what I don't. That's why my script look like a bunch of scraps .
by the way, my OS is Linux Redhat, I'm using Perl which included. My script is used for comparing 2 file which contain lines with this info:

Code:

 coordinate_x coordinate_y  variable_name  value_1 value_2...

My expect output file which contains all lines with same values, another output file contain lines with different values. Currently, I use loop for comparing 2 file but it's seem take time cause input files having few thousand lines each, so I'm finding another way.

@Aia: thank you so much for your hint. it's just where I stuck .
Thank you for the suggestion, hope it can reduce the script running time.

I still have no idea what you're trying to compare when you're looking at lines from your two input files and I have no idea what output you're trying to produce. Are you just trying to extract lines from your 2nd input file that have a variable_name in the 3rd field that matches a variable_name in the 3rd field on any line in your 1st input file? If this is what you want, it will be easy to write a small, fast awk script to do what you want.

I repeat: Please show us a small, representative pair of sample input files, and show us the output that should be produced from those input files.

I want to show you what you're demanding, but I really can't. In my company, pc for working can not access to internet, I have to use another pc which allowed to access internet to go here, and working pc and internet pc are not connected, so there is no way I can show you the infos you want, please pardon me for this.
As I said, my job is rarely relate with scripts. I only know a little C-shell via some scripts for my work verification, know nothing about awk and Perl is just a little since 2 days ago. I use Perl because it can output an excel file (as my colleague told me).

I will try to describe my problem again. I have 2 file which contain lines with these info

Code:

coordinate_x coordinate_y variable_name value1 value2 value3

I need to compare which line in 1st file has same variable_name with 2nd file, which doesn't, then print to excel file one sheet for all same variable_name, another sheet for different variable_name.
Currently, I'm stuck in how to compare them quicker, because my script take terrible long running time for compare them. I'm finding another way to overcome my problem.
Please kindly have some suggestion.

Thank you so much in advance .