Shell Programming and Scripting

Sounds like bc can't handle the huge line size. try this:

Code:

awk '{ print "last + " $0  }' hash_column_wrong.txt | bc  | tail -1

This prints out a sub-result for each line. The only catch is that "last" is a GNU extension.

No . .it's not working..

When I run

$ awk '{ print "last + " $0 }' hash_column_wrong.txt | bc | tail -1
syntax error on line 1,


When I run without tail..

$ awk '{ print "last + " $0 }' hash_column_wrong.txt | bc
syntax error on line 1,

When I run only , i got the result like this...

last + 0000191
last + 0000005
last + 0000001


I think format might be wrong ?.

No, it means that the bc isn't the GNU one. As I mentioned, the "last" keyword is specific to GNU. You can try downloading and installing it. Run "bc --version" afterwards to make sure you're using the GNU version. You might also be asked to install the arbitrary precision library, which I recommend using.

Is it free ware?.. bc is available in my Unix version. As you said, last keyword may not compitable with bc version. Do you mean i need to download from the site?. This is impractical for me becuase .. there are lot of things need to consider as it's client production server.. If you know any other alternate way, pls let me know.

Okay, if I say "GNU", yes, that means it's free.

Now, if you are using a Linux system, obviously the problem is something else (because that's what you would be using). If you have a Sun system, you can get install a CSW "package". Ask the site administrator if s/he knows about CSW/blastwave packages. Here's the link for gnu's bc: CSW - Details for gbc. Click here for the source which you can download and install.

Now, if that's not possible, you can take my original script and find out how many lines ending in "\" that bc can handle. Then you can use split to divide the file into that many lines:

Code:

split -l ?? bigfile

where ?? is the number of lines. You'll get lots of little files. Add them up individually with the awk-bc script (or another method). Then add the output up, again using awk-bc. You might have to recurse over the first step until you have a tree of sums.

Or, you can use perl. See next message.

Hi ,I am using HP-UX B.11.11 ( HP unix ). If i get the freeware for HP unix, I can install the GNU bc with help of Unix admin. Please provide the link for GNU bc of HP unix.

I can't spilit the file as it's a source file which comes from source sytem. I should not touch that.. and I am pasting here my awk program to add the number.. Please look at the last "else " part which shows the addition ... in this existing code only, I need to amend the changes to get the total count with full digit rather the expontial formt..

BEGIN {
totalLatestRetailPrice = 0;
}
#
{
if (substr($0,1,7)=="HCDWC01")
{
printf "%s%58s\n", substr($0,1,28), " "
}
else
if (substr($0,1,7)=="TCDWC01")
{
printf "%s%015d%44s\n", substr($0,1,27), totalLatestRetailPrice,
" "
}
else
{

totalLatestRetailPrice += int(substr($0,14,7))
print
}

}

I'm on a 64-bit machine, and awk and Perl seem to work fine here. I don't have access to a 32-bit machine at the moment. But try it with perl:

Code:

#!/usr/bin/env perl -w
$bc_lines=100;

local $maxint=int(2*(2**30 - 1)+1);
my $a=0;
my @subresults;

while ($_=<>) {
  chop;
  if ($maxint - int($_) < $a) {
    push @subresults, $a;
    $a=0;
  }
  $a+=int($_);
}
while (scalar(@subresults)) {
  print join("+\\\n",splice(@subresults,0,$bc_lines),"0\n");
}

Now run this script, pipe through bc *recursively* until there is only one line left. For example:

Code:

cp bigfile.txt outfile.txt 
while [ ! -f outfile.txt -o `grep -c ^ outfile.txt` -gt 1 ]; do 
  perl test.pl  outfile.txt  |bc >outfile.$$ ; 
  mv outfile.$$ outfile.txt; 
  echo "Subcalc complete" >&2; 
done ; 
cat outfile.txt

If bc complains with the same error, lower 100 to, say, 50. Keep cutting in half till no more complaints.

the GNU bc link is in my previous post.