awk: Internal software error in the tostring function on


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting awk: Internal software error in the tostring function on
# 1  
Old 05-22-2011
awk: Internal software error in the tostring function on

Hello,

I posted a working script on this thread:

https://www.unix.com/emergency-unix-l...rge-files.html

When I run this script on a large file, 351 MB I get this error:

Code:
awk: Internal software error in the tostring function on TS1101?05044400?.0085498227?0?.0011041461?.0034752266?.00397045?0?0?0?0?0?0?11/02/10?09/23/10???10?no??0??no?sct_det3_10_20110516_143936.txt

However when I run it on other smaller files in the same format it runs file.

Please help ! Smilie
# 2  
Old 05-24-2011
Hi,

It seems your version of 'awk' is too old. It seems to be a bug of memory leak which breaks with big files. Take a look to next urls:
Code:
http://lists.gnu.org/archive/html/bug-gnu-utils/2004-08/msg00062.htmlhttp://lists.gnu.org/archive/html/bug-gnu-utils/2004-08/msg00062.html
http://forums13.itrc.hp.com/service/forums/questionanswer.do?admit=109447627+1306255852453+28353475&threadId=944806

Regards,
Birei
# 3  
Old 05-24-2011
Hi,

I tried running the script using the latest version of gawk 3.1.8 and it gave me the error,

out of memory, need more space

Do you know how awk or gawk uses memory?

I'm running on an HP-UX server, on UNIX.
# 4  
Old 05-24-2011
Hi,

No idea. Can't help much more.

But I would try to process the file in two executions, the first half and the second half. Or try with other language, like 'Perl'.

Regards,
Birei.
This User Gave Thanks to birei For This Post:
# 5  
Old 05-24-2011
well I found the HP server's version and awk patch version

uname -a
HP-UX servername B.11.31 U ia64 2183943116 unlimited-user license

what /usr/bin/awk
/usr/bin/awk:
$Revision: B.11.31_LR

this is actually a new server
unless there's some sort of miracle patch

I'm going to make the same script in Perl
# 6  
Old 05-26-2011
Or gnu awk: gawk-3.1.8
# 7  
Old 05-26-2011
I installed gawl 3.1.18 in a directory and ran the script replacing gawk for awk
and I got the error
Code:
out of memory (need more space)

Code:
then I tried it again in gawk and got no error but it didn't create the output file

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. HP-UX

Internal Memory Error ?

================================================================================== SEGV_MAPERR: Address not mapped to object fffffffffffffff0 (Memory location which caused fault) ------------------ C-STACK ---------------------- (0) 0x40000000007622f0 CTrcStack2 + 0x1d0 at dptstack_mt.c:228... (6 Replies)
Discussion started by: sidharthmellam
6 Replies

2. Shell Programming and Scripting

Error using function in AWK code

Hi to all, I have an AWK code that looks like this: awk 'NR==FNR { #code to process file1 next } { #code to process file2 a=myfunction(x) } END { #Some code b=myfunction(x) ... (3 Replies)
Discussion started by: Ophiuchus
3 Replies

3. Shell Programming and Scripting

using an awk internal variable as parameter for an external array

Hello, I am running a bash script under linux which first defines an CA-array like j=0 num1=120.00 num2=10.00 until do CA='echo $num1 + $j*$num2' j=$ done within the later awk section of this same script I want to read data from a file. If the value of the second column is... (3 Replies)
Discussion started by: MotAah
3 Replies

4. Shell Programming and Scripting

Internal software error in the tostring function for files greater than 300 MB

Hello, When I run my awk script with input files greater than 300 MB I always get this error: awk: Internal software error in the tostring function on TS1101?05044400?.0085498227?0?.0011041461?.0034752266?.00397045?0?0?0?0?0?0?11/02/10?09/23/10???10?no??0??no?sct_det3_10_20110516_143936.txt ... (0 Replies)
Discussion started by: script_op2a
0 Replies

5. Shell Programming and Scripting

use internal function with find command

Hi, I need to use a function in the find command to do some process on the file. I'm trying: funcname(){ ... } ... find ./ -name "*" -exec funcname {} \; But somehow this is not working. I don't want to have a separate script for whatever processing the function does. I want to have... (1 Reply)
Discussion started by: victorcheung
1 Replies

6. AIX

Internal error

Dear experts, please inform when i am trying to use dbx to debug my code, iam getting following error: internal error: expected member attribute 's', 'p', 'r' or 'b', found... (1 Reply)
Discussion started by: vin_pll
1 Replies

7. UNIX for Advanced & Expert Users

Forwarding internal internet packets to internal webserver using iptables

Hi, I need to redirect internal internet requests to a auth client site siting on the gateway. Currently users that are authenticated to access the internet have there mac address listed in the FORWARD chain. All other users need to be redirected to a internal site for authentication. Can... (1 Reply)
Discussion started by: mshindo
1 Replies

8. Shell Programming and Scripting

500 Internal Server Error

:)Hi, I am working on perl-cgi script which i wrote on unix server, and now i want to run it from windows. Have put DNS entry, sybase and apache is running... But still I am getting 500 Internal Server Error!!! what could be the reason? (2 Replies)
Discussion started by: darshakraut
2 Replies

9. UNIX for Dummies Questions & Answers

Error: Internal system error: Unable to initialize standard output file

Hey guys, need some help. Running AIX Version 5.2 and one of our cron jobs is writing errors to a log file. Any ideas on the following error message. Error: Internal system error: Unable to initialize standard output file I'm guessing more info might be needed, so let me know. Thanks (2 Replies)
Discussion started by: firkus
2 Replies

10. Shell Programming and Scripting

using awk to drive an internal function

I have a piece of script that needs to pull every element in column 2 from a file of varying size. Rather than writing something to read the file and then pass the data line by line to my script, I want to use awk. However, what is the correct syntax to get awk to call a function (named via: ... (7 Replies)
Discussion started by: quaddriver
7 Replies
Login or Register to Ask a Question