Login or Register to Ask a Question and Join Our Community


UNIX for Advanced & Expert Users

help required - stack trace

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users help required - stack trace
# 1  
Old 08-10-2006
help required - stack trace
Hi all,
One of our programs written in Java, produced this logfile. This job runs 48 threads and only one thread failed with this error. The code is a blackbox(external product), so cant look at the source code. From what I can infer from the log, the job was trying to write the log messages into a file but didnt write and failed. THe error is below
Quote:
----> STACK TRACE (begin)
<---- STACK TRACE (end)
( 0) 0x4000000000945c80 [lsp_engine]
( 1) 0x4000000000d1aa5c [lsp_engine]
( 2) 0x400000000097a9d0 [lsp_engine]
( 3) 0xc0000000001f9398 _sigreturn [/usr/lib/pa20_64/libc.2]
( 4) 0x4000000000ac0a94 [lsp_engine]
( 5) 0x4000000000ae2d14 [lsp_engine]
( 6) 0x4000000000ae174c [lsp_engine]
( 7) 0x4000000000ae00bc [lsp_engine]
( 8) 0x4000000000bb8b68 [lsp_engine]
( 9) 0x4000000000e55384 [lsp_engine]
(10) 0x4000000000a64d7c [lsp_engine]
(11) 0x4000000000a75bc8 [lsp_engine]
(12) 0x4000000001323d48 [lsp_engine]
(13) 0x4000000001255dec [lsp_engine]
(14) 0xc00000000000a770 $START$ + 0xa0 [/usr/lib/pa20_64/dld.sl]
returnCode from lspProcessAgent:11
There was no core dump too. We were having swap space issues on this box previously. our admins increased the swap 2 days back. The next day, the job ran fine. But the subsequent run failed and the error is above. Can anyone throw some light on this.
Box: HP-UX B.11.11
swapinfo -t gives
Quote:
Kb Kb Kb PCT START/ Kb
TYPE AVAIL USED FREE USED LIMIT RESERVE PRI NAME
dev 4194304 591756 3602548 14% 0 - 1 64,0x000002
dev 4194304 0 4194304 0% 0 - 2 64,0x00000b
dev 4096000 84400 4011600 2% 0 -1 /dev/vgdev6_new/lvswap2
dev 8192000 0 8192000 0% 0 - 2 /dev/vgdev6_new/lvswap3
reserve - 9160164 -9160164
memory 19366488 8592160 10774328 44%
total 40043096 18428480 21614616 46% - 0 -
# 2  
Old 08-10-2006
Was swapinfo run during the time tha Java app was running?
# 3  
Old 08-10-2006
No
Sorry for the delayed reply. Was not at desk.

I ran it seperately. But once, while monitoring the job, we got a Red alert in 'glance' saying that the 'Global swap space is nearly full'. It was after pointing out this that the swap was increased.
# 4  
Old 08-10-2006
That means the app is requesting lots of virutal memory. All I get is
1. it's a 64 bit app
2. sigreturn (didn't know it was in HPUX) switches context (like longjmp) after reveiving a signal.

So, what signal triggered the problem... did you check syslog?
# 5  
Old 08-10-2006
no signal in syslog
No signal in syslog. Is there any command to see which job is taking up more virtual memory? If we can know the application using the resources, we can atleast ask for a rescheduling of the job.

Regards,
Ranjith
# 6  
Old 08-10-2006
The lsp_engine - looks like a virtual machine - is the one with the problem. If the virtual memory problem started with running this app, you don't need to worry about who/what is using memory. Try to run the app as close to solo as possible.

I have not done sysadmin for long time - maybe somebody like Perderabo can give you tuning help. What I see is that you have a lot of free pagefile space.

It may also be that you will have to reconfigure the app, if that is possible.
# 7  
Old 08-11-2006
Are you anywhere further along on solving this problem?
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Java stack trace parser in awk

I want the developers to get a mail with Java stack traces on a daily bases. When something is flaged as known issue and will get a fix but mean while this does not need to get sent each dayl. This is what I got so far. It's a bash script that runs some AWK in it. To get the files that needs to... (6 Replies)
Discussion started by: chipmunken
6 Replies

2. Linux

Server hung, is this a stack trace?

Hi everyone, Our Red Hat server hung yesterday, and I managed to log into the console and see the following message: RIP: 0010: mwait_idle_with_hints+0x66/ 0x67 RSP: 0018:ffffffff80457f40 EFLAGS: 00000046 RAX: 0000000000000010 RBX: ffff810c20075910 RCX: 0000000000000001 RDX:... (6 Replies)
Discussion started by: badoshi
6 Replies

3. Programming

View Stack Trace of different cores

I have a C program which is running as daemon and has some threads. The program is running on dual core cpu and it may happen that different threads may run on different cpu core. The problem is sometimes it crashes with some heap memory corruption probably between threads. GDB command(t a a... (2 Replies)
Discussion started by: rupeshkp728
2 Replies

4. Shell Programming and Scripting

Stack Trace

Hi All Thought it would be kind of fun to implement a stack trace for a shell script that calls functions within a sub shell. This is for bash under Linux and probably not portable - #! /bin/bash error_exit() { echo "=======================" echo $1 echo... (4 Replies)
Discussion started by: steadyonabix
4 Replies

5. AIX

How to get the stack trace using kdb?

Hi All, I am trying to debug my core file using kdb. When I try to get the stack trace I am facing this error. core mapped from @ 700000000000000 to @ 70000000306fc04 Preserving 1680415 bytes of symbol table Dump does not start with valid magic number WARNING: Possibly truncated or... (2 Replies)
Discussion started by: Sachin1987
2 Replies

6. Solaris

Need to retrieve stack trace from core using mdb

Hello , I use Solaris 5.10 . I have huge core file , 48 GB , resulted from an application that was running and got crashed with SIGSEGV. On my system only mdb works. Please help me to retrieve the stack trace from this core file. I am novice to mdb and its nuaunces. Please help me with... (2 Replies)
Discussion started by: rmv
2 Replies

7. Filesystems, Disks and Memory

get stack trace from C program on Solaris 8

I'm on solaris 8. I need to check the stack trace inside my C program. I don't have printstack or walkstack. I tested getcontext and it works. But how do I get the symbols from "stack_t" ? Help please. Many thanks! (4 Replies)
Discussion started by: rydahl
4 Replies

8. Shell Programming and Scripting

Need to capture ERROR msg and stack trace

Hi all, I was hoping someone can point me in the right direction. I'm trying to filter out errors from a web log- any lines with ERROR in it. I know I could simply use the grep command to do this. However, there are times when a stack trace follows the error line. I would like to capture these... (2 Replies)
Discussion started by: gswhoops
2 Replies

9. Programming

printing a stack trace with backtrace

I am trying to print a stack trace programatically using backtrace and backtrace_symbols. The problem is that the stack being printed in a mangled format. Is there a way to get the output in more of a human readable form? I am using Red Hat and the program is written in c++. (2 Replies)
Discussion started by: dmirza
2 Replies

10. Programming

Core file without a readable stack trace

I am using gdb to examine a core file but the output contains only the method addresses in hex. Is there anyway to translate these addresses to a human-readable form? :confused: (0 Replies)
Discussion started by: ciregbu
0 Replies
Login or Register to Ask a Question