Login or Register to Ask a Question and Join Our Community


Linux

Server hung, is this a stack trace?

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Operating Systems Linux Server hung, is this a stack trace?
# 1  
Old 01-28-2014
Server hung, is this a stack trace?
Hi everyone,

Our Red Hat server hung yesterday, and I managed to log into the console and see the following message:

Code:
RIP: 0010:[<ffffffff8006b981>]  [<ffffffff8006b981>] mwait_idle_with_hints+0x66/
0x67
RSP: 0018:ffffffff80457f40  EFLAGS: 00000046
RAX: 0000000000000010 RBX: ffff810c20075910 RCX: 0000000000000001
RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000010
RBP: 134d6ef57a8e3fe8 R08: 0000000000000033 R09: 0000000000000033
R10: ffff810001005710 R11: ffffffff8014c2c9 R12: 0000000000000000
R13: ffff810c20075800 R14: 0000000000000000 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffffffff80425000(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 00000000f7fb6980 CR3: 0000000c016ba000 CR4: 00000000000006e0
Process swapper (pid: 0, threadinfo ffffffff80456000, task ffffffff80310b60)
Stack:  ffffffff801a1337 0000000000000000 000000000000039c 0000000000000000
 000000000000039c 0000000000000000 ffffffff801a11e1 0000000000090000
 0000000000000000 0000000000000000 ffffffff800492fd 0000000000200800
Call Trace:
 [<ffffffff801a1337>] acpi_processor_idle_simple+0x156/0x316
 [<ffffffff801a11e1>] acpi_processor_idle_simple+0x0/0x316
 [<ffffffff800492fd>] cpu_idle+0x95/0xb8
 [<ffffffff80461807>] start_kernel+0x220/0x225
 [<ffffffff8046122f>] _sinittext+0x22f/0x236


Code: c3 41 57 41 56 49 89 f6 41 55 49 89 fd 41 54 4c 8d a7 e0 02

I had to reset the server, as I couldnt ping, or get a prompt, and the above is pretty much all we have to go on. I can't find anything meaningful in /var/log/messages or dmesg. Any ideas what the above output is, or what it indicates?

Many thanks.
# 2  
Old 01-28-2014
It is a crash inside the kernel. Kernel errors can't be saved to any log files, because the kernel's help is needed to save files.

I don't see anything useful in the error unfortunately. It looks like it happened while the CPU was idle.
# 3  
Old 01-29-2014
Thanks Corona,

This is the second time this has occured. The first time HP ASR reset the server, we then disabled ASR hoping that next time around we would be able to get some meaningful messages before resetting the server.

I don' think there's much we can do besides a total blind firmware/patch update (which won't happen!).
# 4  
Old 01-29-2014
Or kernel upgrade?
# 5  
Old 03-24-2014
I am experienced the same issue at the moment. Did you resolve this problem? and what was the fix?
# 6  
Old 03-25-2014
We didn't resolve it really. A kernel upgrade didn't help. Red Hat & HP couldn't tell us what was wrong. So we swapped out all the internals with another spare development server we had (kept the internal disks the same) - since then it has functioned ok.

I can only guess that reseating a bit of hardware resolved the issue.
# 7  
Old 03-28-2014
Hello, we have some type of issue for HP server.
Can you said which model do you use?
We have issue with HP DL360p G8. Thank you.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Java stack trace parser in awk

I want the developers to get a mail with Java stack traces on a daily bases. When something is flaged as known issue and will get a fix but mean while this does not need to get sent each dayl. This is what I got so far. It's a bash script that runs some AWK in it. To get the files that needs to... (6 Replies)
Discussion started by: chipmunken
6 Replies

2. Programming

View Stack Trace of different cores

I have a C program which is running as daemon and has some threads. The program is running on dual core cpu and it may happen that different threads may run on different cpu core. The problem is sometimes it crashes with some heap memory corruption probably between threads. GDB command(t a a... (2 Replies)
Discussion started by: rupeshkp728
2 Replies

3. UNIX for Dummies Questions & Answers

View User Mode Call Stack of Hung Process

I have a multithreaded usermode program(actually a daemon) which is in hanged state. To debug it I tried attaching the process to gdb, but the gdb hangs. gstack also gets hanged. I peeped into the proc file system and saw the process to be in sleeping state. /proc/sysrq-trigger I guess... (1 Reply)
Discussion started by: rupeshkp728
1 Replies

4. Shell Programming and Scripting

Stack Trace

Hi All Thought it would be kind of fun to implement a stack trace for a shell script that calls functions within a sub shell. This is for bash under Linux and probably not portable - #! /bin/bash error_exit() { echo "=======================" echo $1 echo... (4 Replies)
Discussion started by: steadyonabix
4 Replies

5. AIX

How to get the stack trace using kdb?

Hi All, I am trying to debug my core file using kdb. When I try to get the stack trace I am facing this error. core mapped from @ 700000000000000 to @ 70000000306fc04 Preserving 1680415 bytes of symbol table Dump does not start with valid magic number WARNING: Possibly truncated or... (2 Replies)
Discussion started by: Sachin1987
2 Replies

6. Solaris

Need to retrieve stack trace from core using mdb

Hello , I use Solaris 5.10 . I have huge core file , 48 GB , resulted from an application that was running and got crashed with SIGSEGV. On my system only mdb works. Please help me to retrieve the stack trace from this core file. I am novice to mdb and its nuaunces. Please help me with... (2 Replies)
Discussion started by: rmv
2 Replies

7. Filesystems, Disks and Memory

get stack trace from C program on Solaris 8

I'm on solaris 8. I need to check the stack trace inside my C program. I don't have printstack or walkstack. I tested getcontext and it works. But how do I get the symbols from "stack_t" ? Help please. Many thanks! (4 Replies)
Discussion started by: rydahl
4 Replies

8. UNIX for Advanced & Expert Users

help required - stack trace

Hi all, One of our programs written in Java, produced this logfile. This job runs 48 threads and only one thread failed with this error. The code is a blackbox(external product), so cant look at the source code. From what I can infer from the log, the job was trying to write the log messages into... (9 Replies)
Discussion started by: ranj@chn
9 Replies

9. Programming

printing a stack trace with backtrace

I am trying to print a stack trace programatically using backtrace and backtrace_symbols. The problem is that the stack being printed in a mangled format. Is there a way to get the output in more of a human readable form? I am using Red Hat and the program is written in c++. (2 Replies)
Discussion started by: dmirza
2 Replies

10. Programming

Core file without a readable stack trace

I am using gdb to examine a core file but the output contains only the method addresses in hex. Is there anyway to translate these addresses to a human-readable form? :confused: (0 Replies)
Discussion started by: ciregbu
0 Replies
Login or Register to Ask a Question