Server hung, is this a stack trace?


Login or Register for Dates, Times and to Reply

 
Thread Tools Search this Thread
# 1  
Server hung, is this a stack trace?

Hi everyone,

Our Red Hat server hung yesterday, and I managed to log into the console and see the following message:

Code:
RIP: 0010:[<ffffffff8006b981>]  [<ffffffff8006b981>] mwait_idle_with_hints+0x66/
0x67
RSP: 0018:ffffffff80457f40  EFLAGS: 00000046
RAX: 0000000000000010 RBX: ffff810c20075910 RCX: 0000000000000001
RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000010
RBP: 134d6ef57a8e3fe8 R08: 0000000000000033 R09: 0000000000000033
R10: ffff810001005710 R11: ffffffff8014c2c9 R12: 0000000000000000
R13: ffff810c20075800 R14: 0000000000000000 R15: 0000000000000000
FS:  0000000000000000(0000) GS:ffffffff80425000(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 00000000f7fb6980 CR3: 0000000c016ba000 CR4: 00000000000006e0
Process swapper (pid: 0, threadinfo ffffffff80456000, task ffffffff80310b60)
Stack:  ffffffff801a1337 0000000000000000 000000000000039c 0000000000000000
 000000000000039c 0000000000000000 ffffffff801a11e1 0000000000090000
 0000000000000000 0000000000000000 ffffffff800492fd 0000000000200800
Call Trace:
 [<ffffffff801a1337>] acpi_processor_idle_simple+0x156/0x316
 [<ffffffff801a11e1>] acpi_processor_idle_simple+0x0/0x316
 [<ffffffff800492fd>] cpu_idle+0x95/0xb8
 [<ffffffff80461807>] start_kernel+0x220/0x225
 [<ffffffff8046122f>] _sinittext+0x22f/0x236


Code: c3 41 57 41 56 49 89 f6 41 55 49 89 fd 41 54 4c 8d a7 e0 02

I had to reset the server, as I couldnt ping, or get a prompt, and the above is pretty much all we have to go on. I can't find anything meaningful in /var/log/messages or dmesg. Any ideas what the above output is, or what it indicates?

Many thanks.
# 2  
It is a crash inside the kernel. Kernel errors can't be saved to any log files, because the kernel's help is needed to save files.

I don't see anything useful in the error unfortunately. It looks like it happened while the CPU was idle.
# 3  
Thanks Corona,

This is the second time this has occured. The first time HP ASR reset the server, we then disabled ASR hoping that next time around we would be able to get some meaningful messages before resetting the server.

I don' think there's much we can do besides a total blind firmware/patch update (which won't happen!).
# 4  
Or kernel upgrade?
# 5  
I am experienced the same issue at the moment. Did you resolve this problem? and what was the fix?
# 6  
We didn't resolve it really. A kernel upgrade didn't help. Red Hat & HP couldn't tell us what was wrong. So we swapped out all the internals with another spare development server we had (kept the internal disks the same) - since then it has functioned ok.

I can only guess that reseating a bit of hardware resolved the issue.
# 7  
Hello, we have some type of issue for HP server.
Can you said which model do you use?
We have issue with HP DL360p G8. Thank you.
Login or Register for Dates, Times and to Reply

Previous Thread | Next Thread
Thread Tools Search this Thread
Search this Thread:
Advanced Search

Test Your Knowledge in Computers #675
Difficulty: Easy
Wi-Fi is generally less vulnerable to hacker attacks than wired networks.
True or False?

10 More Discussions You Might Find Interesting

1. Programming

View Stack Trace of different cores

I have a C program which is running as daemon and has some threads. The program is running on dual core cpu and it may happen that different threads may run on different cpu core. The problem is sometimes it crashes with some heap memory corruption probably between threads. GDB command(t a a... (2 Replies)
Discussion started by: rupeshkp728
2 Replies

2. UNIX for Dummies Questions & Answers

View User Mode Call Stack of Hung Process

I have a multithreaded usermode program(actually a daemon) which is in hanged state. To debug it I tried attaching the process to gdb, but the gdb hangs. gstack also gets hanged. I peeped into the proc file system and saw the process to be in sleeping state. /proc/sysrq-trigger I guess... (1 Reply)
Discussion started by: rupeshkp728
1 Replies

3. Shell Programming and Scripting

Stack Trace

Hi All Thought it would be kind of fun to implement a stack trace for a shell script that calls functions within a sub shell. This is for bash under Linux and probably not portable - #! /bin/bash error_exit() { echo "=======================" echo $1 echo... (4 Replies)
Discussion started by: steadyonabix
4 Replies

4. AIX

How to get the stack trace using kdb?

Hi All, I am trying to debug my core file using kdb. When I try to get the stack trace I am facing this error. core mapped from @ 700000000000000 to @ 70000000306fc04 Preserving 1680415 bytes of symbol table Dump does not start with valid magic number WARNING: Possibly truncated or... (2 Replies)
Discussion started by: Sachin1987
2 Replies

5. Solaris

Need to retrieve stack trace from core using mdb

Hello , I use Solaris 5.10 . I have huge core file , 48 GB , resulted from an application that was running and got crashed with SIGSEGV. On my system only mdb works. Please help me to retrieve the stack trace from this core file. I am novice to mdb and its nuaunces. Please help me with... (2 Replies)
Discussion started by: rmv
2 Replies

6. Filesystems, Disks and Memory

get stack trace from C program on Solaris 8

I'm on solaris 8. I need to check the stack trace inside my C program. I don't have printstack or walkstack. I tested getcontext and it works. But how do I get the symbols from "stack_t" ? Help please. Many thanks! (4 Replies)
Discussion started by: rydahl
4 Replies

7. UNIX for Advanced & Expert Users

help required - stack trace

Hi all, One of our programs written in Java, produced this logfile. This job runs 48 threads and only one thread failed with this error. The code is a blackbox(external product), so cant look at the source code. From what I can infer from the log, the job was trying to write the log messages into... (9 Replies)
Discussion started by: ranj@chn
9 Replies

8. Shell Programming and Scripting

Need to capture ERROR msg and stack trace

Hi all, I was hoping someone can point me in the right direction. Iím trying to filter out errors from a web log- any lines with ERROR in it. I know I could simply use the grep command to do this. However, there are times when a stack trace follows the error line. I would like to capture these... (2 Replies)
Discussion started by: gswhoops
2 Replies

9. Programming

printing a stack trace with backtrace

I am trying to print a stack trace programatically using backtrace and backtrace_symbols. The problem is that the stack being printed in a mangled format. Is there a way to get the output in more of a human readable form? I am using Red Hat and the program is written in c++. (2 Replies)
Discussion started by: dmirza
2 Replies

10. Programming

Core file without a readable stack trace

I am using gdb to examine a core file but the output contains only the method addresses in hex. Is there anyway to translate these addresses to a human-readable form? :confused: (0 Replies)
Discussion started by: ciregbu
0 Replies

Featured Tech Videos