Odd output from sar


 
Thread Tools Search this Thread
Operating Systems Solaris Odd output from sar
# 1  
Old 03-09-2016
Odd output from sar

We're experiencing some intermittent freezes on one of our systems and I'm trying to figure out what is happening.

We're running Solaris 10 zones mounting shares from netapp through nfs.

On the zone that freezes we have sar running and are getting this output:
Code:
SunOS prodserver 5.10 Generic_150400-28 sun4v    03/02/2016 

00:00:00    %usr    %sys    %wio   %idle
.
.
11:00:00      74     111       0 14358111 
11:05:00 14309820 14309781       0     258 
11:10:00 14309386      45       0      72 
11:15:00 14310243 14310270       0     298 
11:20:00     124      51       0 14310758 
11:25:00 14310323 14310331       0     158 
11:30:01 14307924 14307901       0     221 
11:35:00      88     131       0 14358557 
11:40:00      57      82       0 14310318 
11:45:00 14311278 14311269       0     172 
11:50:00      16      12       0      72 
11:55:00 14311277 14311307       0     136 
12:00:00 14310775 14310732       0     259 
12:05:01      60     103       0 14310771 
12:10:00      29      24       0      47 
12:20:00 7156722 7156698       0     135 
12:30:00 7156676 7156668       0     211 
12:40:00      51      59       0 7156837 
12:45:00       0       1       0      99 
12:55:00      49       7       0      44 
13:00:01 14310829 14310830       0     108 
13:05:00 14357716 14357626       0     190 
13:14:58        unix restarts 
13:15:01       3       4       0      93 
13:20:00     796     166       0 14326680 
13:25:01      17      24       0      59 
13:30:00     191      73       0 14357553 
13:35:00     464     196       0 14308366 
13:40:00       2     112       0 14309866 
13:45:00     226     140       0 14309613 
13:50:00     148      64       0 14307384 
13:55:01     259     109       0 14301035 
14:00:00     655     149       0 14357012 
14:05:00 14318914    2014       0 14317060 
14:10:00 14309840 14309838       0     182 
14:15:00 14309174 14309345       0     388 
14:20:00      80      89       0 14308857

Other measurements (eg output from sar -b, sar -c etc) have equally confusing output. What could make sar (or the system) behave like that?

Regards,
Johnny
# 2  
Old 03-09-2016
Indeed this looks totally wrong.
Do
Code:
vmstat 2

and
Code:
iostat -c 2

work okay?
# 3  
Old 03-09-2016
I don't have vmstat and iostat numbers from that time, but the numbers look ok under normal circumstances, ie right now.

Code:
[root@prodserver:~#] vmstat 2
 kthr      memory            page            disk          faults      cpu
 r b w   swap  free  re  mf pi po fr de sr s0 s1 s2 s3   in   sy   cs us sy id
 0 0 0 132095168 241478304 6305 4342 62642 306 301 0 0 0 0 0 6 79352 224337 105252 5 7 88
 0 0 0 266356432 316341632 328 1761 1297 83 83 0 0 0 0 0 6 50602 32976 73253 1 7 92
 1 0 0 263443464 316242568 1022 1455 4593 123 123 0 0 0 0 0 0 43347 33390 59850 1 6 93
 0 0 0 265199128 316344504 942 1561 7398 44 44 0 0 0 0 0 0 44916 63133 59712 5 6 88
 2 0 0 266923856 316343648 467 1886 2092 60 60 0 0 0 0 0 0 53969 237009 77853 6 6 88
 0 0 0 265827728 316345648 762 1568 7625 91 91 0 0 0 0 0 0 51928 37435 71132 2 6 93
 0 0 0 267011904 316345440 647 1379 6349 44 44 0 0 0 0 0 0 46160 32081 62314 1 5 93
 1 0 0 265034464 316202680 474 1580 1544 60 60 0 0 0 0 0 0 46281 27523 66755 1 7 92

Code:
[root@prodserver:~#] iostat -c 2
     cpu
 us sy wt id
  5  7  0 88
  2  6  0 92
  2  7  0 91
  2  5  0 93
  1  6  0 93

But then again, so does sar:
Code:
[root@prodserver:~#] sar 

SunOS prodserver 5.10 Generic_150400-28 sun4v    03/09/2016 

00:00:00    %usr    %sys    %wio   %idle
.
.
11:00:01       4       6       0      90 
11:05:00       4       6       0      91 
11:10:00       4       6       0      90 
11:15:00       3       6       0      90 
11:20:00       3       6       0      91 
11:25:00       4       6       0      91 
11:30:01       3       6       0      91 
11:35:00       4       6       0      90 
11:40:00       4       6       0      91 
11:45:00       4       6       0      91 
11:50:00       5       5       0      90 
11:55:00       3       6       0      91 
12:00:00       4       6       0      91

# 4  
Old 03-09-2016
Hmm, maybe you should run all three commands simultaneously, until the fault occurs.
If it occurs with only sar, then look for a sar patch (SUNWaccu) or file a bug with Oracle support.
Otherwise, look for a kstat patch or kernel patch.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Red Hat

Sar output

I am facing situation where sar -u command is showing 0 for all cps, so does it mean all the cpus are fully utilized, os is oracle Linux 6.8 01:34:13 PM all 0 0 0 0 0.00 0 (2 Replies)
Discussion started by: manoj.solaris
2 Replies

2. Solaris

sar output

One of my servers giving all zero sar output. Could anyone explain this behaviour. Thanks CHaandana Sample: 10:43:37 %usr %sys %wio %idle 16:15:01 2 1 0 97 16:20:02 2 1 0 97 16:25:02 2 1 0 97 16:30:01 ... (3 Replies)
Discussion started by: chaandana
3 Replies

3. UNIX for Advanced & Expert Users

sar -d output... does not make sense

Can someone explain the correlation between how sar names the disk drives and how the rest of the OS names the disk drives? sar lists my disk drives as sd0, sd1, sd2, etc..... while format lists my disk drives as c1t0d0, c1t1d0, c1t2d0,etc... And also why sar shows 8 disks but format... (2 Replies)
Discussion started by: s ladd
2 Replies

4. Solaris

Strange sar output

I was reviewing yesterday's sar file and came across this strange output! What in the world? Any reason why there's output like that? SunOS unixbox 5.10 Generic_144488-07 sun4v sparc SUNW,T5240 Solaris 00:00:58 device %busy avque r+w/s blks/s avwait avserv 11:20:01 ... (4 Replies)
Discussion started by: dangral
4 Replies

5. Solaris

extraction of sar output

Hi, Anyone knows how to extract sar command output to excel or Is there any free grapical tools to extract this sar log file. thanks, regards (2 Replies)
Discussion started by: vijill
2 Replies

6. Shell Programming and Scripting

Formatting Sar Output script

Hi, We have 2 scripts below for reporting sar output which are pretty same. In first script i want to add to the program whatever is given in the comments. In second script I want to use while true to run this program every hour and everything that is in comment. Finally I want to club... (0 Replies)
Discussion started by: noorm
0 Replies

7. Shell Programming and Scripting

sar today's output

Hi All, i tried sar command the output appears to be for several days I would like to just see today's SAR output: Please advice me. $sar Linux 2.6.9-67.ELsmp (lrtp50) 02/28/09 00:00:01 CPU %user %nice %system %iowait %idle 00:05:02 all 3.10... (4 Replies)
Discussion started by: raghur77
4 Replies

8. Shell Programming and Scripting

ksh - odd output from for command...

Help needed - I am sure there is something to do with tabs or white space that is killing me here.. I have a file that is generated from an oracle sql script - when I cat the file I see the below 601888725 14-AUG-08-10:20 3 601888726 14-AUG-08-10:37 ... (4 Replies)
Discussion started by: frustrated1
4 Replies

9. HP-UX

sar output gives 98% idle CPU

Dear All, Our HPUX 8 GB 8CPU database server is behaving abnormally for the last 4+ weeks. I have generated a sar output and it is here- 11:46:52 %usr %sys %wio %idle 11:46:53 1 1 6 92 11:46:54 0 1 0 99 11:46:55 0 1 0... (3 Replies)
Discussion started by: Ashrunil
3 Replies

10. Shell Programming and Scripting

sar -q output for one processor

Hello, We like to know if there is a way to report the sar -q per processor on AIX 4.3 . Please help RGDS,Elie. (1 Reply)
Discussion started by: eyounes
1 Replies
Login or Register to Ask a Question