HP-UX

Hi all..

I need some comments or advices about my HP-UX 11.11 performance.
It runs Oracle, some apps and weblogic.

For several times in a day, it's performance drops poorly (approx for minutes until an hour).
I tried to find articles about unix, oracle and weblogic tuning, which leads me to some informations :

1. Some Unix Kernel configuration (max_thread_proc, maxfiles, maxusers) needs to be set larger than the default configurations (I will reconfigure this soon)

2. My kernel configuration : lotsfree, desfree, minfree sets to 0 (zero)
I found some article which told to set it, according to my memory size. Anyone tried this before? did it give you a good result?

3. I ran vmstat for about 10 minutes (@1 sec), which gave me this results :
- SR : 20% return large page scan rate (avr. 9k, max 60k) and 80% return below 200 pages (most articles say this is not good, needs more RAM)
- RE : 20% return large reclaims (arg 800, max 4k) and 80% return below 10 pages
- R : 4% return more than my CPUs count (avr 10, during large SR) and 96% return below my CPUs count
- W : 5% return avr 15 pages, and 95% return almost none
- and PI also increase while RE increase

I need some comments or advices about 3 points above,
and, is it just configuration problem (tuning problem only) or I 'extremly' need more RAM?


(I'm kinda new at this, need much advices and guidances)
Thank you for your time, comments and advices.

We need to know a bit more..
What is the output of sysdef, how much RAM and what kind of disks are attached, what is the output of swapinfo -tam,

What is the size of the SGA

>output of sysdef
NAME VALUE
acctresume 4
acctsuspend 2
allocate_fs_swapmap 0
bufpages 416197
create_fastlinks 0
dbc_max_pct 50
dbc_min_pct 5
default_disk_ir 0
dskless_node 0
eisa_io_estimate 768
eqmemsize 46
file_pad 10
fs_async 0
hpux_aes_override 0
maxdsiz 262144
maxdsiz_64bit 524288
maxfiles 60
maxfiles_lim 1024
maxssiz 32768
maxssiz_64bit 262144
maxswapchunks 16384
maxtsiz 16384
maxtsiz_64bit 262144
maxuprc 3686
maxvgs 10
msgmap 4095
nbuf 673506
ncallout 7200
ncdnode 150
ndilbuffers 30
netisr_priority -1
netmemmax 0
nfile 63890
nflocks 4096
ninode 35016
no_lvm_disks 0
nproc 4096
npty 60
nstrpty 60
nswapdev 10
nswapfs 10
public_shlibs 1
remote_nfs_swap 0
rtsched_numpri 32
sema 0
semmap 4095
shmem 0
shmmni 1024
streampipes 0
swapmem_on 1
swchunk 2048
timeslice 10
unlockable_mem 16584

>how much RAM
8 Gb

>what kind of disks are attached
SCSI with fiber cable

>what is the output of swapinfo -tam,

(during performance ok)
TYPE AVAIL USED FREE USED LIMIT RESERVE PRI
dev 12000 1012 10988 8% 0 - 1
reserve - 5081 -5081
memory 6285 1906 4379 30%
total 18285 7999 10286 44% - 0 -
(do I need to check it again during bad performance?)

>What is the size of the SGA
Fixed Size 740,232
Variable Size 738,197,504
Database Buffers 1,610,612,736
Redo Buffers 1,323,008
Total (SGA) 2,350,873,480


Thanks.

also, I notice that when the performance starts to slowdown,
the FREE in vmstat also drop below 10Mb (below 10,000 in vmstat display), which in other conditions, the value various between 40-230Mb.

the FREE also increase while SR, RE and IN increase.
any comments or advices? thanks.

before I give you my 2 cents, what kind of disk subsystem, dual path? size of volume group (approx... (idea of db size..) how many processors (2-4?) and have you some spare space on subsystem...

Forgot: in /etc/fstab how are mounted your FS (especially data) are they all vxfs?

Have you notices the slowdown when running batches (vs oltp... e.g. is it when big jobs are running, compared to many users doing queries...)

all FS mounted with vxfs

I'm not quite sure with the meaning of disk subsystem or volume group, but perhaps, this information can give you a clue (bdf command) :
Mount kbytes perc-used
/ 1,048Mb 11%
/tmp 4,096Mb 19%
/home 24,576Mb 86%
/data 425,984Mb 46%

total DB size around 100Gb (currently allocated 110Gb)

3 procs

yes, the last thing I need to check is the users session resource usage (no idea yet), but as far as I know, there is no background job running on the server during daytime.

also, some site recommended to see the x$ksmsp (related to SGA), but they dont
explain how to read them, can you give me some information? (I want to know is my current SGA size is oversize than what we need)

select sum(ksmchsiz) Bytes, ksmchcls Status
from x$ksmsp
group by ksmchcls;

R-free 132,864,168
R-freea 138,840
free 2,079,208
freeabl 308,242,376
perm 74,995,696
recr 85,657,184


Thank you very much.

the reason I started to look at the SGA, is because from the 'top command', I see some of processes are used by Oracle, which each one take 2,391Mb.
although most of it are sleeping (%CPU and %WCPU below 1%), I'm guessing that take lots of server resources too.