Sponsored Content
Full Discussion: Wait process holding CPU
Operating Systems AIX Wait process holding CPU Post 302772675 by gopeezere on Tuesday 26th of February 2013 12:03:21 PM
Old 02-26-2013
Wait process holding CPU

Hi Bakumin,

Thanks for your reply. Let me explain the issue with me right now. The server is completely empty, but still any application i start like WAS 'or' enterprise application is very slow like takes hours together. Even putty login takes like few minutes to login. So we analyzed and found only this wait process looked like bottlenect. But i m not sure, this being kernel process, i m not able to kill them.

Here i post the required details, please do review and let me know if you can find any reason for the server behaviour.



Code:
[srvbd1]root]/]>proctree 8196
[srvbd1]root]/]>        kill -15 8196
kill: 8196: 0403-003 The specified process does not exist.
[srvbd1]root]/]>ps -fk | grep wait
    root   8196      0   0   Feb 20      - 4479:28 wait
    root  53274      0   0   Feb 20      - 4208:33 wait
    root  57372      0   0   Feb 20      - 4466:54 wait
    root  61470      0   0   Feb 20      - 4201:55 wait
[srvbd1]root]/]>vmstat -v
              2035712 memory pages
              1957145 lruable pages
              1052819 free pages
                    1 memory pools
               384893 pinned pages
                 80.0 maxpin percentage
                 20.0 minperm percentage
                 80.0 maxperm percentage
                 13.3 numperm percentage
               260427 file pages
                  0.0 compressed percentage
                    0 compressed pages
                 13.2 numclient percentage
                 80.0 maxclient percentage
               260187 client pages
                    0 remote pageouts scheduled
                    0 pending disk I/Os blocked with no pbuf
                    0 paging space I/Os blocked with no psbuf
                 2228 filesystem I/Os blocked with no fsbuf
                 1019 client filesystem I/Os blocked with no fsbuf
                    0 external pager filesystem I/Os blocked with no fsbuf
                    0 Virtualized Partition Memory Page Faults
                 0.00 Time resolving virtualized partition memory page faults
[srvbd1]root]/]>vmstat -tw 1

System configuration: lcpu=4 mem=7952MB

 kthr          memory                         page                       faults           cpu       time
------- --------------------- ------------------------------------ ------------------ ----------- --------
  r   b        avm        fre    re    pi    po    fr     sr    cy    in     sy    cs us sy id wa hr mi se
  0   0     702600    1052811     0     0     0     0      0     0     2   6268  7339  0  1 99  0 11:52:31
  0   0     702602    1052809     0     0     0     0      0     0     4   5902  7045  0  1 99  0 11:52:32
  0   0     702602    1052809     0     0     0     0      0     0     5   5991  6883  0  1 99  0 11:52:33
  0   0     702602    1052809     0     0     0     0      0     0     4   5913  6100  0  1 99  0 11:52:34
[srvbd1]root]/]>
[srvbd1]root]/]>
[srvbd1]root]/]>svmon -G
               size      inuse       free        pin    virtual
memory      2035712     982932    1052780     384894     702631
pg space    2097152       2404

               work       pers       clnt      other
pin          314839          0          0      70055
in use       702631        240     280061

PageSize   PoolSize      inuse       pgsp        pin    virtual
s   4 KB          -     935236       2404     361214     654935
m  64 KB          -       2981          0       1480       2981
[srvbd1]root]/]>iostat 5

System configuration: lcpu=4 drives=3 paths=2 vdisks=0

tty:      tin         tout    avg-cpu: % user % sys % idle % iowait
          0.0         11.6                0.3   0.7   98.9      0.2

Disks:        % tm_act     Kbps      tps    Kb_read   Kb_wrtn
hdisk0           2.0       3.2       0.4          0        16
hdisk1           2.0       6.4       0.8          0        32
cd0              0.0       0.0       0.0          0         0

tty:      tin         tout    avg-cpu: % user % sys % idle % iowait
          0.0         77.6                0.3   1.5   97.9      0.3

Disks:        % tm_act     Kbps      tps    Kb_read   Kb_wrtn
hdisk0           0.2      11.0       2.4          0        56
hdisk1           0.2       7.9       1.2          0        40
cd0              0.0       0.0       0.0          0         0
[srvbd1]root]/]>
[srvbd1]root]/]>no -a
                 arpqsize = 12
               arpt_killc = 20
              arptab_bsiz = 7
                arptab_nb = 149
                bcastping = 0
      clean_partial_conns = 1
                 delayack = 0
            delayackports = {}
         dgd_packets_lost = 3
            dgd_ping_time = 5
           dgd_retry_time = 5
       directed_broadcast = 0
         extendednetstats = 0
                 fasttimo = 200
        icmp6_errmsg_rate = 10
          icmpaddressmask = 0
ie5_old_multicast_mapping = 0
                   ifsize = 256
          inet_stack_size = 16
               ip6_defttl = 64
                ip6_prune = 1
            ip6forwarding = 0
       ip6srcrouteforward = 1
       ip_ifdelete_notify = 0
                 ip_nfrag = 200
             ipforwarding = 0
                ipfragttl = 2
        ipignoreredirects = 0
                ipqmaxlen = 100
          ipsendredirects = 1
        ipsrcrouteforward = 1
           ipsrcrouterecv = 0
           ipsrcroutesend = 1
          llsleep_timeout = 3
                  lo_perf = 1
                lowthresh = 90
                 main_if6 = 0
               main_site6 = 0
                 maxnip6q = 20
                   maxttl = 255
                medthresh = 95
               mpr_policy = 1
              multi_homed = 1
                nbc_limit = 1017856
            nbc_max_cache = 131072
            nbc_min_cache = 1
         nbc_ofile_hashsz = 12841
                 nbc_pseg = 0
           nbc_pseg_limit = 2035712
           ndd_event_name = {all}
        ndd_event_tracing = 0
            ndp_mmaxtries = 3
            ndp_umaxtries = 3
                 ndpqsize = 50
                ndpt_down = 3
                ndpt_keep = 120
               ndpt_probe = 5
           ndpt_reachable = 30
             ndpt_retrans = 1
             net_buf_size = {all}
             net_buf_type = {all}
        net_malloc_police = 0
           nonlocsrcroute = 0
                 nstrpush = 8
              passive_dgd = 0
         pmtu_default_age = 10
              pmtu_expire = 10
 pmtu_rediscover_interval = 30
              psebufcalls = 20
                 psecache = 1
             pseintrstack = 24576
                psetimers = 20
           rfc1122addrchk = 0
                  rfc1323 = 1
                  rfc2414 = 1
             route_expire = 1
          routerevalidate = 0
                 rto_high = 64
               rto_length = 13
                rto_limit = 7
                  rto_low = 1
                     sack = 0
                   sb_max = 1048576
       send_file_duration = 300
              site6_index = 0
               sockthresh = 85
                  sodebug = 0
              sodebug_env = 0
                somaxconn = 1024
                 strctlsz = 1024
                 strmsgsz = 0
                strthresh = 85
               strturncnt = 15
          subnetsarelocal = 1
       tcp_bad_port_limit = 0
                  tcp_ecn = 0
       tcp_ephemeral_high = 65535
        tcp_ephemeral_low = 32768
             tcp_finwait2 = 1200
           tcp_icmpsecure = 0
          tcp_init_window = 0
    tcp_inpcb_hashtab_siz = 24499
              tcp_keepcnt = 8
             tcp_keepidle = 14400
             tcp_keepinit = 150
            tcp_keepintvl = 150
     tcp_limited_transmit = 1
              tcp_low_rto = 0
             tcp_maxburst = 0
              tcp_mssdflt = 1460
          tcp_nagle_limit = 65535
        tcp_nagleoverride = 0
               tcp_ndebug = 100
              tcp_newreno = 1
           tcp_nodelayack = 0
        tcp_pmtu_discover = 1
            tcp_recvspace = 16384
            tcp_sendspace = 262144
            tcp_tcpsecure = 0
             tcp_timewait = 1
                  tcp_ttl = 60
           tcprexmtthresh = 3
                  thewall = 4071424
         timer_wheel_tick = 0
       udp_bad_port_limit = 0
       udp_ephemeral_high = 65535
        udp_ephemeral_low = 32768
    udp_inpcb_hashtab_siz = 24499
        udp_pmtu_discover = 1
            udp_recvspace = 42080
            udp_sendspace = 9216
                  udp_ttl = 30
                 udpcksum = 1
                 use_isno = 1
           use_sndbufpool = 1
[srvbd1]root]/]>lscfg
INSTALLED RESOURCE LIST

The following resources are installed on the machine.
+/- = Added or deleted from Resource List.
*   = Diagnostic support not available.

  Model Architecture: chrp
  Model Implementation: Multiple Processor, PCI bus

+ sys0                                             System Object
+ sysplanar0                                       System Planar
* vio0                                             Virtual I/O Bus
* vsa0             U789F.001.AAA8080-P1-T3         LPAR Virtual Serial Adapter
* vty0             U789F.001.AAA8080-P1-T3-L0      Asynchronous Terminal
* pci2             U789F.001.AAA8080-P1            PCI Bus
* pci1             U789F.001.AAA8080-P1            PCI Bus
+ fcs0             U789F.001.AAA8080-P1-C13-C1-T1  FC Adapter
* fscsi0           U789F.001.AAA8080-P1-C13-C1-T1  FC SCSI I/O Controller Protocol Device
* fcnet0           U789F.001.AAA8080-P1-C13-C1-T1  Fibre Channel Network Protocol Device
+ fcs1             U789F.001.AAA8080-P1-C13-C1-T2  FC Adapter
* fscsi1           U789F.001.AAA8080-P1-C13-C1-T2  FC SCSI I/O Controller Protocol Device
* fcnet1           U789F.001.AAA8080-P1-C13-C1-T2  Fibre Channel Network Protocol Device
* pci0             U789F.001.AAA8080-P1            PCI Bus
* pci3             U789F.001.AAA8080-P1            PCI Bus
+ ent0             U789F.001.AAA8080-P1-T1         2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902)
+ ent1             U789F.001.AAA8080-P1-T2         2-Port 10/100/1000 Base-TX PCI-X Adapter (14108902)
* pci4             U789F.001.AAA8080-P1            PCI Bus
+ usbhc0           U789F.001.AAA8080-P1            USB Host Controller (33103500)
+ usbhc1           U789F.001.AAA8080-P1            USB Host Controller (33103500)
* pci5             U789F.001.AAA8080-P1            PCI Bus
* ide0             U789F.001.AAA8080-P1-T10        ATA/IDE Controller Device
+ cd0              U789F.001.AAA8080-P1-D3         IDE DVD-RAM Drive
* pci6             U789F.001.AAA8080-P1            PCI Bus
+ sisscsia0        U789F.001.AAA8080-P1            PCI-X Dual Channel Ultra320 SCSI Adapter
+ scsi0            U789F.001.AAA8080-P1-T5         PCI-X Dual Channel Ultra320 SCSI Adapter bus
+ scsi1            U789F.001.AAA8080-P1-T9         PCI-X Dual Channel Ultra320 SCSI Adapter bus
+ hdisk0           U789F.001.AAA8080-P1-T9-L5-L0   16 Bit LVD SCSI Disk Drive (73400 MB)
+ hdisk1           U789F.001.AAA8080-P1-T9-L8-L0   16 Bit LVD SCSI Disk Drive (73400 MB)
+ ses0             U789F.001.AAA8080-P1-T9-L15-L0  SCSI Enclosure Services Device
+ L2cache0                                         L2 Cache
+ mem0                                             Memory
+ proc0                                            Processor
+ proc2                                            Processor
[srvbd1]root]/]>kill -9 8196
kill: 8196: 0403-003 The specified process does not exist.
[srvbd1]root]/]>

 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Process Wait on DG UX

Does anyone know what the equivalent command to pwait on Solaris is on DG/UX. I need my script to kick off a process and wait till it is complete before continuing with the script. (4 Replies)
Discussion started by: fabbas
4 Replies

2. UNIX for Advanced & Expert Users

86% CPU for wait

Hi, is-it normal to have 86% of CPU for wait commande : ps aux| head -20 UTIL PID %CPU %MEM SZ RSS TTY STAT STIME TIME COMMAND root 516 86,6 0,0 12 12 - A 02 nov 2088:03 wait oralfa01 54422 4,6 1,0 68044 39868 - A 09:20:06 2:27 oracleALFA01 If... (3 Replies)
Discussion started by: big123456
3 Replies

3. Shell Programming and Scripting

wait command - cat it wait for not-chile process?

Did not use 'wait' yet. How I understand by now the wait works only for child processes, started background. Is there any other way to watch completion of any, not related process (at least, a process, owned by the same user?) I need to start a background process, witch will be waiting... (2 Replies)
Discussion started by: alex_5161
2 Replies

4. UNIX for Dummies Questions & Answers

how to get persistant cpu utilization values per process per cpu in linux (! top,ps)

hi, i want to know cpu utilizatiion per process per cpu..for single processor also if multicore in linux ..to use these values in shell script to kill processes exceeding cpu utilization.ps (pcpu) command does not give exact values..top does not give persistant values..psstat,vmstat..does njot... (3 Replies)
Discussion started by: pankajd
3 Replies

5. AIX

%wait nmon CPU-UTILISATION

Hi, I collect statistics with nmon. I'm very suprised about % wait of processor. Number Of Processors: 4 Processor Clock Speed: 4204 MHz Do U have an idea about % wait ? │ 0----------25-----------50----------75----------100 ... (1 Reply)
Discussion started by: tagger
1 Replies

6. Shell Programming and Scripting

How to make the parent process to wait for the child process

Hi All, I have two ksh script. 1st script calls the 2nd script and the second script calls an 'C' program. I want 1st script to wait until the 'C' program completes. I cant able to get the process id for the 'C' program (child process) to make the 1st script to wait for the second... (7 Replies)
Discussion started by: sennidurai
7 Replies

7. Solaris

How to check which process is holding up the ilde port

HI All Am on Sun OS.While trying to start a process , we could see that the port is idle and we are not able to find the process holding that port. Below is the result we get after using netstat command. lsof command is not yet installed in our machine. netstat -a | grep "port no"... (5 Replies)
Discussion started by: Whiteboard
5 Replies

8. Solaris

Process holding /tmp space, need to know the process details

Hi , In a server /tmp has almost reached 75% and i can see the File system utilization is 48Mb only , so i believe some process is using the /tmp space. I would like to know which process is using /tmp space. # df -h /tmp Filesystem size used avail capacity Mounted on swap ... (9 Replies)
Discussion started by: chidori
9 Replies

9. AIX

Wait time shows high CPU usage

Hi, I can't seem to make sense of this. My wait time is showing really high but vmstat's and topas are showing normal usage. ps aux USER PID %CPU %MEM SZ RSS TTY STAT STIME TIME COMMAND root 9961810 5680.7 0.0 448 384 - A Dec 16 6703072:12 wait ... (2 Replies)
Discussion started by: techy1
2 Replies

10. UNIX for Advanced & Expert Users

How to find process holding a semaphore?

Hello All, The system concerned has multiple processes communicating with each other using shared memory. These processes use semaphores to protect data being used amongst them. The "key" would uniquely identifies the particular semaphore corresponding to a resource for the various processes. ... (2 Replies)
Discussion started by: saptarshi
2 Replies
All times are GMT -4. The time now is 05:49 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy