Sponsored Content
Operating Systems Solaris No Space Left - Memory/Swap issue Post 302497587 by aychbee45 on Thursday 17th of February 2011 03:53:27 PM
Old 02-17-2011
No Space Left - Memory/Swap issue

SmilieI'm having a bit of a problem with Solaris 10u8 and one of our applications requesting memory and being told, "no space left".

The break down:
24GB Physical Memory
8GB swap

at the time of occurance, here's what a memory breakdown looks like:
Code:
Page Summary                Pages                MB  %Tot
------------     ----------------  ----------------  ----
Kernel                     636499              4972   21%
ZFS File Data              268245              2095    9%
Anon                      1973955             15421   64%
Exec and libs               18347               143    1%
Page cache                  41447               323    1%
Free (cachelist)            30647               239    1%
Free (freelist)            115911               905    4%

Total                     3085051             24101
Physical                  3063472             23933
Filesystem            Size  Used Avail Use% Mounted on
swap                  789M  704K  789M   1% /tmp

Paging stats:
     memory           page          executable      anonymous      filesystem 
   swap  free  re  mf  fr  de  sr  epi  epo  epf  api  apo  apf  fpi  fpo  fpf
 3688208 1356288 285 1777 0 0   0    0    0    0    0    0    0    2    0    0
 762656 1185672 136 674 0   0   0    0    0    0    0    0    0    0    0    0
 757696 1180080 395 2615 0  0   0    0    0    0    0    0    0    0    0    0
 712176 1178880 353 3855 0  0   0    0    0    0    0    0    0    0    0    0
 566184 1168464 269 2736 0  0   0    0    0    0    0    0    0    0    0    0

Virtual Memory stats:
 kthr      memory            page            disk          faults      cpu
 r b w   swap  free  re  mf pi po fr de sr s0 s1 s2 --   in   sy   cs us sy id
 0 0 0 3688208 1356288 285 1777 2 0 0 0  0 10 10 -0  0 1868 341675 1735 5 5 90
 1 0 0 749288 1171536 165 1551 0 0 0  0  0  1  0  0  0 3000 590641 3019 12 6 82
 0 0 0 716488 1182048 177 2050 4 0 0  0  0  0  0  0  0 3700 470588 3925 11 6 83
 0 0 0 762504 1182488 93 558 0  0  0  0  0 124 184 0 0 4330 612541 4701 11 7 82
 0 0 0 762304 1181776 105 489 0 0  0  0  0 86 247 0  0 2730 604930 2779 9 4 87

As you can see, there is 900MB physical memory left and 1.1GB of swap free. There are around 1100 processes, all running as a spawned child of one process. I've looked at projmod for limitations, but haven't found any.

Any thoughts? I'm fresh out of new ideas...
 

10 More Discussions You Might Find Interesting

1. HP-UX

swap space (lvol2) is not using when physical memory is 98% used

Dear all I have rp7620 sever with hp-ux 11.23 this swap space is not yet used when the physical memory usage of 98 %. through openview it's shows memory bottleneck . how to resolve the problem. Rajesh (1 Reply)
Discussion started by: rajeshtt32
1 Replies

2. Shell Programming and Scripting

Issue with insufficient swap or memory space

Hi, When I execute one of my shellscript I am getting the below mentioned error message .This application takes 2input files which have the records counts 26463 and 1178046 exec(2): insufficient swap or memory available. exec(2): insufficient swap or memory available. exec(2):... (2 Replies)
Discussion started by: kavithakuttyk
2 Replies

3. UNIX for Advanced & Expert Users

Issue with insufficient swap or memory space

Hi, When I execute one of my shellscript I am getting the below mentioned error message .This application takes 2input files which have the records counts 26463 and 1178046 exec(2): insufficient swap or memory available. exec(2): insufficient swap or memory available. exec(2): insufficient swap... (3 Replies)
Discussion started by: kavithakuttyk
3 Replies

4. Solaris

swap space issue

HI All, Recently during oracle install I realized that I did not have enough swap space. So I - 1. Created a swap file "swap_fille1" in /rpool using mkfile - # ls -ltr /rpool total 10487121 drwxr-xr-x 3 root root 3 Dec 21 12:09 boot drwxr-xr-x 2 root root ... (10 Replies)
Discussion started by: sumeet
10 Replies

5. Solaris

No space left on device but free space and inodes are available...

hi guys, me again ;) i recently opened a thread about physical to zone migration. My zone is mounted over a "bigger" LUN (500GB) and step is now to move the old files, from the physical server, to my zone. We are talking about 22mio of files. i used rsync to do that and every time at... (8 Replies)
Discussion started by: beta17
8 Replies

6. HP-UX

Swap space issue.

Hi, I am not sure how many scripts / java processes running on my HP-UX server. I need to calculate the total heap of these processes. I then need to recommend increasing the swap memory to be increase and equal to total heap if that is the right concept. Currently we are facing... (2 Replies)
Discussion started by: mohtashims
2 Replies

7. UNIX for Advanced & Expert Users

Swap space issue

I have Solaris-10 with mutiple zones running in it. My Big Brother monitoring is complaining for very less swap space available, but I am not able to find, what process has consumed its swap space and how to clear it. All zones including global server have almost blank /tmp with very less data.... (3 Replies)
Discussion started by: solaris_1977
3 Replies

8. Linux

Swap memory issue

Hi, In our production box i can see the Swap space using the below command free total used free shared buffers cached Mem: 65963232 41041084 24922148 0 877160 35936292 -/+ buffers/cache: 4227632 61735600 Swap: 4192880 ... (6 Replies)
Discussion started by: ratheeshjulk
6 Replies

9. AIX

AIX swap space, physical memory & cache

Hi, I am new to AIX, Can someone please help me how to know the swap space, total physical memory and system cache? We are using AIX 5.3. Thanks! (3 Replies)
Discussion started by: Phaneendra G
3 Replies

10. Linux

No space left on device while there is plenty of space available

Hello all posting here after scanning the net and tried most of the things offered still no solution that worked when I do : $ df -h Filesystem Size Used Avail Use% Mounted on footmpfs 7.9G 60K 7.9G 1% /dev tmpfs 7.9G 0 7.9G 0% /dev/shm /dev/da1 ... (3 Replies)
Discussion started by: umen
3 Replies
vmstat(1M)                                                System Administration Commands                                                vmstat(1M)

NAME
vmstat - report virtual memory statistics SYNOPSIS
vmstat [-cipqsS] [disks] [ interval [count]] DESCRIPTION
vmstat reports virtual memory statistics regarding kernel thread, virtual memory, disk, trap, and CPU activity. On MP (multi-processor) systems, vmstat averages the number of CPUs into the output. For per-processor statistics, see mpstat(1M). vmstat only supports statistics for certain devices. For more general system statistics, use sar(1), iostat(1M), or sar(1M). Without options, vmstat displays a one-line summary of the virtual memory activity since the system was booted. During execution of the kernel status command, the state of the system can change. If relevant, a state change message is included in the vmstat output, in one of the following forms: <<device added: sd0>> <<device removed: sd0>> <<processors added: 1, 3>> <<processors removed: 1, 3>> See System Administration Guide: Advanced Administration for device naming conventions for disks. OPTIONS
The following options are supported: -c Report cache flushing statistics. This option is obsolete, and no longer meaningful. This option might be removed in a future version of Solaris. -i Report the number of interrupts per device. count and interval does not apply to the -i option. -p Report paging activity in details. This option will display the following, respectively: epi Executable page-ins. epo Executable page-outs. epf Executable page-frees. api Anonymous page-ins. apo Anonymous page-outs. apf Anonymous page-frees. fpi File system page-ins. fpo File system page-outs. fpf File system page-frees. When executed in a zone and if the pools facility is active, all of the above only report actitivity on the processors in the pro- cessor set of the zone's pool. -q Suppress messages related to state changes. -s Display the total number of various system events since boot. count and interval does not apply to the -s option. -S Report on swapping rather than paging activity. This option will change two fields in vmstat's ``paging'' display: rather than the ``re'' and ``mf'' fields, vmstat will report ``si'' (swap-ins) and ``so'' (swap-outs). OPERANDS
The following operands are supported: count Specifies the number of times that the statistics are repeated. count does not apply to the -i and -s options. disks Specifies which disks are to be given priority in the output (only four disks fit on a line). Common disk names are id, sd, xd, or xy, followed by a number (for example, sd2, xd0, and so forth). interval Specifies the last number of seconds over which vmstat summarizes activity. This number of seconds repeats forever. inter- val does not apply to the -i and -s options. EXAMPLES
Example 1: Using vmstat The following command displays a summary of what the system is doing every five seconds. example% vmstat 5 kthr memory page disk faults cpu r b w swap free re mf pi p fr de sr s0 s1 s2 s3 in sy cs us sy id 0 0 0 11456 4120 1 41 19 1 3 0 2 0 4 0 0 48 112 130 4 14 82 0 0 1 10132 4280 0 4 44 0 0 0 0 0 23 0 0 211 230 144 3 35 62 0 0 1 10132 4616 0 0 20 0 0 0 0 0 19 0 0 150 172 146 3 33 64 0 0 1 10132 5292 0 0 9 0 0 0 0 0 21 0 0 165 105 130 1 21 78 1 1 1 10132 5496 0 0 5 0 0 0 0 0 23 0 0 183 92 134 1 20 79 1 0 1 10132 5564 0 0 25 0 0 0 0 0 18 0 0 131 231 116 4 34 62 1 0 1 10124 5412 0 0 37 0 0 0 0 0 22 0 0 166 179 118 1 33 67 1 0 1 10124 5236 0 0 24 0 0 0 0 0 14 0 0 109 243 113 4 56 39 ^C example% The fields of vmstat's display are kthr Report the number of kernel threads in each of the three following states: r the number of kernel threads in run queue b the number of blocked kernel threads that are waiting for resources I/O, paging, and so forth w the number of swapped out lightweight processes (LWPs) that are waiting for processing resources to finish. memory Report on usage of virtual and real memory. swap available swap space (Kbytes) free size of the free list (Kbytes) page Report information about page faults and paging activity. The information on each of the following activities is given in units per second. re page reclaims -- but see the -S option for how this field is modified. mf minor faults -- but see the -S option for how this field is modified. pi kilobytes paged in po kilobytes paged out fr kilobytes freed de anticipated short-term memory shortfall (Kbytes) sr pages scanned by clock algorithm When executed in a zone and if the pools facility is active, all of the above (except for "de") only report activity on the processors in the processor set of the zone's pool. disk Report the number of disk operations per second. There are slots for up to four disks, labeled with a single letter and number. The letter indicates the type of disk (s = SCSI, i = IPI, and so forth); the number is the logical unit number. faults Report the trap/interrupt rates (per second). in interrupts sy system calls cs CPU context switches When executed in a zone and if the pools facility is active, all of the above only report actitivity on the processors in the processor set of the zone's pool. cpu Give a breakdown of percentage usage of CPU time. On MP systems, this is an average across all processors. us user time sy system time id idle time When executed in a zone and if the pools facility is active, all of the above only report actitivity on the processors in the processor set of the zone's pool. ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWcsu | +-----------------------------+-----------------------------+ |Interface Stability |See below. | +-----------------------------+-----------------------------+ Invocation is evolving. Human readable output is unstable. SEE ALSO
sar(1), iostat(1M), mpstat(1M), sar(1M), attributes(5) System Administration Guide: Basic Administration System Administration Guide: Advanced Administration NOTES
The sum of CPU utilization might vary slightly from 100 because of rounding errors in the production of a percentage figure. The -c option (Report cache flushing statistics) is not supported in this release. SunOS 5.10 20 Dec 2004 vmstat(1M)
All times are GMT -4. The time now is 02:12 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy