Received error as Not enough space left on device


 
Thread Tools Search this Thread
Operating Systems HP-UX Received error as Not enough space left on device
# 1  
Old 12-12-2013
Tools Received error as Not enough space left on device

Hi Forum,

We have observed one problem in one of our HP-UX machines which runs a software which connects the radio frequency scan devices and the scanned information is stored in the database through the same software.

This software has thrown an error like "Not enough space left on the device". In my experience, this error occurs when there is not enough space left on the partition where the process is trying to write in to a file. However the person who was in charge that time has rectified this issue without actually clearing any disk partition space.

According to that person, he logged off all the connected users, cleared all the <defunct> processes and also cleared the illegal shared memory segments & data queues observed through the ipcs command.

As per my general observation -

- There is enough disk space in the software partition. But I am not aware of the space available in /var or /tmp partitions.
- There is ample memory available for running the programs.

I would like to ask the forum couple of questions:

1) This error "Not enough space left on the device" - Is it due to disk partition space not sufficient or due to insufficient Kernel memory?
2) In HP-UX machines please help to identify:
a) Real memory - Used & Free
b) Virtual memory - Used & Free

3) I tried top command - but in HP-UX it gives a wierd result like -
Memory: XXXXXX (YYYYY) real, ZZZZZZ (WWWWW) virtual, UUUUU free

What are these memory values represented as mentioned above both in & out of parantheses?

4) I tried Glance command - but I didnt understand what are the values represented against cpu utilization, memory utilization and they kept on changing.

5) I tried swapinfo command (swapinfo -tam) - but I didn't understand what is the reserve memory for? It was shown as (-4096 b) which is negative. Also the memory shown in swapinfo - is it virtual or real memory?

6) I tried kmeminfo - But it didn't work

7) I tried vmstat - but failed to understand the meaning of avm & free - do they represent virtual memory? If so why are the values different from the values seen in top command?

Thanks a lot for reading my post. Appreciate your help and your time.

Regards,
Nishant
# 2  
Old 12-12-2013
I suspect the error message means what it says.

Killing processes can easily clear up disk space, because it may finish deleting any files which were deleted but held open by a program.
# 3  
Old 12-12-2013
pls upload more logs ,
your problem no enough space.pls execute #bdf
maybe you need extend your filesystem
# 4  
Old 12-13-2013
The current situation looks as below:

The error occurred with the software present in /wh2ppkg/dlx partition.

Code:
bdf
Filesystem          kbytes    used   avail %used Mounted on
/dev/vg00/lvol3    1048576  256048  786448   25% /
/dev/vg00/lvol1     251696   77304  149216   34% /stand
/dev/vg00/lvol9    4194304 3181616 1009472   76% /var
/dev/vg00/lvol12    131072   51674   74439   41% /var/opt/perf/datafiles
/dev/vg00/lvol11   2097152 1300772  746655   64% /var/adm/sw
/dev/vg00/lvol10   4194304    2128 3930172    0% /var/adm/crash
/dev/vg00/utl        65536    2986   58696    5% /utl
/dev/vg00/lvol8    2408448 1576440  825520   66% /usr
/dev/vg00/lvol7    2097152  350143 1638219   18% /tmpadm
/dev/vg00/lvol6    2097152    5816 2075896    0% /tmp
/dev/vg00/lvol5    4194304 2012376 2165392   48% /opt
/dev/vg00/opt-patrol
                   2097152  338322 1649433   17% /opt/patrol
/dev/vg00/lvol4    1048576   10712 1029784    1% /home
/dev/vg01/opt-oralocal
                   4194304 1795739 2248944   44% /opt/oralocal
/dev/vg50wh1p/wh1ppkg
                    131072    1145  121809    1% /wh1ppkg
/dev/vg50wh1p/wh1ppkg-oracle
                   10240000 6737214 3393934   67% /wh1ppkg/oracle
/dev/vg50wh1p/wh1ppkg-admin
                   10240000    3406 9916708    0% /wh1ppkg/admin
/dev/vg50wh1p/wh1ppkg-precise
                   1024000    8926  951643    1% /wh1ppkg/precise
/dev/vg50wh1p/wh1ppkg-arc1
                   6144000 1438580 4411398   25% /wh1ppkg/arc1
/dev/vg50wh1p/wh1ppkg-arc2
                   6144000 2007942 3877609   34% /wh1ppkg/arc2
/dev/vg50wh1p/wh1ppkg-redos
                   1024000  624420  374612   63% /wh1ppkg/redos
/dev/vg50wh1p/wh1ppkg-db1_wh1p
                   35840000 18279880 17422952   51% /wh1ppkg/db1_wh1p
/dev/vg50wh1p/wh1ppkg-db2_wh1p
                   35840000 21188264 14537336   59% /wh1ppkg/db2_wh1p
/dev/vg50wh1p/wh1ppkg-dlx
                   5120000 2970377 2131442   58% /wh1ppkg/dlx
/dev/vg50wh1p/wh1ppkg-dlx-incoming
                   1024000    1357  958735    0% /wh1ppkg/dlx/incoming
/dev/vg51wh2p/wh2ppkg
                    131072    1143  121811    1% /wh2ppkg
/dev/vg51wh2p/wh2ppkg-dlx
                   10240000 5819722 4151916   58% /wh2ppkg/dlx
/dev/vg51wh2p/wh2ppkg-dlx-incoming
                   1032192    1357  966415    0% /wh2ppkg/dlx/incoming
/dev/vg51wh2p/wh2ppkg-precise
                   1032192  195746  784175   20% /wh2ppkg/precise
/dev/vg51wh2p/wh2ppkg-oracle
                   10240000 2867110 7143508   29% /wh2ppkg/oracle
/dev/vg51wh2p/wh2ppkg-admin
                   10240000    3406 9916708    0% /wh2ppkg/admin
/dev/vg51wh2p/wh2ppkg-arc1
                   6144000 1498003 4355684   26% /wh2ppkg/arc1
/dev/vg51wh2p/wh2ppkg-arc2
                   6144000 1498011 4355676   26% /wh2ppkg/arc2
/dev/vg51wh2p/wh2ppkg-redos
                   1032192  625700  381092   62% /wh2ppkg/redos
/dev/vg51wh2p/wh2ppkg-db1_wh2p
                   40960000 31688096 9199472   78% /wh2ppkg/db1_wh2p
/dev/vg51wh2p/wh2ppkg-db2_wh2p
                   40960000 35065736 5848280   86% /wh2ppkg/db2_wh2p
/dev/vg51wh2p/wh2ppkg-db3_wh2p
                   40960000 29466872 11403344   72% /wh2ppkg/db3_wh2p
/dev/vg52wh3p/wh3ppkg
                    131072    1143  121811    1% /wh3ppkg
/dev/vg52wh3p/wh3ppkg-dlx
                   10371072 8774753 1503767   85% /wh3ppkg/dlx
/dev/vg52wh3p/wh3ppkg-dlx-incoming
                   1032192    1357  966415    0% /wh3ppkg/dlx/incoming
/dev/vg52wh3p/wh3ppkg-precise
                   1032192    1357  966415    0% /wh3ppkg/precise
/dev/vg52wh3p/wh3ppkg-oracle
                   10240000 4912528 5164034   49% /wh3ppkg/oracle
/dev/vg52wh3p/wh3ppkg-admin
                   10240000 1985708 7996348   20% /wh3ppkg/admin
/dev/vg52wh3p/wh3ppkg-arc1
                   6144000 2145107 3749013   36% /wh3ppkg/arc1
/dev/vg52wh3p/wh3ppkg-arc2
                   6144000 1417185 4431448   24% /wh3ppkg/arc2
/dev/vg52wh3p/wh3ppkg-redos
                   1032192  625380  381392   62% /wh3ppkg/redos
/dev/vg52wh3p/wh3ppkg-db1_wh3p
                   40960000 23566432 17257712   58% /wh3ppkg/db1_wh3p
/dev/vg52wh3p/wh3ppkg-db2_wh3p
                   40960000 31952720 8936976   78% /wh3ppkg/db2_wh3p
/dev/vg52wh3p/wh3ppkg-db3_wh3p
                   40960000 5238128 35442800   13% /wh3ppkg/db3_wh3p
/dev/vg00/nsr      2097152   36231 1932162    2% /nsr

The vmstat details are as below:
Code:
vmstat
         procs           memory                   page                              faults       cpu
    r     b     w      avm    free   re   at    pi   po    fr   de    sr     in     sy    cs  us sy id
    2     3     0  2812341  11023728  343   32     0    0     0    0     0   1858  31455  2873  13  5 82

The swapinfo -tam details are as below:

Code:
swapinfo -tam
             Mb      Mb      Mb   PCT  START/      Mb
TYPE      AVAIL    USED    FREE  USED   LIMIT RESERVE  PRI  NAME
dev        4096       0    4096    0%       0       -    1  /dev/vg00/lvol2
reserve       -    4096   -4096
memory    53042   18182   34860   34%
total     57138   22278   34860   39%       -       0    -

The top command looks as below:
Code:
 top
Load averages: 0.34, 0.45, 0.34
1067 processes: 865 sleeping, 190 running, 12 zombies
Cpu states:
CPU   LOAD   USER   NICE    SYS   IDLE  BLOCK  SWAIT   INTR   SSYS
 0    0.41  24.3%   1.0%   5.1%  69.7%   0.0%   0.0%   0.0%   0.0%
 1    0.31  20.4%   0.0%   4.5%  75.1%   0.0%   0.0%   0.0%   0.0%
 2    0.31  22.3%   0.0%   4.5%  73.2%   0.0%   0.0%   0.0%   0.0%
 3    0.33  22.1%   0.0%   6.1%  71.8%   0.0%   0.0%   0.0%   0.0%
 4    0.32  26.8%   1.8%   6.5%  65.0%   0.0%   0.0%   0.0%   0.0%
 5    0.34  23.1%   0.0%   8.6%  68.3%   0.0%   0.0%   0.0%   0.0%
---   ----  -----  -----  -----  -----  -----  -----  -----  -----
avg   0.34  23.2%   0.4%   5.9%  70.5%   0.0%   0.0%   0.0%   0.0%

Memory: 14746840K (6597992K) real, 23180416K (11584048K) virtual, 44064000K free  Page# 1/40

CPU TTY    PID USERNAME PRI NI   SIZE    RES STATE    TIME %WCPU  %CPU COMMAND
 2   ?   26970 root     237 20    32K    32K zomb     0:07 34.45 32.90 gzip
 5   ?   26967 root     235 20    32K    32K zomb     0:07 34.12 32.58 gzip
 0   ?   25272 oracle   149 20  2979M  8928K sleep    1:39 21.85 21.81 ora_p008_wh2p
 4   ?   25270 oracle   149 20  2979M  8928K sleep    1:38 20.55 20.51 ora_p007_wh2p
 0   ?   25266 oracle   148 20  2979M  8928K sleep    1:41 20.33 20.29 ora_p005_wh2p
 2   ?   25268 oracle   149 20  2979M  8928K sleep    1:38 19.78 19.75 ora_p006_wh2p
 5   ?   25274 oracle   200 20  2979M  8928K run      1:42 19.53 19.49 ora_p009_wh2p
 1   ?   19523 wh2p     154 20  2979M  9376K sleep    0:45 19.02 18.98 oraclewh2p
 0   ?   24689 oracle   156 20  2997M 26464K sleep    1:38  9.97  9.95 ora_j000_wh2p
 1   ?      41 root     152 20 22624K 22624K run   14933:44  4.57  4.56 vxfsd
 0   ?   13796 patuxl   154 30 46500K 35772K sleep 17591:31  1.84  1.83 PatrolAgent

The glance output as below:
Code:
B3692A GlancePlus C.03.72.00    01:25:14 ap1hpx24 9000/800                                                                          Current  Avg  High
------------------------------------------------------------------------------------------------------------------------------------------------------
CPU  Util   S           SU                                U                                                                          | 39%   48%   55%
Disk Util   F                  F                                                                                                     | 17%   55%   91%
Mem  Util   S         SU                          UB  B                                                                              | 35%   34%   35%
Swap Util   U                                    UR      R                                                                           | 39%   39%   39%
------------------------------------------------------------------------------------------------------------------------------------------------------
                                                                     PROCESS LIST                                                         Users=   53
                              User      CPU Util     Cum     Disk           Thd
Process Name   PID   PPID Pri Name   (  600% max)    CPU   IO Rate    RSS   Cnt
--------------------------------------------------------------------------------
ora_p002_wh  25260      1 156 oracle   22.8/15.8    77.3  126/11.0  31.9mb    1
ora_p003_wh  25262      1 156 oracle   22.8/15.7    76.7  114/11.0  31.9mb    1
ora_p001_wh  25258      1 156 oracle   22.5/16.6    81.1  128/11.5  31.9mb    1
ora_p004_wh  25264      1 156 oracle   22.3/15.7    76.8  123/10.8  31.9mb    1
ora_p000_wh  25256      1 156 oracle   22.1/15.4    74.9  120/10.8  31.9mb    1
ora_p008_wh  25272      1 207 oracle   21.7/22.2   108.3  108/ 246  45.9mb    1
ora_p009_wh  25274      1 149 oracle   20.0/22.9   111.4  102/ 236  45.9mb    1
ora_p006_wh  25268      1 149 oracle   19.8/22.0   107.2  105/ 246  45.9mb    1
ora_p007_wh  25270      1 204 oracle   16.8/22.1   107.6 61.6/ 241  45.9mb    1
ora_p005_wh  25266      1 149 oracle   16.2/22.5   109.6 73.5/ 234  41.9mb    1
vxfsd           41      0 138 root      7.5/  8m  894189  1.8/114m  22.1mb  132
PatrolAgent  13796      1 154 patuxl    3.4/  9m 1051805 21.8/ 63m  37.3mb    1
midaemon      1746      1 -16 root      2.5/  8m  969415  0.0/ 0.1  19.7mb    3
bgscollect    7038   7031 154 patuxl    1.3/ 1.6  121458  0.0/ 0.0   9.9mb    1

# 5  
Old 12-13-2013
your mean "/dev/vg51wh2p/wh2ppkg-dlx 10240000 5819722 4151916 58% /wh2ppkg/dlx" is the directory where the sofware installed ,but i do not see the directory is going to full. and your CPU/MEM use rate is not high.




your memory ,you can use "#machinfo" to check the MEM size.

use “#glance plus m command ” to check the free memory and used memory
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Solaris

Sol11 - Error at prompt (no space left on device)

user1@:/$ -ksh: line 3: write to 1 failed user11@:/$ -ksh: line 3: write to 1 failed user1@:/$ -ksh: line 3: write to 1 failed user1@:/$ -ksh: line 3: write to 1 failed user1@:/$ -ksh: line 3: write to 1 failed But theres plenty of space :- user1@:/$ df -kh Filesystem ... (9 Replies)
Discussion started by: psychocandy
9 Replies

2. Solaris

Write to 1 failed [No space left on device] Error

Running a installation on Solaris 11 and getting error write to 1 failed If anyone can advise ? ORIGINAL_PATH="${PATH}" # prepend /usr/xpg4/bin to PATH as needed temporaryPath=`expr "${PATH}:" : '\(/usr/xpg4/bin:\)'` if then PATH="/usr/xpg4/bin:${PATH}" seem to have... (6 Replies)
Discussion started by: Mpumi
6 Replies

3. Linux

No space left on device while there is plenty of space available

Hello all posting here after scanning the net and tried most of the things offered still no solution that worked when I do : $ df -h Filesystem Size Used Avail Use% Mounted on footmpfs 7.9G 60K 7.9G 1% /dev tmpfs 7.9G 0 7.9G 0% /dev/shm /dev/da1 ... (3 Replies)
Discussion started by: umen
3 Replies

4. Shell Programming and Scripting

No Space left On Device

Hi, We are trying to sort the 40GB file in unix and getting following error. Error: sort: can't write /var/tmp/stmAAAvsaGfJ.00002929: No space left on device sort -t ',' -k4 $DIR/INF_ff_FULL.dat >>$DIR/Sort_INF_ff_FULL.dat; 2>$DIR/sort_error.log Can you please advise how to... (2 Replies)
Discussion started by: koti_rama
2 Replies

5. Solaris

visudo: write error: No space left on device

Hi All, This is Sandeep Gupta, I am facing a problem with sudo command. Whenever i am executing the command "visudo" i am getting the error "visudo: write error: No space left on device". but i have checked on my Solaris Box everything is ok, i have enough free space on my box, and also... (13 Replies)
Discussion started by: Sandeepgupta
13 Replies

6. Solaris

No space left on device but free space and inodes are available...

hi guys, me again ;) i recently opened a thread about physical to zone migration. My zone is mounted over a "bigger" LUN (500GB) and step is now to move the old files, from the physical server, to my zone. We are talking about 22mio of files. i used rsync to do that and every time at... (8 Replies)
Discussion started by: beta17
8 Replies

7. UNIX for Dummies Questions & Answers

No space left on device

hello all, i have a proc binary that we run on unix environment, and it is generating this error '' tstfile(): No space left on device '' can you please assist on how to narrow down the problem? thanks (4 Replies)
Discussion started by: mjdbouk
4 Replies

8. Solaris

No space left on device

Hi all, A very strange problem I have this morning with my Solaris 8. I have a FS full, I deleted some files but the system doesn't seems to reallocate the free space (I'm using Veritas): df -k : /dev/vx/dsk/dlds02vg/dlds02oralv 4194304 4194304 0 100% /dlds02/lds/oracle ... (4 Replies)
Discussion started by: unclefab
4 Replies

9. UNIX for Dummies Questions & Answers

cat: write error: No space left on device

I am trying to create new files under my directory...but i getting the following message... cat: write error: No space left on device How do we handle this error. I am not getting this error when I login as the super user (3 Replies)
Discussion started by: igandu
3 Replies

10. UNIX for Advanced & Expert Users

no space left on device

I have a SCO UNIX on my Server. When I last tried to shutdown my system, I got an error message “no space left on device”. Now when I try to boot the system again, I just can't and I get the same error message. Please help! (2 Replies)
Discussion started by: anjane
2 Replies
Login or Register to Ask a Question