CentOs server generating several alarms on partition /proc/


 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers CentOs server generating several alarms on partition /proc/
# 1  
Old 03-02-2019
How to edit /proc/self/mounts in order to remove weird entries that appeared there ?

Greetings,

I have been facing one issue here and I am not understanding what is causing.
I am getting a lot of alarms complaining that the partition for example /proc/12345 , is full, but the partition does not existe on the server. Which is not supposed to happen, because /proc is not a real FileSystem.

I checked the server and when I checked the disk space :

Code:
[root@server ~]# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/vg_umpom01brb-LogVol01
                      260G   23G  224G  10% /
tmpfs                 7.9G   26M  7.9G   1% /dev/shm

Which is not supposed to happen because there are other mounted partition which should have been show there.

So I ran :

Code:
[root@server ~]# mount -l
/dev/mapper/vg_umpom01brb-LogVol01 on / type ext4 (rw)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
/usr/share/myspell/shell/.myempty on /proc/25669 type none (rw,bind)
/dev/sda1 on /boot type ext4 (rw)
10.000.000.00:/umplogs on /var/UMP_LOGS type nfs (rw,nosuid,addr=10.000.000.00)
10.000.000.00:/DBBACKUP on /var/DBBACKUP type nfs (rw,nosuid,addr=10.000.000.00)
10.000.000.00:/opt/sysreports on /opt/sysreports type nfs (rw,nosuid,vers=4,addr=10.000.000.00,clientaddr=10.000.000.00)

And them was okay :

Code:
[root@umpom01brb ~]# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/vg_umpom01brb-LogVol01
                      260G   23G  224G  10% /
tmpfs                 7.9G   26M  7.9G   1% /dev/shm
/dev/sda1             194M   58M  127M  32% /boot
10.238.202.15:/umplogs
                       89G   32G   57G  36% /var/UMP_LOGS
10.238.202.27:/DBBACKUP
                       99G   60G   40G  60% /var/DBBACKUP
10.238.202.65:/opt/sysreports
                       15G  2.1G   13G  15% /opt/sysreports

The above is the expected, and should be like that, but after a few hours I got the alarm again, and the partition which was supposed to be mounted is not there again :

Code:
[root@server ~]# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/mapper/vg_umpom01brb-LogVol01
                      260G   23G  224G  10% /
tmpfs                 7.9G   26M  7.9G   1% /dev/shm


@@@EDIT@@@

I think I am getting close to the issue

I was looking on /proc/self/mounts and I saw a lot of weird entries :

Code:
/dev/mapper/vg_umpom01brb-LogVol01 /proc/14779 ext4 rw,relatime,barrier=1,stripe=64,data=ordered 0 0
/dev/mapper/vg_umpom01brb-LogVol01 /proc/45537 ext4 rw,relatime,barrier=1,stripe=64,data=ordered 0 0
/dev/mapper/vg_umpom01brb-LogVol01 /proc/13170 ext4 rw,relatime,barrier=1,stripe=64,data=ordered 0 0

Code:
device /dev/mapper/vg_umpom01brb-LogVol01 mounted on /proc/13142 with fstype ext4
device /dev/mapper/vg_umpom01brb-LogVol01 mounted on /proc/30085 with fstype ext4
device /dev/mapper/vg_umpom01brb-LogVol01 mounted on /proc/38674 with fstype ext4

Code:
68 16 253:0 /usr/share/myspell/shell/.myempty /proc/20718 rw,relatime - ext4 /dev/mapper/vg_umpom01brb-LogVol01 rw,barrier=1,stripe=64,data=ordered
69 16 253:0 /usr/share/myspell/shell/.myempty /proc/29767 rw,relatime - ext4 /dev/mapper/vg_umpom01brb-LogVol01 rw,barrier=1,stripe=64,data=ordered
70 16 253:0 /usr/share/myspell/shell/.myempty /proc/38871 rw,relatime - ext4 /dev/mapper/vg_umpom01brb-LogVol01 rw,barrier=1,stripe=64,data=ordered

and all entries are to this myspell thing.

There are hundreds of entries like that, and all alarms I got was listed there. So looks like this is the "source" of all alarms .

Even removing the entry below from mtab, if keeps returning :

Code:
/usr/share/myspell/shell/.myempty /proc/9127 none rw,bind 0 0

So I think that my question now is :

How I am supposed to edit this file /proc/self/mounts, if this file is created by the Kernel and this one is "read only". ?

Last edited by Yagami_Sama; 03-02-2019 at 03:20 PM.. Reason: A better explanation of the issue.
# 2  
Old 03-02-2019
Quote:
..... that the partition for example /proc/12345
Why do you call /proc/12345 a "partition" ?

/proc/12345 is a directory in the proc file system which maintains system information for process "12345" .....

Are you saying this directory in proc is full?
# 3  
Old 03-02-2019
man proc:
Quote:
The proc filesystem is a pseudo-filesystem which provides an interface to kernel data structures.
So I'm surprised the error message calls a proc "subdir" a "partition". Please post the entire error messages, and some info about e.g. memory status, like the output of free.
# 4  
Old 03-02-2019
I think I am getting close to the issue

I was looking on /proc/self/mounts and I saw a lot of weird entries :

Code:
/dev/mapper/vg_umpom01brb-LogVol01 /proc/14779 ext4 rw,relatime,barrier=1,stripe=64,data=ordered 0 0
/dev/mapper/vg_umpom01brb-LogVol01 /proc/45537 ext4 rw,relatime,barrier=1,stripe=64,data=ordered 0 0
/dev/mapper/vg_umpom01brb-LogVol01 /proc/13170 ext4 rw,relatime,barrier=1,stripe=64,data=ordered 0 0

Code:
device /dev/mapper/vg_umpom01brb-LogVol01 mounted on /proc/13142 with fstype ext4
device /dev/mapper/vg_umpom01brb-LogVol01 mounted on /proc/30085 with fstype ext4
device /dev/mapper/vg_umpom01brb-LogVol01 mounted on /proc/38674 with fstype ext4

Code:
68 16 253:0 /usr/share/myspell/shell/.myempty /proc/20718 rw,relatime - ext4 /dev/mapper/vg_umpom01brb-LogVol01 rw,barrier=1,stripe=64,data=ordered
69 16 253:0 /usr/share/myspell/shell/.myempty /proc/29767 rw,relatime - ext4 /dev/mapper/vg_umpom01brb-LogVol01 rw,barrier=1,stripe=64,data=ordered
70 16 253:0 /usr/share/myspell/shell/.myempty /proc/38871 rw,relatime - ext4 /dev/mapper/vg_umpom01brb-LogVol01 rw,barrier=1,stripe=64,data=ordered

and all entries are to this myspell thing.

There are hundreds of entries like that, and all alarms I got was listed there. So looks like this is the "source" of all alarms .

So I think that my question now is :

How I am supposed to edit this file /proc/self/mounts, if this file is created by the Kernel and this one is "read only". ?
# 5  
Old 03-02-2019
The application is mapping information in the proc filesystem to the application so the application can use interact with the information in the proc filesystem.

In your original post, you said:

Quote:
I am getting a lot of alarms complaining that the partition for example /proc/12345 , is full, but the partition does not exist on the server. Which is not supposed to happen, because /proc is not a real FileSystem.
You should post the exact error message or alarm.

/proc/12345 maps to a process.

If that process is not available because the process is dead or is throwing an error, then the system will be in an error state, of course.

However, if you do not actually post the exact error message, cut-and-paste in full, you are not really providing the necessary information to get expert help.
This User Gave Thanks to Neo For This Post:
# 6  
Old 03-03-2019
Quote:
Originally Posted by Neo
Why do you call /proc/12345 a "partition" ?

/proc/12345 is a directory in the proc file system which maintains system information for process "12345" .....

Are you saying this directory in proc is full?
Thanks for replying back.

By alarm I mean the zabbix trigger which monitore the server. Like the last I got was this :

Code:
disk space is less than 20% on volume /proc/56371

This /proc/56371, does not exist on the server, but is mapped on /proc/self/mounts.
I did not find any information on any other log. So I think that this will not help.

This could be besides the point, but I checked the other server of the cluster and the configuration are similar, except the :

Code:
/usr/share/myspell/shell/.myempty /proc/56371 rw,relatime - ext4 /dev/mapper/vg_umpom01brb-LogVol01 rw,barrier=1,stripe=64,data=ordered

And the other hundred of entries are different, just exist on this server.

Any suggestion in where in I might found a detailed error log or something that could help is much appreciate.

Thanks again, for the help.
# 7  
Old 03-03-2019
So why is your Zabbix configuration monitoring disk space on the proc filesystem?

If I were you, I would immediately go into the Zabbix configuration and disable monitoring for the proc file system.

You should not be monitoring /proc with the same Zabbix tools used to monitor a normal filesystem. When you stop monitoring the /proc filesystem like it is a regular filesystem, those alarms with go away.
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Build NFS Server on CentOS

Dear All, I'm using AWS EC2 instance for my application. My application is high disk I/O based and EFS could not be used in my case. So, i need to build my own NFS server on Ec2 instance. I'm looking for High availability solution for my disk which i shared for NFS. Looking for builtin... (5 Replies)
Discussion started by: Bala
5 Replies

2. UNIX for Beginners Questions & Answers

FreeBSD vs CentOS as server

I have a HP Proliant server with centOS. This is the software that I run: - SSH + SFTP - NGINX - PHP7 - Bitcoind - MYSQL Would you recommend FreeBSD or CentOS for this software. Also how hard is it to set this up with FreeBSD compaired to CentOS? I never used FreeBSD before, is it hard... (3 Replies)
Discussion started by: jwz104
3 Replies

3. Web Development

Building LAMP server from scratch (build a server with compiled LAMP from CentOS mini)

Hello everyone, I would like to setup a lamp server from a minimal distro and to compile PHP, MySQL and Apache myself. I have chosen CentOS minimal for the OS and I am trying to build the stack by hand... But well, it appears I need some help! First: I am looking for good and recent... (3 Replies)
Discussion started by: freddie50
3 Replies

4. UNIX for Dummies Questions & Answers

Generating server and client certificates

Hi, I am currently in the process of implementing port based authentication(802.1x) in my home network through radius(FreeRadius). I want all my clients to use a certificate for authenticating (eap-tls) However openssl's massive amount of configuration options has me a bit confused. And... (0 Replies)
Discussion started by: regexp
0 Replies

5. Linux

Moving Whole OS Centos Server

I currently have a web server its on a small harddrive I didn't know my site would grow so fast but now I need a bigger hard drive. Instead of adding another harddrive (host charge monthly of how many hard drives connected to server) is there anyway to just move the whole os to a bigger hard drive... (2 Replies)
Discussion started by: awww
2 Replies

6. UNIX for Advanced & Expert Users

Mail server in centos!!

Hi all!! 1. I am totally new to Mail server but now in our management decided to run own mail server, still now we are running our mail server using godaddy!! if we transfer all mail accounts to here means what are the steps i need to do?? 2. I have basic idea in postfix , which... (2 Replies)
Discussion started by: anishkumarv
2 Replies

7. UNIX for Dummies Questions & Answers

_/proc/stat vs /proc/uptime

Hi, I am trying to calculate the CPU Usage by getting the difference between the idle time reported by /proc/stat at 2 different intervals. Now the 4th entry in the first line of /proc/stat will give me the 'idle time'. But I also came across /proc/uptime that gives me 2 entries : 1st one as the... (0 Replies)
Discussion started by: coderd
0 Replies

8. Shell Programming and Scripting

Error in script to automate the daily monitoring process of UNIX server and it's proc

hi friends, I am trying to automate the daily monitoring process of UNIX server and it's processes. the script are below i executed the above script using ksh -x monitortest1.sh in root login . It shows error at some lines . 1. i logged in using root ,but it... (8 Replies)
Discussion started by: rdhaprakasam
8 Replies

9. Solaris

Problem in generating codes in solaris server!!

I have a solaris server having oracle and oracle apps running ! When some one attempts to generate a code, they click a link on the web interface which runs an rsh script from a computer called Helpdesk onto my solaris server and what happens is the web interface show an error message saying... (4 Replies)
Discussion started by: SmartestVEGA
4 Replies
Login or Register to Ask a Question