Login or Register to Ask a Question and Join Our Community


Emergency UNIX and Linux Support

[Solved] /var is filling continuously

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Homework and Emergencies Emergency UNIX and Linux Support [Solved] /var is filling continuously
# 1  
Old 09-12-2011
[Solved] /var is filling continuously
Hi All,

I have Solaris-10 machine. Yesterday I patched it with Solaris-10 patch Cluster. Since then glance software is filling up /var/core continuously. In every few minutes, it will fill /var to 100%.
Glance runs through /etc/init.d/mwa and I already stopped it, still core files are generating, I don't know, from where. How will I know and can stop it. Please help.

Code:
# ps -ef | egrep -i "mwa|glance"
    root 18647 17055   0 05:18:09 pts/2       0:00 egrep -i mwa|glance
# du -sh /var/core/*
 3.5G   /var/core/core_tstbgp11_glance_0_1984_1315829327_16469
 3.5G   /var/core/core_tstbgp11_glance_0_1984_1315829627_18040
 2.1G   /var/core/core_tstbgp11_glance_0_1984_1315829928_19553
# df -h .
Filesystem             size   used  avail capacity  Mounted on
/dev/vx/dsk/bootdg/var
                        12G    12G     0K   100%    /var
# uname -a
SunOS tstbgp11 5.10 Generic_144488-17 sun4u sparc SUNW,Sun-Fire-V490

Regards
# 2  
Old 09-12-2011
You can disable writing core files to /var/core by using:
Code:
coreadm -d global

But you should still investigate why your applications keeps crashing...
# 3  
Old 09-12-2011
See: When Glance stop working | System Adm
# 4  
Old 09-12-2011
Quote:
Originally Posted by yazu
Hi Yazu,

I tried your steps, but still it is generating core files
Code:
# ps -ef | egrep -i "sco|mwa|ttd|midaemon"
    root 10163 26426   0 06:27:37 pts/1       0:00 egrep -i sco|mwa|ttd|midaemon
# du -sh /var/core/*
 3.5G   /var/core/core_tstbgp11_glance_0_1984_1315833828_9576

# 5  
Old 09-12-2011
Can you try following below steps and see if you are still getting the core files.

Code:
 
/opt/perf/bin/mwa stop
/opt/perf/bin/midaemon -T [If the midaemon is still active]
/opt/perf/bin/ttd -k [If the ttd is still active]
/opt/perf/bin/perfstat

This will stop all the performance tools and you can see the same in the output of the last command.

After this the core files due to glance should not be there since we haven't started anything.

If still you are getting the core files, then please collect the below command output for every minute.

Code:
 
ps -ef

Once a core file is generated you can get the process number from its name and check which process is making it to crash and can daignose it better.

Regards,
Vishal
# 6  
Old 09-12-2011
Hi Vishal,

I ran all mentioned commands. /opt/perf/bin/perfstat also shows as below
Code:
MeasureWare scope status:
WARNING: scopeux    is not active (MWA data collector)
MeasureWare background daemon status:
(Should always be running when the system is up)
WARNING: ttd        is not active (Transaction Tracking daemon)
MeasureWare server status:
WARNING: alarmgen   is not active (alarm generator)
WARNING: agdbserver is not active (alarm database server)
WARNING: perflbd    is not active (location broker)
WARNING: rep_server is not active (repository server)

But still core file is generating
Code:
# ls -l /var/core
total 10943792
-rw-------   1 root     root     3772379034 Sep 12 07:16 core_tstbgp11_glance_0_1984_1315836828_24759
-rw-------   1 root     root     1828080968 Sep 12 07:19 core_tstbgp11_glance_0_1984_1315837127_26379
# ps -ef | egrep -i "sco|mwa|ttd|midaemon"
    root 24761     1   0 07:13:31 ?           0:00 /opt/perf/bin/midaemon
    root 26954 26426   0 07:20:06 pts/1       0:00 egrep -i sco|mwa|ttd|midaemon

I killed PID 24761, deleted core file, waited for 2 minutes. And again I can see core file is generating. Something is starting midaemon
Code:
# ls
core_tstbgp11_glance_0_1984_1315837428_28015
# ps -ef | egrep -i "sco|mwa|ttd|midaemon"
    root 28586 26426   0 07:24:29 pts/1       0:00 egrep -i sco|mwa|ttd|midaemon
    root 28017     1   0 07:23:31 ?           0:00 /opt/perf/bin/midaemon

# 7  
Old 09-12-2011
Post the output of
Code:
crontab -l
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

[bash] script is filling up my /var/log

I am trying to create a script that checks if my VPN connection is up and running... Everything seems to work as except but for some reason, the script fills up my /var/log/auth.log with the below information Dec 13 01:07:44 debian sudo: soichiro : TTY=pts/0 ; PWD=/home/soichiro/Desktop ;... (5 Replies)
Discussion started by: soichiro
5 Replies

2. Shell Programming and Scripting

Csh , how to set var value into new var, in short string concatenation

i try to find way to make string concatenation in csh ( sorry this is what i have ) so i found out i can't do : set string_buff = "" foreach line("`cat $source_dir/$f`") $string_buff = string_buff $line end how can i do string concatenation? (1 Reply)
Discussion started by: umen
1 Replies

3. Shell Programming and Scripting

[SOLVED] Read html attachment from /var/mail

Hi, I am receiving an email to the server with a html attachment. When I check the /var/mail the attachment is showing as junk characters. I want to move that html file to a particular location in that server. Please help me. Regards Neethu (4 Replies)
Discussion started by: Neethu
4 Replies

4. Emergency UNIX and Linux Support

Error filling /var/adm/messages

I have Solaris-11 non-global zone running under Solaris-11 global zone. Every few minutes, this message is getting in /var/adm/message of non-global zone Aug 31 08:31:53 zonnjc002dbp01 statd: statd: cannot talk to statd at NAS1, RPC: Timed out(5) NAS1 is already mounted as NFS and working... (2 Replies)
Discussion started by: solaris_1977
2 Replies

5. Shell Programming and Scripting

[Solved] Looping var from two files

Hey Guys, I have been searching but unable to find solution for this; Got 2 files: #File A A B C #File B 1 2 3 And would like to 'merge' file and get a out put like; A1 A2 A3 B1 (2 Replies)
Discussion started by: bsdguy
2 Replies

6. HP-UX

[Solved] /var directory in HP-UX is showing 95%?

Hi Everyone, My var directory is showing near to 100% ? What are the files should i delete to make it less?? Kindly suggest # bdf -i Filesystem kbytes used avail %used iused ifree %iuse Mounted on /dev/vg00/lvol3 1048576 107616 933616 10% 3342 29394 10% /... (10 Replies)
Discussion started by: yadvinder
10 Replies

7. Solaris

Difference between /var/log/syslog and /var/adm/messages

Hi, Is the contents in /var/log/syslog and /var/adm/messages are same?? Regards (3 Replies)
Discussion started by: vks47
3 Replies

8. Solaris

diff b/w /var/log/syslog and /var/adm/messages

hi sirs can u tell the difference between /var/log/syslogs and /var/adm/messages in my working place i am having two servers. in one servers messages file is empty and syslog file is going on increasing.. and in another servers message file is going on increasing but syslog file is... (2 Replies)
Discussion started by: tv.praveenkumar
2 Replies

9. UNIX for Advanced & Expert Users

diff command filling /var filesystem space

Hi, I am using diff command to check difference between two files.Both files are very big and when i execute this command /var temp space is filled up almost 99%. Can any one please tell me is there any way i can specify directory name which has more space so that diff can use that dir for... (2 Replies)
Discussion started by: ukatru
2 Replies

10. UNIX for Advanced & Expert Users

Process responsible for filling up /var/tmp

Hi, Help ! - I have a process which I cannot find that is writing to /var/tmp every 10 minutes and filling up my partition, it is also filling up my wtmpx file. I have some software error correction for a faulty DIMM at the moment - is this likely to be causing this as well as over-loading my... (3 Replies)
Discussion started by: Mal
3 Replies
Login or Register to Ask a Question