Temp mysql files jamming CPU resources Post: 302438488

Sponsored Content

Top Forums UNIX for Dummies Questions & Answers Temp mysql files jamming CPU resources Post 302438488 by egully on Tuesday 20th of July 2010 01:27:09 AM

07-20-2010

Registered User

Temp mysql files jamming CPU resources

Hello Friends

I am currently facing high CPU usage problem which is making my site extremely slow.
Currently I am using a 8GB RAM with 8 cores but, the creation of temporary files is eating away a lot of the CPU resource making the site very slow.
The normal CPU load average remains below 2-3 but, suddenly it shoots to double digits in order of 20-30
On investigating the mysql data files, I could see huge files created as listed below :

Code:

/var/tmp/#sql_25dd_0.MYD 
/var/tmp/#sql_25dd_1.MYD 
/var/lib/mysql/egully1_cpdata2009/isc_product_search.MYD 
/var/lib/mysql/egully1_cpdata2009/isc_product_search.MYD 
/var/lib/mysql/egully1_cpdata2009/isc_product_search.MYD 
/var/lib/mysql/egully1_cpdata2009/isc_product_search.MYD 
/var/lib/mysql/egully1_cpdata2009/isc_product_search.MYI

These files are in order of 0.5-2.5GB.
After restarting mysql all the temp files gets deleted and system gets back to normal. But, after some time the problem again resurfaces.

Can anyone suggest how to deal with this problem and how to flush huge temp files from system to keep the site performance smooth.

Last edited by Scott; 07-20-2010 at 02:32 AM.. Reason: Code tags

egully

View Public Profile for egully

Find all posts by egully

8 More Discussions You Might Find Interesting

1. Programming

Application occupying CPU resources

Dear all, I have a pro c application running in the unix environement. This pro c program actually trigger by a java application from sun workstation. Recently, when we released a new proc c application and notice that the application occupying the CPU resources even through we check that the...

2. Linux

Shared web server resources (CPU&RAM)

Hello, guys ! Long time no seen. I have a question about Linux web servers. I guess it is a more general question, but in my case it is a Linux web server. I want to know how much RAM memory should I put on my servers. Do you have some formula or guidelines on how should I calculate the amount...

3. Solaris

CPU resources

Hi, I got a solarsi 10 box with 9 zones and the cpu shares as following ID NAME SHARES 0 global 1 1 FMW1 100 2 FMW2 100 3 OID1 100 4 OID2 100 5 OVD1 100 6 OID0 100 7 FMW5 100 8...

4. UNIX for Dummies Questions & Answers

Security issue and temp files

Hello, One of the senior network admins at work told me that I should not hard code temp files into my scripts. Rather I should use the mktemp commands in the script to create them on the fly. His argument was that if a malicious user knew the name of my temp files in the script they could...

5. Shell Programming and Scripting

temp files

Hi there, As a regular unix user I am forever programming on the command line or writing scripts so that I first write a load of data to a file to read from. In the end I am always left with a bundle of .txt, .tmp which is what I usually call them. As a basic programmmer I was wondering is...

6. Shell Programming and Scripting

RMTF (ReMove Temp Files)

Heyas As some applications (sed,grep,vi, etc) create some tempfiles, i'd changed a script to this: (sadly i cant find the original post (code) anymore (which just removed 2 'diffrent kinds'), just similar ones - forgot that as i was new to all this) :) ~ $ cat $(which rmtf) #!/bin/sh #...

7. Solaris

Sun Fire V210 CPU Fan Temp too high?

Hey, I have a V210 with a failed CPU fan. The temperature is currently at 84C and I've been asked to wait a few weeks before replacing as its a production system and it cant be shut down yet. Is it too hot? Do I risk killing the CPU at this temp? Its been like this for a few weeks now...

8. Shell Programming and Scripting

Removing large number of temp files

Hi All, I am having a situation now to delete a huge number of temp files created during run times approx. 16700+ files. We have never imagined that we will get this this much big list of files during run time. It worked fine for lesser no of files in the list. But when list is huge we are...

LEARN ABOUT DEBIAN

dbix::searchbuilder::handle::mysql

DBIx::SearchBuilder::Handle::mysql(3pm) 		User Contributed Perl Documentation		   DBIx::SearchBuilder::Handle::mysql(3pm)

NAME

	 DBIx::SearchBuilder::Handle::mysql - A mysql specific Handle object

SYNOPSIS

DESCRIPTION

       This module provides a subclass of DBIx::SearchBuilder::Handle that compensates for some of the idiosyncrasies of MySQL.

METHODS

   Insert
       Takes a table name as the first argument and assumes that the rest of the arguments are an array of key-value pairs to be inserted.

       If the insert succeeds, returns the id of the insert, otherwise, returns a Class::ReturnValue object with the error reported.

   SimpleUpdateFromSelect
       Customization of "SimpleUpdateFromSelect" in DBIx::SearchBuilder::Handle.  Mysql doesn't support update with subqueries when those fetch
       data from the table that is updated.

   DatabaseVersion
       Returns the mysql version, trimming off any -foo identifier

   CaseSensitive
       Returns undef, since mysql's searches are not case sensitive by default

   SimpleDateTimeFunctions
       Returns hash reference with specific date time functions of this database for "DateTimeFunction" in DBIx::SearchBuilder::Handle.

   ConvertTimezoneFunction
       Custom implementation of "ConvertTimezoneFunction" in DBIx::SearchBuilder::Handle.

       Use the following query to get list of timezones:

	   SELECT Name FROM mysql.time_zone_name;

       Read docs about keeping timezone data up to date:

	   http://dev.mysql.com/doc/refman/5.5/en/time-zone-upgrades.html

AUTHOR

       Jesse Vincent, jesse@fsck.com

SEE ALSO

       DBIx::SearchBuilder, DBIx::SearchBuilder::Handle

perl v5.14.2							    2011-09-21				   DBIx::SearchBuilder::Handle::mysql(3pm)