Sponsored Content
Full Discussion: MySQL Performance Problems
The Lounge What is on Your Mind? MySQL Performance Problems Post 303041393 by Neo on Friday 22nd of November 2019 06:14:47 AM
Old 11-22-2019
I just completed (for the most part) a database optimization which was slowing the site down.

In a nutshell, when I created some new code to mitigate against Google soft 404 "errors" (slim content) by adding matching man pages to posts with very little content, I used a "real time" FULLTEXT search of over 350K man pages, and this was causing some performance issues.

Plus, my new code worked, and Google search referrals have just about doubled since I created the solution, but the upside/downside was that the site traffic also doubled (which is a good thing) and the new queries were killing performance (a bad thing).

In the final optimization, I preprocessed all these matches and stored the results in the DB (the ids of all the man pages which match the discussion contents) so, the long MySQL queries doing these FULLTEXT NATURAL LANGUAGE searches on the fly were eliminated (right now about 99.5+ are gone, I have about a half a day of processing to get to 99.999 percent.

The performance improvement is remarkable and the site is much faster, and I have earned my black belt (or at least a brown belt) in MySQL performance tuning, after all these years.

Smilie Smilie Smilie Smilie Smilie Smilie
This User Gave Thanks to Neo For This Post:
 

4 More Discussions You Might Find Interesting

1. AIX

Performance and paging problems

... a disk drive to be 100% busy? hdisk0 100.0 1.3K 342.7 1.3K 22.0 PgspIn 651 % Noncomp 75.5 hdisk1 100.0 1.3K 320.2 1.2K 20.0 PgspOut 6 % Client 75.5 It's really slowing down performance on my system and I would like to know what is causing this. ... (2 Replies)
Discussion started by: bbbngowc
2 Replies

2. SCO

CPU Performance Problems on VMWARE

hi We have migrated SCO 5.0.6 into ESX4, but the VM eats 100% of the virtual CPU. Here is top print from the SCO VM: last pid: 16773; load averages: 1.68, 1.25, 0.98 02:08:41 79 processes: 75 sleeping, 2 running, 1 zombie, 1 onproc CPU states: 0.0% idle, 17.0% user,... (7 Replies)
Discussion started by: ccc
7 Replies

3. AIX

AIX 5.3 performance problems

Hello, I encounter some performance issues on my AIX 5.3 server running in a LPAR on a P520. How do I investigate performance issues in AIX. Is there any kind of procedure that takes me to the steps to investigate my server and find the sub systems that is causing the issues? The performance... (1 Reply)
Discussion started by: petervg
1 Replies

4. Programming

Xlib - Rotation and interpolation of pixmap - Performance problems

I need to rotate a pixmap in XLib with some kind of interpolation to reduce the aliasing. I came up with the following code, which uses bilinear interpolation. It works fine: the rotated image looks perfect, but unfortunately it takes 5 or 6 seconds for each rotation. (in a 300x300, 16 colours... (5 Replies)
Discussion started by: mghis
5 Replies
MAN(1)							    BSD General Commands Manual 						    MAN(1)

NAME
man -- display the on-line manual pages (aka ``man pages'') SYNOPSIS
man [-acw|-h] [-C file] [-M path] [-m path] [-S srch] [[-s] section] name ... man -k [-C file] [-M path] [-m path] keyword ... man -p DESCRIPTION
The man utility displays the manual pages named on the command line. Its options are as follows: -a Display all of the man pages for a specified section and name combination. (Normally, only the first man page found is displayed.) -C Use the specified file instead of the default configuration file. This permits users to configure their own man environment. See man.conf(5) for a description of the contents of this file. -c Copy the man page to the standard output instead of using more(1) to paginate it. This is done by default if the standard output is not a terminal device. -h Display only the ``SYNOPSIS'' lines of the requested man pages. For commands, this is typically the command line usage information. For library functions, this usually contains the required include files and function prototypes. -k Display the header lines for any man pages matching keyword(s), in the same manner as apropos(1). -M Override the list of standard directories which man searches for man pages. The supplied path must be a colon (``:'') separated list of directories. This search path may also be set using the environment variable MANPATH. The subdirectories to be searched, and their search order, is specified by the ``_subdir'' line in the man configuration file. -m Augment the list of standard directories which man searches for man pages. The supplied path must be a colon (``:'') separated list of directories. These directories will be searched before the standard directories or the directories specified using the -M option or the MANPATH environment variable. The subdirectories to be searched, and their search order, is specified by the ``_subdir'' line in the man configuration file. -p Print the search path for the manual pages. -s Restrict the directories that man will search to the specified section. The man configuration file (see man.conf(5)) specifies the possible section values that are currently available. -S Display only man pages that have the specified string in the directory part of their filenames. This allows the man page search process criteria to be narrowed without having to change the MANPATH or ``_default'' variables. -w List the pathnames of the man pages which man would display for the specified section and name combination. If the '-s' option is not specified, there is more than one argument, the '-k' option is not used, and the first argument is a valid section, then that argument will be used as if specified by the '-s' option. If name is given with a full or relative path then man interprets it as a file specification, so that you can do man ./foo.5 or even man /cd/foo/bar.1.gz. ENVIRONMENT
MACHINE As some man pages are intended only for specific architectures, man searches any subdirectories, with the same name as the current architecture, in every directory which it searches. Machine specific areas are checked before general areas. The current machine type may be overridden by setting the environment variable MACHINE to the name of a specific architecture. MANPATH The standard search path used by man may be overridden by specifying a path in the MANPATH environment variable. The format of the path is a colon (``:'') separated list of directories. The subdirectories to be searched as well as their search order is speci- fied by the ``_subdir'' line in the man configuration file. PAGER The pagination command used for writing the output. If the PAGER environment variable is null or not set, the standard pagination program more(1) will be used. FILES
/etc/man.conf default man configuration file. /usr/{share,X11R7,pkg,local}/man/whatis.db standard whatis/apropos database search path, set in /etc/man.conf. SEE ALSO
apropos(1), whatis(1), whereis(1), man.conf(5), mdoc(7), mdoc.samples(7) STANDARDS
man conforms to X/Open Commands and Utilities Issue 5 (``XCU5''). BUGS
The on-line man pages are, by necessity, forgiving toward stupid display devices, causing a few man pages to be not as nicely formatted as their typeset counterparts. BSD
October 7, 2011 BSD
All times are GMT -4. The time now is 03:14 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy