Unix/Linux Go Back    

Red Hat Red Hat is the world's leading open source technology solutions provider with offerings including Red Hat Enterprise Linux (RHEL), Fedora, open source applications, security and systems management, virtualization, and Services Oriented Architecture (SOA) solutions.

How to troubleshoot a 1000 nodes Apache cluster?

Red Hat

Thread Tools Search this Thread Display Modes
Old Unix and Linux 01-02-2013   -   Original Discussion by admin_xor
admin_xor's Unix or Linux Image
admin_xor admin_xor is offline
Registered User
Join Date: Jun 2011
Last Activity: 3 May 2015, 12:12 PM EDT
Posts: 452
Thanks: 13
Thanked 80 Times in 76 Posts
RedHat How to troubleshoot a 1000 nodes Apache cluster?

Hi all.

May I get some expert advice on troubleshooting performance issues of a 1000 nodes Apache LB cluster. Users report slow loading/response of webpages. Different websites are hosted on this cluster for different clients. But all are reporting the same issue.

Could you please let me know what all basic aspects you would take into consideration for this sort of issue.

FYI. I do not have access to the load-balancers.
Sponsored Links
Old Unix and Linux 01-02-2013   -   Original Discussion by admin_xor
thmnetwork thmnetwork is offline
Registered User
Join Date: Mar 2004
Last Activity: 13 April 2013, 4:20 PM EDT
Location: Boise, Idaho, United States
Posts: 144
Thanks: 13
Thanked 6 Times in 6 Posts
The load balancer is going to be a choking point (bandwidth and CPU utilization-wise). If it's bandwidth you may consider increasing the number of links. You can try to increase links through interface bonding. If it's CPU utilization, you might consider multiple load balances (kind of like google.com does) so you can spread load amongst several physical machines. I'd recommend doing that latter anyways, for availability reasons.

Before anyone can give you specific advice though, you need to localize the performance issue. For example, if you run a jMeter test against the serving nodes directly is that faster? If it is, then the load balancer is the choke point. If not then you may check to see if the network links are being saturated with some sort of command-line bandwidth checking tool (I use bwm-ng). If that's not the issue then move onto CPU, memory, etc. Once you've done that you should be in a better position to do something about the performance problems.

It's also possible that it's an application-level latency. For example if a particular website is served by a particular DB cluster and that cluster is going slow it may slow down the end user's experience.
Sponsored Links

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Linux More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
What is the procedure to reboot cluster nodes newtoaixos Solaris 7 12-14-2011 02:47 PM
Need advise on setting up solaris 10 2 nodes cluster spitfire2011 Solaris 3 08-18-2011 10:20 AM
Centos/rhel 5 cluster 3 nodes with out Quorum Flomaster Red Hat 3 06-12-2011 06:37 AM
Rebooting 3 to 1 Cluster nodes. EmbedUX Emergency UNIX and Linux Support 4 05-27-2010 07:34 AM
Bonding, IP alias, Virtual IP, 2 nodes cluster Danny Gilbert High Performance Computing 0 07-28-2008 10:56 PM

All times are GMT -4. The time now is 06:51 PM.