Unix/Linux Go Back    


High Performance Computing Message Passing Interface (MPI) programming and tuning, MPI library installation and management, parallel administration tools, cluster monitoring, cluster optimization, and more HPC topics.

How to check performance of your HPC cluster?

High Performance Computing


Closed    
 
Thread Tools Search this Thread Display Modes
    #1  
Old Unix and Linux 05-18-2012
albertspade albertspade is offline
Registered User
 
Join Date: Dec 2008
Last Activity: 1 June 2012, 12:52 AM EDT
Posts: 7
Thanks: 3
Thanked 0 Times in 0 Posts
How to check performance of your HPC cluster?

Hello Everybody,

I have few queries :

Do you have any idea how to check the performance of HPC cluster having mpich on top of centos 6.2?
Are there any standard programs (like FFT, graphics rendering etc) to check the performance of mpi cluster with single node and multiple nodes?
Can we check the performance of single core and dual core?
Can we benchmark small cluster of 4 nodes or is benchmarking softwares are only for big clusters?

Thanks..
Sponsored Links
    #2  
Old Unix and Linux 05-19-2012
otheus's Unix or Linux Image
otheus otheus is offline Forum Advisor  
Smartass
 
Join Date: Feb 2007
Last Activity: 6 September 2017, 5:43 AM EDT
Location: Innsbruck, Austria
Posts: 2,157
Thanks: 12
Thanked 51 Times in 48 Posts
the standard measuring tool is HPL which solves for a very large multidimensional array. Prepackaged rpms might be found in the Rocks distribution. The answer is yes to each of your other questions
The Following User Says Thank You to otheus For This Useful Post:
albertspade (05-20-2012)
Sponsored Links
    #3  
Old Unix and Linux 05-20-2012
albertspade albertspade is offline
Registered User
 
Join Date: Dec 2008
Last Activity: 1 June 2012, 12:52 AM EDT
Posts: 7
Thanks: 3
Thanked 0 Times in 0 Posts
Thanks for your help Otheus.
Linux
I am new to the field of HPC. I installed HPCC and HPL. Even I am able run it and get the results. But I am not able to understand it. Also its running for my colete cluster, I also want to run them for my single machine. And now I am not able to tell whether its running on both the cores of my machine or only one process per machine, as I am having core 2 duo machines.
    #4  
Old Unix and Linux 05-21-2012
otheus's Unix or Linux Image
otheus otheus is offline Forum Advisor  
Smartass
 
Join Date: Feb 2007
Last Activity: 6 September 2017, 5:43 AM EDT
Location: Innsbruck, Austria
Posts: 2,157
Thanks: 12
Thanked 51 Times in 48 Posts
"Understanding" isn't so important. At the end of the results, there is a number labeled "GLOPS". It looks like this:

Code:
WR00L2C2        8192    16     1     1             327.60          1.119e+00

The first column expresses some of the options used in the options (HPL.dat) file. The next two columns express the size in dimensions. The last column -- the one you want -- is the number of Gigaflops measured for that run. It's in scientific notation, meaning:

Code:
1.119 x 10^(00)  = 1.119 GFlops

If the output were 3.42e-01, then you'd have:

Code:
3.42 x 10^(-01) = 0.342 GFlops = 342 MFlops

Do you understand now?

---------- Post updated at 10:02 AM ---------- Previous update was at 09:34 AM ----------

As to how to configure this to run on multiple nodes, you have to (1) configure HPL.dat to run on mxn processors, where m and n are close together; so if you have a cluster containing 12 cores, optimal is normally m=3 and n=4. That's not always the case, but it typically is. (2) You must configure your MPI environment so that it runs on that many processors. How you do #2 depends on your MPICH software and setup. If you have a batch system like PBS or SGE, that further complicates the matter, as you need to queue the job with that number of processors. Sometimes with queuing engines, you can't easily dictate which nodes the job will run on. So if you have 6 nodes each with 4 cores, it might not be possible to say "run this on 3 nodes using all cores on each one". (But normally it's possible to say "run it on 3 nodes using 1 core on each one".)
The Following 2 Users Say Thank You to otheus For This Useful Post:
albertspade (05-21-2012), figaro (08-25-2012)
Sponsored Links
    #5  
Old Unix and Linux 05-21-2012
albertspade albertspade is offline
Registered User
 
Join Date: Dec 2008
Last Activity: 1 June 2012, 12:52 AM EDT
Posts: 7
Thanks: 3
Thanked 0 Times in 0 Posts
Thanks Otheus for your generous reply.
Its very helpful.Linux

I configured my system and somehow able to get the results from HPL.
I used one website which says "How do I tune my HPL.dat file?" http: //www.advancedclustering. com/faq/how-do-i-tune-my-hpldat-file.html to create the auto generated HPL.dat file.

The parameters which I used are :
Nodes: 5
Cores per Node: 2
Memory per Node (MB): 2048
Block Size (NB): 128

But I don't know whether the parameters which I used are correct or not.
I built a cluster of 5 PC's and all of them are having intel core 2 duo processors. I don't even know what this block size signifies.

Also, is there a way to chaeck the performance of single PC with respect to its individual core? As I am having Core 2 duo PC, I want to check the performance of this PC while its using single core and on the other hand when it uses both cores.

Thanks.

---------- Post updated at 01:46 PM ---------- Previous update was at 01:30 PM ----------

I have one more query.Linux
While going through website http ://hpl-calculator.sourceforge.net/
I came across one more parameter Operations Per Cycle, which by default they used 4. I don't understand how to calculate this value. I googled and there are various terms, flops, mips, instructions per cycle, instructions per second and other things. can you tell me how to calculate this value for core 2 duo processor and i7 processor? As now a days multiple cores are there in PCs this per second calculations are for single core or multiple core?

Thanks again...
Sponsored Links
Closed

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Linux More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
How to check if a filesystem is part of a cluster asanchez AIX 2 03-01-2011 10:17 AM
Cluster check anshu ranjan Linux 4 11-11-2010 05:19 AM
How to check if the server is on a Cluster jinslick25 UNIX for Dummies Questions & Answers 6 03-19-2010 03:57 PM
Monitoring script to check if cm cluster is up or not. sparcguy Shell Programming and Scripting 2 01-15-2010 02:10 AM
how to check all the applications are in cluster using shell script ahamed Shell Programming and Scripting 2 12-11-2009 10:36 AM



All times are GMT -4. The time now is 02:15 PM.