The UNIX and Linux Forums  
Hello and Welcome from to the UNIX and Linux Forums! Thank You for Visiting and Joining Our Global Community.

Go Back   The UNIX and Linux Forums > Special Forums > High Performance Computing
.
google unix.com



High Performance Computing Message Passing Interface (MPI) programming and tuning, MPI library installation and management, parallel administration tools, cluster monitoring, cluster optimization, and more HPC topics.

More UNIX and Linux Forum Topics You Might Find Helpful
Thread Thread Starter Forum Replies Last Post
MySQL Cluster - Designing, Evaluating and Benchmarking (reg. req'd) iBot High Performance Computing 0 09-30-2008 02:50 PM
Building a Solaris Cluster Express cluster in a VirtualBox on OpenSolaris iBot High Performance Computing 0 09-09-2008 11:55 AM
IOzone for filesystem performance benchmarking iBot UNIX and Linux RSS News 0 07-03-2008 05:20 AM
HP-Unix Hardware benchmarking dgatkal HP-UX 0 12-11-2006 01:50 AM
Server and Workstation benchmarking Sergiu-IT UNIX Benchmarks 0 03-29-2005 02:40 PM

Closed Thread
English Japanese Spanish French German Portuguese Italian Dutch Swedish Russian Norwegian Hungarian Hebrew Danish Bulgarian Greek Powered by Powered by Google
 
LinkBack Thread Tools Search this Thread Rating: Thread Rating: 1 votes, 5.00 average. Display Modes
  #1 (permalink)  
Old 05-11-2009
mercthunder mercthunder is offline
Registered User
  
 

Join Date: Apr 2009
Posts: 10
Quote:
Originally Posted by otheus View Post
You are getting a different error.
Code:

HPL ERROR from process # 0, on line 621 of function HPL_pdinfo:
>>> Illegal input in file HPL.dat. Exiting ... <<<
Unfortunately, I don't have access to the source code to say what the error is. The HPL.dat file I posted was a suggested sample based on my reading of internet documentation. It could be that documentation is out-of-date or perhaps newer or perhaps just wrong. Check the README and/or sample HPL.dat files that came with you HPL and go through them line-by-line vis-a-vis your own.
Hi Otheus, same error as the other day, just that i accidently didnt copy the part of the error about there needing to be a certain number of processes for the test. The thing is, when i change the P and Q values to 1 and 1 respectively within the HPL.dat file, it works, and it performs the tests. The moment i make them anything other than 1 and 1, such as 2 and 4 to run across 8 processes on 2 nodes, then it gives me the original error message.

Been stumped for weeks now =(

Edit: The full error message being received is still the same as the other one:

"HPL ERROR from process # 0, on line 419 of function HPL_pdinfo:
>>> Need at least 8 processes for these tests <<<

HPL ERROR from process # 0, on line 621 of function HPL_pdinfo:
>>> Illegal input in file HPL.dat. Exiting ... <"

Last edited by mercthunder; 05-11-2009 at 11:27 AM.. Reason: Adding full error message
  #2 (permalink)  
Old 05-11-2009
otheus's Avatar
otheus otheus is offline Forum Staff  
Moderator ala Mode
  
 

Join Date: Feb 2007
Location: Innsbruck, Austria
Posts: 1,886
Did you make sure you compiled with your MPI installation, with mpicc ??
  #3 (permalink)  
Old 05-11-2009
mercthunder mercthunder is offline
Registered User
  
 

Join Date: Apr 2009
Posts: 10
Quote:
Originally Posted by otheus View Post
Did you make sure you compiled with your MPI installation, with mpicc ??
Hi Otheus, thanks for your reply.

By "compiled with your MPI installation", do you mean simply placing openmpi in the execution line, such as:

mpirun -np 8 -machinefile machines xhpl_em64t

That is the line i have been using, to make use of openmpi.

I apologise if this is not what you meant, i am still very new to all this, as well as linux, a total newbie i might add, but decided to take on this challenging task at uni for a research topic, and to learn about linux.

Hoping you can shed some light on what you meant by "compiled with your MPI installation", or how i go about doing this.

Thanks Otheus.
  #4 (permalink)  
Old 05-11-2009
otheus's Avatar
otheus otheus is offline Forum Staff  
Moderator ala Mode
  
 

Join Date: Feb 2007
Location: Innsbruck, Austria
Posts: 1,886
How did you compile and install this program?
  #5 (permalink)  
Old 05-11-2009
mercthunder mercthunder is offline
Registered User
  
 

Join Date: Apr 2009
Posts: 10
Quote:
Originally Posted by otheus View Post
How did you compile and install this program?
Oh the software was already installed by the university. I am using the university cluster to run these tests, with open mpi, and Linpack Benchmark all already installed and have been told by the administrator that they are all working properly, and that i just need to know how to learn to use Linpack and tune the Dat file.

Just that once the values of P and Q are other than 1 and 1 in the dat file, then the errors begin.
  #6 (permalink)  
Old 05-11-2009
otheus's Avatar
otheus otheus is offline Forum Staff  
Moderator ala Mode
  
 

Join Date: Feb 2007
Location: Innsbruck, Austria
Posts: 1,886
Quote:
Oh the software was already installed by the university...have been told by the administrator that they are all working properly
Uh-hunh. I wouldn't completely trust that if I were you. Let's take it step-by-step.
  1. Use "type" or "which" or "whence" to find the full path of the linpack executable:
    Code:
    type -a hpl
  2. verify this has been compiled dynamically and not statically:
    Code:
    file <hpl path from step 1>
    You should see something like "Dynamically linked i386 object". As long as you don't see "statically linked binary" proceed to the next step. Otherwise, talk to your system admin and ask him/her very specifically how he/she compiled it.
  3. Next, run
    Code:
    ldd <hpl path from step 1>
    You should see something like "libopen-rte.so" in the output. If you do not, ask your sysadmin to point you to the correct hpl, the one this is compiled "against" (with) the openMPI runtimes.
  4. The libopen-rte.so should point to the full path of a file. If it does not, again, go to your system administrator and ask him/her for the full LD_LIBRARY_PATH that you should have to run against this hpl program.
  5. The path should be available to you by default on all machines in the cluster. If not, add the LD_LIBRARY_PATH setting into the .bashrc file and include your .bashrc from your .bash_profile (if you're using csh, god help you; if ksh, just change the names to .kshrc and .profile). Now log into the other machine and run the ldd command as above; you should see the line pointing to the full path of the MPI rte library.
  6. Make sure this all works by running:
    Code:
    mpirun -np 8 printenv LD_LIBRARY_PATH
    You should get 8 instances of the correct LD_LIBRARY_PATH.
  7. Now go back and try getting this to run for exactly 2 processes. (P=2, Q=1, -np 2)
  8. Now modify the machine file so it has two lines in it, one for each hostname, and run it again.
  9. If we're at this point, try again with 8; if it fails, there are some other things to look at and try.
Bits Awarded / Charged to otheus for this Post
Date User Comment Amount
05-20-2009 Neo Great job otheus! 1,000
  #7 (permalink)  
Old 05-11-2009
mercthunder mercthunder is offline
Registered User
  
 

Join Date: Apr 2009
Posts: 10
Quote:
Originally Posted by otheus View Post
Uh-hunh. I wouldn't completely trust that if I were you. Let's take it step-by-step.
  1. Use "type" or "which" or "whence" to find the full path of the linpack executable:
    Code:
    type -a hpl
Hi Otheus. After typing in which -a hpl, this is what comes up:

/usr/bin/which: no hpl in (/usr/local/openmpi-1.2.6/bin:/usr/local/lam-7.1.4/bin:/usr/local/openmpi-1.2.6/bin:/usr/local/lam-7.1.4/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/bin:/usr/X11R6/bin:/usr/NX/bin:/home/jleungsh/bin:/usr/NX/bin)

Which of those directories is the correct one?

I have skipped down to step 6 in the mean time, and i get this:

[jleungsh@hydrus14 em64t]$ mpirun -np 8 printenv LD_LIBRARY_PATH
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:



Thanks

Last edited by mercthunder; 05-11-2009 at 10:53 PM..
Closed Thread

Bookmarks

Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On




All times are GMT -4. The time now is 01:16 AM.


Powered by: vBulletin, Copyright ©2000 - 2006, Jelsoft Enterprises Limited. Language Translations Powered by .
vBCredits v1.4 Copyright ©2007 - 2008, PixelFX Studios
The UNIX and Linux Forums Content Copyright ©1993-2009. All Rights Reserved.Ad Management by RedTyger

Content Relevant URLs by vBSEO 3.2.0