High Performance Computing

Sorry, try:

which xhpl_em64t

Ok Otheus, i have done everything you have said, and still the same error.

This is the output from steps 1-2:

in_intel/em64t/xhpl_em64t
/opt/intel/mkl/10.0.1.014/benchmarks/mp_linpack/bin_intel/em64t/xhpl_em64t: ELF 64-bit LSB executable, AMD x86-64, version 1 (SYSV), for GNU/Linux 2.4.1, dynamically linked (uses shared libs), for GNU/Linux 2.4.1, not stripped.

Output from step 3:

libpthread.so.0 => /lib64/libpthread.so.0 (0x0000003d2c400000)
librt.so.1 => /lib64/librt.so.1 (0x0000003d31000000)
libdl.so.2 => /lib64/libdl.so.2 (0x0000003d2c000000)
libm.so.6 => /lib64/libm.so.6 (0x0000003d2bc00000)
libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x0000003d30000000)
libc.so.6 => /lib64/libc.so.6 (0x0000003d2b800000)
/lib64/ld-linux-x86-64.so.2 (0x0000003d2a600000)

Output from step 6:

/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:
/usr/local/openmpi-1.2.6/lib:

I then opened the HPL.dat, and made P = 2, Q = 1.

I then opened my machines file, and included the names of the node i am logged into, plus another free node:
hydrus1
hydrus2

And then i ran this command from the terminal:

mpirun -np 2 -machinefile machines xhpl_em64t

And i was displayed with the following error:

HPL ERROR from process # 0, on line 419 of function HPL_pdinfo:
>>> Need at least 2 processes for these tests <<<

HPL ERROR from process # 0, on line 621 of function HPL_pdinfo:
>>> Illegal input in file HPL.dat. Exiting ... <<<

HPL ERROR from process # 0, on line 419 of function HPL_pdinfo:
>>> Need at least 2 processes for these tests <<<

HPL ERROR from process # 0, on line 621 of function HPL_pdinfo:
>>> Illegal input in file HPL.dat. Exiting ... <<<



I am really desperate to get this to work, have been trying for weeks.


Thanks for your help once again Otheus, i really appreciate the efforts you are going to.

As I suspected, your administrator did not give you the MPI version; rather he compiled it for the threading model. Show your administrator the output from step 3 and kindly ask him/her to recompile it for you with the OpenMPI.

After that, everything should work fine.

I was able to succesfully run xhpl using your HPL.dat file on 6 processors across 2 nodes.

The command used was:

Code:

mpirun -mca btl tcp,self -np 6 -hostfile machines ./xhpl

(Note the "-mca btl tcp,self" is to avoid warnings and errors w.r.t. Infiniband, which we don't have here. If this is your problem, it's still your admin's fault!)

The machines file was as follows:

Code:

sandbox
sandbox
sandbox2
sandbox2
sandbox2
sandbox2

The HPL.dat file was identical to the one you posted here, with the exception of Q = 3 (since I have one 4-cpu host and one 2-cpu host). Also HPL.out was changed to 340 for speed reasons, but prior tests indicated it worked well to at least 2500 on my hosts. Large values of N may cause the system to run out of memory, but this would be a different error.


To compile the HPL program, I used the command "make arch=TIS" (my firm is called Tiscover) and the following Makefile (Make.TIS). For your admin's sake, I have hilighted some important changes:

Code:

SHELL        = /bin/sh
CD           = cd
CP           = cp
LN_S         = ln -s
MKDIR        = mkdir
RM           = /bin/rm -f
TOUCH        = touch
ARCH         = TIS
TOPdir       = $(HOME)/downloads/hpl-2.0
INCdir       = $(TOPdir)/include
BINdir       = $(TOPdir)/bin/$(ARCH)
LIBdir       = $(TOPdir)/lib/$(ARCH)
HPLlib       = $(LIBdir)/libhpl.a
MPinc        =
MPlib        =
LAdir        =
LAinc        =
LAlib        = /usr/lib/libblas.a
F2CDEFS      = -DAdd__ -DF77_INTEGER=int -DStringSunStyle
HPL_INCLUDES = -I$(INCdir) -I$(INCdir)/$(ARCH) $(LAinc) $(MPinc)
HPL_LIBS     = $(HPLlib) $(LAlib) $(MPlib)
HPL_OPTS     =
HPL_DEFS     = $(F2CDEFS) $(HPL_OPTS) $(HPL_INCLUDES)
CC           = /usr/bin/mpicc
CCNOOPT      = $(HPL_DEFS)
CCFLAGS      = $(HPL_DEFS) -fomit-frame-pointer -O3 -funroll-loops
LINKER       = /usr/bin/mpif77
LINKFLAGS    = $(CCFLAGS)
ARCHIVER     = ar
ARFLAGS      = r
RANLIB       = echo