IRIX mpirun error!! - High Level Programming

lakeat · #1 (**permalink**) 05-14-2008

Dear Experts,

I have been suffering in porting a CFD code called OpenFOAM to sgi-IRIX system for many months but to no avail, and the problem is about MPI!
I installed gcc-4.3.0, gnu-binutils for my compilation.
And after the building process, I can run the executive with single CPU, but when I use mpirun to run the program, it failed strangely.
I use Sgi-native mpirun and debug option is on!
The CFD codes can be built and run very well on linux.

Could anyone help me examine these error messages, where on earth is the problem?

I have also attached a "par -s -SS -i mpirun -np 4 `which icoFoam` $FOAM_RUN/tutorials/icoFoam cavity -parallel > why.log" file.
what "ldd" shows seems everything is okay.

Any help would be highly appreciated!

Daniel

Quote:

bash-2.05$ mpirun -np 4 `which icoFoam` $FOAM_RUN/tutorials/icoFoam cavity -parallel
MPI Pstream initialized with:
floatTransfer : 1
nProcsSimpleSum : 0
scheduledTransfer : 0

/*---------------------------------------------------------------------------*\
| ========= | |
| \\ / F ield | OpenFOAM: The Open Source CFD Toolbox |
| \\ / O peration | Version: 1.4.1-dev |
| \\ / A nd | Web: OpenFOAM: The Open Source Computational Fluid Dynamics (CFD) Toolbox |
| \\/ M anipulation | |
\*---------------------------------------------------------------------------*/

Exec : /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/bin/sgiN32GccDPDebug/icoFoam /disk4/usr/people/student3/OpenFOAM/student3-1.4.1-dev/run/tutorials/icoFoam cavity -parallel
[0] Date : Apr 28 2008
[0] Time : 16:44:15
[0] Host : onyx-bridge
[0] PID : 513629
[3] Date : Apr 28 2008
[3] Time : 16:44:15
[3] Host : onyx-bridge
[3] PID : 513638
[1] Date : Apr 28 2008
[1] Time : 16:44:15
[1] Host : onyx-bridge
[1] PID : 513610
[2] Date : Apr 28 2008
[2] Time : 16:44:15
[2] Host : onyx-bridge
[2] PID : 513608
MPI: Program /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/bin/sgiN32GccDPDebug/icoFoam, Rank 3, Process 513638 received signal SIGBUS(10)

MPI: --------stack traceback-------
PC: 0x5ddb100 MPI_SGI_stacktraceback in /usr/lib32/libmpi.so
PC: 0x5ddb544 first_arriver_handler in /usr/lib32/libmpi.so
PC: 0x5ddb7d8 slave_sig_handler in /usr/lib32/libmpi.so
PC: 0xfaee79c _sigtramp in /usr/lib32/libc.so.1
libexc(513638): ERROR __exc_get_fde_name: Couldn't find any name at 0x60204334 in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
0 0x60197ac8 abs
(a lot of messages the same as above)
(......)
115 0x60197ac8 abs
PC: 0x42d432c (null) in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
0 0x60197ac8 abs
(a lot of messages the same as above)
(......)
6 0x60197ac8 abs
libexc(513638): ERROR __exc_get_fde_name: Couldn't find any name at 0x6020374c in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
7 0x60197ac8 abs
(a lot of messages the same as above)
(......)
115 0x60197ac8 abs
PC: 0x42d3744 (null) in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
libexc(513638): ERROR __exc_get_fde_name: Couldn't find any name at 0x602064bc in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
0 0x60197ac8 abs
(a lot of messages the same as above)
(......)
115 0x60197ac8 abs
PC: 0x42d64b4 (null) in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
libexc(513638): ERROR __exc_get_fde_name: Couldn't find any name at 0x601ee308 in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
0 0x60197ac8 abs
(a lot of messages the same as above)
(......)
115 0x60197ac8 abs
PC: 0x42be300 (null) in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
libexc(513638): ERROR __exc_get_fde_name: Couldn't find any name at 0x601c262c in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
0 0x60197ac8 abs
(a lot of messages the same as above)
(......)
115 0x60197ac8 abs
PC: 0x4292624 (null) in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
libexc(513638): ERROR __exc_get_fde_name: Couldn't find any name at 0x601b0904 in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
0 0x60197ac8 abs
(a lot of messages the same as above)
(......)
115 0x60197ac8 abs
PC: 0x42808fc (null) in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
PC: 0x1002aeec main in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/bin/sgiN32GccDPDebug/icoFoam

MPI: dbx version 7.3.3 (78517_Dec16 MR) Dec 16 2001 07:45:22
MPI: Process 513638 (icoFoam) stopped at [__waitsys:24 +0x8,0xfa53338]
MPI: Source (of /xlv42/6.5.23m/work/irix/lib/libc/libc_n32_M4/proc/waitsys.s) not available for Process 513638
MPI: > 0 __waitsys(0x0, 0x7d662, 0x7ffb5080, 0x3, 0x0, 0x7ffb4ec8, 0x0, 0xf8) ["/xlv42/6.5.23m/work/irix/lib/libc/libc_n32_M4/proc/waitsys.s":24, 0xfa53338]
MPI: 1 _system(0x7ffb5150, 0x7d662, 0x7ffb5080, 0x3, 0x0, 0x7ffb4ec8, 0x0, 0xf8) ["/xlv42/6.5.23m/work/irix/lib/libc/libc_n32_M4/stdio/system.c":116, 0xfa5f868]
MPI: 2 MPI_SGI_stacktraceback(0x0, 0x7d662, 0x7ffb5080, 0x3, 0x0, 0x7ffb4ec8, 0x0, 0xf8) ["/xlv4/mpt/1.8/mpi/work/4.3/lib/libmpi/libmpi_n32_M4/adi/sig.c":242, 0x5ddb268]
MPI: 3 first_arriver_handler(0xa, 0x71756974, 0x7ffb5080, 0x3, 0x0, 0x7ffb4ec8, 0x0, 0xf8) ["/xlv4/mpt/1.8/mpi/work/4.3/lib/libmpi/libmpi_n32_M4/adi/sig.c":445, 0x5ddb544]
MPI: 4 slave_sig_handler(0xa, 0x7d662, 0x7ffb5080, 0x3, 0x0, 0x7ffb4ec8, 0x0, 0xf8) ["/xlv4/mpt/1.8/mpi/work/4.3/lib/libmpi/libmpi_n32_M4/adi/sig.c":542, 0x5ddb7e0]
MPI: 5 _sigtramp(0x0, 0x7d662, 0x0, 0x3, 0x0, 0x0, 0x0, 0xf8) ["/xlv42/6.5.23m/work/irix/lib/libc/libc_n32_M4/signal/sigtramp.s":71, 0xfaee79c]
MPI: 6 Foam::IPstream::readFromBuffer(this = <illegal>, t = <illegal>) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/src/OpenFOAM/db/IOstreams/Pstreams/IPread.C":2, 0x42d4334]
MPI: 7 Foam::IPstream::read(this = <illegal>, l = <illegal>) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/src/OpenFOAM/db/IOstreams/Pstreams/IPread.C":27, 0x42d3744]
MPI: 8 Foam::IPstream::read(this = <illegal>, t = <illegal>) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/src/OpenFOAM/db/IOstreams/Pstreams/IPreadToken.C":4
MPI: More (n if no)?, 0x42d64b4]
MPI: 9 Foam::token::token(this = <illegal>, is = <illegal>) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/src/OpenFOAM/db/IOstreams/token/tokenIO.C":4, 0x42be300]
MPI: 10 <Unknown>(is = <illegal>, L = <illegal>) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/src/OpenFOAM/global/argList/argList.C":40, 0x4292624]
MPI: 11 <Unknown>(this = <illegal>, argc = <illegal>, argv = <illegal>, checkArgs = <illegal>, checkOpts = <illegal>) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/src/OpenFOAM/global/argList/argList.C":66, 0x42808fc]
MPI: 12 ::main(The debugger has detected a dbxpcs server error (Internal Consistency Error).
MPI: dbxpcs server attempting to continue
MPI: ) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/solvers/incompressible/icoFoam/icoFoam.C":0, 0x1002aeec]
MPI: 13 __start() ["/xlv55/kudzu-apr12/work/irix/lib/libc/libc_n32_M4/csu/crt1text.s":177, 0x1002a668]

MPI: -----stack traceback ends-----
MPI: Program /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/bin/sgiN32GccDPDebug/icoFoam, Rank 3, Process 513638: Dumping core on signal SIGBUS(10) into directory /disk4/usr/people/student3/OpenFOAM/student3-1.4.1-dev/run/tutorials/icoFoam
MPI: Program /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/bin/sgiN32GccDPDebug/icoFoam, Rank 1, Process 513610: Core dump on signal SIGBUS(10) suppressed.
MPI: Program /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/bin/sgiN32GccDPDebug/icoFoam, Rank 2, Process 513608: Core dump on signal SIGBUS(10) suppressed.
MPI: MPI_COMM_WORLD rank 1 has terminated without calling MPI_Finalize()
MPI: aborting job
MPI: Received signal 9

lakeat · #2 (**permalink**) 05-14-2008

I have posted it to Nekochan forum, but no reponse yet for some weeks.
I have checked the arrary service, and I think it is okay. (I guess)
From a website I guess the problem would be with single precision or double precision problem, but both try failed with the same errors.

I headached because gdb dbx ldd objdump give me very little infomation.
I try to debug mannually by inserting codes to each pieces of my codes and then I found and guess it might be native mpi problem but I don't know how to solve it.

Any insight would be appreciated!

Daniel

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
'AT: Bad year' error in Irix 4.0.5E	spaantje	UNIX for Dummies Questions & Answers	0	03-17-2008 07:15 AM
how and where can i download sun solaris hpc mpirun software	jingwp	SUN Solaris	1	07-12-2005 06:27 AM
Executing mpirun commands	tesswulf	Shell Programming and Scripting	0	02-10-2004 11:57 PM
Irix 5.3	Trixee	High Level Programming	3	10-17-2001 07:45 AM
Irix	DPAI	UNIX for Dummies Questions & Answers	7	08-30-2001 09:53 AM

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode