IRIX mpirun error!!


 
Thread Tools Search this Thread
Top Forums Programming IRIX mpirun error!!
# 1  
Old 05-14-2008
IRIX mpirun error!!

Dear Experts,

I have been suffering in porting a CFD code called OpenFOAM to sgi-IRIX system for many months but to no avail, and the problem is about MPI!
I installed gcc-4.3.0, gnu-binutils for my compilation.
And after the building process, I can run the executive with single CPU, but when I use mpirun to run the program, it failed strangely.
I use Sgi-native mpirun and debug option is on!
The CFD codes can be built and run very well on linux.

Could anyone help me examine these error messages, where on earth is the problem?

I have also attached a "par -s -SS -i mpirun -np 4 `which icoFoam` $FOAM_RUN/tutorials/icoFoam cavity -parallel > why.log" file.
what "ldd" shows seems everything is okay.

Any help would be highly appreciated!

Daniel


Quote:
bash-2.05$ mpirun -np 4 `which icoFoam` $FOAM_RUN/tutorials/icoFoam cavity -parallel
MPI Pstream initialized with:
floatTransfer : 1
nProcsSimpleSum : 0
scheduledTransfer : 0

/*---------------------------------------------------------------------------*\
| ========= | |
| \\ / F ield | OpenFOAM: The Open Source CFD Toolbox |
| \\ / O peration | Version: 1.4.1-dev |
| \\ / A nd | Web: OpenFOAM: The Open Source Computational Fluid Dynamics (CFD) Toolbox |
| \\/ M anipulation | |
\*---------------------------------------------------------------------------*/

Exec : /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/bin/sgiN32GccDPDebug/icoFoam /disk4/usr/people/student3/OpenFOAM/student3-1.4.1-dev/run/tutorials/icoFoam cavity -parallel
[0] Date : Apr 28 2008
[0] Time : 16:44:15
[0] Host : onyx-bridge
[0] PID : 513629
[3] Date : Apr 28 2008
[3] Time : 16:44:15
[3] Host : onyx-bridge
[3] PID : 513638
[1] Date : Apr 28 2008
[1] Time : 16:44:15
[1] Host : onyx-bridge
[1] PID : 513610
[2] Date : Apr 28 2008
[2] Time : 16:44:15
[2] Host : onyx-bridge
[2] PID : 513608
MPI: Program /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/bin/sgiN32GccDPDebug/icoFoam, Rank 3, Process 513638 received signal SIGBUS(10)


MPI: --------stack traceback-------
PC: 0x5ddb100 MPI_SGI_stacktraceback in /usr/lib32/libmpi.so
PC: 0x5ddb544 first_arriver_handler in /usr/lib32/libmpi.so
PC: 0x5ddb7d8 slave_sig_handler in /usr/lib32/libmpi.so
PC: 0xfaee79c _sigtramp in /usr/lib32/libc.so.1
libexc(513638): ERROR __exc_get_fde_name: Couldn't find any name at 0x60204334 in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
0 0x60197ac8 abs
(a lot of messages the same as above)
(......)
115 0x60197ac8 abs
PC: 0x42d432c (null) in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
0 0x60197ac8 abs
(a lot of messages the same as above)
(......)
6 0x60197ac8 abs
libexc(513638): ERROR __exc_get_fde_name: Couldn't find any name at 0x6020374c in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
7 0x60197ac8 abs
(a lot of messages the same as above)
(......)
115 0x60197ac8 abs
PC: 0x42d3744 (null) in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
libexc(513638): ERROR __exc_get_fde_name: Couldn't find any name at 0x602064bc in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
0 0x60197ac8 abs
(a lot of messages the same as above)
(......)
115 0x60197ac8 abs
PC: 0x42d64b4 (null) in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
libexc(513638): ERROR __exc_get_fde_name: Couldn't find any name at 0x601ee308 in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
0 0x60197ac8 abs
(a lot of messages the same as above)
(......)
115 0x60197ac8 abs
PC: 0x42be300 (null) in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
libexc(513638): ERROR __exc_get_fde_name: Couldn't find any name at 0x601c262c in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
0 0x60197ac8 abs
(a lot of messages the same as above)
(......)
115 0x60197ac8 abs
PC: 0x4292624 (null) in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
libexc(513638): ERROR __exc_get_fde_name: Couldn't find any name at 0x601b0904 in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
0 0x60197ac8 abs
(a lot of messages the same as above)
(......)
115 0x60197ac8 abs
PC: 0x42808fc (null) in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/lib/sgiN32GccDPDebug/libOpenFOAM.so
PC: 0x1002aeec main in /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/bin/sgiN32GccDPDebug/icoFoam


MPI: dbx version 7.3.3 (78517_Dec16 MR) Dec 16 2001 07:45:22
MPI: Process 513638 (icoFoam) stopped at [__waitsys:24 +0x8,0xfa53338]
MPI: Source (of /xlv42/6.5.23m/work/irix/lib/libc/libc_n32_M4/proc/waitsys.s) not available for Process 513638
MPI: > 0 __waitsys(0x0, 0x7d662, 0x7ffb5080, 0x3, 0x0, 0x7ffb4ec8, 0x0, 0xf8) ["/xlv42/6.5.23m/work/irix/lib/libc/libc_n32_M4/proc/waitsys.s":24, 0xfa53338]
MPI: 1 _system(0x7ffb5150, 0x7d662, 0x7ffb5080, 0x3, 0x0, 0x7ffb4ec8, 0x0, 0xf8) ["/xlv42/6.5.23m/work/irix/lib/libc/libc_n32_M4/stdio/system.c":116, 0xfa5f868]
MPI: 2 MPI_SGI_stacktraceback(0x0, 0x7d662, 0x7ffb5080, 0x3, 0x0, 0x7ffb4ec8, 0x0, 0xf8) ["/xlv4/mpt/1.8/mpi/work/4.3/lib/libmpi/libmpi_n32_M4/adi/sig.c":242, 0x5ddb268]
MPI: 3 first_arriver_handler(0xa, 0x71756974, 0x7ffb5080, 0x3, 0x0, 0x7ffb4ec8, 0x0, 0xf8) ["/xlv4/mpt/1.8/mpi/work/4.3/lib/libmpi/libmpi_n32_M4/adi/sig.c":445, 0x5ddb544]
MPI: 4 slave_sig_handler(0xa, 0x7d662, 0x7ffb5080, 0x3, 0x0, 0x7ffb4ec8, 0x0, 0xf8) ["/xlv4/mpt/1.8/mpi/work/4.3/lib/libmpi/libmpi_n32_M4/adi/sig.c":542, 0x5ddb7e0]
MPI: 5 _sigtramp(0x0, 0x7d662, 0x0, 0x3, 0x0, 0x0, 0x0, 0xf8) ["/xlv42/6.5.23m/work/irix/lib/libc/libc_n32_M4/signal/sigtramp.s":71, 0xfaee79c]
MPI: 6 Foam::IPstream::readFromBuffer(this = <illegal>, t = <illegal>) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/src/OpenFOAM/db/IOstreams/Pstreams/IPread.C":2, 0x42d4334]
MPI: 7 Foam::IPstream::read(this = <illegal>, l = <illegal>) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/src/OpenFOAM/db/IOstreams/Pstreams/IPread.C":27, 0x42d3744]
MPI: 8 Foam::IPstream::read(this = <illegal>, t = <illegal>) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/src/OpenFOAM/db/IOstreams/Pstreams/IPreadToken.C":4
MPI: More (n if no)?, 0x42d64b4]
MPI: 9 Foam::token::token(this = <illegal>, is = <illegal>) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/src/OpenFOAM/db/IOstreams/token/tokenIO.C":4, 0x42be300]
MPI: 10 <Unknown>(is = <illegal>, L = <illegal>) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/src/OpenFOAM/global/argList/argList.C":40, 0x4292624]
MPI: 11 <Unknown>(this = <illegal>, argc = <illegal>, argv = <illegal>, checkArgs = <illegal>, checkOpts = <illegal>) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/src/OpenFOAM/global/argList/argList.C":66, 0x42808fc]
MPI: 12 ::main(The debugger has detected a dbxpcs server error (Internal Consistency Error).
MPI: dbxpcs server attempting to continue
MPI: ) ["/disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/solvers/incompressible/icoFoam/icoFoam.C":0, 0x1002aeec]
MPI: 13 __start() ["/xlv55/kudzu-apr12/work/irix/lib/libc/libc_n32_M4/csu/crt1text.s":177, 0x1002a668]

MPI: -----stack traceback ends-----
MPI: Program /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/bin/sgiN32GccDPDebug/icoFoam, Rank 3, Process 513638: Dumping core on signal SIGBUS(10) into directory /disk4/usr/people/student3/OpenFOAM/student3-1.4.1-dev/run/tutorials/icoFoam
MPI: Program /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/bin/sgiN32GccDPDebug/icoFoam, Rank 1, Process 513610: Core dump on signal SIGBUS(10) suppressed.
MPI: Program /disk4/usr/people/student3/OpenFOAM/OpenFOAM-1.4.1-dev/applications/bin/sgiN32GccDPDebug/icoFoam, Rank 2, Process 513608: Core dump on signal SIGBUS(10) suppressed.
MPI: MPI_COMM_WORLD rank 1 has terminated without calling MPI_Finalize()
MPI: aborting job
MPI: Received signal 9
# 2  
Old 05-14-2008
I have posted it to Nekochan forum, but no reponse yet for some weeks.
I have checked the arrary service, and I think it is okay. (I guess)
From a website I guess the problem would be with single precision or double precision problem, but both try failed with the same errors.

I headached because gdb dbx ldd objdump give me very little infomation.
I try to debug mannually by inserting codes to each pieces of my codes and then I found and guess it might be native mpi problem but I don't know how to solve it.

Any insight would be appreciated!

Daniel
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. High Performance Computing

Problem running mpirun

Hi, I have a difficulty running mpirun on my workstation, RHEL 4. I have uninstalled lam-7.1.4 with 'rpm -e lam-7.1.4'. No problem. The I downloaded openmpi-1.3.tar.gz. unzipped as normal. No problem. Then did 'make clean'. Then './configure'. No problems. Then I did 'make' and then 'make... (1 Reply)
Discussion started by: The_Watcher
1 Replies

2. UNIX for Dummies Questions & Answers

'AT: Bad year' error in Irix 4.0.5E

I want to schedule some commands with 'at' on a SGI Indigo running irix 4.0.5. When i give the command : #at 16:00 /usr/bin/blahblah i get a "at: bad year error". The command is exactly according the man page. Also other forms, like 'at now + 1 hour', 'at 16:00 Mar 18', etc gives the same error.... (0 Replies)
Discussion started by: spaantje
0 Replies

3. Solaris

how and where can i download sun solaris hpc mpirun software

how and where can i download sun solaris2.8 hpc mprun software?thanks (1 Reply)
Discussion started by: jingwp
1 Replies

4. UNIX for Dummies Questions & Answers

IRIX 6.5 newbie

I have had the great fortune to get an sgi octane for free! :D I have managed to get me an OS(IRIX 6.5.19f) but I have some questions that I hope are not too simple to the gurus out there. Before I ask, I build macs and PC's and have had some experience hacking osx into old beige macs, and pcs,... (2 Replies)
Discussion started by: gheem
2 Replies

5. UNIX for Dummies Questions & Answers

PASSLENGTH on Irix

My first post here, and hopefully it will be one of many to come. I am currently running multiple SGI's with different versions of Irix. I have a problem setting the minimum password length for users. I have modified the /etc/default/passwd so that PASSLENGTH = 8 However, it still... (1 Reply)
Discussion started by: herrmag
1 Replies

6. Shell Programming and Scripting

Executing mpirun commands

Basically, I would like to run an mpirun query on my web server to query your databases via yours when using the BLAST program, however the server seems not able to execute even basic mpirun programs such as cpi (to calculate pi). Are there any settings I should take note of? I am running Perl... (0 Replies)
Discussion started by: tesswulf
0 Replies

7. Programming

Irix 5.3

I am using IRIX 5.3, When I type "man" in a UNIX text console from any machine on my network, I want to pull out the man pages from the station where they have been installed. Would anyone know the link? (3 Replies)
Discussion started by: Trixee
3 Replies

8. UNIX for Advanced & Expert Users

I am looking for a link in IRIX 5.3

I am using IRIX 5.3, When I type "man" in a UNIX text console from any machine on my network, I want to pull out the man pages from the station where they have been installed. Would anyone know the link? I would be so greatfull. (1 Reply)
Discussion started by: Trixee
1 Replies

9. UNIX for Dummies Questions & Answers

Irix

I have an SGI running IRIX 6.5 The prob is when i login as user and open a file , it gives me error as "OUT OF MEMORY" when i su or login as root . THis error disappers I have lot of space in the System . Thanx DPai (7 Replies)
Discussion started by: DPAI
7 Replies

10. UNIX for Dummies Questions & Answers

Problem with IRIX

I have a SGI sys with Irix running on it. Actually i cant see the console login . It just shows a blank blue screen . I can use the mouse though. Also i can remote login into the m/c I am new to SGI . Can anybody help (2 Replies)
Discussion started by: Jai
2 Replies
Login or Register to Ask a Question