Programming parallel for C++ and Python application Post: 302775393

Sponsored Content

Special Forums UNIX and Linux Applications High Performance Computing Programming parallel for C++ and Python application Post 302775393 by figaro on Monday 4th of March 2013 05:47:49 PM

03-04-2013

Registered User

Programming parallel for C++ and Python application

I am looking to have a C++ and Python application developed using the processing power of at least one GPU.
We are already using Boost, so Boost.MPI comes to mind.
We already have some experience in developing C++ applications for multi-core CPUs by using threading.
However, since we have not developed sufficient expertise in MPI, we were wondering if a Python solution would be more appropriate, because it will give the developers a better understanding of what the code does. In such a case something like mpi4py would come to mind.

Of course having a GPU specifically for simulation purposes could mean that something like PyOpenCL may be even better.
I mention "simulation", because the machine will be calculating variations on what is largely the same problem, ie not be a general purpose machine.

So in summary:
1- For raw processing speed with a multi-core CPU and a GPU, would a openCL solution or Boost.MPI solution be recommended?
2- Should the Python solution be used only for high level functionality, such as handling data upon return, or does Python compromise speed too much?

figaro

View Public Profile for figaro

Find all posts by figaro

7 More Discussions You Might Find Interesting

1. Programming

ftp application using socket programming

i have made a ftp application in socket programming which uses TCP/IP .. i have the problem runing the only problem is on the client side i take the user input for the file to be downloaded from the command promt. write(s, argv, strlen(argv)+1); // this is how i write in client side argv is...

2. Programming

Modifying sniffex.c to include concepts of parallel programming or threads

HI For the past 1 week i have been trying to include the concepts of parallel programming or thread in the sniffex.c code. Haven't been able to.. Please suggest sm appropriate modifications to the following code: /* * sniffex.c * * Sniffer example of TCP/IP packet capture using...

3. Debian

Programming, Python.

I do some Python programming in windows, understand how to use python in windows... However I do not know how to use python in Linux. I do know the commands n such are the same but there isn't any IDLE or anything its ran straight from the terminal by typing python but I have never used python that...

4. UNIX for Advanced & Expert Users

Python Programming for ASN.1 file

Hi. Has anyone here got an experience doing conversion from asn1 format to a readable format so that it can be processed by Oracle? I want to load the data into a table. This is a CDR file. Attached is the pairing file. Please remove the .txt at the end. Someone said that it is possible...

5. Shell Programming and Scripting

Python Programming for asn1 file

6. Shell Programming and Scripting

Python GNU parallel single command on multiple cores

Hello, I have a 4 core machine. Here is my initial script cd /work/ python script.py input.txt output.txt 1 2 3 This script runs for 1.5hrs. So I read across the web and figured out that you can use GNU parallel to submit multiple jobs using parallel. But I am not sure if I can run...

7. UNIX for Beginners Questions & Answers

Redploymnet of python application on UNIX Server

I have created the python application, which was deployed on UNIX server but due to some certain issues I have to redeploy the application every time while logging in to the server I am trying to make it work permanently on that server even when I am not using the UNIX server also Any...

LEARN ABOUT DEBIAN

mpi_op_c2f

MPI_Op_c2f(3)							      LAM/MPI							     MPI_Op_c2f(3)

NAME

       MPI_Op_c2f -  Convert an op handle from its C representation to its Fortran representation

SYNOPSIS

       #include <mpi.h>
       MPI_Fint
       MPI_Op_c2f(MPI_Op op)

INPUT PARAMETER

       op     - C op handle

RETURN VALUE

       f_handle
	      - Fortran op handle

NOTES FOR FORTRAN

       All  MPI  routines in Fortran (except for MPI_WTIME and MPI_WTICK ) have an additional argument ierr at the end of the argument list.  ierr
       is an integer and has the same meaning as the return value of the routine in C.	In Fortran, MPI routines are subroutines, and are  invoked
       with the call statement.

       All MPI objects (e.g., MPI_Datatype , MPI_Comm ) are of type INTEGER in Fortran.

ERRORS

       This function does not return the normal MPI_SUCCESS integer value upon success.  Instead, it returns a handle to the converted object.	If
       an error occurs, the appropriate NULL handle will be returned.

SEE ALSO

       MPI_Op_c2f(3)

MORE INFORMATION

       For more information, please see the official MPI Forum web site, which contains the text of both the MPI-1  and  MPI-2	standards.   These
       documents contain detailed information about each MPI function (most of which is not duplicated in these man pages).

       http://www.mpi-forum.org/

LOCATION

       handles.c

LAM
/MPI 7.1.4							     6/24/2006							     MPI_Op_c2f(3)