Programming parallel for C++ and Python application Post: 302775393

Sponsored Content

Special Forums UNIX and Linux Applications High Performance Computing Programming parallel for C++ and Python application Post 302775393 by figaro on Monday 4th of March 2013 05:47:49 PM

03-04-2013

Registered User

Programming parallel for C++ and Python application

I am looking to have a C++ and Python application developed using the processing power of at least one GPU.
We are already using Boost, so Boost.MPI comes to mind.
We already have some experience in developing C++ applications for multi-core CPUs by using threading.
However, since we have not developed sufficient expertise in MPI, we were wondering if a Python solution would be more appropriate, because it will give the developers a better understanding of what the code does. In such a case something like mpi4py would come to mind.

Of course having a GPU specifically for simulation purposes could mean that something like PyOpenCL may be even better.
I mention "simulation", because the machine will be calculating variations on what is largely the same problem, ie not be a general purpose machine.

So in summary:
1- For raw processing speed with a multi-core CPU and a GPU, would a openCL solution or Boost.MPI solution be recommended?
2- Should the Python solution be used only for high level functionality, such as handling data upon return, or does Python compromise speed too much?

figaro

View Public Profile for figaro

Find all posts by figaro

7 More Discussions You Might Find Interesting

1. Programming

ftp application using socket programming

i have made a ftp application in socket programming which uses TCP/IP .. i have the problem runing the only problem is on the client side i take the user input for the file to be downloaded from the command promt. write(s, argv, strlen(argv)+1); // this is how i write in client side argv is...

2. Programming

Modifying sniffex.c to include concepts of parallel programming or threads

HI For the past 1 week i have been trying to include the concepts of parallel programming or thread in the sniffex.c code. Haven't been able to.. Please suggest sm appropriate modifications to the following code: /* * sniffex.c * * Sniffer example of TCP/IP packet capture using...

3. Debian

Programming, Python.

I do some Python programming in windows, understand how to use python in windows... However I do not know how to use python in Linux. I do know the commands n such are the same but there isn't any IDLE or anything its ran straight from the terminal by typing python but I have never used python that...

4. UNIX for Advanced & Expert Users

Python Programming for ASN.1 file

Hi. Has anyone here got an experience doing conversion from asn1 format to a readable format so that it can be processed by Oracle? I want to load the data into a table. This is a CDR file. Attached is the pairing file. Please remove the .txt at the end. Someone said that it is possible...

5. Shell Programming and Scripting

Python Programming for asn1 file

6. Shell Programming and Scripting

Python GNU parallel single command on multiple cores

Hello, I have a 4 core machine. Here is my initial script cd /work/ python script.py input.txt output.txt 1 2 3 This script runs for 1.5hrs. So I read across the web and figured out that you can use GNU parallel to submit multiple jobs using parallel. But I am not sure if I can run...

7. UNIX for Beginners Questions & Answers

Redploymnet of python application on UNIX Server

I have created the python application, which was deployed on UNIX server but due to some certain issues I have to redeploy the application every time while logging in to the server I am trying to make it work permanently on that server even when I am not using the UNIX server also Any...

LEARN ABOUT LINUX

py3compile

PY3COMPILE(1)                                                                                                                        PY3COMPILE(1)

NAME

       py3compile - byte compile Python 3 source files

SYNOPSIS

          py3compile [-V [X.Y][-][A.B]] DIR_OR_FILE [-X REGEXPR]

          pycompile -p PACKAGE

DESCRIPTION

       Wrapper around Python standard library's py_compile module to byte-compile Python 3 files.

OPTIONS

       --version
              show program's version number and exit

       -h, --help
              show this help message and exit

       -f, --force
              force rebuild of byte-code files even if timestamps are up-to-date

       -O     byte-compile to .pyo files

       -q, --quiet
              be quiet

       -v, --verbose
              turn verbose mode on

       -p PACKAGE, --package=PACKAGE
              specify Debian package name whose files should be bytecompiled

       -V VRANGE
              force  private  modules to be bytecompiled with Python 3 version from given range, regardless of the default Python 3 version in the
              system. If there are no other options, bytecompile all public modules for installed Python 3 versions that match given range.   VER-
              SION_RANGE examples:

                 o 3.1    version 3.1 only,

                 o 3.1-   version 3.1 or newer,

                 o 3.1-3.3        version 3.1 or 3.2,

                 o -4.0   all supported 3.X versions

       -X REGEXPR, --exclude=REGEXPR
              exclude items that match given REGEXPR. You may use this option multiple times to build up a list of things to exclude

AUTHOR

       Piotr Oarowski, 2012-2013

                                                                                                                                     PY3COMPILE(1)