Quote:
Originally Posted by
pludi
So you've got a bunch of data, transpose it to another form & then process that further, right? If you've got access to the source for the last part of the processing, might it be possible to rewrite it using
OpenMP (
Wikipedia)? That way it'd be portable across different OS', processors and number of cores, and you'd eliminate the need for a central control program.
The individual programs aren't really parallelizable. (In CS jargon, they're conjectured to be
P-complete, outside NC.) They're doing many sequential operations to a single piece of data. That's why I want to run them individually.
So instead I write a program to find the most efficient solution for each piece, calculate its likely runtime, solve an approximate bin-packing problem, and schedule each across a user-tunable number of processors.