Location: Saint Paul, MN USA / BSD, CentOS, Debian, OS X, Solaris
Posts: 2,288
Thanks Given: 430
Thanked 480 Times in 395 Posts
Hi.
Here is an example of GNU parallel running on an (old) OSX box. This call spawns as many processes as needed for each filename with a suffix of txt. There are also controls for CPUs as well as number of cores.
producing:
See URLs mentioned in comments if you do not have the items in your repository.
Thanks everyone for the helpful responses! I was messing around some last night, I think where I will go from here is change my loop, which looks like this:
to this:
Adding the "&" to send files to the background. Then I will do some testing to see how many files I should send through at once, and change the loop accordingly. I'll also do some experimenting with parallel, that looks like a nice tool.
Hi All,
I am trying to achieve threading inside each process of multiprocessing. I have 2 queues one for multiprocess (process) & another inside each process. when i execute it got hung after below output. My goal here is to go through p_source queue & for each process picks up all t_source... (0 Replies)
Hi there,
I have a code that can take in any function with two arguements and do processing. However, I would like to implement a feature whether it can limit a number of process running concurrently so as not take up too much resources. I have tried researching for pool.map however I am unable... (1 Reply)
I have a complex problem.....
I have to search files on directory "text files"
then search on all of them for a word or sentence....the user inter
my problem is,,,, if I want to create a child for each file...and point a file by pointer to search...and I don't know how much files i have in... (2 Replies)
I'm writing C programs to be executed on a multi-processor UNIX (GNU/Linux, kernel 2.6.11) Do I need to add a special kind of code to somewhere or run a special utility to execute the program file to be executed by all processors? Or is it handled automatically by kernel? (1 Reply)