Sponsored Content
Full Discussion: Multiprocessing Help
Top Forums UNIX for Dummies Questions & Answers Multiprocessing Help Post 302724797 by Tyler_92 on Thursday 1st of November 2012 10:00:29 AM
Old 11-01-2012
Multiprocessing Help

Hello all,
I recently wrote a simple script for the analysis jobs I do at work. I have to run multiple files through 5 different stages of an analysis program, the script simply runs all of the files through each stage automatically. My question is this: The computer I'm using has 12 cores, each with two virtual cores, so I am working with 24 virtual processors. Is there a way to either 1) assign different jobs to different processors, or 2) get all of the processors to collaborate on one job? Does this happen automatically? To clarify, the script runs the files through the analysis one at a time, we are looking to speed up the process and this will help. Does anyone have any ideas?
Thanks!

PS: The machine is a new Mac Pro, OS 10.7
 

4 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Multiprocessing under Linux

I'm writing C programs to be executed on a multi-processor UNIX (GNU/Linux, kernel 2.6.11) Do I need to add a special kind of code to somewhere or run a special utility to execute the program file to be executed by all processors? Or is it handled automatically by kernel? (1 Reply)
Discussion started by: rayne
1 Replies

2. Programming

Multiprocessing multipointers

I have a complex problem..... I have to search files on directory "text files" then search on all of them for a word or sentence....the user inter my problem is,,,, if I want to create a child for each file...and point a file by pointer to search...and I don't know how much files i have in... (2 Replies)
Discussion started by: fwrlfo
2 Replies

3. Shell Programming and Scripting

Multiprocessing in Python

Hi there, I have a code that can take in any function with two arguements and do processing. However, I would like to implement a feature whether it can limit a number of process running concurrently so as not take up too much resources. I have tried researching for pool.map however I am unable... (1 Reply)
Discussion started by: alvinoo
1 Replies

4. Shell Programming and Scripting

<< Threading inside multiprocessing using queues >>

Hi All, I am trying to achieve threading inside each process of multiprocessing. I have 2 queues one for multiprocess (process) & another inside each process. when i execute it got hung after below output. My goal here is to go through p_source queue & for each process picks up all t_source... (0 Replies)
Discussion started by: kamauv234
0 Replies
hostinfo(8)						    BSD System Manager's Manual 					       hostinfo(8)

NAME
hostinfo -- host information SYNOPSIS
hostinfo DESCRIPTION
The hostinfo command displays information about the host system on which the command is executing. The output includes a kernel version description, processor configuration data, available physical memory, and various scheduling statistics. OPTIONS
There are no options. DISPLAY
Mach kernel version: The version string compiled into the kernel executing on the host system. Processor Configuration: The maximum possible processors for which the kernel is configured, followed by the number of physical and logical processors avail- able. Note: on Intel architectures, physical processors are referred to as cores, and logical processors are referred to as hardware threads; there may be multiple logical processors per core and multiple cores per processor package. This command does not report the number of processor packages. Processor type: The host's processor type and subtype. Processor active: A list of active processors on the host system. Active processors are members of a processor set and are ready to dispatch threads. On a single processor system, the active processor, is processor 0. Primary memory available: The amount of physical memory that is configured for use on the host system. Default processor set: Displays the number of tasks currently assigned to the host processor set, the number of threads currently assigned to the host proces- sor set, and the number of processors included in the host processor set. Load average: Measures the average number of threads in the run queue. Mach factor: A variant of the load average which measures the processing resources available to a new thread. Mach factor is based on the number of CPUs divided by (1 + the number of runnablethreads) or the number of CPUs minus the number of runnable threads when the number of runnable threads is less than the number of CPUs. The closer the Mach factor value is to zero, the higher the load. On an idle system with a fixed number of active processors, the mach factor will be equal to the number of CPUs. SEE ALSO
sysctl(8) Mac OS X October 30, 2003 Mac OS X
All times are GMT -4. The time now is 03:09 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy