Sponsored Content
Top Forums Programming Parallel Execution of Programs Post 302391599 by pludi on Tuesday 2nd of February 2010 01:06:22 AM
Old 02-02-2010
Whoops, meant "commands". Corrected that.

And yes, it's classical fork/exec. However, as some posters expressed a need for a program to do just that (eg run multiple gzips in parallel without a CPU idling) I thought I'd try to fill that need.
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Parallel Execution

Hello, I wish to run parallel process forked from one script. Currently I doing is submit them in background. For example: --------------------------------------------------------------- #!/usr/bin/ksh process1 & process2 & process3 & ..... ..... #here I check for completion of... (4 Replies)
Discussion started by: RishiPahuja
4 Replies

2. AIX

Make : parallel execution

Hi, Is there any way to run parallel jobs using make command? I am using non-GNU make utility on AIX 4.3. I want to run 2 jobs symultaneously using make utility. Thanks. Suman (0 Replies)
Discussion started by: suman_jakkula
0 Replies

3. High Performance Computing

Parallel Execution on Multiple System

Hi All, I am working on a project where I need to execute set of arguments (around 500) on a Simulator. If I execute this on one linux (RedHat 8.0) machine it will approximately takes 2~3 days. Since I am having more linux machines am thinking of executing these on different machines in... (7 Replies)
Discussion started by: 123an
7 Replies

4. Shell Programming and Scripting

Parallel Job Execution

Hi All, At present I am using a UNIX Script which is running a set of JOBS. These JOBS are to be repeated for 20 times, means the same set of JOBS are repeated by just passing different arguments (From 1 to 20). Is there any way by which I can execute them parallel? At present its all... (4 Replies)
Discussion started by: Prashantckc
4 Replies

5. Shell Programming and Scripting

Conditional execution and parallel jobs

how can i process jobs parallel with conditions below. Script1.ksh Script2.ksh Script3.ksh Script4.ksh Script5.ksh Script6.ksh Script7.ksh Script8.ksh Script9.ksh Script10.ksh After successful completion of Script1.ksh I need to run Script7.ksh. After successful... (4 Replies)
Discussion started by: ford2020
4 Replies

6. Shell Programming and Scripting

Parallel execution of script not syncronize

I am haveing 2 scripts, 1st script calls 2ed script for each parameter.(parameters are kept in a different txt file) 1st script for x in `cat Export_Tables_List.txt` do sh Exp_Table.sh $x & done echo -e "1) following tables are successfully exported : \n" > temp cat... (1 Reply)
Discussion started by: sbmk_design
1 Replies

7. Shell Programming and Scripting

What is the parallel execution command available in Ubuntu Linux?

Hi, I am using Ubuntu 10.04 LTS 32-bit. I would like to execute a command in two or more servers (multiple remote hosts) in parallel. The commands "shmux" or "on" are not available in Ubuntu. Could anyone tell me what other equivalent commands available in Ubuntu to accomplish this task? (1 Reply)
Discussion started by: royalibrahim
1 Replies

8. UNIX for Advanced & Expert Users

Parallel Execution of Command

Hi All, We have a table that has to store around 80-100 million records. The table is partitioned by a column called Market Code. There are 30 partitions each corresponding to one MRKT_CD. The source of this table is a join between 3-4 other tables. We are loading this table through SQLPLUS... (2 Replies)
Discussion started by: jerome_rajan
2 Replies

9. Shell Programming and Scripting

How to make parallel execution on folder ?

I have few very huge files ~ 2 Billion rows of 130 column(CDR data) in a folder, I have written shell script need to read on each file in a folder and will create a new files based on some logic. But problem is it's taking time to create a new file due to the size , So i dont want to corrupt... (6 Replies)
Discussion started by: rspwilliam
6 Replies
MDM.SCREEN(1)							   User Commands						     MDM.SCREEN(1)

NAME
mdm.screen - run a command under mdm-master SYNOPSIS
mdm.screen [-c iospec] [-n slaves] command DESCRIPTION
mdm.screen runs command under mdm-master so that mdm-run commands in command can run in parallel. This program is a part of the Middleman System (mdm). OPTIONS
The mdm.screen command has two optional options. -c iospec The iospec file (see below). -n slaves The number of mdm-slave process to start (default 6). THE IOSPEC FILE
mdm-master uses the iospec file to decide whether two commands interfere with each other, and it only runs two commands at the same time if they do not interfere. Each line of the iospec file specifies the I/O behavior of a program, unless the line starts with a '#' character, in which case the line is treated as comments and ignored. The format is as follows: program spec spec ... program names the program whose behavior you are specifying. For each spec element, the first character indicates usage, and the remaining characters indicate resource. A resource that starts with a '-' character represents the argument of the corresponding program option. A resource that is an empty string represents a program argument. A resource that is not empty and does not start with a '-' character represents the resource string itself. A usage is typically an upper-case character. If two commands access the same resource with different usage, mdm-master will not run these two commands at the same time. Furthermore, if a command access a resource with 'W' usage, mdm-master will not run it with any command that access the same resource in any way (including 'W'). There is a special case: if usage is '0' and resource starts with a '-' charac- ter, it means that the resource program option does not take any arguments. All programs has an implicit spec 'Rglobal', so if you mark a program as 'Wglobal', it will not run while any other command is running. Here is an example to help clarify matters. Suppose we have the following iospec file: cc W-o 0-c R rm W Then these two commands can run at the same time: cc -o pa pa.o lib.o cc -o pb pb.o lib.o These two commands cannot run at the same time: cc -o pa.o -c pa.c cc -o pa pa.o lib.o And these two commands also cannot run at the same time: cc -o pa pa.o lib.o rm pa EXIT STATUS
The exit status of mdm.screen is 0. EXAMPLE
Here is what you do to decompress all files with .gz extension in the current directory tree. mdm.screen find . -iname '*.gz' -exec mdm-run gunzip {} ; Since we run find under mdm.screen and invoking gunzip under mdm-run, we specify that we wish to run the gunzip commands in parallel. SEE ALSO
mdm-run(1), mdm-sync(1), ncpus(1) Linux 2009-03-06 MDM.SCREEN(1)
All times are GMT -4. The time now is 11:02 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy