Sponsored Content
Full Discussion: For loop in parallel
Top Forums Shell Programming and Scripting For loop in parallel Post 302713249 by chercheur857 on Wednesday 10th of October 2012 11:51:40 AM
Old 10-10-2012
Here is my problem:
Code:
for i in $(seq $nb_lignes) # a list of machines
do
 machine=`head $1 -n $i | tail -1`
ssh root@$machine -x "java ....."
done

i have three machines: A,B and C
"A " run the script
list of machines contain B and C
i'd like to execute java command in the two machines B and C , A display that B run the command only
And when i do ctrl+C it display that C run the command

Last edited by Corona688; 10-10-2012 at 01:26 PM..
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to do parallel processing??

Hi All, I am working on solaris 8 sparc machine with 2 cpu. I am trying to run my application which generates files. I run multiple instance of the application, but the results don't seem to show as if it were runing parallely. When i run the application once it takes 12 secs to generate a... (1 Reply)
Discussion started by: zing
1 Replies

2. Shell Programming and Scripting

Execute commands parallel in a for loop ?

Hi, please can someone point me in the right direction with a shell scripting problem. I want to execute a command in a for loop and the command should be started not one-by-one meaning the for loop is waiting for the exit code , it should be started in parallel. I have a plain text file... (3 Replies)
Discussion started by: networkfre@k
3 Replies

3. Shell Programming and Scripting

parallel processing

hi i am preparing a set of batches for a set of files sequentially There is a folder /xyz where all the files reside now all the files starting with 01 - will be appended for one below other to form a batch batch01 then all the files starting with 02 - will be appended for one below other to... (7 Replies)
Discussion started by: mad_man12
7 Replies

4. Shell Programming and Scripting

parallel while loop based on the file records

Hi, I need to execute parallel with while loop. Input File(source_file.csv) contains filenames the below source_file.csv file contains Customer1.txt Product1.txt Sales.txt Emp.txt Dept.txt Based on the number of rows that file I want to run the script ‘n' times. while... (2 Replies)
Discussion started by: onesuri
2 Replies

5. UNIX for Dummies Questions & Answers

Need to test 100 ssh connections in parallel using loop and sleep? How to do that ?

Hello All, I want to test how much parallel ssh connections can be done on a server. I am thinking of reading username and hostname from a file and then using a loop (may be for) to do ssh on different host. Could anyone suggest me how can i write the script for the above. Thank you in... (0 Replies)
Discussion started by: ABHIKORIA
0 Replies

6. Shell Programming and Scripting

Run the for loop in parallel

I have the below code which runs on multiple databases , but this runs one-after-one. I will need this to run in parallel so that i could save a lot of time. Please help!!! Thanks in advance for Db in `cat /var/opt/oracle/oratab |egrep -v "ASM" |grep -v \# |cut -d\: -f1` do { export... (5 Replies)
Discussion started by: jjoy
5 Replies

7. Shell Programming and Scripting

awk loop using array:wish to store array values from loop for use outside loop

Here's my code: awk -F '' 'NR==FNR { if (/time/ && $5>10) A=$2" "$3":"$4":"($5-01) else if (/time/ && $5<01) A=$2" "$3":"$4-01":"(59-$5) else if (/time/ && $5<=10) A=$2" "$3":"$4":0"($5-01) else if (/close/) { B=0 n1=n2; ... (2 Replies)
Discussion started by: klane
2 Replies

8. Shell Programming and Scripting

Run script in parallel in while loop

Hi I am running a loop which actually runs same script for different argument value passed to it. while read repID do echo "Starting for $repID"; date; perl process_report.pl $repID done<${FILE_TO_READ} However this runs in sequence. I want the loop to not to wait for perl to... (3 Replies)
Discussion started by: dashing201
3 Replies

9. UNIX for Advanced & Expert Users

Trying to use a convoluted for loop with VLC and Parallel or OpenMPI with no success. Help?

I have about 12,000,000 mod files I'm trying to turn into a test of "unlimited cloud storage" by running them all through VLC and blowing them into mp3 files. I can get this to work serially but when trying to use openMPI or Parallel, something in the syntax is tripping it up some. Here is an... (1 Reply)
Discussion started by: sparticus414
1 Replies

10. Shell Programming and Scripting

Parallel increment of nested for loop

Hi, I am using solaris 5.10 environment and need help on doing parallel increment of nested for loop. Samples #inside the code the values assigned to a variable by another awk command will be like a=/xyz/pg/as /xyz/pg/as2 /xyz/pg/as3 b=/xyz/sd/fd1 /xyz/sd/fd2 /xyz/sd/fd3 for q in... (1 Reply)
Discussion started by: ananan
1 Replies
dsh(1)							      Dancer Tools reference							    dsh(1)

NAME
dsh - Distributed shell, or dancer's shell SYNOPSIS
dsh [-m machinename | -a | -g groupname] [-r remoteshellname] [-c | -w | -i | -F forklimit ] -- commandline DESCRIPTION
dsh executes command remotely on several different machines at the same time. An utility to effectively do a for a in $(seq 1 10); do rsh $a command; done in bourne shell. OPTIONS
The options available are as follows. --verbose | -v Give verbose output of the execution process. --quiet | -q Makes output quieter. --machine | -m [machinename[,machinename]*] Adds machinename to the list of machines that the command is exeuted. The syntax of machinename allows username@machinename where remote shell is invoked with the option to make it of username. From version 0.21.4, it is possible to specify in the format of username@machinename,username@machinename,username@machinename so that multiple hosts can be specified with comma-delimited values. --all | -a Add all machines found in /etc/dsh/machines.list to the list of machines that the specified command is executed. --group groupname | -g groupname Add all machines found in /etc/dsh/group/groupname to the list of machines that the specified command is executed. If groupname is on the form @netgroup then the machines in the given netgroup is used to specify the list of machines to execute on. --file machinefile | -f machinefile Add all machines found in the specified file to the list of machines that the specified command is executed. The file should list one machine specification per line (with the same syntax as the machinename argument). Lines starting with "#" are ignored. From version 0.21.4, Specifying the same machine several times using any of the machine specification options will result in multi- ple invocations merged into one. --remoteshell shellname | -r shellname Execute remote shell shellname as the remote shell. Usually any of "rsh", "remsh" or "ssh" are available --remoteshellopt rshoption | -o rshoption Add one option rshoption to the list of options passed on to the remote shell. --help | -h Output help message and exits. --wait-shell | -w Executes on each machine and waits for the execution finishing before moving on to the next machine. --concurrent-shell | -c Executes shell concurrently. --show-machine-names | -M Prepends machine names on the standard output. Useful to be used in conjunction with the --concurrent-shell option so that the out- put is slightly more parsable. --hide-machine-names | -H Do not prepend machine names on the standard output. --duplicate-input | -i Duplicates the input to dsh process to individual process that are remotely invoked. Needs to have --concurrent-shell set. Due to limitations in current implementation, it is only useful for running shell. Terminate the shell session with ctrl-D. --bufsize | -b [buffer-size in bytes] Sets the buffer size used in replicating input for --duplicate-input option. --version | -V Outputs version information and exits. --num-topology | -N Changes the current topology from 1. 1 is the default behavior of spawning the shell from one node to every node. Changing the num- ber to a value greater than 2 would result in dsh being spawned on other machines as well. --forklimit | -F fork limit Similar to -c with a limit on the number of simultaneous connections. dsh will wait before creating new connection if the limit is reached. Useful when the number of nodes to be accessed is going somewhere above 200, and using -N option is not possible. EXIT STATUS
The first non-zero exit code of child processes is returned, or zero if none returned non-zero exit code. 1 if error is found in command-line specifications. 2 if signal is received from child processes. EXAMPLES
dsh -a w Shows list of users logged in on all workstations. dsh -r ssh -a -- w Shows list of users logged in on all workstations, and use ssh command to connect. (It should be of note that when using ssh, ssh- agent is handy.) dsh -r ssh -m node1 -m node2 -c -- 'echo $HOSTNAME $(cat/proc/loadavg )' Shows the load average of machines node1 and node2. FILES
/etc/dsh/machines.list | $(HOME)/.dsh/machines.list List of machine names to be used for when -a command-line option is specified. /etc/dsh/group/groupname | $(HOME)/.dsh/group/groupname List of machine names to be used for when -g groupname command-line option is specified. /etc/dsh/dsh.conf | $(HOME)/.dsh/dsh.conf Configuration file containing the day-to-day default. BUGS
There should be a dcp for copying files to remote systems. Configuration files should really be able to do something more than it does now. AUTHOR
Junichi Uekawa (dancer@debian.org) Upstream page is available at http://www.netfort.gr.jp/~dancer/software/dsh.html SEE ALSO
rsh(1), ssh(1), remsh(1), dsh.conf(5) Debian-Beowulf/Dancer 2007 Aug 15 dsh(1)
All times are GMT -4. The time now is 02:34 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy