04-26-2016
Parallel execution on multiple servers in UNIX
I have a requirement (in a shell script) to connect to several servers at once and execute a series of commands.
I am aware that ssh can be used for sequential execution. But since most of the commands that I need to execute take a long time, I have to go for the parallel option.
Is there a way to run commands simultaneously without using any command line tools such as pssh, cluster ssh etc?
Can someone please help?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello,
I wish to run parallel process forked from one script.
Currently I doing is submit them in background.
For example:
---------------------------------------------------------------
#!/usr/bin/ksh
process1 &
process2 &
process3 &
.....
.....
#here I check for completion of... (4 Replies)
Discussion started by: RishiPahuja
4 Replies
2. Shell Programming and Scripting
Hi,
I have a simple windows batch file which connects to a UNIX server and runs a shell script in my home directory on the server.
It works perfectly, using plink + ssh keys in the background.
What I plan to do is expand this batch file to connect to multiple servers and execute one script... (2 Replies)
Discussion started by: Moxy
2 Replies
3. High Performance Computing
Hi All,
I am working on a project where I need to execute set of arguments (around 500) on a Simulator. If I execute this on one linux (RedHat 8.0) machine it will approximately takes 2~3 days. Since I am having more linux machines am thinking of executing these on different machines in... (7 Replies)
Discussion started by: 123an
7 Replies
4. HP-UX
Hi,
I've to do a simple job many times whenever it has been asked, just i've to log in to all of fourtien HP servers and i've to execute
ps -fu user > temp
cat temp|sendmail "xyz@z.com"
commands to send the statics of all of 14 servers over the mail to particular user id..
Though logging... (4 Replies)
Discussion started by: vickramshetty
4 Replies
5. Programming
Since there've been a few requests for a method to execute commands on multiple CPUs (logical or physical), with various levels of shell-, make-, or Perl-based solutions, ranging from well-done to well-meant, and mostly specific to a certain problem, I've started to write a C-based solution... (4 Replies)
Discussion started by: pludi
4 Replies
6. UNIX for Advanced & Expert Users
Hi,
I need to grep(look) for a line in filename named /tmp/Test on all 90 unix servers. Without logging to each servers manually and grep'ing for the line, is there a way to pull this info in output file thru' the ksh/sh/bash script. Can someone pl. help to create this script for me?
Ex.... (3 Replies)
Discussion started by: Mike1234
3 Replies
7. Shell Programming and Scripting
hi guys,
i need a script that does a simple task on multiple aix servers.
if possible with both telnet and ssh.
the simple task i wanna do is connect to a server and run "ifconfig -a" and get the output. nextweek i need to do similar jobs on like 50 servers... :(
can anybody help me with making... (2 Replies)
Discussion started by: curtis911
2 Replies
8. Solaris
So I have a scriptlet called solaris_command:
for i in \
server1 server2 server3
do
echo $i
ssh $i $1
echo ""
done
I then use that as a command in multiple scripts to allow for data gathering for all virtual hosts in the environment thusly:
solaris_command "cat... (3 Replies)
Discussion started by: os2mac
3 Replies
9. UNIX for Beginners Questions & Answers
i have say x number of procedure to run, ie i have one procedure which accepts variable and i need that to run in parallel and capture the error code if in case if it fails through the unix.
sqlplus <EOF> exec test_t (abc,124); </EOF>
sqlplus <EOF> exec test_t (abc,125); </EOF>
sqlplus <EOF>... (2 Replies)
Discussion started by: ATWC
2 Replies
10. Shell Programming and Scripting
Hi,
Trying to run the Oracle Proc in parallel, but not working.. below code runs each call of the procedure and its coming out of the loop before its completion and printing the last statement! not waiting for the sqlplus to complete.
for name in `cat abc.txt`
do
(sqlplus -s ... (3 Replies)
Discussion started by: ATWC
3 Replies
LEARN ABOUT DEBIAN
ganeti-listrunner
ganeti-listrunner(8) Version 2.5.2 ganeti-listrunner(8)
NAME
ganeti-listrunner - Run commands in parallel over multiple machines
SYNOPSIS
ganeti-listrunner -l logdir {-x executable | -c shell-cmd} {-f hostfile | -h hostlist} [-a aux-file] [-b batch-size] [-u username] [-A]
DESCRIPTION
ganeti-listrunner is a tool to run commands in parallel over multiple machines. It differs from dsh or other tools in that it asks for the
password once (if not using ssh-agent) and then reuses the password to connect to all machines, thus being easily usable even when public
key authentication or Kerberos authentication is not available.
It can run either a command or a script (which gets uploaded first and deleted after execution) on a list of hosts provided either via a
file (one host per line) or as a comma-separated list on the commandline. The output (stdout and stderr are merged) of the remote execution
is written to a logfile. One logfile per host is written.
OPTIONS
The options that can be passed to the program are as follows:
-l logdir
The directory under which the logfiles files should be written.
-x executable
The executable to copy and run on the target hosts.
-c shell-cmd
The shell command to run on the remote hosts.
-f hostfile
The file with the target hosts, one hostname per line.
-h hostlist
Comma-separated list of target hosts.
-a aux-file
A file to copy to the target hosts. Can be given multiple times, in which case all files will be copied to the temporary directory.
The executable or the shell command will be run from the (temporary) directory where these files have been copied.
-b batch-size
The host list will be split into batches of batch-size which will be processed in parallel. The default if 15, and should be
increased if faster processing is needed.
-u username
Username to connect as instead of the default root username.
-A Use an existing ssh-agent instead of password authentication.
--args Arguments to pass to executable (-x).
EXIT STATUS
The exist status of the command will be zero, unless it was aborted in some way (e.g. ^C).
EXAMPLE
Run a command on a list of hosts:
listrunner -l logdir -c "uname -a" -h host1,host2,host3
Upload a script, some auxiliary files and run the script:
listrunner -l logdir -x runme.sh
-a seed.dat -a golden.dat
-h host1,host2,host3
SEE ALSO
dsh(1), cssh(1)
REPORTING BUGS
Report bugs to project website (http://code.google.com/p/ganeti/) or contact the developers using the Ganeti mailing list (ganeti@google-
groups.com).
SEE ALSO
Ganeti overview and specifications: ganeti(7) (general overview), ganeti-os-interface(7) (guest OS definitions).
Ganeti commands: gnt-cluster(8) (cluster-wide commands), gnt-job(8) (job-related commands), gnt-node(8) (node-related commands), gnt-
instance(8) (instance commands), gnt-os(8) (guest OS commands), gnt-group(8) (node group commands), gnt-backup(8) (instance import/export
commands), gnt-debug(8) (debug commands).
Ganeti daemons: ganeti-watcher(8) (automatic instance restarter), ganeti-cleaner(8) (job queue cleaner), ganeti-noded(8) (node daemon),
ganeti-masterd(8) (master daemon), ganeti-rapi(8) (remote API daemon).
Ganeti htools: htools(1) (generic binary), hbal(1) (cluster balancer), hspace(1) (capacity calculation), hail(1) (IAllocator plugin),
hscan(1) (data gatherer from remote clusters).
COPYRIGHT
Copyright (C) 2006, 2007, 2008, 2009, 2010, 2011 Google Inc. Permission is granted to copy, distribute and/or modify under the terms of
the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later
version.
On Debian systems, the complete text of the GNU General Public License can be found in /usr/share/common-licenses/GPL.
Ganeti ganeti-listrunner(8)