Ok. I am using one cluster to remotely write into another cluster. I can scp to copy files from cluste1 to cluster2, however, I need to copy a file that already exists in cluster 2 and replace it with the new file. I was thinking I could either remove the file in cluster 2 (which I don't know how to do) then use scp to copy the new file over, or use some variation of scp to overwrite the existing file in cluster2 with the new file in cluster1 (which I don't know how to do).
So lets say I do a
Code:
scp directory/file1 user@host:directory/file1
but file2 in user@host already exists.
---------- Post updated at 10:39 PM ---------- Previous update was at 09:23 PM ----------
Ok. I'm trying to do this another way. If I can execute a script from cluster one to cluster 2 then I won't need to scp the file. I can seem to get it to work. This is what I have so far.
Hi,
I have a pecular problem that I am experiencing. I have a few directories that seems to be missing, however, I can vi the files within them and I can also execute them (script files). For missing, I mean when I issue the "ls" command I don't see anything.
Any help will be greatly... (1 Reply)
For example,
/tmp/folder1
includes /tmp/folder1/a /tmp/folder1/b
/tmp/folder2
includes /tmp/c
Is there a command without removing files in /tmp/folder2 first to copy the /tmp/folder1 to /tmp/folder2?
and the result should be
/tmp/folder2 will include only /tmp/folder2/a... (2 Replies)
Hi,
1)I have two zip files a.zip and b.zip.
a.zip contains the files a.txt,b.txt and c.txt
b.zip contains the files a.txt,b.txt,d.txt,e.txt
Though some of the filenames in a.zip and b.zip are same, the size is different,i.e., the files are completely different even though their name is same.... (1 Reply)
Hi,
Please let me know how to find out number of files in a directory excluding existing files..The existing file format will be unknown..each time..
Thanks (3 Replies)
Hey,
Can someone pls give me an idea on how to write a shell script for the below requirement.
I am generating lot of .txt files in a unix directory through a etl tool, now I need to write a shell script which will move these files to another directory(\abc\xyz\source), but in the... (2 Replies)
I have several directories and all those directories have .dat files in them. I want to copy all those .dat files to one directory say "collected_directory"
The problem is I don't want to overwrite files. So, if two file names match, I don't want the old file to be overwritten with a new one.
... (1 Reply)
Hi,
I am using solaris 10 OS.Please help me out with the commands needed in below two scenarios.
1)How to delete the existing files in the tar file.
suppose i have a main tarfile named application.tar and it contains a file called ingres.tar.
what is the command to remove ingres.tar... (2 Replies)
I have a lot of binary files I need to copy to a folder. The folder is already filled with files of the same name. Copying on top of the old files takes MUCH longer than if I were to delete the old files then copy the new files to the now-empty folder. This result is specific to one system -... (3 Replies)
i use the split command to split a one terabyte backup file into 10 chunks of 100 GB each. The files are split one after the other. While the files is being split, I will like to scp the files one after the other as soon as the previous one completes, from server A to Server B. Then on server B ,... (2 Replies)
Discussion started by: malaika
2 Replies
LEARN ABOUT DEBIAN
parallel-scp
PARALLEL-SCP(1)PARALLEL-SCP(1)NAME
parallel-scp - parallel versions of scp
SYNOPSIS
parallel-scp [OPTIONS] -h hosts.txt local remote
DESCRIPTION
pssh provides a number of commands for executing against a group of computers, using SSH. It's most useful for operating on clusters of
homogenously-configured hosts.
parallel-scp copy files in parallel to a set of machines.
OPTIONS -r --recursive
recusively copy directories (OPTIONAL)
-h --hosts
hosts file (each line "host[:port] [user]")
-l --user
username (OPTIONAL)
-p --par
max number of parallel threads (OPTIONAL)
-o --outdir
output directory for stdout files (OPTIONAL)
-e --errdir
output directory for stderr files (OPTIONAL)
-t --timeout
timeout (secs) (-1 = no timeout) per host (OPTIONAL)
-O --options
SSH options (OPTIONAL)
-v --verbose
turn on warning and diagnostic messages (OPTIONAL)
EXAMPLE
The following example runs hostname on three machines (IPs or hostnames) specified in the file ips.txt using login irb2 and saves the
output in /tmp/foo.
# parallel-scp -h ips.txt -l irb2 /etc/hosts /tmp/hosts
Success on 128.112.152.122:22
Success on 18.31.0.190:22
Success on 128.232.103.201:22
ENVIRONMENT
All four programs take similar sets of options. All of these options can be set using the following environment variables:
o PSSH_HOSTS
o PSSH_USER
o PSSH_PAR
o PSSH_OUTDIR
o PSSH_VERBOSE
o PSSH_OPTIONS
SEE ALSO parallel-ssh(1), parallel-slurp(1), parallel-nuke(1), parallel-rsync(1), ssh(1), scp(1),
AUTHOR
Brent N. Chun <bnc@theether.org>
COPYING
Copyright: 2003, 2004, 2005, 2006, 2007 Brent N. Chun
NOTES
1. bnc@theether.org
mailto:bnc@theether.org
03/30/2009 PARALLEL-SCP(1)