Sponsored Content
Top Forums Shell Programming and Scripting HELP! Need to compare 2 folders on 2 different systems, and copy unmatched filenames to other folder Post 302591528 by damang111 on Thursday 19th of January 2012 06:57:22 PM
Old 01-19-2012
HELP! Need to compare 2 folders on 2 different systems, and copy unmatched filenames to other folder

This has been tearing my hair out.

I need to:
1: compare server1:/data/archive/ to server2:/data/archive/ (through rsync, ssh, etc)
2: filenames that don't match, get copied (scp) to server2:/data/

server1 and server2 have ssh, scp, rsync access between eachother.

Is there any option in rsync to check/compare server1:/data/archive/ to server2:/data/archive/ and have the files synced to another destination such as server2:/data/ ??

TIA
 

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Auto copy for files from folder to folder upon instant writing

Hello all, I'm trying to accomplish that if a file gets written to folder /path/to/a/ it gets automatically copied into /path/to/b/ the moment its get written. I thought of writing a shell script and cron it that every X amount of minutes it copies these files over but this will not help me... (2 Replies)
Discussion started by: Bashar
2 Replies

2. Shell Programming and Scripting

copy some files from users home folders to my folder

i have users home directories in /home all the users have some files starting with character e and i want to copy all these files in a folder in my (root) home using a script i tried the script for i in m5 do cd m5 cp e1* /home/pc/exam cd .. done but get these... (3 Replies)
Discussion started by: pcrana
3 Replies

3. Shell Programming and Scripting

copy all files with the same filenames as those in another folder

Hi, all: I've got two folders, folder A contains some image files (say, 100 files) in .jpg format; folder B contains all description files (say, 500 files) in .txt format. All image files in folder A are able to find their corresponding description files in folder B. That is to say,... (3 Replies)
Discussion started by: jiapei100
3 Replies

4. Shell Programming and Scripting

Find files of type within folder copy multiple results to different folders

Ok question number two: I'd like to search a directory for multiple file types (rar, txt, deb) and depending on what's found, copy those files to folders named Rar, TextFiles, and Debs. I'm looking for speed here so the faster the script the better. I want it to be a function that I pass 1 argument... (4 Replies)
Discussion started by: DC Slick
4 Replies

5. Shell Programming and Scripting

Change all filenames under different folders...

Hi, all: I'd love to use shell script to change all filenames under different folders once for all: I've got over 100 folders, in each of them, there is a file named "a.ppm". I wanna change all these "a.ppm" to "b.ppm", and still . Visually, the directory structure looks like: and hope... (1 Reply)
Discussion started by: jiapei100
1 Replies

6. Shell Programming and Scripting

How best to remove certain characters from filenames and folders recursively

hello, I'm trying to figure out which tool is best for recursively renaming and files or folders using the characters \/*?”<>| in their name. I've tried many examples that use Bash, Python and Perl, but I'm not much of a programmer I seem to have hit a roadblock. Does anyone have any... (15 Replies)
Discussion started by: prometheon123
15 Replies

7. Shell Programming and Scripting

Linux Script to compare two folders and copy missing files

Hi, I need help in shell scripting. If someone can help me, that would be great! Problem. I want Linux Script to compare two folders and copy missing files. Description. I have two directories /dir1 /dir2 I need to copy all distinct/new/unique/missing files from /dir1 and that... (1 Reply)
Discussion started by: S.Praveen Kumar
1 Replies

8. Shell Programming and Scripting

How to copy files with the same filenames as those in another folder to that same folder?

Hello All A similar question like this was asked before but I need to change part of the question. I've two folders, Folder A contains some image files in 150 subfolders; Folder B contains text files in 350 subfolders. All image files in Folder A have the same filename as the text... (5 Replies)
Discussion started by: chlade
5 Replies

9. Shell Programming and Scripting

How do you compare two folders and copy the difference to a third folder in a remote server?

How do you compare one local folder and a remote folder and copy the difference to a third folder in a remote folder.e.g. Folder A -- Is in a remote server and it has the following files TEST1.OUT TEST2.OUT TEST3.OUT Folder B --Is in a local server and it has the following files ... (5 Replies)
Discussion started by: cumeh1624
5 Replies

10. Shell Programming and Scripting

Script to compare partial filenames in two folders and delete duplicates

Background: I use a TV tuner card to capture OTA video files (.mpeg) and then my Plex Media Server automatically optimizes the files (transcodes for better playback) and places them in a new directory. I have another Plex Library pointing to the new location for the optimized .mp4 files. This... (2 Replies)
Discussion started by: shaky
2 Replies
dput.cf(5)                                                      File Formats Manual                                                     dput.cf(5)

NAME
dput.cf - Debian package upload tool configuration file DESCRIPTION
This manpage gives a brief overview of dput's configuration file and the available options in it. dput is a tool to upload Debian packages to the archive. FORMAT
dput.cf consists of different groups of configuration options, one for each host where you want to be able to upload packages. Hosts are defined using an identifier header with a short name for the host, enclosed in square brackets. Note that only if multiple such headers are encountered in the configuration, only the group following the last header is considered. This is done to avoid confusion when overrid- ing a global configuration file with a user-specific one. There's a special identifier, [DEFAULT], which holds default parameters for all the hosts. The defaults can be overridden by redefining them again in each host section. The available parameters are listed below: fqdn This is the fully qualified domain name that will be used (can be specified as host:port for HTTP, HTTPS and FTP). login Your login on the machine named before. A single asterisk * will cause the scp and rsync uploaders to not use supply a login name when calling to ssh, scp, and rsync. incoming The directory that you should upload the files to. method The method that you want to use for uploading the files. Currently, dput accepts the following values for method: ftp the package will be uploaded via ftp, either anonymously or using a login/password. Note that ftp is unencrypted so you should not use password authentication with this. http and https the package will be uploaded via http or https using the PUT method as specified in WebDAV. The upload method will prompt for a password if necessary. scp the package will be uploaded using ssh's scp. This transfers files using a secure ssh tunnel, and needs an account on the upload machine. rsync the package will be uploaded using rsync over ssh. This is similar to scp, but can save some bandwidth if the destination file already exists on the upload server. It also needs a login on the remote machine as it uses ssh. local the package will be "uploaded" locally using /usr/bin/install. This transfers files to a local incoming directory, and needs appropriate permissions set on that directory. hash The hash algorithm that should be used in calculating the checksum of the files before uploading them. Currently, dput accepts the following values for hash: md5 use the md5 algorithm for calculation sha use the sha algorithm for calculation allow_unsigned_uploads This defines if you are allowed to upload files without a GnuPG signature to this host or not. allow_dcut This defines if you are allowed to upload a dcut changes file to the queue to remove or move files. distributions This defines a comma-separated list of distributions that this host accepts, used to guess the host to use when none is given on the command line. allowed_distributions A regular expression (of Python re module syntax) that the distribution field must match or dput will refuse the upload. delayed Set a numeric default parameter for delayed uploads (i.e. uploads to this queue will be delayed the specified number of days. Defaults to the empty string, meaning no delay. This only works with upload queues that support delayed uploads. run_lintian This option defines if lintian should be run before the package will be uploaded or not. If the package is not lintian clean, the upload will not happen. run_dinstall This options defines if dinstall -n should be run after the package has been uploaded or not. This is an easy way to test if your package would be installed into the archive or not. check_version This option defines if dput should check if the user has installed the package in his system for testing it before putting it into the archive. If the user has not installed and tested it, dput will reject the upload. passive_ftp This option defines if dput should use passive ftp or active ftp for uploading a package to one of the upload queues. By default, dput uses passive ftp connections. If you need to use active ftp connections, set passive_ftp to 0. progress_indicator This integer option defines if dput should display a progress indicator for the upload. (Currently implemented in ftp only.) Supported values: 0 (default) - no progress, 1 - rotating progress indicator, and 2 - kilobyte counter. scp_compress This option defines if the scp upload to the host will be compressed, or not. This option is only used for the 'scp' upload method, and has been found to decrease upload time for slow links, and increase upload times for faster links. ssh_config_options The arguments of this config options should be ssh config file options in the style documented in ssh_config(5). They will be passed to all automatic invocations of ssh and scp by dput. Note that you can define multiline (dput) configuration options by indenting the second line with whitespace (i.e. similar to RFC822 header continuations). post_upload_command This option defines a command to be run by dput after a successful upload. pre_upload_command This option defines a command to be run by dput before a upload happens. default_host_main This defines the default host for packages that are allowed to be uploaded to the main archive. This variable is used when guessing the host to upload to. BUGS
Please send bug reports to the author. FILES
/etc/dput.cf global dput configuration file ~/.dput.cf peruser dput configuration file AUTHOR
Christian Kurz. Updated by Thomas Viehmann <tv@beamnet.de>. Many other people have contributed to this code. See the Thanks file. SEE ALSO
dput(1) /usr/share/doc/dput COMMENTS
The author appreciates comments and suggestions from you, if any. April 8, 2001 dput.cf(5)
All times are GMT -4. The time now is 04:36 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy