LFTP Mirroring


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users LFTP Mirroring
# 1  
Old 07-21-2008
LFTP Mirroring

LFTP Mirroring
We are planning to use lftp to mirror some of the files and
directories on to the remote server.

What we exactly want to do is mirror some of the directories and
exclude some of the the directories from "/" i.e. main root. . What
lftp is doing is mirroring all the directories. It seems the include
and exclude doesnt work properly.

The script that we are trying to run is as below:

HomeBackUpDir=/
RemotePath=/data/
lftp -u $RemoteUser,$RemotePass -e "mirror --dry-run --reverse
--delete -I '/home/*/web/' -I '/home/*/data/' -i
'/home/cla_backup/scripts/' -i '/etc/apache2' -X
'/home/*/data/lucene_data/' -X '*data/temp/*' -X '*backup/*' -X
'*templater_cache/*' --only-newer --ignore-time --verbose=4
$HomeBackUpDir $RemotePath" $RemoteHost

What we intend to do is to mirror
/etc/apache2/
in the home/ directory wherever there is a web/ directory mirror that
in the home/ directory wherever there is a data/ directory mirror that
/home/cla_backup/scripts

Exclude:
in the home/ directory wherever there is a data/lucene_data/
/data/temp/
backup/
templater_cache/


The above script tries to mirror even directories like /dev, /proc and
all other directories that are present in "/".
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Error with LFTP

I use below ftp command to push the file from UNIX server to Mainframe system. (lftp -d -e "set ftp:passive-mode false; put -a ${SPOOLFILE} -o ${FNAME}; exit" -u ${id},${paswd} ${host} ) >> $ftplog To ftp the file successfully i need to get the out put for FNAME as "'filename'" (double... (5 Replies)
Discussion started by: zooby
5 Replies

2. Shell Programming and Scripting

Lftp command

Hello, I am trying to write a script that will lftp a file. The parameters are being passed in to the script from ETL tool. The put command is not working. put $file_name $tgt_file_name in the function ftpfile(). When I hardcode the file name with path its working. can some one help me... (5 Replies)
Discussion started by: skatpally
5 Replies

3. Shell Programming and Scripting

lftp is not working.how to replace lftp with expect utility using same .cfg file.

We have lftp command inside shell file. which is intern calling .cfg file for transferring the file from one server to other. Below command to not working. lftp -e "set net:max-retries 1; set net:reconnect-interval-base 1; put -E -O /destinationdir/inbox/ /sourcedir/test.txt; bye" -u... (4 Replies)
Discussion started by: johnsnow
4 Replies

4. UNIX for Dummies Questions & Answers

Lftp operation

dear all, I need to get files from ftp when only files consist of words 'EUROPE' ftp sources in folder /ftp1/ftp2/ftp3/201409 files inside /ftp1/ftp2/ftp3/201409is as below 201409_EUROPE_citizen.txt 201409_EUROPE_natality.txt 201409_EUROPE_occupancy.txt 201409_ASIA_citizen.txt... (1 Reply)
Discussion started by: radius
1 Replies

5. Red Hat

Lftp issue

I installed KVM and configured two virtual machines in it server1.example.com(192.168.100.193) and tester1.example.com(192.168.100.230).I want to access server1.example.com from tester1.example.com over lftp.As far as networking is concerned between both I do have some doubts. I tried ping and... (5 Replies)
Discussion started by: shazgaurav
5 Replies

6. Shell Programming and Scripting

Lftp with dialog

Hi all. I want to know, if there is any chance to pass lftp listing to CLI dialog. I want to make an interactive CLI ftp manager, based on lftp. Version of dialog I use: root@dlink:~# dialog -v cdialog (ComeOn Dialog!) version 1.1-20100428 (0 Replies)
Discussion started by: n158
0 Replies

7. UNIX for Advanced & Expert Users

lftp connection issues

Hi guys, We are receiving fatal error while trying to use lftp client to connect to an external server using ftps protocol. It seems to connect but when I issue 'ls' command, it fails with below error: $ lftp -u user,pwd ftps://<URL>:990/Submit lftp user@URL:~> ls ls: Fatal error:... (0 Replies)
Discussion started by: nice_chapp
0 Replies

8. UNIX for Advanced & Expert Users

lftp: Option to lftp a file, wait and download a file as soon as its created

Please let me know what is lftp options combination to wait and download a file from target as soon as its gets created. I tried with different options but not able to get it working as I need any help would be appreciated (4 Replies)
Discussion started by: bmkux
4 Replies

9. Shell Programming and Scripting

lftp, get file list

hello I need script which give me file list from server (4 Replies)
Discussion started by: stahoo23
4 Replies
Login or Register to Ask a Question
MM(1L)																	    MM(1L)

NAME
mm - mirror master SYNOPSIS
mm [flags] [package-files] DESCRIPTION
mm is the mirror master. It runs multiple calls to mirror in parallel and handles locking and minimal retry times. As with mirror, mm is a package written in Perl. mm presumes that all the package details are stored in a directory called packages. All the packages for a given site must be in a file whose name is the same as that of the site. So in packages/sunsite.org.uk will be all the package details for the host sunsite.org.uk. OPTIONS
-t Ignore the minimal retry timers. -o site:package Only mirror the given site:package. -debug Enable debugging. If this argument is given more than once the debugging level will increase. Currently the maximum useful level is four. -s Enable status debugging. This will print out the status of any subprocess as it is spawned or as it exits. CONFIGURATION FILE The configuration file is parsed as a series of statements. Blank lines and lines beginning with a hash are ignored. There are are two kinds of statements, controls and site:package details. Control statements are of the form: keyword=value You can add whitespace around the equals. Here is a list of the keywords and their values, any defaults are given inside square brackets: home Directory that mm chdirs to before doing any work. [''] max Maximum number of mirrors that can be running in parallel at any one time ['6'] mirror This is the way to call mirror. Any occurence of $args, $package or $site is replace with the appropriate entry from the package. Any $pkg is replaced with a version of $package with all characters that cause problems in filenames converted to underscore. The default is: exec ./mirror $args -p'$package' packages/$site > logs/$site:$pkg 2>&1 [''] cmd Run the given command. This can occur multiple times. [''] cmdin Run the given command and use its output as mm input. This can occur multiple times. [''] skip Skip the given site:package when it occurs. [''] In addition to control statements there are also package details. Each package details statement is of the form: site:package min-restart-last-ok min-restart-last-notok mirror-args The site and package fields are matched against those in the packages. A mirror will only be run to this site:package if the last mirror run was more than min hours out. The min-restart-last-ok limit will be used if the last call to mirror was successful. If the mirror call failed then min-restart-last-notok will be used. EXAMPLES
Here is a simple mm input file to manage mirroring two packages. home=/public/mirror ftp.cl.cam.ac.uk:JIPS-nrs 20 20 hcrl.open.ac.uk:hcrl-psion 20 20 More usually the auxilly program pkgs_to_mmin will be used to automatically convert the contents of the packages directory into the site:package statements. home=/public/mirror cmdin=./pkgs_to_mmin packages/* AUTHOR
Written by Lee McLoughlin <lmjm@icparc.ic.ac.uk>. 21 April 1993 MM(1L)