LFTP Mirroring


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users LFTP Mirroring
# 1  
Old 07-21-2008
LFTP Mirroring

LFTP Mirroring
We are planning to use lftp to mirror some of the files and
directories on to the remote server.

What we exactly want to do is mirror some of the directories and
exclude some of the the directories from "/" i.e. main root. . What
lftp is doing is mirroring all the directories. It seems the include
and exclude doesnt work properly.

The script that we are trying to run is as below:

HomeBackUpDir=/
RemotePath=/data/
lftp -u $RemoteUser,$RemotePass -e "mirror --dry-run --reverse
--delete -I '/home/*/web/' -I '/home/*/data/' -i
'/home/cla_backup/scripts/' -i '/etc/apache2' -X
'/home/*/data/lucene_data/' -X '*data/temp/*' -X '*backup/*' -X
'*templater_cache/*' --only-newer --ignore-time --verbose=4
$HomeBackUpDir $RemotePath" $RemoteHost

What we intend to do is to mirror
/etc/apache2/
in the home/ directory wherever there is a web/ directory mirror that
in the home/ directory wherever there is a data/ directory mirror that
/home/cla_backup/scripts

Exclude:
in the home/ directory wherever there is a data/lucene_data/
/data/temp/
backup/
templater_cache/


The above script tries to mirror even directories like /dev, /proc and
all other directories that are present in "/".
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Error with LFTP

I use below ftp command to push the file from UNIX server to Mainframe system. (lftp -d -e "set ftp:passive-mode false; put -a ${SPOOLFILE} -o ${FNAME}; exit" -u ${id},${paswd} ${host} ) >> $ftplog To ftp the file successfully i need to get the out put for FNAME as "'filename'" (double... (5 Replies)
Discussion started by: zooby
5 Replies

2. Shell Programming and Scripting

Lftp command

Hello, I am trying to write a script that will lftp a file. The parameters are being passed in to the script from ETL tool. The put command is not working. put $file_name $tgt_file_name in the function ftpfile(). When I hardcode the file name with path its working. can some one help me... (5 Replies)
Discussion started by: skatpally
5 Replies

3. Shell Programming and Scripting

lftp is not working.how to replace lftp with expect utility using same .cfg file.

We have lftp command inside shell file. which is intern calling .cfg file for transferring the file from one server to other. Below command to not working. lftp -e "set net:max-retries 1; set net:reconnect-interval-base 1; put -E -O /destinationdir/inbox/ /sourcedir/test.txt; bye" -u... (4 Replies)
Discussion started by: johnsnow
4 Replies

4. UNIX for Dummies Questions & Answers

Lftp operation

dear all, I need to get files from ftp when only files consist of words 'EUROPE' ftp sources in folder /ftp1/ftp2/ftp3/201409 files inside /ftp1/ftp2/ftp3/201409is as below 201409_EUROPE_citizen.txt 201409_EUROPE_natality.txt 201409_EUROPE_occupancy.txt 201409_ASIA_citizen.txt... (1 Reply)
Discussion started by: radius
1 Replies

5. Red Hat

Lftp issue

I installed KVM and configured two virtual machines in it server1.example.com(192.168.100.193) and tester1.example.com(192.168.100.230).I want to access server1.example.com from tester1.example.com over lftp.As far as networking is concerned between both I do have some doubts. I tried ping and... (5 Replies)
Discussion started by: shazgaurav
5 Replies

6. Shell Programming and Scripting

Lftp with dialog

Hi all. I want to know, if there is any chance to pass lftp listing to CLI dialog. I want to make an interactive CLI ftp manager, based on lftp. Version of dialog I use: root@dlink:~# dialog -v cdialog (ComeOn Dialog!) version 1.1-20100428 (0 Replies)
Discussion started by: n158
0 Replies

7. UNIX for Advanced & Expert Users

lftp connection issues

Hi guys, We are receiving fatal error while trying to use lftp client to connect to an external server using ftps protocol. It seems to connect but when I issue 'ls' command, it fails with below error: $ lftp -u user,pwd ftps://<URL>:990/Submit lftp user@URL:~> ls ls: Fatal error:... (0 Replies)
Discussion started by: nice_chapp
0 Replies

8. UNIX for Advanced & Expert Users

lftp: Option to lftp a file, wait and download a file as soon as its created

Please let me know what is lftp options combination to wait and download a file from target as soon as its gets created. I tried with different options but not able to get it working as I need any help would be appreciated (4 Replies)
Discussion started by: bmkux
4 Replies

9. Shell Programming and Scripting

lftp, get file list

hello I need script which give me file list from server (4 Replies)
Discussion started by: stahoo23
4 Replies
Login or Register to Ask a Question
APT-MIRROR(1)						User Contributed Perl Documentation					     APT-MIRROR(1)

NAME
apt-mirror - apt sources mirroring tool SYNOPSIS
apt-mirror [configfile] DESCRIPTION
A small and efficient tool that lets you mirror a part of or the whole Debian GNU/Linux distribution or any other apt sources. Main features: * It uses a config similar to apts sources.list * It's fully pool comply * It supports multithreaded downloading * It supports multiple architectures at the same time * It can automatically remove unneeded files * It works well on overloaded channel to internet * It never produces an inconsistent mirror including while mirroring * It works on all POSIX compliant systems with perl and wget COMMENTS
apt-mirror uses /etc/apt/mirror.list as a configuration file. By default it is tuned to official Debian or Ubuntu mirrors. Change it for your needs. After you setup the configuration file you may run as root: # su - apt-mirror -c apt-mirror Or uncomment line in /etc/cron.d/apt-mirror to enable daily mirror updates. FILES
/etc/apt/mirror.list Main configuration file /etc/cron.d/apt-mirror Cron configuration template /var/spool/apt-mirror/mirror Mirror places here /var/spool/apt-mirror/skel Place for temporarily downloaded indexes /var/spool/apt-mirror/var Log files placed here. URLs and MD5 summs also here. CONFIGURATION EXAMPLES
The mirror.list configuration supports many options, the file is well commented explinging each option. here are some sample mirror configuration lines showing the various supported ways : Normal: deb http://example.com/debian stable main contrib non-free Arch Specific: ( many other arch's are supported ) deb-powerpc http://example.com/debian stable main contrib non-free HTTP and FTP Auth or non-standard port: deb http://user:pass@example.com:8080/debian stable main contrib non-free Source Mirroring: deb-src http://example.com/debian stable main contrib non-free ORIGINAL AUTHOR
Dmitry N. Hramtsov <hdn@nsu.ru> CURRENT AUTHORS
Dmitry N. Hramtsov <hdn@nsu.ru> Brandon Holtsclaw <me@brandonholtsclaw.com> perl v5.14.2 2012-01-28 APT-MIRROR(1)