Visit Our UNIX and Linux User Community


Lftp mirror pattern


 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers Lftp mirror pattern
# 15  
Old 03-15-2020
All I can advise
Code:
#!/bin/bash
DATE=`date +%Y%m%d -d "1 days ago"`

USER='user'
PASS='pass'

HOST='192.168.1.1'
LOCAL_BACKUP_DIR='/app/'${DATE}''
REMOTE_DIR='/app/log'
tmp=($(lftp -e "cd $REMOTE_DIR && glob -d echo [0-9]*; quit" -u $USER,$PASS $HOST))
REMOTE_DIR="$REMOTE_DIR/${tmp[@]: -1}"

mkdir -p '/app/'${DATE}''

lftp -u $USER,$PASS $HOST <<EOF
set ftp:ssl-protect-data true
set ftp:ssl-force true
set ssl:verify-certificate no
cd $REMOTE_DIR
lcd $LOCAL_BACKUP_DIR

mirror

quit
EOF

# 16  
Old 03-15-2020
unfortunately on remote location there are some directories that use 6 digit number!
when I ran script it copy them instead of 8 digit directories.


e.g: remote directory content like this:

Code:
13991010 
13991011 
13991012 
13991013 
Fabric 
Test 
Test2
991018
991019

output of script: (copy content of this directory 991019 instead of this 13991013)

Code:
 991019

expected output: (content of this 13991013 (exact 8digit))
Code:
 13991013

# 17  
Old 03-15-2020
Code:
tmp=($(lftp -e "cd $REMOTE_DIR && glob -d echo [0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9]; quit" -u $USER,$PASS $HOST))

Or maybe you have access via the SSH protocol? For example, by public key
Code:
REMOTE_DIR="$REMOTE_DIR/$(ssh user@host "cd $REMOTE_DIR; ls -tp | grep -Em1 '[0-9]{8}/$'")"

--- Post updated at 16:00 ---

Another option. If there is any sequence in the numbering of remote directories, for example,
the number in the name increases by one every day. You can simply organize a daily increase number in the local script
This User Gave Thanks to nezabudka For This Post:
# 18  
Old 03-16-2020
Work like charm! This is exactly what I want.

Thank you so much brother Smilie

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Error with LFTP

I use below ftp command to push the file from UNIX server to Mainframe system. (lftp -d -e "set ftp:passive-mode false; put -a ${SPOOLFILE} -o ${FNAME}; exit" -u ${id},${paswd} ${host} ) >> $ftplog To ftp the file successfully i need to get the out put for FNAME as "'filename'" (double... (5 Replies)
Discussion started by: zooby
5 Replies

2. Shell Programming and Scripting

lftp is not working.how to replace lftp with expect utility using same .cfg file.

We have lftp command inside shell file. which is intern calling .cfg file for transferring the file from one server to other. Below command to not working. lftp -e "set net:max-retries 1; set net:reconnect-interval-base 1; put -E -O /destinationdir/inbox/ /sourcedir/test.txt; bye" -u... (4 Replies)
Discussion started by: johnsnow
4 Replies

3. UNIX for Dummies Questions & Answers

Lftp operation

dear all, I need to get files from ftp when only files consist of words 'EUROPE' ftp sources in folder /ftp1/ftp2/ftp3/201409 files inside /ftp1/ftp2/ftp3/201409is as below 201409_EUROPE_citizen.txt 201409_EUROPE_natality.txt 201409_EUROPE_occupancy.txt 201409_ASIA_citizen.txt... (1 Reply)
Discussion started by: radius
1 Replies

4. Red Hat

Lftp issue

I installed KVM and configured two virtual machines in it server1.example.com(192.168.100.193) and tester1.example.com(192.168.100.230).I want to access server1.example.com from tester1.example.com over lftp.As far as networking is concerned between both I do have some doubts. I tried ping and... (5 Replies)
Discussion started by: shazgaurav
5 Replies

5. HP-UX

What is the difference between DRD and Root Mirror Disk using LVM mirror ?

what is the difference between DRD and Root Mirror Disk using LVM mirror ? (3 Replies)
Discussion started by: maxim42
3 Replies

6. UNIX for Advanced & Expert Users

lftp: Option to lftp a file, wait and download a file as soon as its created

Please let me know what is lftp options combination to wait and download a file from target as soon as its gets created. I tried with different options but not able to get it working as I need any help would be appreciated (4 Replies)
Discussion started by: bmkux
4 Replies

7. Solaris

What is mirror and sub mirror in RAID -1 SVM

Hi , I am new to SVM .when i try to learn RAID 1 , first they are creating two RAID 0 strips through metainit d51 1 1 c0t0d0s2 metainit d52 1 1 c1t0d0s2 In the next step metainit d50 -m d51 d50: Mirror is setup next step is metaattach d50 d52 d50 : submirror d52 is... (7 Replies)
Discussion started by: vr_mari
7 Replies

8. Solaris

ZFS Mirror versus Hardware Mirror

I've looked a little but haven't found a solid answer, assuming there is one. What's better, hardware mirroring or ZFS mirroring? Common practice for us was to use the raid controllers on the Sun x86 servers. Now we've been using ZFS mirroring since U6. Any performance difference? Any other... (3 Replies)
Discussion started by: Lespaul20
3 Replies

9. UNIX for Advanced & Expert Users

LFTP Mirroring

LFTP Mirroring We are planning to use lftp to mirror some of the files and directories on to the remote server. What we exactly want to do is mirror some of the directories and exclude some of the the directories from "/" i.e. main root. . What lftp is doing is... (0 Replies)
Discussion started by: sameerarora
0 Replies

Featured Tech Videos