copying a list of files from one machine to another with the same path


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting copying a list of files from one machine to another with the same path
# 1  
Old 07-07-2010
copying a list of files from one machine to another with the same path

Hello All,

I would like to download a list of files from a remote server to my local machine preserving the path i.e, create a similar directory tree.

ex:
files on the remote machine with path

Code:
/remoteserver/005_S_0221/mpr/m1/I72128/dat/06A515T.dat
/remoteserver/005_S_0221/mpr/m2/I102054/dat/515T.dat
/remoteserver/006_S_0547/mpr/m1/I75279/dat/6A515T.dat
/remoteserver/006_S_0547/mpr/m2/I78722/dat/A515T.dat
/remoteserver/007_S_1339/mpr/m1/I56319/dat/5T.dat
/remoteserver/007_S_1339/mpr/m2/I104363/dat/1515T.dat
/remoteserver/010_S_0786/mpr/m1/I65597/dat/15T.dat

after downloading the path on the local machine should look like this
Code:
/localmachine/005_S_0221/mpr/m1/I72128/dat/06A515T.dat
/localmachine/005_S_0221/mpr/m2/I102054/dat/515T.dat
/localmachine/006_S_0547/mpr/m1/I75279/dat/6A515T.dat
/localmachine/006_S_0547/mpr/m2/I78722/dat/A515T.dat
/localmachine/007_S_1339/mpr/m1/I56319/dat/5T.dat
/localmachine/007_S_1339/mpr/m2/I104363/dat/1515T.dat
/localmachine/010_S_0786/mpr/m1/I65597/dat/15T.dat

On the remote server there are many other files in the directory that i do not want so could not use rsync or scp -r

Thanks in advance
# 2  
Old 07-07-2010
tar these files on remote server, and scp the tar file to local, then untar it.
# 3  
Old 07-07-2010
thank your for the quick reply rdcwayx

but how do i tar only the files from the list. There are many other files and subdirectories on the remote machine

---------- Post updated at 07:47 PM ---------- Previous update was at 07:33 PM ----------

This seems to work. Thanks again

cat list.txt|xargs tar cf archive.tar
# 4  
Old 07-07-2010
Code:
echo "/remoteserver/005_S_0221/mpr/m1/I72128/dat/06A515T.dat
/remoteserver/005_S_0221/mpr/m2/I102054/dat/515T.dat
/remoteserver/006_S_0547/mpr/m1/I75279/dat/6A515T.dat
/remoteserver/006_S_0547/mpr/m2/I78722/dat/A515T.dat
/remoteserver/007_S_1339/mpr/m1/I56319/dat/5T.dat
/remoteserver/007_S_1339/mpr/m2/I104363/dat/1515T.dat
/remoteserver/010_S_0786/mpr/m1/I65597/dat/15T.dat" |xargs tar cvf file.tar

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

List all files and copying to different location

Hello All, I want to copy all files from the list below to a path /qa0/repo/AS/CPY (lnx17:qa0:/qa0/repo/AS>) ls -lrt | grep 'Feb 14' -rw-rw-r-- 1 Ks1 qa0 39 Feb 14 20:11 HHH.dat -rw-rw-r-- 1 Ks1 qa0 32 Feb 14 20:11 HHH1.dat -rw-rw-r-- 1 Ks1 qa0 29 Feb 14 20:11... (3 Replies)
Discussion started by: arunkumar_mca
3 Replies

2. Shell Programming and Scripting

Need help in finding and copying list of files using bash shell script

Dear All, I have a situation where I want to copy some files of type .txt. These files are o/p from one program. Some of the files are named as fileName .txt instead of fileName.txt after fileName by mistake I have specified "space". Now I want to move these files as follows. mv fileName*... (13 Replies)
Discussion started by: linuxUser_
13 Replies

3. Shell Programming and Scripting

List all the files in the present path and Folders and subfolders files also

Hi, I need a script/command to list out all the files in current path and also the files in folder and subfolders. Ex: My files are like below $ ls -lrt total 8 -rw-r--r-- 1 abc users 419 May 25 10:27 abcd.xml drwxr-xr-x 3 abc users 4096 May 25 10:28 TEST $ Under TEST, there are... (2 Replies)
Discussion started by: divya bandipotu
2 Replies

4. Shell Programming and Scripting

Copying List of Files Under Different File Names ?!

Hi to all here , Excuse me for the lamer question but I need UNIX command for copying List of Files Under Different File Names ! for example I have this list: new_001.jpg new_002.jpg new_003.jpg ..... I want to copy all files that start with "new_" to the same directory but under... (7 Replies)
Discussion started by: boboweb_
7 Replies

5. UNIX for Dummies Questions & Answers

latest files copying over to new path

ls -lrt | nawk -v D="$(date +'%b%e:'| sed 's/ //g')" 'D==$6$7":"{sub(".*"$9,$9);print}' This picks only the latest files created based on the timestamp for that particular day.. how do i copy over the same files to a different location???? (1 Reply)
Discussion started by: win4luv
1 Replies

6. UNIX for Dummies Questions & Answers

Copying a list of files from one 'server' to another?

I have two servers. I would like to copy some files from one directory on server A into the same directory on server B. Its not all the files in in the directory, just some of them. Is there a way to make a file list in a txt file and then somehow copy all the files in that list in one go to... (6 Replies)
Discussion started by: Sepia
6 Replies

7. Shell Programming and Scripting

copying unreference files and keeping absolute path

Hi guys, I'm creating a script that basically remove unreference files so at the moment I have something like: DAYS=30 for DIRECTORY in `mount | awk '{ print $7}'` do find $DIRECTORY -type f -atime +$DAYS < ~/files.log done for FILE in `awk '{print $1}' ~/files.log` do cp... (2 Replies)
Discussion started by: hariza
2 Replies

8. UNIX for Dummies Questions & Answers

copying files from one location to another based on a list

I have a text list of about 3,000 file names (image files), which exist on a server and that I want to copy over to another location. I understand the Unix cp code, but what's the string to have it copy multiple files based on an external list? Many thanks! (4 Replies)
Discussion started by: rebornhonest
4 Replies

9. UNIX for Advanced & Expert Users

Copying files from 1 machine to another

hi i have a script that works on a file A in unix server. it basically extracts data from file A & put it into another file B. what i need to do is that, i have to copy file B onto another machine having Windows as its operating System. Presently i am doing this manually using FTP. now i need to... (1 Reply)
Discussion started by: rochitsharma
1 Replies

10. Shell Programming and Scripting

copying files to another machine

hello, i need to make a script in which a file on my unix server is copied to another machine using windows operating system in its C:\ drive. both the machines are connected through LAN. (2 Replies)
Discussion started by: rochitsharma
2 Replies
Login or Register to Ask a Question