Visit Our UNIX and Linux User Community


copying a list of files from one machine to another with the same path


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting copying a list of files from one machine to another with the same path
# 1  
Old 07-07-2010
copying a list of files from one machine to another with the same path

Hello All,

I would like to download a list of files from a remote server to my local machine preserving the path i.e, create a similar directory tree.

ex:
files on the remote machine with path

Code:
/remoteserver/005_S_0221/mpr/m1/I72128/dat/06A515T.dat
/remoteserver/005_S_0221/mpr/m2/I102054/dat/515T.dat
/remoteserver/006_S_0547/mpr/m1/I75279/dat/6A515T.dat
/remoteserver/006_S_0547/mpr/m2/I78722/dat/A515T.dat
/remoteserver/007_S_1339/mpr/m1/I56319/dat/5T.dat
/remoteserver/007_S_1339/mpr/m2/I104363/dat/1515T.dat
/remoteserver/010_S_0786/mpr/m1/I65597/dat/15T.dat

after downloading the path on the local machine should look like this
Code:
/localmachine/005_S_0221/mpr/m1/I72128/dat/06A515T.dat
/localmachine/005_S_0221/mpr/m2/I102054/dat/515T.dat
/localmachine/006_S_0547/mpr/m1/I75279/dat/6A515T.dat
/localmachine/006_S_0547/mpr/m2/I78722/dat/A515T.dat
/localmachine/007_S_1339/mpr/m1/I56319/dat/5T.dat
/localmachine/007_S_1339/mpr/m2/I104363/dat/1515T.dat
/localmachine/010_S_0786/mpr/m1/I65597/dat/15T.dat

On the remote server there are many other files in the directory that i do not want so could not use rsync or scp -r

Thanks in advance
# 2  
Old 07-07-2010
tar these files on remote server, and scp the tar file to local, then untar it.
# 3  
Old 07-07-2010
thank your for the quick reply rdcwayx

but how do i tar only the files from the list. There are many other files and subdirectories on the remote machine

---------- Post updated at 07:47 PM ---------- Previous update was at 07:33 PM ----------

This seems to work. Thanks again

cat list.txt|xargs tar cf archive.tar
# 4  
Old 07-07-2010
Code:
echo "/remoteserver/005_S_0221/mpr/m1/I72128/dat/06A515T.dat
/remoteserver/005_S_0221/mpr/m2/I102054/dat/515T.dat
/remoteserver/006_S_0547/mpr/m1/I75279/dat/6A515T.dat
/remoteserver/006_S_0547/mpr/m2/I78722/dat/A515T.dat
/remoteserver/007_S_1339/mpr/m1/I56319/dat/5T.dat
/remoteserver/007_S_1339/mpr/m2/I104363/dat/1515T.dat
/remoteserver/010_S_0786/mpr/m1/I65597/dat/15T.dat" |xargs tar cvf file.tar


Previous Thread | Next Thread
Test Your Knowledge in Computers #496
Difficulty: Easy
Many programming languages assign special meaning to keywords such as for, if, and while (for example) that are used to define various control structures.
True or False?

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

List all files and copying to different location

Hello All, I want to copy all files from the list below to a path /qa0/repo/AS/CPY (lnx17:qa0:/qa0/repo/AS>) ls -lrt | grep 'Feb 14' -rw-rw-r-- 1 Ks1 qa0 39 Feb 14 20:11 HHH.dat -rw-rw-r-- 1 Ks1 qa0 32 Feb 14 20:11 HHH1.dat -rw-rw-r-- 1 Ks1 qa0 29 Feb 14 20:11... (3 Replies)
Discussion started by: arunkumar_mca
3 Replies

2. Shell Programming and Scripting

Need help in finding and copying list of files using bash shell script

Dear All, I have a situation where I want to copy some files of type .txt. These files are o/p from one program. Some of the files are named as fileName .txt instead of fileName.txt after fileName by mistake I have specified "space". Now I want to move these files as follows. mv fileName*... (13 Replies)
Discussion started by: linuxUser_
13 Replies

3. Shell Programming and Scripting

List all the files in the present path and Folders and subfolders files also

Hi, I need a script/command to list out all the files in current path and also the files in folder and subfolders. Ex: My files are like below $ ls -lrt total 8 -rw-r--r-- 1 abc users 419 May 25 10:27 abcd.xml drwxr-xr-x 3 abc users 4096 May 25 10:28 TEST $ Under TEST, there are... (2 Replies)
Discussion started by: divya bandipotu
2 Replies

4. Shell Programming and Scripting

Copying List of Files Under Different File Names ?!

Hi to all here , Excuse me for the lamer question but I need UNIX command for copying List of Files Under Different File Names ! for example I have this list: new_001.jpg new_002.jpg new_003.jpg ..... I want to copy all files that start with "new_" to the same directory but under... (7 Replies)
Discussion started by: boboweb_
7 Replies

5. UNIX for Dummies Questions & Answers

latest files copying over to new path

ls -lrt | nawk -v D="$(date +'%b%e:'| sed 's/ //g')" 'D==$6$7":"{sub(".*"$9,$9);print}' This picks only the latest files created based on the timestamp for that particular day.. how do i copy over the same files to a different location???? (1 Reply)
Discussion started by: win4luv
1 Replies

6. UNIX for Dummies Questions & Answers

Copying a list of files from one 'server' to another?

I have two servers. I would like to copy some files from one directory on server A into the same directory on server B. Its not all the files in in the directory, just some of them. Is there a way to make a file list in a txt file and then somehow copy all the files in that list in one go to... (6 Replies)
Discussion started by: Sepia
6 Replies

7. Shell Programming and Scripting

copying unreference files and keeping absolute path

Hi guys, I'm creating a script that basically remove unreference files so at the moment I have something like: DAYS=30 for DIRECTORY in `mount | awk '{ print $7}'` do find $DIRECTORY -type f -atime +$DAYS < ~/files.log done for FILE in `awk '{print $1}' ~/files.log` do cp... (2 Replies)
Discussion started by: hariza
2 Replies

8. UNIX for Dummies Questions & Answers

copying files from one location to another based on a list

I have a text list of about 3,000 file names (image files), which exist on a server and that I want to copy over to another location. I understand the Unix cp code, but what's the string to have it copy multiple files based on an external list? Many thanks! (4 Replies)
Discussion started by: rebornhonest
4 Replies

9. UNIX for Advanced & Expert Users

Copying files from 1 machine to another

hi i have a script that works on a file A in unix server. it basically extracts data from file A & put it into another file B. what i need to do is that, i have to copy file B onto another machine having Windows as its operating System. Presently i am doing this manually using FTP. now i need to... (1 Reply)
Discussion started by: rochitsharma
1 Replies

10. Shell Programming and Scripting

copying files to another machine

hello, i need to make a script in which a file on my unix server is copied to another machine using windows operating system in its C:\ drive. both the machines are connected through LAN. (2 Replies)
Discussion started by: rochitsharma
2 Replies

Featured Tech Videos