copying files of certain extension?

Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers copying files of certain extension?
# 1  
Old 09-14-2011
copying files of certain extension?


I am using scp to copy a certain directory over the network. This folder contain some files that I am not interested in. My question is; is it possible to copy files of certain extension only, keeping the same directory hierarchy as it is (that is sub-folders)?

# 2  
Old 09-14-2011
find path/to/dir -name '*.ext' |
        tar -cf - |
        ssh username@host tar -C /path/to/dest -tf -

The -tf just has the server print files and paths. Replace it with -xf once you've tested to make sure it's getting the right files and paths.

Last edited by Corona688; 09-14-2011 at 04:57 PM..
# 3  
Old 09-14-2011

I haven't tried it, and I can't since I cannot create a tar file on the destination folder. I do not have a permission to create (or delete files).
So how can the script be tweaked?
# 4  
Old 09-14-2011
If you don't have permission to create or delete files, you're going to have a heck of a time copying anything by any means.

Originally Posted by faizlo

I haven't tried it, and I can't since I cannot create a tar file on the destination folder.
The archive never gets put on disk anywhere. It processes it as a stream without needing to keep a huge file around. tar's good at that, because tapes had to operate that way.

In effect it's creating a big list of files and their contents, all in a row, and sending it directly to stdout as it goes -- no storage needed.
And on the client side, it just reads directly from stdin, processing as it goes, without needing to store anything on disk except the files encoded in it.

Last edited by Corona688; 09-14-2011 at 06:45 PM..
# 5  
Old 09-14-2011
For the first part of the script
find path/to/dir -name '*.ext' |

Does it mean I should use `find' while logged into the distant machine? If so, then does ssh means I should login to my machine (the one I am physically at) to copy the files to it?
# 6  
Old 09-14-2011
find | tar -cf - needs to run on the source machine. tar -xf - runs on the destination machine.

The order can be reversed with a little work.

ssh username@host find /remote/source -name "'*.ext'" '|' xargs tar -cf - |
        tar -C /local/dest -tf -

Note the extra single quotes around *.ext and |, those are necessary to get that bit running on the remote server.
# 7  
Old 09-14-2011
Here is what I did:
ssh -Y user@server find /path/as/on/the/distant/machine/ -name "'*.ext'" '|' xargs tar -cf - | tar -C ~/store_here/

And here is the output:
tar: You must specify one of the `-Acdtrux' or `--test-label'  options

(.ext was .ps) And I was not prompted to login!
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Copying multiple files and appending time stamp before file extension

Hi, I have multiple files that read: Asa.txt Bad.txt Gnu.txt And I want to rename them using awk to Asa_ddmmyytt.txt and so on ... If there is a single command or more efficient executable please share! Thanks! (4 Replies)
Discussion started by: Jesshelle David
4 Replies

2. UNIX for Dummies Questions & Answers

Display the .csv extension files based on .done extension fine

Hi All, I want to fetch the files based on .done file and display the .csv files and Wil take .csv files for processing. 1.I need to display the .done files from the directory. i need to search for the .Csv files based on .done file.then move .csv files for the one directory ... (2 Replies)
Discussion started by: girija.g6
2 Replies

3. Shell Programming and Scripting

Python - glob () - How to grep same files with different extension files

Hi I Have a directory and i have some files below abc.txt abc.gif gtee.txt umni.log unmi.tar How can use glob function to grep abc files , i have created a variable "text" and i assigned value as "abc", please suggest me how can we use glob.glob( ) to get the output as below... (2 Replies)
Discussion started by: kumar85shiv
2 Replies

4. UNIX for Dummies Questions & Answers

How to list files with no extension together with *.prog files?

Hi, I know that to list files with no extension, we can use.. ls -1 | grep -v "\." And to list .prog files, we can use.. ls -1 *.prog or ls -1 | grep '.prog$' (4 Replies)
Discussion started by: adshocker
4 Replies

5. Shell Programming and Scripting

copying with a certain extension

trying to copy all the files without extension then add "*.txt" but its not working is there any other way and i do not want to use cpio -vdump just want to use copy command FROM=/usr/share/doc TO=/aleza/doc #the follow function copies all the files without extensions call(){ cd $FROM... (3 Replies)
Discussion started by: elginmulizwa
3 Replies

6. UNIX for Dummies Questions & Answers

How do I delete all files except one of a certain extension?

Let's say I wanna Delete all the files of a certain extension exept one. How do I do it? I know, if you wanna delete them all is with the command: find ~/ -type f -iname '*.txt' -exec rm {} ~/ ';' But If I want to keep an Specific file? Let's say I wanna keep 'Log.txt'. How do I do it? (1 Reply)
Discussion started by: lsteamer
1 Replies

7. Shell Programming and Scripting

Files copying - [ Listed files alone. ] - Shell script

Hi All, I am doing this for svn patch making. I got the list of files to make the patch. I have the list in a file with path of all the files. To Do From Directory : /myproject/MainDir To Directory : /myproject/data List of files need to copy is in the file: /myproject/filesList.txt ... (4 Replies)
Discussion started by: linuxadmin
4 Replies

8. UNIX for Advanced & Expert Users

copying of files by userB, dir & files owned by userA

I am userB and have a dir /temp1 This dir is owned by me. How do I recursively copy files from another users's dir userA? I need to preserve the original user who created files, original group information, original create date, mod date etc. I tried cp -pr /home/userA/* . ... (2 Replies)
Discussion started by: Hangman2
2 Replies

9. Linux

copying all files except those with certain extension

Hi, I have a root directory which has a big number of other subdirectories and contains a big number of files. I want to copy all these files and directories to another folder except files with certain extension, say .txt, files - how may I do this? Thanks, faizlo (8 Replies)
Discussion started by: faizlo
8 Replies

10. HP-UX

Files without extension

I am brand new to hp unix systems. I see some files without extension on this system. If I type name of the file it shows me so many detail but does not take me back to command prompt. What are these files and how do I come back to command prompt? Please help (1 Reply)
Discussion started by: rajahindustani
1 Replies
Login or Register to Ask a Question