rsync with particular file pattern


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users rsync with particular file pattern
# 1  
Old 08-14-2009
rsync with particular file pattern

I'd like to rsync any files that end with 'rpt' under source dir called 'opt', and here is the command i tried:
Code:
rsync -avz --include='*.rpt' --exclude='*' /opt /tmp -n

but the list returned is a complete listing under opt. can anyone help out please?

Last edited by Yogesh Sawant; 12-10-2010 at 05:22 AM.. Reason: added code tags
# 2  
Old 08-17-2009
Its surprising that !!

1. Without slash at the end in SOURCE..
Code:
# rsync -avz --include='*.rpt' --exclude='*' /opt /tmp/2 -n
sending incremental file list

sent 10 bytes  received 12 bytes  44.00 bytes/sec
total size is 0  speedup is 0.00 (DRY RUN)

2. With slash at the end in SOURCE.
Code:
# rsync -avz --include='*.rpt' --exclude='*' /opt/ /tmp/2 -n
sending incremental file list
./
a.rpt
b.rpt

sent 67 bytes  received 21 bytes  176.00 bytes/sec
total size is 8  speedup is 0.09 (DRY RUN)

Its quite opposite to what you are speaking !! And only *.rpt syncs when you have / at the end !
# 3  
Old 08-17-2009
It's actually slightly more complicated then that - my rpt's are within recursive dirs under SOURCE. eg.

Code:
$ find /tmp/opt -name "*.rpt"
/tmp/opt/d/def.rpt
/tmp/opt/b.rpt
/tmp/opt/a.rpt
$ rsync -aruv --include='*.rpt' --exclude='*' /tmp/opt/ /tmp/2 -n
building file list ... done
created directory /tmp/2
./
a.rpt
b.rpt

sent 124 bytes  received 38 bytes  324.00 bytes/sec
total size is 0  speedup is 0.00

Note d/def.rpt is missing from the list.

But that said.... I'd finally GOT IT!!!

Code:
$ rsync -aruv --include="*/" --include="*.rpt" --exclude="*" /tmp/opt/ /tmp/2/ -n

-a, --archive archive mode, equivalent to -rlptgoD
-r, --recursive recurse into directories
-u, --update update only (don't overwrite newer files)
-v, --verbose increase verbosity

the first 'include' is to ensure recursiveness
the second 'include' is the actual inclusion rule
finally use an exclude to fence off everything else

The real trick is that 'include' and 'exclude' have to come in pair to work properly, so you either go : include <*> then exclude <PATTERN>, or exclude <*> then include <PATTERN>

Thanks heaps for the reply. Yous slash at the end of the SOURCE was a real big hint for me. Much appreciate! ': )
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Rsync Error: rsync: link_stat failed: No such file or directory (2)

I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Discussion started by: mohtashims
2 Replies

2. Shell Programming and Scripting

Big pattern file matching within another pattern file in awk or shell

Hi I need to do a patten match between files . I am new to shell scripting and have come up with this so far. It take 50 seconds to process files of 2mb size . I need to tune this code as file size will be around 50mb and need to save time. Main issue is that I need to search the pattern from... (2 Replies)
Discussion started by: nitin_daharwal
2 Replies

3. Shell Programming and Scripting

Identify file pattern, take count of pattern, then act

Guys - Need your ideas on a section of code to finish something up. To make a long story short, I'm parsing a print output file that goes to pre-printed forms. I'm intercepting it, parsing it, formatting it, cutting it up into individual pages, grabbing the text I want in zones, building an... (3 Replies)
Discussion started by: ampsys
3 Replies

4. Shell Programming and Scripting

Splitting textfile based on pattern and name new file after pattern

Hi there, I am pretty new to those things, so I couldn't figure out how to solve this, and if it is actually that easy. just found that awk could help:(. so i have a textfile with strings and numbers (originally copy pasted from word, therefore some empty cells) in the following structure: SC... (9 Replies)
Discussion started by: luja
9 Replies

5. Shell Programming and Scripting

Finding the pattern and replacing the pattern inside the file

i have little challenge, help me out.i have a file where i have a value declared and and i have to replace the value when called. for example i have the value for abc and ccc. now i have to substitute the value of value abc and ccc in the place of them. Input File: go to &abc=ddd; if... (16 Replies)
Discussion started by: saaisiva
16 Replies

6. Shell Programming and Scripting

How to use sed to search a particular pattern in a file backward after a pattern is matched.?

Hi, I have two files file1.txt and file2.txt. Please see the attachments. In file2.txt (which actually is a diff output between two versions of file1.txt.), I extract the pattern corresponding to 1172c1172. Now ,In file1.txt I have to search for this pattern 1172c1172 and if found, I have to... (9 Replies)
Discussion started by: saurabh kumar
9 Replies

7. Shell Programming and Scripting

Search for a pattern in a String file and count the occurance of each pattern

I am trying to search a file for a patterns ERR- in a file and return a count for each of the error reported Input file is a free flowing file without any format example of output ERR-00001=5 .... ERR-01010=10 ..... ERR-99999=10 (4 Replies)
Discussion started by: swayam123
4 Replies

8. Shell Programming and Scripting

rsync - update file on backup when file renamed on source

hi all, Please help me with rsync. I configured rsync to preserve timestamps using the -a option. When i renamed fileA to fileB on source machine I have to copies at the backup server. The aim is to keep the most recent file. fileA & fileB has same contents. When i renamed fileB to... (2 Replies)
Discussion started by: coolatt
2 Replies

9. Shell Programming and Scripting

Searching a pattern in file and deleting th ewhole line containing the pattern

Hi All, Please can someone assist in the script I have made that searches a pattern in a file and delete the whole line containing the pattern. #!bin/sh # The pattern that user want to add to the files echo "Enter the pattern of the redirect" read value # check if the user has... (1 Reply)
Discussion started by: Shazin
1 Replies

10. Shell Programming and Scripting

Search file for pattern and grab some lines before pattern

I want to search a file for a string and then if the string is found I need the line that the string is on - but also the previous two lines from the file (that the pattern will not be found in) This is on solaris Can you help? (2 Replies)
Discussion started by: frustrated1
2 Replies
Login or Register to Ask a Question