Copy files in thumbnail folder to a secondary location for Amazon S3


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Copy files in thumbnail folder to a secondary location for Amazon S3
# 1  
Old 01-19-2012
Copy files in thumbnail folder to a secondary location for Amazon S3

Hello all! I am trying to create a script that will copy files from one location, to another but only folders that are filled with thumbnails to an exact directory replica in the second location. For example:
Code:
/images/2012/01/19/Event/Photographer/thumbnails

to

/amazon/2012/01/19/Event/Photographer/thumbnails

I'm assuming there's a way with the copy command with the -u argument so that it only updates files that are newer in the source directory. There are photos in the photographer folder that I don't want transferred to the Amazon folder. I'd rather serve a few large images from my server but reap the benefits of CloudFront for all my thumbnails.
# 2  
Old 01-20-2012
if your copy command supports -u option, you can just try

Code:
cp -R -u /images/2012/01/19/Event/Photographer/thumbnails /amazon/2012/01/19/Event/Photographer/thumbnails


Last edited by rdcwayx; 01-24-2012 at 07:22 PM..
# 3  
Old 01-20-2012
Thanks for the response rdcwayx! Smilie

I should have clarified in my first post that I have multiple directories that I want to crawl through and transfer all thumbnail folders over to. For example:
Code:
/images/2012/01/19/Event/Photographer/thumbnails
/images/2008/10/27/AnotherEvent/AnotherPhotographer/thumbnails
/images/2009/02/08/YetAnotherEvent/ADifferentPhotographer/thumbnails
etc.

I need to go through every directory and if a directory has a thumbnail folder, mimic the directory structure of the /images folder in the /amazon folder for only the thumbnail folder.. Smilie
# 4  
Old 01-20-2012
Code:
find / -type d -name "thumbnail" |while read folder
do
  dir=$(echo $folder|sed "s/images/amazon/")
  mkdir -p $dir
  cp -u $folder $dir
done

This User Gave Thanks to rdcwayx For This Post:
# 5  
Old 01-24-2012
Awesome rdcwayx! That worked marveously! I had to change the / in the find function to the correct directory with the initial images but then it worked flawlessly! Smilie
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Copy data at specified location from multiple files

Hello everyone, Im super new to coding but increasingly in need of it at work. Im have task stacked because of this problems, that I cannot figure out how to solve looking on the internet after trying many many things that looked similar to me. I have multiple data files of the form (see below).... (2 Replies)
Discussion started by: Xfiles_fan
2 Replies

2. Shell Programming and Scripting

Copying files from various folders to similar folder structure in another location

Hi, I need to write a script the has to copy the files from folders and subfolders to the same folder structure located in another location. Ex: mainfolder1 file1,file2,file3 subfolder1(file1,etc) subfolder2(file1,etc) to another folder location of same folder structure. rsync is not... (7 Replies)
Discussion started by: Raji Perumal
7 Replies

3. Shell Programming and Scripting

How to copy files from one location to another using xargs??

Hello Experts, I need to copy files from one location to another using xargs. Tried something like this (In Ubuntu & Solaris ). mkdir -p 1234; find /home/emd/Desktop/n007/M007/ -type f -name "A2014*" | xargs -0 cp -r {} /home/emd/Desktop/1234 But every time i run this, a weird error... (6 Replies)
Discussion started by: Saidul
6 Replies

4. Shell Programming and Scripting

Copy files from one location to another

I have below files in one location /test/files and also for each dates there are similar files A20130924.0000-0005_file1 A20130924.0000-0005_file2 A20130924.0005-0010_file1 A20130924.0005-0010_file2 . . . A20130924.2355-0000_file1 A20130924.2355-0000_file2 If i execute the script like... (4 Replies)
Discussion started by: Saidul
4 Replies

5. Shell Programming and Scripting

How to copy files from one location to another based on a priority?

Hi Gurus, I am a newbie to shell scripting and I am facing a problem right now.I have to automate the copy of files based on a priority.The scenario is as below: 1) There will be files from Mon-Fri with Mon file being named as abc_def_01_YYYYMMDD and Tue file being abc_def_02_YYYYMMDD and so... (4 Replies)
Discussion started by: vikramgk9
4 Replies

6. Shell Programming and Scripting

How to copy files with the same filenames as those in another folder to that same folder?

Hello All A similar question like this was asked before but I need to change part of the question. I've two folders, Folder A contains some image files in 150 subfolders; Folder B contains text files in 350 subfolders. All image files in Folder A have the same filename as the text... (5 Replies)
Discussion started by: chlade
5 Replies

7. Shell Programming and Scripting

Shell Script for Copy files from one location to another location

Create a script that copies files from one specified directory to another specified directory, in the order they were created in the original directory between specified times. Copy the files at a specified interval. (2 Replies)
Discussion started by: allways4u21
2 Replies

8. Shell Programming and Scripting

Find all text files in folder and then copy to a new folder

Hi all, *I use Uwin and Cygwin emulator. I´m trying to search for all text files in the current folder (C/Files) and its sub folders using find -depth -name "*.txt" The above command worked for me, but now I would like to copy all found text files to a new folder (C/Files/Text) with ... (4 Replies)
Discussion started by: cgkmal
4 Replies

9. UNIX for Advanced & Expert Users

copy files from one location to similar location

I need help in forming a script to copy files from one location which has a sub directory structure to another location with similar sub directory structure, say location 1, /home/rick/tmp_files/1-12/00-25/ here 1-12 are the number of sub directories under tmp_files and 00-25 are sub... (1 Reply)
Discussion started by: pharos467
1 Replies

10. UNIX for Advanced & Expert Users

Auto copy for files from folder to folder upon instant writing

Hello all, I'm trying to accomplish that if a file gets written to folder /path/to/a/ it gets automatically copied into /path/to/b/ the moment its get written. I thought of writing a shell script and cron it that every X amount of minutes it copies these files over but this will not help me... (2 Replies)
Discussion started by: Bashar
2 Replies
Login or Register to Ask a Question