Ignoring already copied files


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Ignoring already copied files
# 1  
Old 04-30-2008
Ignoring already copied files

I'm almost brand new to UNIX, so I have no idea if how easy or difficult this would be, or if it's even possible.

I've been using FTP to copy a total of about 150gb of files to a remote drive. Since the directory being copied is so large, I've been trying to break it up into smaller chunks based on file names and file extensions, but I'm still running into some timing problems, where I'll have started it first thing in the morning, and it'll only be a quarter or so done by the end of the day, and if I try to start again the next day, it'll start at the very beginning of the directory and just copy files that have already been copied

My question is would there be any way to get around this? Would it be possible to somehow start the FTP session and skip copying the files already in the new drive?

Thanks
 
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Bash: copying lines with specific character to files with same name as copied line.

I am trying to make my script as simple as a possible but, I am not sure if the way I am approaching is necessarily the most efficient or effective it can be. What I am mainly trying to fix is a for loop to remove a string from the specified files and within this loop I am trying to copy the lines... (2 Replies)
Discussion started by: Allie_gastrator
2 Replies

2. Shell Programming and Scripting

Count the number of files copied from source to destination location

Hi Guys, how to count number of files successfully copied while coping files from source to destination path ex:10 files from source to target location copying if 8 files copied successfully then echo successfully copied=8 failure=2 files if two files get error to coping files from... (23 Replies)
Discussion started by: sravanreddy
23 Replies

3. UNIX for Dummies Questions & Answers

How to count number files successfully copied from source to target location?

Hi Guys, how to count number of files successfully copied while coping files from source to destination path ex:10 files from source to target location copying if 8 files copied successfully then echo successfully copied=8 failure=2 files if two files get error to coping files... (2 Replies)
Discussion started by: sravanreddy
2 Replies

4. Shell Programming and Scripting

How to get user to choose files to be copied to FTP server?

Hey all. I'm writing a script to automatically login to a router, change directories to where crashfiles are located, then listing all files in that directory. This is where I'm at so far and wish to have some user interaction to choose the files. What I am trying to do is list the files and get... (1 Reply)
Discussion started by: Gouda
1 Replies

5. Red Hat

Files copied to FTP server not shown

I had copied 2 files to an FTP server which I deployed on my RHEL 5.8 server. The ownership I kept for the files are for the user, ftp. But, I do not see the files on the FTP location using either accessing through Windows explorer or the browser. The ftp location is ftp://10.101.17.80/incoming.... (7 Replies)
Discussion started by: RHCE
7 Replies

6. Shell Programming and Scripting

Check files copied from remote server

There is a process which copy files form unix a to unix b I would like to check whether all files copied from a to b or not ,and list which are the missing files. Is there a command to check like that (3 Replies)
Discussion started by: lalitpct
3 Replies

7. Shell Programming and Scripting

no of files copied by scp command

hi, I have a script which copy files by using scp command. when i run that script, i can see the process meter but I want to know how many files have been copied. suppose, by using scp 10 files is being copied and I can see process meter for all 10 files. but i also want to see ... that 10... (0 Replies)
Discussion started by: anshu ranjan
0 Replies

8. UNIX for Advanced & Expert Users

Monitor files being copied/accessed

Hello, Is there a way (without 3rd party software) to know if a file has been accessed and/or copied ? I'm interested in any solution : doing command line instructions , running background scripts etc... I apologize if I posted this in the wrong forum. Thank you! (8 Replies)
Discussion started by: prostiiinet
8 Replies

9. Programming

monitoring files copied onto hard disk

hi... i need pointers to books/website... 'm trytin to write a daemon that monitors files of particular type(eg. text or pdfs) copied onto the hard disk. the daemon should detect the above n write the file name (along with the absolute path) to a file. please DO NOT give me the code... (2 Replies)
Discussion started by: abhi_abhijith
2 Replies
Login or Register to Ask a Question
cp(1)							      General Commands Manual							     cp(1)

Name
       cp - copy file data

Syntax
       cp [ -f ] [ -i ] [ -p ] file1 file2

       cp [ -f ] [ -i ] [ -p ] [ -r ] file... directory

       cp [ -f ] [ -i ] [ -p ] [ -r ] directory... directory

Description
       The command copies file1 onto file2.  The mode and owner of file2 are preserved if it already existed; the mode of file1 is used otherwise.
       Note that the command will not copy a file onto itself.

       In the second form, one or more files are copied into the directory with their original file names.

       In the third form, one or more source directories are copied into the destination directory with their original file names.

Options
       -f   Forces existing destination pathnames to be removed before copying, without prompting for confirmation.  The -i option is  ignored	if
	    the -f option is specified.

       -i   Prompts  user  with  the name of file whenever the copy will cause an old file to be overwritten. A yes answer will cause to continue.
	    Any other answer will prevent it from overwriting the file.

       -p   Preserves (duplicates) in the copies the modification time, access time, file mode, user ID, and group ID as allowed  by  the  permis-
	    sions of the source files, ignoring the present umask.

       -r   Copies  directories.  Entire directory trees, including their subtrees and the individual files they contain, are copied to the speci-
	    fied destination directory. The directory, its subtrees, and the individual files retain their original names. For	example,  to  copy
	    the directory including all of its subtrees and files, into the directory enter the following command:
	    cp -r reports news

See Also
       cat(1), pr(1), mv(1)

																	     cp(1)