10-29-2012
How to copy very large directory trees
I have constant trouble with XCOPY/s for multi-gigabyte transfers.
I need a utility like XCOPY/S that remembers where it left off if I reboot. Is there such a utility? How about a free utility (free as in free beer)?
How about an md5sum sanity check too?
I posted the above query in another forum. Answers to the above question are welcome here too. My question for this forum is: How feasible is it it write a script in groovy, python, cygwin bash, Activestate perl, powershell, etc... to implement a linux "cp -R" or windows "xcopy/s" program that can continue where it left off after a reboot?
I cannot think of clever way do do this easily -- can you?
I could write it in C++ -- but I'm hoping for something more quick and elegant.
Thanks
Siegfried
8 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi Experts..
Could anyone please let me know the easier way to copy large dump of files from one server to another. I am trying to copy a set of dump files on two different servers placed in different geographic locations.. Though there are other factors such as latency, etc., slowing up the... (4 Replies)
Discussion started by: ganga.dharan
4 Replies
2. Shell Programming and Scripting
Hi
I have a job that will be running nightly incremental backsup of a large directory tree.
I did the initial backup, now I want to write a script to verify that all the files were transferred correctly. I did something like this which works in principle on small trees:
diff -r -q... (6 Replies)
Discussion started by: same1290
6 Replies
3. UNIX for Advanced & Expert Users
I want to backup all the directory tress, including hidden directories, without copying any files.
find . -type d gives the perfect list.
When I tried tar, it won't work for me because it tars all the files.
find . -type d | xargs tar -cvf a.tar
So i tried rsync.
On my own test box, the... (4 Replies)
Discussion started by: fld2007
4 Replies
4. Shell Programming and Scripting
Hi experts
cp bin root src /mnt
but not copy bin/bigfile
any help?
( I post this thread in the "redhat" forum wrongly, I don't know how to withdraw that question in that wrong forum)
Thanks (6 Replies)
Discussion started by: yanglei_fage
6 Replies
5. UNIX for Dummies Questions & Answers
Possibly a dumb question, but I'm deciding how I'm going to do this. I'm currently rsyncing a 25TB directory (with several layers of sub directories most of which have video files ranging from 500 megs to 4-5 gigs), from one NAS to another using rsync -av. By the time I need to act ~15TB should... (3 Replies)
Discussion started by: DeCoTwc
3 Replies
6. Slackware
Hi:
What's asked. (2 Replies)
Discussion started by: stf92
2 Replies
7. Shell Programming and Scripting
How to copy files from one directory to another directory with the subfolders copied.
If i have folder1/sub1/sub2/* it needs to copy files to folder2/sub1/sub2/*.
I do not want to create sub folders in folder2.
Can copy command create them automatically?
I tried cp -a and cp -R but did... (4 Replies)
Discussion started by: santosh2626
4 Replies
8. Shell Programming and Scripting
Hi
Can somebody please show me how to check from within a KSH script if a directory exists on that same host when parts of the directory tree are unknown?
If these wildcard dirs were the only dirs at that level then ...
RETCODE=$(ls -l /u01/app/oracle/local/*/* | grep target_dir) ... will... (4 Replies)
Discussion started by: user052009
4 Replies
LEARN ABOUT OPENDARWIN
nice
NICE(1) BSD General Commands Manual NICE(1)
NAME
nice -- execute a utility at an altered scheduling priority
SYNOPSIS
nice [-n increment] utility [argument ...]
DESCRIPTION
The nice utility runs utility at an altered scheduling priority, by incrementing its ``nice'' value by the specified increment, or a default
value of 10. The lower the nice value of a process, the higher its scheduling priority.
The superuser may specify a negative increment in order to run a utility with a higher scheduling priority.
Some shells may provide a builtin nice command which is similar or identical to this utility. Consult the builtin(1) manual page.
ENVIRONMENT
The PATH environment variable is used to locate the requested utility if the name contains no '/' characters.
EXAMPLES
Execute utility 'date' at priority 5 assuming the priority of the shell is 0:
nice -n 5 date
Execute utility 'date' at priority -19 assuming the priority of the shell is 0 and you are the super-user:
nice -n 16 nice -n -35 date
DIAGNOSTICS
If utility is invoked, the exit status of nice is the exit status of utility.
An exit status of 126 indicates utility was found, but could not be executed. An exit status of 127 indicates utility could not be found.
SEE ALSO
builtin(1), csh(1), idprio(1), rtprio(1), getpriority(2), setpriority(2), renice(8)
COMPATIBILITY
The traditional -increment option has been deprecated but is still supported.
STANDARDS
The nice utility conforms to IEEE Std 1003.1-2001 (``POSIX.1'').
HISTORY
A nice utility appeared in Version 4 AT&T UNIX.
BSD
June 6, 1993 BSD