06-03-2013
Quote:
Originally Posted by
jaiseaugustine
That is why I gave you the command I am familiar and experienced with.
This is more or less always what I end up doing and I guess it is a reasonable way to proceed in most cases. I keep notes on what I have used for various situations, especially those methods that worked well.
The command,
find . -name "*.back" -type f -exec rm -f {} \;
worked well and cleared out about 50GB or older incremental versions. I ran this while I was out for a while and I didn't run it under time, so I can't comment on how fast the method is compared to other possibilities. I generally presume that there is no fast script based method to process a directory tree with 4+ million files.
I also did a defrag/optimize (auslogics) and clean out of MFT records. All told it took almost 24 hours to run, but I find I need to keep these backups well maintained, or they eventually bork and you have to reformat and start again. It seems as if rsync tends to lead to very fragmented repositories. I have never quite understood why you get lots of fragmenting on a drive with 500GB of empty space.
Thanks for all the additional explanations. I do always try to understand what a script is doing and why you would choose one method over another. I think I need to read a bit about exec.
LMHmedchem
This User Gave Thanks to LMHmedchem For This Post:
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
i have a directory "ABC" with lots of old files and sub directories in it.
the issue now is i want to delete away files which are older than 15 days in "ABC" without deleting the files in the sub directories and without deleting the sub directory.
i tried using find command but it will drill down... (2 Replies)
Discussion started by: legato
2 Replies
2. Shell Programming and Scripting
Hi All,
How do I get only the files with the .csv extension. I have a shell script something like below:
#!/usr/bin/
#Directory to scan for files
SCANDIR="/cmb/data/exstream/scriptslogs/";
LOGFILE="/cmb/data/exstream/scriptslogs/test.log";
cd $SCANDIR
for FILE in * ; do
FILENAME=$FILE... (9 Replies)
Discussion started by: janavenki
9 Replies
3. Shell Programming and Scripting
Hi
I am a shell-script newbie and am looking to synchronize certain files in two directory structures.
Both these directory-trees are in CVS and so I dont want the CVS directory to be copied over.
I want only .sh and .pl files in each subdirectory under these directory trees to be... (3 Replies)
Discussion started by: sharpsharkrocks
3 Replies
4. UNIX for Dummies Questions & Answers
Is this possible? Let me know If I need specify further on what I am trying to do- I just want to spare you the boring details of my personal file management.
Thanks in advance-
Brian- (2 Replies)
Discussion started by: briandanielz
2 Replies
5. Shell Programming and Scripting
Hello,
I have several files in a specific directory.
A specific string in one file can occur in another files.
If this string is in other files. Then all the files in which this string occured should be deleted and only 1 file should remain with the string.
Example.
file1
ShortName "Blue... (2 Replies)
Discussion started by: premier_de
2 Replies
6. UNIX for Dummies Questions & Answers
Iam in the process of copying a directory with thousands of directories and files into a new directory.
I need to preserve permissions, owner, group, date and timestamps, everything.
Iam using AIX and would need help of writing the command whether it is cp-RP or cpio.
Apprecaite your... (3 Replies)
Discussion started by: baanprog
3 Replies
7. UNIX for Dummies Questions & Answers
Let's say I wanna Delete all the files of a certain extension exept one.
How do I do it?
I know, if you wanna delete them all is with the command:
find ~/ -type f -iname '*.txt' -exec rm {} ~/ ';'
But If I want to keep an Specific file? Let's say I wanna keep 'Log.txt'. How do I do it? (1 Reply)
Discussion started by: lsteamer
1 Replies
8. Shell Programming and Scripting
Hi friends,
Hello again :)
i got stuck in problem. Is there any way to get a special directory from directory tree?
Here is my problm.." Suppose i have one fix directory structure "/abc/xyz/pqr/"(this will be fix).Under this directory structure i have some other directory and... (6 Replies)
Discussion started by: harpal singh
6 Replies
9. Shell Programming and Scripting
he following are the files available in my directory
RSK_123_20141113_031500.txt
RSK_123_20141113_081500.txt
RSK_126_20141113_041500.txt
RSK_126_20141113_081800.txt
RSK_128_20141113_091600.txt
Here, "RSK" is file prefix and 123 is a code name and rest is just timestamp of the file when its... (7 Replies)
Discussion started by: kridhick
7 Replies
10. Shell Programming and Scripting
hi,
i have a requirement to delete all the files from all the directories except some specific directories like archive and log.
for example:
there are following directories such as
A B C D Archive E Log F
which contains some sub directories and files. The requirement is to delete all the... (7 Replies)
Discussion started by: Little
7 Replies
LEARN ABOUT LINUX
rsync_selinux
rsync_selinux(8) rsync Selinux Policy documentation rsync_selinux(8)
NAME
rsync_selinux - Security Enhanced Linux Policy for the rsync daemon
DESCRIPTION
Security-Enhanced Linux secures the rsync server via flexible mandatory access control.
FILE_CONTEXTS
SELinux requires files to have an extended attribute to define the file type. Policy governs the access daemons have to these files. If
you want to share files using the rsync daemon, you must label the files and directories public_content_t. So if you created a special
directory /var/rsync, you would need to label the directory with the chcon tool.
chcon -t public_content_t /var/rsync
To make this change permanent (survive a relabel), use the semanage command to add the change to file context configuration:
semanage fcontext -a -t public_content_t "/var/rsync(/.*)?"
This command adds the following entry to /etc/selinux/POLICYTYPE/contexts/files/file_contexts.local:
/var/rsync(/.*)? system_u:object_r:publix_content_t:s0
Run the restorecon command to apply the changes:
restorecon -R -v /var/rsync/
SHARING FILES
If you want to share files with multiple domains (Apache, FTP, rsync, Samba), you can set a file context of public_content_t and pub-
lic_content_rw_t. These context allow any of the above domains to read the content. If you want a particular domain to write to the pub-
lic_content_rw_t domain, you must set the appropriate boolean. allow_DOMAIN_anon_write. So for rsync you would execute:
setsebool -P allow_rsync_anon_write=1
BOOLEANS
system-config-selinux is a GUI tool available to customize SELinux policy settings.
AUTHOR
This manual page was written by Dan Walsh <dwalsh@redhat.com>.
SEE ALSO
selinux(8), rsync(1), chcon(1), setsebool(8), semanage(8)
dwalsh@redhat.com 17 Jan 2005 rsync_selinux(8)