Shell Programming and Scripting

Hi Guys,

I'm very new to bash scripting. Please help me on this.

I'm in need of a backup script which does the ff.

1. If a file is larger than 5GB. split it and tar the file.
2. Weekly backup file to amazon s3 using s3rsync
3. If a file is unchanged it doesn't need to copy to amazon s3

I've searched google and can't find a script that suit my needs.

Can anyone post some of their scripts or links for reference which may help?

Thank you.

To find any file that is larger than 5Gb AND has been modified in the last week you can use:

Code:

find / mtime -7 -size +10485760 -print

Note: size is in 512 byte blocks hence 10485760 x 512 = 5,368,709,120 (5Gb).
mtime -7 is modification time less than 7 days ago

Thank you Chubler_XL for the input.

But I already created a directory where in all of the users copy their files for backup. My task now is to compress it and split it less than 5GB automatically. In preparation for backup to amazon s3.

I think it is possible in bash scripting, but since I'm a newbie here. I find it difficult to do the task. Can anyone give me sample of their bash script related on this topic? or any sites that can help me to solved this problem?

Thank you very much.

Try this:

Code:

cd /path/to/your/back/files
tar cz --remove-files -f ./backup.tgz ./*
split -b 4g backup.tgz backup.

This will compress all the files in the path into 1 big backup.tgz (tar gzip) file and then split the file into a heap of 4Gb pieces. Each piece will be named like backup.aa, backup.ab, backup.ac, etc.

Assumption is that everything under the path is to be backuped up and removed once done.

Now transfer the files as you normally would and remove the backup.* files when the transfer is completed OK.


To re-extract the files try cat backup.* | tar xzf -

to make it more specific, I created a directory called /backups it has a subdirectories named after each user. (user1, user2, user3). Now, each users will copy all their files that they need to backup on their respected folders. How can I automatically split and tar the files even if without knowing the name of the file?

I'm getting the point of your input. but I'm in need of a script which can automatically do the split and tar things. I know cron will do the automated job. My biggest problem is the script itself.

Sorry for being noob here and I hope you'll understand my situation.

Thank you,