06-17-2012
Backup script to split and tar files
Hi Guys,
I'm very new to bash scripting. Please help me on this.
I'm in need of a backup script which does the ff.
1. If a file is larger than 5GB. split it and tar the file.
2. Weekly backup file to amazon s3 using s3rsync
3. If a file is unchanged it doesn't need to copy to amazon s3
I've searched google and can't find a script that suit my needs.
Can anyone post some of their scripts or links for reference which may help?
Thank you.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I have some file in /users/xyz directoty with .tar.gz extension. i need to find these files and if found in need to run other commands. I now the command for finding files,but how to put if condition ?please help me
Thanks (3 Replies)
Discussion started by: bmkreddy
3 Replies
2. Shell Programming and Scripting
I'm specifically trying to find help or insight on using the --incremental ('-G') option for creating a tar. Please resist the urge to tell me to use --listed-incremental ('-g') option. That's fairly well documented in the GNU tar manual. GNU tar 1.19
This is what the manual does say in section... (0 Replies)
Discussion started by: protienplant
0 Replies
3. Shell Programming and Scripting
I had an idea of very-very easy bacup script that packs ALL of the files in current dir (including the subfulders and with spaces in name), packs them with tar+gz and moves to a directory. I'm using Cywin under WinXP.
But I have a problem with tar. When I do in a single line
"tar -rf... (2 Replies)
Discussion started by: TennageWerewolf
2 Replies
4. UNIX for Advanced & Expert Users
I'm trying to do a incremental backup for a big NFS. Since space is not an issue, I don't want to compress them or end up with a big tarball for full backup( and a series of small tarballs for incremental backup). Basically I want the TAR backup/restore functionality but not TAR files up.... (3 Replies)
Discussion started by: overmindxp
3 Replies
5. Shell Programming and Scripting
I have written a shell script to perform backups using tar, rsync and optionally utilise lvm snapshots. The script is not finished but is in a working state and comments/descriptions are poor.
I would greatly appreciate any criticism and suggestions of the script to help improve my own learning... (0 Replies)
Discussion started by: jelloir
0 Replies
6. Shell Programming and Scripting
Hello,
Recently, I've started with shell scripting, and decided to write a script for my system backup using tar. When I was dealing with tar execution inside shell script I found this, inside shell we have the following code:
tar $TAR_PARAMS $ARCHIVE_FILE $EXCLUDE $BACKUP_STARTwith... (6 Replies)
Discussion started by: ilnar
6 Replies
7. Shell Programming and Scripting
Hi all,
I have a tar file and inside that tar file is a folder with additional tar.gz files. What I want to do is look inside the first tar file and then find the second tar file I'm looking for, look inside that tar.gz file to find a certain directory. I'm encountering issues by trying to... (1 Reply)
Discussion started by: bashnewbee
1 Replies
8. Shell Programming and Scripting
Hi,
I need backup all the files(including sub directories files ) which we modified today and create the tar file with the filename_<current_date>.tar
Thanks (1 Reply)
Discussion started by: gavemani
1 Replies
9. UNIX for Dummies Questions & Answers
I have a huge directoy(200+ gb) for backup. I want upload the tar file(split files) simultaneous to a remote ftp. (pipeline, stdout, stdin etc.)
I don't want write a data to local hdd. I have a ssd hdd. thanks.
this code doesn't work.( yes i know the problem is split command!)
tar cvzf -... (8 Replies)
Discussion started by: tara123
8 Replies
10. Shell Programming and Scripting
Hi all,
I have to write a script which will keep for a particular user (username is first argument) backups of the account area to another.
The script should accept as the second argument is a directory (or file), create one by storing a copy of the argument (using tar) and copies it to the list... (0 Replies)
Discussion started by: peter20
0 Replies
LEARN ABOUT DEBIAN
backup.d
BACKUP.D(5) backupninja package BACKUP.D(5)
NAME
BACKUP.D - Action configuration files for backupninja(1).
SYNOPSIS
/etc/backup.d/*
DESCRIPTION
To preform the actual backup actions, backupninja processes each action configuration file in /etc/backup.d according to the file's suffix.
.sh run this file as a shell script.
.rdiff backup action for rdiff-backup.
.dup backup action for duplicity.
.maildir backup action for slow, incremental rsyncs of tens of thousands of maildirs.
.mysql backup action for safe MySQL dumps.
.pgsql backup action for safe PostgreSQL dumps.
.sys backup action for general system reports and hardware information.
.svn backup action for safe backups of subversion repositories.
.trac backup action for safe backups of trac repositories.
.makecd backup action for burning backups to CD/DVD or creating ISOs.
These files must be owned by root and must not be world or group readable/writable. Support for additional configuration types can be added
by dropping bash scripts with the name of the suffix into /usr/share/backupninja.
The configuration files are processed in alphabetical order. However, it is suggested that you name the config files in "sysvinit style."
For example:
10-local.pgsql.disabled
15-runthisfirst.sh
20-runthisnext.mysql
90-runthislast.rdiff
Typically, you will put a '.rdiff' config file last, so that any database dumps you make are included in the filesystem backup. Action con-
figurations which end with .disabled are skipped.
Example templates for the action configuration files can be found in /usr/share/doc/backupninja/examples. You can also use ninjahelper(1),
a console based "wizard" for creating backup actions.
SCHEDULING
By default, each configuration file is processed everyday at 01:00 (1 AM). This can be changed by specifying the 'when' option in a backup
action's config file or in the global configuration file. Special value 'manual' will disable scheduling for the backup action. It is pos-
sible to run the backup action manually by invoking ninjahelper(1) with --run command line argument.
For example:
when = sundays at 02:00
when = 30th at 22
when = 30 at 22:00
when = everyday at 01
when = Tuesday at 05:00
when = hourly
when = manual
These values for "when" are invalid:
when = tuesday at 2am
when = tuesday at 2
when = tues at 02
A configuration file will be processed at the time(s) specified by the "when" option. If multiple "when" options are present, then they all
apply. If two configurations files are scheduled to run in the same hour, then we fall back on the alphabetical ordering specified above.
The "when" must occur before any sections in the action configuration file.
FILE FORMAT
The file format of the action configuration files is "ini style." Sections are created by using square bracket. Long lines are connected
with a backslash. For example:
# this is a comment
[fishes]
fish = red
fish = blue
[fruit]
apple = yes
pear = no thanks
i will not have a pear.
SEE ALSO
backupninja(1), ninjahelper(1), backupninja.conf(5),
AUTHOR
BACKUPNINJA was written by the riseup.net collective.
riseup October 10, 2005 BACKUP.D(5)