12-12-2016
If the content is a database, then backing up in this way may also not give you a consistent restore in any case, especially if you are unable to read some of them!
You might be better getting the database tools to make a backup. Another alternate (but I'm guaranteeing it) might be to use LVM snapshots if you OS supports it. This way, you can be sure that the files are idle and although the database might go into crash-recovery (as though you've had a power loss) it should give you a point-in-time restore from when you split off the copy.
What OS are you using?
One worries that this is not a good plan though. If you cannot read all the data, how would you plan to restore it?
On your point about getting it to run faster, it will always depend on a number of factors, such as volume of data, if there is I/O contention etc. I/O contention can occur for various reasons, such as sharing physical media/access path (shared controllers, fibre etc.) or other users even.
Is the device SAN based? There may be a way to use SAN tools to copy a LUN that would give a suitable restore point. Of course it would revert everything on that LUN, so that might not be what you want, but perhaps you could mount the copy LUN as another filesystem and back that up away from the live database.
Can you explain a bit more about your server setup?
Kind regards,
Robin
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi, I have the following script running in my cron.
--------------------------------------------------------------------
#!/bin/csh
bnstat -p GPD_VSLinux | grep pg | grep varcon | awk '{print $1, $2, $3, $4, $5, $6, $7, $8, $9, $10}' > /tmp/LX_xbatch.log
bnstat -p GPD_VSLinux_test | grep pg... (2 Replies)
Discussion started by: killerserv
2 Replies
2. UNIX for Dummies Questions & Answers
Every day we back up all files on our system that are older than 7 days, so effectively we do a day's worth at a time.
The way we do this is to issue a find command using mtime +7 - we then loop round and for each result we issue a MV to move the file to a newly created directory. We then TAR the... (20 Replies)
Discussion started by: tonysab
20 Replies
3. Shell Programming and Scripting
Hello everyone,
This is my first post here and this is the first time I am using UNIX OS (Slackware). I find it really useful and powerful and would like to master it but as you may guess I am expreicing quite a few problems.
I've been reading a few documentations about it and bash this week... (17 Replies)
Discussion started by: sanchopansa
17 Replies
4. Shell Programming and Scripting
I would like some advice on how to logically put together a script to handle a daily task of data gathering for the following problem.
I have two files, file1 has 125,000 records that I cut and remove unwanted fields through scripts and cron. In file2, I have 25000 records that has the same... (4 Replies)
Discussion started by: greengrass
4 Replies
5. Shell Programming and Scripting
Ok. I want to parse a log file and search only for denied traffic for the previous hour. The log looks like this:
Jun 18 17:47:56 routername 36806: Jun 18 17:53:01.088: %SEC-6-IPACCESSLOG: list ingress-filter denied tcp 1.2.3.4(1234) -> 6.7.8.9(53), 4 packets
I only really care about the... (12 Replies)
Discussion started by: earnstaf
12 Replies
6. Shell Programming and Scripting
Alright, I feel like I have a pretty good basic knowledge of shell scripting, but this one is throwing me for a loop. I know I've seen something similar done with awk, but I couldn't find it with the search function.
I've grepped through my log file and get results like this:
--... (14 Replies)
Discussion started by: earnstaf
14 Replies
7. Filesystems, Disks and Memory
Hi all
i'm looking for good advice regarding backup plan becuase its first time to me handle large scale database expected to grow up 10000 - 20000 record per year with daily operations on it
I'm working as sysAdmin in educational organization ( junior level ) with mixed OSes environment... (3 Replies)
Discussion started by: h@foorsa.biz
3 Replies
8. Shell Programming and Scripting
Hi folks,
I use following script:-
#!/bin/sh
# cd Linbread
TODAY=`date +"%m%d"`
DATA=`grep $TODAY linbread.dat`
HOUR=`date +"%H"`
if
then TOD="Morning"
elif
then TOD="Afternoon"
else
TOD="Evening"
fi
echo $DATA | gawk -F"|" '{printf("%s\n\n%s",$2,$3)}' > $$tmp
fold -s -w60... (0 Replies)
Discussion started by: satimis
0 Replies
9. Shell Programming and Scripting
All
I have 2 parent directories - input and output. Each parent has multiple sub-directories...each sub-directory has multiple files. Each parent directory structure is a mirror image of itself
I need to poll the imput directory and if a new file is found, encrypt the file, move the file to... (2 Replies)
Discussion started by: davidra
2 Replies
10. Shell Programming and Scripting
HI all, im new to shell scripting. need your guidence for my script. i wrote one script and is attached here
Im explaining the requirement of script.
AIM: Shell script to run automatically as per scheduled and backup few network devices configurations. Script will contain a set of commands... (4 Replies)
Discussion started by: saichand1985
4 Replies
LEARN ABOUT DEBIAN
amzfs-snapshot
AMZFS-SNAPSHOT(8) System Administration Commands AMZFS-SNAPSHOT(8)
NAME
amzfs-snapshot - Amanda script to create zfs snapshot
DESCRIPTION
amzfs-snapshot is an Amanda script implementing the Script API. It should not be run by users directly. It create a zfs snapshot of the
filesystem where the path specified is mounted.
PRE-DLE-* create a snapshot and the POST-DLE-* destroy the snapshot, *-DLE-AMCHECK, *-DLE-ESTIMATE and *-DLE-BACKUP must be set to be
executed on the client:
execute-on pre-dle-amcheck, post-dle-amcheck, pre-dle-estimate, post-dle-estimate, pre-dle-backup, post-dle-backup
execute-where client
The PRE_DLE_* script output a DIRECTORY property telling where the directory is located in the snapshot. The application must be able to
use the DIRECTORY property, amgtar can do it.
The script is run as the amanda user, it must have the priviledge to create and destroy snapshot:
zfs allow -ldu AMANDA_USER mount,snapshot,destroy FILESYSTEM
Some system doesn't have "zfs allow", but you can give the Amanda backup user the rights to manipulate ZFS filesystems by using the
following command:
usermod -P "ZFS File System Management,ZFS Storage Management" AMANDA_USER
This will require that your run zfs under pfexec, set the PFEXEC property to YES.
The format of the DLE must be one of:
Desciption Example
---------- -------
Mountpoint /data
Arbitrary mounted dir /data/interesting_dir
ZFS pool name datapool
ZFS filesystem datapool/database
ZFS logical volume datapool/dbvol
The filesystem must be mounted.
PROPERTIES
This section lists the properties that control amzfs-snapshot's functionality. See amanda-scripts(7) for information on the Script API,
script configuration.
DF-PATH
Path to the 'df' binary, search in $PATH by default.
ZFS-PATH
Path to the 'zfs' binary, search in $PATH by default.
PFEXEC-PATH
Path to the 'pfexec' binary, search in $PATH by default.
PFEXEC
If "NO" (the default), pfexec is not used, if set to "YES" then pfexec is used.
EXAMPLE
In this example, a dumptype is defined to use amzfs-snapshot script to create a snapshot and use amgtar to backup the snapshot.
define script-tool amzfs_snapshot {
comment "backup of zfs snapshot"
plugin "amzfs-snapshot"
execute-on pre-dle-amcheck, post-dle-amcheck, pre-dle-estimate, post-dle-estimate, pre-dle-backup, post-dle-backup
execute-where client
#property "DF-PATH" "/usr/sbin/df"
#property "ZFS-PATH" "/usr/sbin/zfs"
#property "PFEXEC-PATH" "/usr/sbin/pfexec"
#property "PFEXEC" "NO"
}
define dumptype user-zfs-amgtar {
dt_amgtar
script "amzfs_snapshot"
}
SEE ALSO
amanda(8), amanda.conf(5), amanda-client.conf(5), amanda-scripts(7)
The Amanda Wiki: : http://wiki.zmanda.com/
AUTHORS
Jean-Louis Martineau <martineau@zmanda.com>
Zmanda, Inc. (http://www.zmanda.com)
Dustin J. Mitchell <dustin@zmanda.com>
Zmanda, Inc. (http://www.zmanda.com)
Amanda 3.3.1 02/21/2012 AMZFS-SNAPSHOT(8)