Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Do incremental backup without tar files up
Top Forums UNIX for Advanced & Expert Users Do incremental backup without tar files up Post 302435131 by overmindxp on Tuesday 6th of July 2010 12:32:30 PM
Old 07-06-2010
Quote:
Originally Posted by methyl
What are the two Operating Systems involved? Please be very very specific.

How far apart (in network terms) are the computers? Are there any stoppers such as firewalls or restricted bandwidth?

What network file transfer software do you have available? Obviously GET/LIST/PUT implies ftp but with better knowledge of your systems there may be more?

If we are confined to ftp, do you have enough disc space to copy back an archive when you want individual files or do you expect the target system to deal with such requests?

How big in measurable units is "big" ?
I'm backup things from NFS on RHEL5 to S3, but I cant use all the features that S3 provides(specifically versioning), because I need to go through a mandatory encryption.

bandwidth is not an issue.

I dont have space to copy back a full archive, but I am considering splitting them into small parts.

data is about 5TB
Last edited by overmindxp; 07-06-2010 at 01:43 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

tar - incremental backup

Hello everyone! I'm trying to make incremental tar archives of a folder for an example. On the box I use is UNIX AIX installed. I tried some sample codes I found on several web pages but with no success. Don't know what I'm doing wrong. Please write some sample code to make incremental tar... (0 Replies)
Discussion started by: Funky_ass
0 Replies

2. SCO

Incremental Backup using TAR in sco Openserver 5.0

Incremental Backup using TAR in sco Openserver 5.0 Dear all I am using sco openserver 5.0. I wanted to take backup of two folder (each 600 MB size) with lot of files. I used to take backup using tar command daily using a script. But the same takes more time. Is there any way to take backup... (0 Replies)
Discussion started by: jamcalicut
0 Replies

3. UNIX for Dummies Questions & Answers

incremental backup

Hi All.. i am trying to write a script which will give the incremental tar backup of all files with latest timestam. i tried with find -mmin -2 but if it takes half on hour or something to creat the tar itself, then no meaning in using the above command. so please help me to find the... (2 Replies)
Discussion started by: Usha Shastri
2 Replies

4. Shell Programming and Scripting

Incremental backup

Hi, I would like to create a daily incremental backup of a directory with all of the files within and add a timestamp (year-month-day) to the tar.gz file. I have the following, but it doesn't backup the inside files of the directory. #!/bin/bash tar -czf... (1 Reply)
Discussion started by: agasamapetilon
1 Replies

5. Windows & DOS: Issues & Discussions

Incremental Backup

I have a folder /root/test in a centos 5.3 system. I want to take an incremental backup of the contents of the folder in the C:\Downloads folder of a windows system present in the same lan as the linux system. What are the ways of executing this plan? Kindly help (0 Replies)
Discussion started by: proactiveaditya
0 Replies

6. Shell Programming and Scripting

Backup files in tar format

Hi, I need backup all the files(including sub directories files ) which we modified today and create the tar file with the filename_<current_date>.tar Thanks (1 Reply)
Discussion started by: gavemani
1 Replies

7. Shell Programming and Scripting

Backup script to split and tar files

Hi Guys, I'm very new to bash scripting. Please help me on this. I'm in need of a backup script which does the ff. 1. If a file is larger than 5GB. split it and tar the file. 2. Weekly backup file to amazon s3 using s3rsync 3. If a file is unchanged it doesn't need to copy to amazon s3 ... (4 Replies)
Discussion started by: ganitolngyundre
4 Replies

8. UNIX for Dummies Questions & Answers

Create an incremental tar

Hello, I need to create a tar file with a list of files from a directory. The directory has about 1000+ files of which I only need to create a tar ball of 150 files. The 150 files I need in the tar ball do not have common names or a common start letter. No two file names match, example: 1st... (3 Replies)
Discussion started by: babyPen1985
3 Replies

9. Shell Programming and Scripting

Append files (backup .tar)

Hi all, I have to write a script which will keep for a particular user (username is first argument) backups of the account area to another. The script should accept as the second argument is a directory (or file), create one by storing a copy of the argument (using tar) and copies it to the list... (0 Replies)
Discussion started by: peter20
0 Replies

10. Shell Programming and Scripting

Incremental Backup using tar for more than one path

Hi everyone; I need to create a shell script for full and incremental backup purposes. for incremental backup only for one folder (test1) located in /home/test1 syntax below works fine and have no problem: tar -cvf /home/backup/backup-0.tar.gz -g /home/test1/test.snar /home/test Problem is here... (5 Replies)
Discussion started by: momed131
5 Replies

LEARN ABOUT HPUX

nfs2_max_threads

nfs2_max_threads(5)						File Formats Manual					       nfs2_max_threads(5)

NAME

       nfs2_max_threads - control the number of kernel threads that perform asynchronous I/O for the NFS version 2 client

VALUES

   Failsafe
   Default
   Allowed values
   Recommended values
       A  warning will be issued at runtime if the tunable is set to a value greater than 256 threads since this is beyond the tested limit.  This
       is not a serious warning but just an information message for the administrator.

DESCRIPTION

       controls the number of kernel threads that perform asynchronous I/O for the NFS version 2 client. Since NFS is based  on  RPC  and  RPC	is
       inherently  synchronous,  separate execution contexts are required to perform NFS operations that are asynchronous from the calling thread.
       The operations which can be executed asynchronously are read for read-ahead, readdir for readdir read-ahead,  and  write  for  putpage  and
       pageio requests.

   Who Is Expected to Change This Tunable?
       The distributed file system administrator should examine this value depending on the network bandwidth available.

   Restrictions on Changing
       The  tunable  is  dynamic;  however, the number of threads for a file system is set when the file system is mounted. To affect a particular
       file system, unmount and mount the file system after changing this parameter.

   When Should the Value of This Tunable Be Raised?
       If the network is very high bandwidth and the client and server have sufficient resources, increase this value to more effectively  utilize
       the available network bandwidth, the client resources, and the server resources.

   What Are the Side Effects of Raising the Value?
       An  increase  in the system resources and the possibility that (see nkthread(5)) may need to be increased. The total number of asynchronous
       threads for NFS version 2 and NFS version 3 mount points cannot exceed 20% of the available threads defined by NFS mounts will fail if  the
       NFS mount command cannot guarantee the ability to create the maximum number of threads for that mount point.

   When Should the Value of This Tunable Be Lowered?
       In a very low bandwidth network, decrease this value so that the NFS client does not overload the network.

   What Are the Side Effects of Lowering the Value?
       Decreasing this value may impact NFS performance.

WARNINGS

       All  HP-UX kernel tunable parameters are release specific.  This parameter may be removed or have its meaning changed in future releases of
       HP-UX.

       Installation of optional kernel software, from HP or other vendors, may cause changes to tunable  parameter  values.   After  installation,
       some  tunable  parameters may no longer be at the default or recommended values.  For information about the effects of installation on tun-
       able values, consult the documentation for the kernel software being installed.	For information about optional kernel  software  that  was
       factory installed on your system, see at

AUTHOR

       was developed by Sun Microsystems, Inc.

SEE ALSO

       kctune(1M), sam(1M), gettune(2), settune(2), nfs3_max_threads(5), nfs4_max_threads(5), nkthread(5).

							     Tunable Kernel Parameters					       nfs2_max_threads(5)
All times are GMT -4. The time now is 07:45 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy