03-02-2011
RHEL 5.6 Slow rsync to NFS array
Hi All,
I have RHEL 5.6 with a 70GB local directory of Web content. Images, PHP scripts etc.
I need to copy all this content to an NFS array thats mounted on the RHEL server.
I did a baseline cp to copy the content one week ago. Since my baseline copy the local directory has grown by 8GB.
Now I am using the below rsync command to run an incremental copy of all the new content.
rsync -avz --stats <source> <destination>
Rsync has been running for 2 days now and and it only appears to have copied about 2GB.
Is there a faster way I can do the copy? I seriously need to sync this content and I can't wait a week for it to complete.
Can someone please help me here?
I'll provide whatever info you need.
Thanks,
10 More Discussions You Might Find Interesting
1. UNIX for Advanced & Expert Users
I have an HP-UX server with a Network Appliance Filer attached over Gigabit Ethernet. I am noticing very slow response time when using "ls -l" on one directory on one of the several NFS mounted filesystems. The "ls" command by itself does not seem to be a problem. Typically I get a response within... (3 Replies)
Discussion started by: keelba
3 Replies
2. UNIX for Dummies Questions & Answers
Hi,
Following my last post I've mounted the remote server on my local server. However copying files from this mounted server is increadbily slow. If I copy files using rcp it's very fast so I assume there must be a setting somewhere?
Any help appreicated.
Thanks (2 Replies)
Discussion started by: AngryBunny
2 Replies
3. Red Hat
Hi, I facing an NFS problem. I have machine1, which has diskA and diskB, and machine2, both are Mandriva 2009 Linux.
When I am on machine2 and NFS mount both diskA and diskB of machine1. Writing to diskA is very fast, but writing to diskB is very slow. I tried different mount rsize and wsize... (2 Replies)
Discussion started by: hiepng
2 Replies
4. Red Hat
Hi guys,
I am trying something. I wrote a simple shell program to test something where continuous while loop writes on a file over the nfs. The time taken to write "hello" 3000 times take about 10 sec which is not right. Ideally it should take fraction of seconds. If I write on the local disk, it... (1 Reply)
Discussion started by: abhig
1 Replies
5. Red Hat
Ok, Im trying to get NFS working on my RHEL 5 box, apparently i can use the box as a client, but not as a server. If it helps i cant ssh into the box (server), but as a client ssh works fine. Ive configured
server:
/etc/hosts.allow:
all : all
all :all@all
setup my /etc/exports file... (4 Replies)
Discussion started by: drs.grid
4 Replies
6. AIX
Hi,
I have a bit of a NFS problem on AiX 6.1 : When I set the mount to cio and dio - needed for a database app - Everything slows down. The following is copying 700mb, top one is a normal mount bottom one is a mount with the cio/dio option enabled :
# ./a.sh
Wed Jan 11 11:41:24 GMT 2012... (5 Replies)
Discussion started by: AJCG1976
5 Replies
7. UNIX for Dummies Questions & Answers
Hello,
I have some files in a local directory and perform an rsync command with the files in a remote directory, Now when I checked the files in the local and the remote directory, I found some strange filetypes such as this: .nfs0000000001d0c8e000002ff2 , .fuse_hidden000014da00000001 etc etc,... (3 Replies)
Discussion started by: ajayram
3 Replies
8. Red Hat
RHEL 7.1 client using autofs to mount a NIS map of home directories being exported by a Solaris 10x86 nfs server.
The owner and group are correct on the NFS server, but on the RHEL client, the owner and group end up being nobody nobody. The USERS and GROUPS are NIS maps as well. They are... (2 Replies)
Discussion started by: mrmurdock
2 Replies
9. Solaris
NFS server: RHEL:6
/nfsdb 192.168.8.10/28(rw,sync,no_root_squash) 192.168.7.10/28(rw,sync,no_root_squash)
Client: Solaris 11.3
vfstab entry :
192.168.8.9:/nfsdbarch - /archive_data nfs - yes rw,soft,vers=4
# ls -ld /archive_data
drwxr-xr-x 4 root root... (3 Replies)
Discussion started by: Shirishlnx
3 Replies
10. Solaris
I have "inherited" a OmniOS (illumos based) server.
I noticed rsync is significantly slower in respect to my reference, FreeBSD 12-CURRENT, running on exactly same hardware.
Using same hardware, same command with same source and target disks, OmniOS r151026 gives:
test@omniosce:~# time... (11 Replies)
Discussion started by: priyadarshan
11 Replies
LEARN ABOUT DEBIAN
ns_conncopytochannel
Ns_ConnCopy(3aolserver) AOLserver Library Procedures Ns_ConnCopy(3aolserver)
__________________________________________________________________________________________________________________________________________________
NAME
Ns_ConnCopyToChannel, Ns_ConnCopyToDString, Ns_ConnCopyToFd, Ns_ConnCopyToFile - Copy request content to open file or dstring
SYNOPSIS
#include "ns.h"
int
Ns_ConnCopyToChannel(conn, ncopy, chan)
int
Ns_ConnCopyToDString(conn, ncopy, dsPtr)
int
Ns_ConnCopyToFd(conn, ncopy, fd)
int
Ns_ConnCopyToFile(conn, ncopy, fp)
ARGUMENTS
Ns_Channel chan (in) Pointer to Tcl channel open for write.
Ns_Conn conn (in) Pointer to open connection.
Ns_DString dsPtr (in) Initialized dstring.
int fd (in) File descriptor open for write.
FILE fp (in) Stdio FILE pointer open for write.
int ncopy (in) Number of bytes to copy.
_________________________________________________________________
DESCRIPTION
These functions copy content from an open connection request to the given open file descriptor, FILE, dstring, or Tcl_Channel. The rou-
tines work by copying from the content buffer; see the man page on Ns_ConnContent for how this buffer is managed for both small and large
requests.
The functions all return the number of bytes copied which will match the requested ncopy argument unless there is an error writing the con-
tent or the requested bytes is greater than the number of bytes still available to be read. An internal offset into the connection is
maintained and is shared with routines such as Ns_ConnRead which also consume content from the same buffer. Note that routines which
access the entire content, e.g., Ns_ConnContent, Ns_ConnContentFd, or Ns_ConnGetQuery will continue to provide access to the entire request
regardless if one of the Ns_ConnCopy or Ns_ConnRead functions have been used.
EXAMPLES
The following example demonstrates copying user data to a temp file:
fd = open("myfile.out", O_WRONLY|O_BINARY);
len = Ns_ConnContentLength(conn);
if (Ns_ConnCopyToFd(conn, len, fd) != len) {
... error writing content or content already consumed ...
}
SEE ALSO
Ns_ConnRead(3), Ns_ConnReadLine(3), Ns_ConnContent(3), Ns_ConnContentFd(3)
KEYWORDS
connection, content, read
AOLserver 4.0 Ns_ConnCopy(3aolserver)