Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Rsync size descrepancies
Top Forums UNIX for Dummies Questions & Answers Rsync size descrepancies Post 302771037 by Corona688 on Tuesday 19th of February 2013 11:18:14 AM
Old 02-19-2013
du does not measure the strict size of the files. du measures disk used, at the sector and cluster level.

Perhaps one of your files was a sparse file -- a file with a big hole of empty space in the middle. Many UNIX filesystems support these. You can make one by opening a file, seeking forward a whole bunch, then writing; the operating system will just mark the space before it as empty instead of actually storing all the 0's. du's results will be skewed for it, since it measures what's stored on disk, not the length of the file itself.

It's difficult to replicate sparse files with the sparse section intact. They usually get converted to real binary 0's instead of an actual hole. This would make them bigger when copied by any traditional means.
 

10 More Discussions You Might Find Interesting

1. Solaris

command to find out total size of a specific file size (spread over the server)

hi all, in my server there are some specific application files which are spread through out the server... these are spread in folders..sub-folders..chid folders... please help me, how can i find the total size of these specific files in the server... (3 Replies)
Discussion started by: abhinov
3 Replies

2. Solaris

Rsync Size ????

Hi I have been using rsync for the past few days and would vouch for it anytime.However i am unable to find the total size of files being transferred. The output of rsync looks something like this: sent 2.92M bytes received 90.75K bytes 6.78K bytes/sec total size is 6.27G speedup... (2 Replies)
Discussion started by: Hari_Ganesh
2 Replies

3. Solaris

Directory size larger than file system size?

Hi, We currently have an Oracle database running and it is creating lots of processes in the /proc directory that are 1000M in size. The size of the /proc directory is now reading 26T. How can this be if the root file system is only 13GB? I have seen this before we an Oracle temp file... (6 Replies)
Discussion started by: sparcman
6 Replies

4. Shell Programming and Scripting

The scripts not able to make the file to size 0, every times it go back to its original size

#!/bin/sh ########################################################################################################## #This script is being used for AOK application for cleaning up the .out files and zip it under logs directory. # IBM # Created #For pdocap201/pdoca202 .out files for AOK #1.... (0 Replies)
Discussion started by: mridul10_crj
0 Replies

5. Shell Programming and Scripting

Script to read file size and send email only if size > 0.

Hi Experts, I have a script like $ORACLE_HOME/bin/sqlplus username/password # << ENDSQL set pagesize 0 trim on feedback off verify off echo off newp none timing off set serveroutput on set heading off spool Schemaerrtmp.txt select ' TIMESTAMP COMPUTER NAME ... (5 Replies)
Discussion started by: welldone
5 Replies

6. UNIX for Advanced & Expert Users

Limiting size of rsync batch output

Anyone know if there's a way to limit the size of rsync batch output blob? I need each batch to fix on a 64GB USB key. Using syntax like: rsync -av --only-write-batch=/Volumes/usb/batch --stats /Users/dfbadmin/sandbox/ /Users/dfbadmin/archives/ (7 Replies)
Discussion started by: dfbills
7 Replies

7. UNIX for Advanced & Expert Users

Physical disk IO size smaller than fragment block filesystem size ?

Hello, in one default UFS filesystem we have 8K block size (bsize) and 1K fragmentsize (fsize). At this scenary I thought all "FileSytem IO" will be 8K (or greater) but never smaller than the fragment size (1K). If a UFS fragment/blocksize is allwasy several ADJACENTS sectors on disk (in a ... (4 Replies)
Discussion started by: rarino2
4 Replies

8. Solaris

/tmp size is less whereas size allocated to swap is more

Hi, the /tmp size is less whereas the size allocated to swap is quite big. how to increase the size of /tmp - #: swap -l swapfile dev swaplo blocks free /dev/md/dsk/d20 85,20 8 273096 273096 #: swap -s total: 46875128k bytes allocated + 2347188k reserved =... (2 Replies)
Discussion started by: psb74
2 Replies

9. UNIX for Dummies Questions & Answers

Ls directory size reporting byte size instead of file count

I have been searching both on Unix.com and Google and have not been able to find the answer to my question. I think it is partly because I can't come up with the right search terms. Recently, my virtual server switched storage devices and I think the problem may be related to that change.... (2 Replies)
Discussion started by: jmgibby
2 Replies

10. Shell Programming and Scripting

Rsync Error: rsync: link_stat failed: No such file or directory (2)

I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Discussion started by: mohtashims
2 Replies

LEARN ABOUT DEBIAN

ocf_heartbeat_rsyncd

OCF_HEARTBEAT_RSYNCD(7) 					OCF resource agents					   OCF_HEARTBEAT_RSYNCD(7)

NAME

       ocf_heartbeat_rsyncd - Manages an rsync daemon

SYNOPSIS

       rsyncd [start | stop | monitor | meta-data | validate-all]

DESCRIPTION

       This script manages rsync daemon

SUPPORTED PARAMETERS

       binpath
	   The rsync binary path. For example, "/usr/bin/rsync" (optional, string, default rsync)

       conffile
	   The rsync daemon configuration file name with full path. For example, "/etc/rsyncd.conf" (optional, string, default /etc/rsyncd.conf)

       bwlimit
	   This option allows you to specify a maximum transfer rate in kilobytes per second. This option is most effective when using rsync with
	   large files (several megabytes and up). Due to the nature of rsync transfers, blocks of data are sent, then if rsync determines the
	   transfer was too fast, it will wait before sending the next data block. The result is an average transfer rate equaling the specified
	   limit. A value of zero specifies no limit.  (optional, string, no default)

SUPPORTED ACTIONS

       This resource agent supports the following actions (operations):

       start
	   Starts the resource. Suggested minimum timeout: 20s.

       stop
	   Stops the resource. Suggested minimum timeout: 20s.

       monitor
	   Performs a detailed status check. Suggested minimum timeout: 20s. Suggested interval: 60s.

       validate-all
	   Performs a validation of the resource configuration. Suggested minimum timeout: 20s.

       meta-data
	   Retrieves resource agent metadata (internal use only). Suggested minimum timeout: 5s.

EXAMPLE

       The following is an example configuration for a rsyncd resource using the crm(8) shell:

	   primitive p_rsyncd ocf:heartbeat:rsyncd 
	     op monitor depth="0" timeout="20s" interval="60s"

SEE ALSO

       http://www.linux-ha.org/wiki/rsyncd_(resource_agent)

AUTHOR

       Linux-HA contributors (see the resource agent source for information about individual authors)

resource-agents UNKNOWN 					    03/09/2014						   OCF_HEARTBEAT_RSYNCD(7)
All times are GMT -4. The time now is 01:54 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy