Disclaimer, I've been a Linux admin for a while but don't frequently setup rsysnc jobs.
Here's the command I'm running on CentOS 5.5, rsync 2.6.8:
/src has 1.5 TB of data, /dest/ is a new destination and started out empy. Oh ya, both /srv and /dest are cifs shares. I know that /src is off a Windows 2008 server and /dest I have no idea. The /src is a local file server connected via 1g ethernet and /dest is remote on the other end of a slow WAN link.
Here's the mount output:
Here's the part that's got me scratching my head. This transfer has been running for a few hours and seems to be fine. I know it's gonna take a few days and I'm good with that. BUT, I'm watching transfer and as a file completes I'm doing a ls -lah so I can see the completed file but its not there... like all the directories are being created, the copies are taking time and doing their work but when I browse or ls the directory it's empty.
What's the deal?
---------- Post updated at 10:20 PM ---------- Previous update was at 10:18 PM ----------
Bonus question; without stopping the running job anyone got a good way to see how much has transferred? df -h /dest doesn't seem to produce any useful output.
Last edited by Scrutinizer; 03-14-2014 at 11:43 PM..
Reason: code tags
I am using th following to get the percentage and have never used bc before:
percent=$(echo "scale=4;(34117/384000)*100" | bc)
8.884600
percent=$(echo "scale=2;(34117/384000)*100" | bc)
8.00
Why do I get the results of 8.00 instead of 8.88 when using a scale of 2. I only want 2 decimal... (2 Replies)
Hi all,
I am writing script that returns the size of each disk or partition when called. I am using FDISK -l and parsing the results to get the result I want. When I execute fdisk -l it shows correct results, BUT when I execute the same thing with results to be put in a variable, I get strange... (5 Replies)
Hello ,
When using vim, can ctag and cscope support recording search results and displaying the history results ? Once I jump to one tag, I can use :tnext to jump to next tag, but how can I display the preview search result? (0 Replies)
Hello.
Using Rsync to synchronize files on 2 red hat servers, works fine.
Trying to use the compress options, but I don't know if it is working?
Nothing logged in the progress messages.
Not sure in my case if compression will be helpful in my case, so I would like to see some statistics.
Is... (2 Replies)
I want to remove any files that are older than 2 days from a directory. It deletes those files. Then it comes back with a message it is a directory. What am I doing wrong here?
+ find /mydir -mtime +2 -exec rm -f '{}' ';'
rm: /mydir is a directory (2 Replies)
I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location
I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Hi Folks -
I have this file that looks like this:
outbox/logs/Client_1042.log
outbox/logs/Client_941.log
outbox/logs/Client_942.log
outbox/logs/Client_943.log
outbox/logs/Client_944.log
And this is my code:
#!/bin/bash
_OUTBOX_BIN="outbox/logs/"
_NAME="Client"
_TEMP="temp.txt"... (9 Replies)
Good morning all,
This is the file name in question OD_Orders_2019-02-19.csv
I am trying to create a bash script to read into files with yesterdays date on the file name while retaining the rest of the files name. I would like for $y to equal, the name of the file with a formula output with... (2 Replies)
Using the 'strings' command and piping the result to 'sort' is producing strange results. I get block of lines that begin with asterisks, then a block that begins with some text, then more lines that begin with asterisks. The actual content is correct - lines beginning with asterisks is the... (5 Replies)
Discussion started by: edstevens
5 Replies
LEARN ABOUT DEBIAN
ropkg::rsync::logparser
RoPkg::Rsync::LogParser(3pm) User Contributed Perl Documentation RoPkg::Rsync::LogParser(3pm)NAME
RoPkg::Rsync::LogParser - a rsync log parser class
SYNOPSIS
#!/usr/bin/perl
use strict;
use warning;
sub main {
my $lp = new RoPkg::Rsync::LogParser( type => 'client' );
$lp->Parse('/tmp/debian-log.txt');
}
main();
Short description
RoPkg::Rsync::LogParser is a class used to parse (for the moment) client side rsync logs. Using this class you can extract the transfered
files, symlinks created, directories, total number of files, transfered bytes, speed of transfer etc. LogParser support list filter trough
probes (used by many projects to verify the mirrors). The primary use of this class is inside Simba, but can be used without problems in
any other project who needs a rsync client log parser.
METHODS
new(hash)
Constructor of the class. When creating a new class instance you must provide the type of log: client or server . For the moment only the
client parsing routines are defined.
Log($raw_log)
Get/Set the raw rsync log. With no parameters, the get behaviour is selected. If a parameter is present (and valid) the method acts as a
Set method.
Probes(@probes_list)
Get/Set the raw probes list. If no parameter is present, the method returns the number of probes defined (0 if none). If a list of probes
is given, the list is added to the existing list of probes.
Parse($filename)
Parse a rsync client log. If no filename is specified, the method parses the log previsiously set with Log() method. Please take extra care
with the filename. If it does not exists, or is not a file a exception will be raised (Param::Wrong and File::Open).
Files()
In scalar context returns the number of transfered files (filtered by probes list). In list context, returns the list of transfered files.
RealFiles()
In scalar context returns the number of transfered files. In list context, returns the list of transfered files.
Deleted()
In scalar context returns the number of deleted files (filtered by probes list). In list context, returns the list of deleted files.
RealDeleted()
In scalar context returns the number of deleted files. In list context, returns the list of deleted files.
Speed()
Returns the speed (as reported by rsync [in bytes/sec]) of the transfer.
Size()
Returns the size of the synced content.
TransfData()
Returns the total number of bytes transfered during the sync session
Symlinks()
In scalar context returns the number of symlinks (filtered by probes list). In list context, returns the list of symlinks.
RealSymlinks()
In scalar context returns the number of symlinks. In list context, returns the list of symlinks.
PREREQUISITES
RoPkg::Utils requires perl 5.008 or later and RoPkg::Exceptions class. From CPAN, you need the Scalar::Util module. At build time
Test::More is required for tests (if you don't plan to use the tests ignore this dependency).
SEE ALSO
RoPkg::Rsync::Node RoPkg::Rsync::ConfFile RoPkg::Exceptions
AUTHOR
Subredu Manuel <diablo@iasi.roedu.net>
LICENSE
Copyright (C) 2005 Subredu Manuel. All Rights Reserved. This module is free software; you can redistribute it and/or modify it under the
same terms as Perl itself. The LICENSE file contains the full text of the license.
perl v5.8.8 2006-06-09 RoPkg::Rsync::LogParser(3pm)