Sponsored Content
Top Forums Shell Programming and Scripting Rsync to an external list of URLs Post 302240405 by danmero on Thursday 25th of September 2008 05:11:39 PM
Old 09-25-2008
Post what have you tried so far and where exactly are you stuck?

Please read https://www.unix.com/unix-dummies-que...om-forums.html before posting, especially 5 and 6.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Rsync file list

Hello, I'm trying to utilize rsync to backup 7 gigs of approximately 10,000 files, from what I've read this should be no sweat. However subsequent syncs seem to build an entirely new file list and the process takes a great deal of time. Reading the man page I'm not sure if I need to specify a file... (3 Replies)
Discussion started by: hexaplus
3 Replies

2. Shell Programming and Scripting

finding and removing patterns in a large list of urls

I have a list of urls for example: Google Google Base Yahoo! Yahoo! Yahoo! Video - It's On Google The problem is that Google and Google are duplicates as are Yahoo! and Yahoo!. I'm needing to find these conical www duplicates and append the text "DUP#" in from of both Google and... (3 Replies)
Discussion started by: totus
3 Replies

3. UNIX for Advanced & Expert Users

Rsync building file list/catalog path/location

Where is the file list created by rsync when it says building file list ? (1 Reply)
Discussion started by: glev2005
1 Replies

4. Web Development

Tricky mod_rewrite for clean urls problems when fetching external sources

Hi, I have problems with mod rewrite. I will try to describe... I want clean urls but fail to make it work propperly. Maybe I have problems, because the content displayed is fetched from my other site... There is a lot of stuff I already red about this, but somehow I can not find a solution... (2 Replies)
Discussion started by: lowmaster
2 Replies

5. Shell Programming and Scripting

Remove external urls from .html file

Hi everyone. I have an html file with lines like so: link href="localFolder/..."> link href="htp://..."> img src="localFolder/..."> img src="htp://..."> I want to remove the links with http in the href and imgs with http in its src. I'm having trouble removing them because there... (4 Replies)
Discussion started by: CowCow339
4 Replies

6. UNIX for Dummies Questions & Answers

rsync file list help

Is it possible to make rsync output a list of all the files transferred to a separate text file? If so how? I wondered if the --write-batch=FILE optionis what I need Thanks (1 Reply)
Discussion started by: barrydocks
1 Replies

7. Shell Programming and Scripting

Trying to extract domain and tld from list of urls.

I have done a fair amount of searching the threads, but I have not been able to cobble together a solution to my challenge. What I am trying to do is to line edit a file that will leave behind only the domain and tld of a long list of urls. The list looks something like this: www.google.com... (3 Replies)
Discussion started by: chamb1
3 Replies

8. OS X (Apple)

Rsync for back up, external HD

Hello all! I am quite unsure with all options of rsync. Here my backup configuration: I am on Mac X (10.8) and want an exact copy of my HD to an external HD. I formatted the new USB drive with Mac OS extended (Journaled, Encrypted) and made in my shell the following command and got the... (9 Replies)
Discussion started by: marek
9 Replies

9. Solaris

How can i list Solaris External storages?

Hi how can i list Solaris external storage's only, ie SAN, # for fs in `mount -p | egrep 'ufs|zfs|vxfs' | awk '{print $3}'`; do df -h $fs | sed 's/%//g' | grep -v capacity; done /dev/dsk/c2t5000C5003C31721Bd0s0 30G 18G 12G 61 /... (5 Replies)
Discussion started by: bentech4u
5 Replies

10. Shell Programming and Scripting

Rsync Error: rsync: link_stat failed: No such file or directory (2)

I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Discussion started by: mohtashims
2 Replies
RoPkg::Rsync::Node(3pm) 				User Contributed Perl Documentation				   RoPkg::Rsync::Node(3pm)

NAME
RoPkg::Rsync::Node DESCRIPTION
A node is a rsync module. A node is formed of zero or more atoms. Example: [debian] path = /var/ftp/pub/mirrors/debian.org/ #This comment will show on rsync -v comment = Debian Mirror list = yes [debian] is the node. The node name is debian. The node has 4 atoms: *) param atom (path) *) comment atom (the comment) *) param atom (comment) *) param atom (list) SYNOPSIS
#!/usr/bin/perl use strict; use warnings; sub main { my $node = new RoPkg::Rsync::Node(node_name => 'debian'); $node->AddParam('path', '/var/ftp/pub/mirrors/debian.org'); $node->AddComment('#This comment will show on rsync -v'); $node->AddParam('comment', 'Debian Mirror'); $node->AddParam('list', 'yes'); print $node->ToString(); } main(); The result is: [debian] path = /var/ftp/pub/mirrors/debian.org #This comment will show on rsync -v comment = Debian Mirror list = yes METHODS
All methods, throw the OutsideClass exception, if you use them as class methods. Besides OutsideClass the methods are throwing other exceptions as well. Refer to each method documentation for more information. new(%hash) The constructor of the class. Expects a hash as parameter. At this time, the only valid option is node_name . Any other option will be dis- carded. The node_name is a required parameter. If is not defined, a Param::Missing exception will be raised. Example: my $node = new RoPkg::Rsync::Node(node_name => 'debian'); Add(%atom_details) Add a new atom to the node. The atom details (type, name and value) are keys from the hash. All three parameters must be defined. There are 2 special cases: when the atom is a comment or a blank. In both cases, RoPkg::Rsync::Node generates a name for them. If the atom is a com- ment or a blank the returned value is the name of the atom. If the atom is a parameter, the total number of atoms for this node is returned. Example: $node->Add( type => 'param', name => 'path', value => '/var/ftp/pub/mirrors/debian.org', ); The returned value is the total number of atoms for this node. Example: $node->Add( type => 'comment', value => '#This comment will show on rsync -v', ); The returned value is the name of the atom (the name is autogenerated). Exceptions: *) Param::Missing - $atom_details{type} is not defined *) Param::Wrong = $atom_details{name} or $atom_details{value} are not defined AddParam($pname, $pvalue) A wrapper around Add provided for comodity. See Add documentation for more details about the behaviour. AddComment($comment_value) A wrapper around Add provided for comodity. See Add documentation for more details about the behaviour. AddBlank($blank_value) A wrapper around Add provided for comodity. See Add documentation for more details about the behaviour. GetAtom(%atom_details) Returns a RoPkg::Rsync::Atom object based on parameters specified in %atom_details. The %atom_details fields can be: type, name and value. type and value must be specified. Exceptions: *) Param::Missing - type/name were not specified *) Param::Unknown - no objects were found Take note that only the first object who match the criterias is returned. GetParam($name) A wrapper around GetAtom provided for comodity. See GetAtom documentation for more details about the behaviour. GetComment($name) A wrapper around GetAtom provided for comodity. See GetAtom documentation for more details about the behaviour. GetBlank($name) A wrapper around GetAtom provided for comodity. See GetAtom documentation for more details about the behaviour. GetAll() Returns a array with all the atoms of the node. In scalar context returns the number of atoms. GetAtomsNo() Returns the number of atoms for this node. Has($atom) Returns 1 if the $atom object is already a atom for this node, 0 otherwise. Delete($atom_name) Removes the atom those name is $atom_name. Returns 1 on success (the atom was found and removed), 0 otherwise. Name($node_name) get/set method for node name. Using this method you can change the node name or find it. ToString($indent, $include_node_name) Returns the string representation of the node. If $indent is true, the atoms are indented. If $include_node_name is true, the node name will be included in the string. Example: $node = new RoPkg::Rsync::Node(node_name => 'debian'); $node->AddParam('gid', 'users'); print $node->ToString(0, 0),$/, $node->ToString(0, 1),$/, $node->ToString(1, 1),$/, $node->ToString(),$/; The result is: gid = users [debian] gid = users; [debian] gid = users [debian] gid = users PREREQUISITES
perl 5.008 (or later) is required. Besides perl, you must have the following: *) RoPkg::Exceptions *) Scalar::Util *) English SEE ALSO
RoPkg::Rsync::Atom RoPkg::Rsync::ConfFile RoPkg::Exceptions AUTHOR
Subredu Manuel <diablo@iasi.roedu.net> LICENSE
Copyright (C) 2005 Subredu Manuel. All Rights Reserved. This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself. The LICENSE file contains the full text of the license. perl v5.8.8 2006-06-09 RoPkg::Rsync::Node(3pm)
All times are GMT -4. The time now is 06:24 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy