Login or Register to Ask a Question and Join Our Community


UNIX and Linux Applications

How can I make multiple mirror websites on the fly?

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Special Forums UNIX and Linux Applications How can I make multiple mirror websites on the fly?
# 1  
Old 05-03-2009
How can I make multiple mirror websites on the fly?
-How can I make multiple mirror websites on the fly?
How can I make multiple mirror websites on the fly, transparently, seemingly created, from multiple donor sites?
For example hxxp://website.that-i-want-to-mirror.net/ to my hxxp://mymirror.website.com on dedicated server with WINDOWS or LINUX?
Without IFRAME, FRAME, etc.
So it looks like my domain, my html code output when “view source” done.
Is there any software proxy that sits in the process and when accessed to my specific domain creates WebPages on the fly from specific domain I pointed at and attaches codes or replaces code to output WebPages, let's say to the </body> tag or any other tag or string or regexp, etc.
For now I use offline copier like teleport pro, or offline browser but this is time consuming, space, effort, traffic etc and old-school and inefficient.
I make offline copy of a desired website, for example it takes 600 MB space and 235 000 files and many hours of downloading and uploading and tweaking and it's already outdated. Then upload it to my server and show it through hxxp://mymirror.website.com and then show it. And if I want to make 20 mirrored websites this tasks become impossible to do....
I want it seemingly output through my domain name, may be by CURL, SOCKET, or any other means....
Any ideas and suggestions, guys?
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. HP-UX

What is the difference between DRD and Root Mirror Disk using LVM mirror ?

what is the difference between DRD and Root Mirror Disk using LVM mirror ? (3 Replies)
Discussion started by: maxim42
3 Replies

2. Shell Programming and Scripting

How to make multiple copies?

At work I have to create multiple copies of a file all the time. Example: I have a file called Sec30p01.txt I need thirty of these, then I edit one line in each to make 30 different control files. So I end up with Sec30p02.txt, Sec30p03.txt and so on up to 30 Currently I copy the first file... (8 Replies)
Discussion started by: faaslave
8 Replies

3. Shell Programming and Scripting

Make multiple files of equal length

I have 150 files with 4 columns each but variable row lengths that I need to combine by column. I do not have any common column. I want to use "paste " command in unix to do it but before that I have to get all my files to be of equal length. Is there a way using awk or sed to fill up n no. of... (7 Replies)
Discussion started by: manishabh
7 Replies

4. Shell Programming and Scripting

How to make this run in multiple threads

Hi, I have a list of URLs in a csv file which I'm checking for page status. It just prints the URL and the status as output. This works perfectly fine. I'm looking to run this in multiple threads to make this process faster. I'm pretty new to Perl and I managed to complete this. It would be... (9 Replies)
Discussion started by: kzenthil
9 Replies

5. Solaris

Solaris Volume Manager: Break Mirror and use to make a 2nd machine

Hello: I have a machine built on 2 drives and mirrors have been created to a second set of 2 drives (4 total) on the same platform. SVM. Might anyone provide guidance to create a second machine by breaking the mirrored set, moving the two mirrors (2) to another machine (same platform type),... (1 Reply)
Discussion started by: 4dailyrunner
1 Replies

6. UNIX for Dummies Questions & Answers

sed command, make multiple lines into one

:confused:Hi, I'm relativley new at unix so am having difficulties at the most basic of areas. I am trying using sed to make multiple lines into one line. For example, i would like: Mary had a little lamb to look like this Maryhadalittlelamb so far i have tried sed... (1 Reply)
Discussion started by: cavanac2
1 Replies

7. Solaris

What is mirror and sub mirror in RAID -1 SVM

Hi , I am new to SVM .when i try to learn RAID 1 , first they are creating two RAID 0 strips through metainit d51 1 1 c0t0d0s2 metainit d52 1 1 c1t0d0s2 In the next step metainit d50 -m d51 d50: Mirror is setup next step is metaattach d50 d52 d50 : submirror d52 is... (7 Replies)
Discussion started by: vr_mari
7 Replies

8. Solaris

ZFS Mirror versus Hardware Mirror

I've looked a little but haven't found a solid answer, assuming there is one. What's better, hardware mirroring or ZFS mirroring? Common practice for us was to use the raid controllers on the Sun x86 servers. Now we've been using ZFS mirroring since U6. Any performance difference? Any other... (3 Replies)
Discussion started by: Lespaul20
3 Replies

9. Shell Programming and Scripting

Moving multiple files and renaming them on the fly

Hi All, Being new to scripting I am facing a new situation. We have an application that generates a file lets say dumpfile for each user under the users home directory when they execute the application. This is quite a huge file and imagine having that for over 40 users on a daily basis. The... (1 Reply)
Discussion started by: daemongk
1 Replies

10. Shell Programming and Scripting

How to make the same change in multiple shell scripts?

I would like to make the same change in multiple shell script files and would like to know if anyone can be of some help? I would appreciate it. (4 Replies)
Discussion started by: rdakhan
4 Replies
Login or Register to Ask a Question

LEARN ABOUT DEBIAN

webhttrack

webhttrack(1)						      General Commands Manual						     webhttrack(1)

NAME

       webhttrack - offline browser : copy websites to a local directory

SYNOPSIS

       webhttrack [ keyword value [ keyword value .. ] ]

DESCRIPTION

       webhttrack this program is a script frontend to httrack(1) and htsserver(1) , a website copier.

EXAMPLES

       webhttrack lang 1
	       will launch the webhttrack server frontend, and the default system browser, with "lang" set to "english" (language #1)

FILES

       /etc/httrack.conf
	      The system wide configuration file.

ENVIRONMENT

       HOME   Is being used if you defined in /etc/httrack.conf the line path ~/websites/#

DIAGNOSTICS

       Errors/Warnings are reported to hts-log.txt located in the destination directory.

BUGS

       Please  reports	bugs  to <bugs@httrack.com>.  Include a complete, self-contained example that will allow the bug to be reproduced, and say
       which version of (web)httrack you are using. Do not forget to detail options used, OS version, and any other information  you  deem  neces-
       sary.

COPYRIGHT

       Copyright (C) Xavier Roche and other contributors

       This  program  is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
       the Free Software Foundation; either version 3 of the License, or any later version.

       This program is distributed in the hope that it will be useful, but WITHOUT ANY	WARRANTY;  without  even  the  implied	warranty  of  MER-
       CHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the GNU General Public License for more details.

       You  should  have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation,
       Inc., 59 Temple Place - Suite 330, Boston, MA  02111-1307, USA.

AVAILABILITY

       The  most  recent released version of (web)httrack can be found at: http://www.httrack.com

AUTHOR

       Xavier Roche <roche@httrack.com>

SEE ALSO

       The HTML documentation (available online at http://www.httrack.com/html/ ) contains more detailed information. Please  also  refer  to  the
       httrack FAQ (available online at http://www.httrack.com/html/faq.html )

httrack website copier						     Mar 2003							     webhttrack(1)