How can I make multiple mirror websites on the fly?

 
Thread Tools Search this Thread
Special Forums UNIX and Linux Applications How can I make multiple mirror websites on the fly?
# 1  
Old 05-03-2009
How can I make multiple mirror websites on the fly?

-How can I make multiple mirror websites on the fly?
How can I make multiple mirror websites on the fly, transparently, seemingly created, from multiple donor sites?
For example hxxp://website.that-i-want-to-mirror.net/ to my hxxp://mymirror.website.com on dedicated server with WINDOWS or LINUX?
Without IFRAME, FRAME, etc.
So it looks like my domain, my html code output when “view source” done.
Is there any software proxy that sits in the process and when accessed to my specific domain creates WebPages on the fly from specific domain I pointed at and attaches codes or replaces code to output WebPages, let's say to the </body> tag or any other tag or string or regexp, etc.
For now I use offline copier like teleport pro, or offline browser but this is time consuming, space, effort, traffic etc and old-school and inefficient.
I make offline copy of a desired website, for example it takes 600 MB space and 235 000 files and many hours of downloading and uploading and tweaking and it's already outdated. Then upload it to my server and show it through hxxp://mymirror.website.com and then show it. And if I want to make 20 mirrored websites this tasks become impossible to do....
I want it seemingly output through my domain name, may be by CURL, SOCKET, or any other means....
Any ideas and suggestions, guys?
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. HP-UX

What is the difference between DRD and Root Mirror Disk using LVM mirror ?

what is the difference between DRD and Root Mirror Disk using LVM mirror ? (3 Replies)
Discussion started by: maxim42
3 Replies

2. Shell Programming and Scripting

How to make multiple copies?

At work I have to create multiple copies of a file all the time. Example: I have a file called Sec30p01.txt I need thirty of these, then I edit one line in each to make 30 different control files. So I end up with Sec30p02.txt, Sec30p03.txt and so on up to 30 Currently I copy the first file... (8 Replies)
Discussion started by: faaslave
8 Replies

3. Shell Programming and Scripting

Make multiple files of equal length

I have 150 files with 4 columns each but variable row lengths that I need to combine by column. I do not have any common column. I want to use "paste " command in unix to do it but before that I have to get all my files to be of equal length. Is there a way using awk or sed to fill up n no. of... (7 Replies)
Discussion started by: manishabh
7 Replies

4. Shell Programming and Scripting

How to make this run in multiple threads

Hi, I have a list of URLs in a csv file which I'm checking for page status. It just prints the URL and the status as output. This works perfectly fine. I'm looking to run this in multiple threads to make this process faster. I'm pretty new to Perl and I managed to complete this. It would be... (9 Replies)
Discussion started by: kzenthil
9 Replies

5. Solaris

Solaris Volume Manager: Break Mirror and use to make a 2nd machine

Hello: I have a machine built on 2 drives and mirrors have been created to a second set of 2 drives (4 total) on the same platform. SVM. Might anyone provide guidance to create a second machine by breaking the mirrored set, moving the two mirrors (2) to another machine (same platform type),... (1 Reply)
Discussion started by: 4dailyrunner
1 Replies

6. UNIX for Dummies Questions & Answers

sed command, make multiple lines into one

:confused:Hi, I'm relativley new at unix so am having difficulties at the most basic of areas. I am trying using sed to make multiple lines into one line. For example, i would like: Mary had a little lamb to look like this Maryhadalittlelamb so far i have tried sed... (1 Reply)
Discussion started by: cavanac2
1 Replies

7. Solaris

What is mirror and sub mirror in RAID -1 SVM

Hi , I am new to SVM .when i try to learn RAID 1 , first they are creating two RAID 0 strips through metainit d51 1 1 c0t0d0s2 metainit d52 1 1 c1t0d0s2 In the next step metainit d50 -m d51 d50: Mirror is setup next step is metaattach d50 d52 d50 : submirror d52 is... (7 Replies)
Discussion started by: vr_mari
7 Replies

8. Solaris

ZFS Mirror versus Hardware Mirror

I've looked a little but haven't found a solid answer, assuming there is one. What's better, hardware mirroring or ZFS mirroring? Common practice for us was to use the raid controllers on the Sun x86 servers. Now we've been using ZFS mirroring since U6. Any performance difference? Any other... (3 Replies)
Discussion started by: Lespaul20
3 Replies

9. Shell Programming and Scripting

Moving multiple files and renaming them on the fly

Hi All, Being new to scripting I am facing a new situation. We have an application that generates a file lets say dumpfile for each user under the users home directory when they execute the application. This is quite a huge file and imagine having that for over 40 users on a daily basis. The... (1 Reply)
Discussion started by: daemongk
1 Replies

10. Shell Programming and Scripting

How to make the same change in multiple shell scripts?

I would like to make the same change in multiple shell script files and would like to know if anyone can be of some help? I would appreciate it. (4 Replies)
Discussion started by: rdakhan
4 Replies
Login or Register to Ask a Question
SIMPLE-CDD(1)						      General Commands Manual						     SIMPLE-CDD(1)

NAME
simple-cdd - create custom debian-installer CDs SYNOPSIS
simple-cdd [options] OPTIONS
--conf Specify a configuration file --dist Specify a distribution (etch, lenny, sid) --graphical-installer|-g Enable graphical installer by default --serial-console|-s Set defaults for serial console --do-mirror Generate a local mirror --no-do-mirror Do not generate a local mirror --profiles|-p Select profiles (Examples in /usr/share/simple-cdd/profiles/ directory) --build-profiles|-b Profiles only used while building the CD --auto-profiles|-a Pre-select and automatically install these profiles --local-packages List of packages to be included on CD's local package repository --locale Select locale (language and country) --keyboard Select keyboard (console-keymaps-at/keymap debconf question) --debian-mirror Specify debian mirror (The default is: ftp://ftp.us.debian.org/debian) --security-mirror Specify securty mirror (The default is: http://security.debian.org/) --mirror-tools List the mirror tools to be used (The defaults are both wget and reprepro) --kernel-packages List of kernel packages to be included on the CD --help|-h Display the usage message --qemu|-q Use qemu to test the built image --force-preseed Only issue a warning if a preseeding file is invalid --profiles-udeb-dist Specify distribution to pull simple-cdd-profiles udeb from --extra-udeb-dist Specify additional distribution to pull udebs from EXAMPLES
simple-cdd --profiles x-basic -g Build a custom image using the default options, except for using the graphical installer by default and the x-basic profile (/usr/share/simple-cdd/x-basic.*) AUTHOR
This manual page was written by Gustavo Franco <stratus@acm.org>, for the Debian project (but may be used for others). Oct 28th, 2007 SIMPLE-CDD(1)