Login or Register to Ask a Question and Join Our Community


UNIX for Dummies Questions & Answers

Methods of reducing latency with downloading webpages?

 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Methods of reducing latency with downloading webpages?
# 1  
Old 03-22-2011
Methods of reducing latency with downloading webpages?
I've been wondering how I can reduce latency in downloading webpages. I've been pointed to network sockets (This guide in specific, beej's guide to network programming ) as some method to do so, but I can't figure out how to apply it in the way I need it.

I am iterating through webpages like this:
www . webpage . com / page-x

where x is a number, e.g. 1, 6, 11, 16.

Currently I'm using lynx --dump. I can get an okay speed by running the scripts in parallel and having them write to different files, but that's annoying and not really faster. Here's the steps of what occurs, roughly...


1. lynx connects to page, latency occurs
2. Page downloaded, parsed and results appended to a file
3. lynx stops
4. repeat until I stop it.

Thanks for your help.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. AIX

Latency Test

Hi every one, we have a set up in solaris 8 and 9 and running many cshell scripts.. we are migrate to AIX . Now, i want to know the latency difference between two boxes(Solaris and AIX). Kindly help me to , how to do Latency test.. (0 Replies)
Discussion started by: Madhu Siddula
0 Replies

2. Web Development

Get command-output to webpage from solaris-10-OS invoked from html webpages

Hello, I am a middleware administrator and as an admin I need to monitor a number of middleware instances (weblogic servers). But since it is a not the forum for that i would like to put my problem in simple terms and need guidance on that. I need to use apache webserver on Solaris 10 zones to... (3 Replies)
Discussion started by: poga
3 Replies

3. Shell Programming and Scripting

Scripts to Interact with Webpages

Hi, Is it possible to have a script to interact with webpages. I want to create a script that logs a user into a specific site, and is able to get/post information. Would anyone give me instructions on how it's should be done, and where I can find information on starting it out. I know... (2 Replies)
Discussion started by: Pztar
2 Replies

4. Hardware

Use of SSD for serving webpages

I have seen research articles and forum postings that demonstrate that SSDs are poor at reading large files: the larger the file, the slower the SSD compared to traditional hard disk drives. The difference with hard disk drives becomes apparent at medium size files, say 20KB. Does this mean that... (2 Replies)
Discussion started by: figaro
2 Replies

5. UNIX for Dummies Questions & Answers

Hosting webpages(jspx) on Linux

Hi guys, I have developed a small website using jspx pages. Now i want to host the website to a server which is a linux machine. The linux machine which i m referring to is already hosting some web pages(jspx) through a web server Which is running at port 8888. My first question would be... (0 Replies)
Discussion started by: pinga123
0 Replies

6. Shell Programming and Scripting

AWK script to detect webpages from file

Hi guys I'm very new to unix and I have to create an awk script that detects webpage addresses from a file/webpage and outputs how many times each webpage was detected.e.g. if my file was: www.google.com www.facebook.com www.google.com the output should be: www.google.com x2... (2 Replies)
Discussion started by: ROFL
2 Replies

7. Shell Programming and Scripting

AWK script to detect webpages from file

Hi guys I'm very new to unix and I have to create an awk script that detects webpage addresses from a file/webpage and outputs how many times each webpage was detected.e.g. if my file was: (Note: The symbol " was added to stop them being created into links) "www.google.com"... (1 Reply)
Discussion started by: ROFL
1 Replies

8. UNIX for Dummies Questions & Answers

Threaded Discussions for Webpages

Dear All, I run a website for a non-profit. Does anyone know where I can get free or cheap software to run threaded discussions for our website? Our website is obviously running off a unix platform. Thanks (4 Replies)
Discussion started by: evertk
4 Replies
Login or Register to Ask a Question

LEARN ABOUT PHP

lgrp_latency

lgrp_latency(3LGRP)													       lgrp_latency(3LGRP)

NAME

       lgrp_latency, lgrp_latency_cookie - get latency between two lgroups

SYNOPSIS

       cc [ flag... ] file... -llgrp [ library... ]
       #include <sys/lgrp_user.h>

       int lgrp_latency_cookie(lgrp_cookie_t cookie, lgrp_id_t from, lgrp_id_t to, lgrp_lat_between_t between);

       int lgrp_latency(lgrp_id_t from, lgrp_id_t to);

       The  lgrp_latency_cookie()  function  takes  a  cookie  representing  a snapshot of the lgroup hierarchy obtained from lgrp_init(3LGRP) and
       returns the latency value between a hardware resource in the from lgroup to a hardware resource in the to  lgroup.  If  from  is  the  same
       lgroup as to, the latency value within that lgroup is returned.

       The between argument should be set to the following value to specify between which hardware resources the latency should be measured:

       LGRP_LAT_CPU_TO_MEM     /* latency from CPU to memory */

       The  latency  value  is defined by the operating system and is platform-specific. It can be used only for relative comparison of lgroups on
       the running system. It does not necessarily represent the actual latency between hardware devices, and it might not  be	applicable  across
       platforms.

       The  lgrp_latency()  function  is  similiar to the lgrp_latency_cookie() function, but returns the latency between the given lgroups at the
       given instant in time. Since lgroups can be freed and reallocated, this function might not be able to provide a	consistent  answer  across
       calls. For that reason, the lgrp_latency_cookie() function should be used in its place.

       Upon successful completion, the latency value is returned. Otherwise -1 is returned and errno is set to indicate the error.

       The lgrp_latency_cookie() and lgrp_latency() functions will fail if:

       EINVAL	       The specified cookie, lgroup ID, or value given for the between argument is not valid.

       ESRCH	       The  specified  lgroup ID was not found, the from lgroup does not contain any CPUs, or the to lgroup does not have any mem-
		       ory.

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Interface Stability	     |Evolving			   |
       +-----------------------------+-----------------------------+
       |MT-Level		     |MT-Safe			   |
       +-----------------------------+-----------------------------+

       lgrp_init(3LGRP), lgrp_parents(3LGRP), lgrp_children(3LGRP), liblgrp(3LIB), attributes(5)

								    26 Jan 2005 					       lgrp_latency(3LGRP)