fair downloads with flashget, reget etc.


 
Thread Tools Search this Thread
Operating Systems Linux fair downloads with flashget, reget etc.
# 1  
Old 08-13-2004
fair downloads with flashget, reget etc.

I would like to shape multi-threaded downloaders (like flashget, reget etc.) but I don't want to make a limit on connections less then two (i.e. you download something from an ftp and want to browse this ftp at the same time). I found a pack of utilities - iproute2 and found a patch to linux kernel and iproute2 - esfq which allows to hash queues by destination ip (no matter how many packets are from an ip address - the key of decision is dest ip). But i can't compile it against 2.4.27 (I also tried 2.4.25/26? 2.6.7/8) kernel because these kernels lack RTNETLINK feature. I tried google and I looked through all docs I was able to find, tried some irc channels also, no solution is found yet. If there is anyone here who have ever faced the problem and has the solution please, help me. Perhaps, there is another way to solve the problem, wihtout iproute2 (but I definitely want to use Linux), please point me the way to dig. I simply want to give our ftp users a qualitive service. Thanks in advance :)
Login or Register to Ask a Question

Previous Thread | Next Thread

6 More Discussions You Might Find Interesting

1. Linux

TCP Fair Share

Hi, Am trying to use TCP as transport for a system that can support large number of connections where all of them potentially can send data at the same time. I came across ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=643715&tag=1 that says TCP's ability to share a bottleneck fairly and... (1 Reply)
Discussion started by: vavatutu
1 Replies

2. UNIX for Dummies Questions & Answers

Free O/S for Unix downloads

Can I download Debian or SUSE for free? If so, from where on the internet can I get a free version of Unix? (3 Replies)
Discussion started by: jsb1022
3 Replies

3. Shell Programming and Scripting

Help with watermarking photos downloads with corresponding URLs

Hi Everybody :) Once again I seek the wisdom of the community:b: I wish to accomplish a task on the command line that involves watermarking download photos with the URL that they originated from. So far I have a command that downloads images from Picasa and creates a file of the URL... (0 Replies)
Discussion started by: o0110o
0 Replies

4. Post Here to Contact Site Administrators and Moderators

downloads on sidekicks

I downloaded the terminal client on my sidekick one and I am trying to figure out what is the right host to log in to unix,in order to use its feature. (0 Replies)
Discussion started by: elwil
0 Replies

5. Cybersecurity

Viruses in downloads/webs

How secure are downloads from unix.com, linux.com, etc? Not talking about off the wall individual user sites, but sites like unix.com, download.com, tucows.com? We've been inundated at work lately from viruses, and I want to make sure that for things like work related downloads, that those kind... (5 Replies)
Discussion started by: kymberm
5 Replies

6. Shell Programming and Scripting

online halo any downloads?

Someone told me that I can download a thing that I can play Halo over the Internet for xbox (1 Reply)
Discussion started by: memattmyself
1 Replies
Login or Register to Ask a Question
AXEL(1) 						      General Commands Manual							   AXEL(1)

NAME
Axel - A light download accelerator for Linux. SYNOPSIS
axel [OPTIONS] url1 [url2] [url...] DESCRIPTION
Axel is a program that downloads a file from a FTP or HTTP server through multiple connection, each connection downloads its own part of the file. Unlike most other programs, Axel downloads all the data directly to the destination file, using one single thread. It just saves some time at the end because the program doesn't have to concatenate all the downloaded parts. OPTIONS
One argument is required, the URL to the file you want to download. When downloading from FTP, the filename may contain wildcards and the program will try to resolve the full filename. Multiple URL's can be specified as well and the program will use all those URL's for the download. Please note that the program does not check whether the files are equal. Other options: --max-speed=x, -s x You can specify a speed (bytes per second) here and Axel will try to keep the average speed around this speed. Useful if you don't want the program to suck up all of your bandwidth. --num-connections=x, -n x You can specify an alternative number of connections here. --output=x, -o x Downloaded data will be put in a local file with the same name, unless you specify a different name using this option. You can spec- ify a directory as well, the program will append the filename. --search[=x], -S[x] Axel can do a search for mirrors using the filesearching.com search engine. This search will be done if you use this option. You can specify how many different mirrors should be used for the download as well. The search for mirrors can be time-consuming because the program tests every server's speed, and it checks whether the file's still available. --no-proxy, -N Don't use any proxy server to download the file. Not possible when a transparent proxy is active somewhere, of course. --verbose If you want to see more status messages, you can use this option. Use it more than once if you want to see more. --quiet, -q No output to stdout. --alternate, -a This will show an alternate progress indicator. A bar displays the progress and status of the different threads, along with current speed and an estimate for the remaining download time. --header=x, -H x Add an additional HTTP header. This option should be in the form "Header: Value". See RFC 2616 section 4.2 and 14 for details on the format and standardized headers. --user-agent=x, -U x Set the HTTP user agent to use. Some websites serve different content based upon this parameter. The default value will include "Axel", its version and the platform. --help, -h A brief summary of all the options. --version, -V Get version information. NOTE
Long (double dash) options are supported only if your platform knows about the getopt_long call. If it does not (like *BSD), only the short options can be used. RETURN VALUE
The program returns 0 when the download was succesful, 1 if something really went wrong and 2 if the download was interrupted. If something else comes back, it must be a bug.. EXAMPLES
axel ftp://ftp.{be,nl,uk,de}.kernel.org/pub/linux/kernel/v2.4/linux-2.4.17.tar.bz2 This will use the Belgian, Dutch, English and German kernel.org mirrors to download a Linux 2.4.17 kernel image. axel -S4 ftp://ftp.kernel.org/pub/linux/kernel/v2.4/linux-2.4.17.tar.bz2 This will do a search for the linux-2.4.17.tar.bz2 file on filesearching.com and it'll use the four (if possible) fastest mirrors for the download. (Possibly including ftp.kernel.org) (Of course, the commands are a single line, but they're too long to fit on one line in this page.) FILES
/etc/axelrc System-wide configuration file. Note that development versions place this file in /usr/local/etc. ~/.axelrc Personal configuration file These files are not documented in a man-page, but the example file which comes with the program contains enough information, I hope. The position of the system-wide configuration file might be different. COPYRIGHT
Axel is Copyright 2001-2002 Wilmer van der Gaast. BUGS
Please report bugs at https://alioth.debian.org/tracker/?group_id=100070&atid=413085. AUTHORS
Wilmer van der Gaast. <wilmer@gaast.net> AXEL(1)