|
|
Sponsored Content
Special Forums
IP Networking
QOS script
Post 302459421 by DGPickett on Monday 4th of October 2010 03:40:44 PM
10-04-2010
A back door possibility is to use lsof to show what files and sockets are open on the server, and post-process to link socket processes to files to file size or extension. Of course, if there is a multithreaded server process, it gets fuzzy again.
Finding a way to throttle sockets that have moved too many bytes might be nasty to persistent HTTP1.1 users, a kind of usage that is friendlier to the server than file per connection, never mind ftp's two connections. If you could serve one packet out per socket in strict rotation, the long connections for big files have less effect on the new ones. Optimally, you want the oldest connection to get done, so you have fewer concurrent connections and least redo activity, yet you want the new connections to be favored for a while, since they may want little. If you can move aging connections to the long pool tagged with their start time, you can favor the young connections and allow the oldest to take from their excess bandwidth. You may have more bandwidth than the oldest connection, so what it cannot use of that excess goes to the second oldest, and so on.
I am not sure what tools facilitate this, or if any tool can tag HTTP1.1 persistent connections and tell if such a connection is not doing large files.
Packet size is maxed out for every transfer with more than MTU to move at that moment, but MTU is characteristically only 1500, not much of a challenge to fill.
Large files served out might have their sockets tagged, or be segregated on a server that is allowed less priority to the network.
Uploads are really hard, since you cannot look at the file in advance. Extensions and even Content-type: are not very reliable, easily subverted for download/upload by a zip of temporary rename. Files may be encoded to make them not sniffable for type signatures.
Just spitballing!
Finding a way to throttle sockets that have moved too many bytes might be nasty to persistent HTTP1.1 users, a kind of usage that is friendlier to the server than file per connection, never mind ftp's two connections. If you could serve one packet out per socket in strict rotation, the long connections for big files have less effect on the new ones. Optimally, you want the oldest connection to get done, so you have fewer concurrent connections and least redo activity, yet you want the new connections to be favored for a while, since they may want little. If you can move aging connections to the long pool tagged with their start time, you can favor the young connections and allow the oldest to take from their excess bandwidth. You may have more bandwidth than the oldest connection, so what it cannot use of that excess goes to the second oldest, and so on.
I am not sure what tools facilitate this, or if any tool can tag HTTP1.1 persistent connections and tell if such a connection is not doing large files.
Packet size is maxed out for every transfer with more than MTU to move at that moment, but MTU is characteristically only 1500, not much of a challenge to fill.
Large files served out might have their sockets tagged, or be segregated on a server that is allowed less priority to the network.
Uploads are really hard, since you cannot look at the file in advance. Extensions and even Content-type: are not very reliable, easily subverted for download/upload by a zip of temporary rename. Files may be encoded to make them not sniffable for type signatures.
Just spitballing!
|
|
7 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi guys
I have a shell script that executes sql statemets and sends the output to a file.the script takes in parameters executes sql and sends the result to an output file.
#!/bin/sh
echo " $2 $3 $4 $5 $6 $7
isql -w400 -U$2 -S$5 -P$3 << xxx
use $4
go
print"**Changes to the table... (0 Replies)
Discussion started by: magikminox
0 Replies
2. IP Networking
My question is such:
I want to control the bandwidth of my users and cap there speed on the network. I was told by a Cisco rep that it is better to police or control the bandwidth at the switch and not via the router. It that the correct place to control bandwidth at the switch or would it be... (0 Replies)
Discussion started by: metallica1973
0 Replies
3. Windows & DOS: Issues & Discussions
hi,
did anyone know how to configure a priority of dns ports (and other ports) on QOS on windows 2003? hard to understand the group policy "explain" tab on 'qos packet scheduler', no elaboration on how to use it.
thanks for any comment you may add.
---------- Post updated at 05:03 PM... (0 Replies)
Discussion started by: itik
0 Replies
4. IP Networking
Hello all my friends
Please Read to understand my problem
I have 1 MB bandwidth and two networks then i did traffic control on my two internal interfaces i.e eth1(192.168.3.0/24) and eth2(172.16.3.0/24) (internal) and eth0 (outside)
Then i divided my bandwidth using tc command with the... (3 Replies)
Discussion started by: rink
3 Replies
5. IP Networking
I'm looking for recommendations for a general problem.
Apparently (that is according to my boss and coworkers) I am responsible for guaranteeing quality of service to our remote MySQL server during the course of the day. They may run a complete database restore for any number of reasons and are... (1 Reply)
Discussion started by: Astrocloud
1 Replies
6. Shell Programming and Scripting
I am using blow script :--
#!/bin/bash
FIND=$(ps -elf | grep "snmp_trap.sh" | grep -v grep) #check snmp_trap.sh is running or not
if
then
# echo "process found"
exit 0;
else
echo "process not found"
exec /home/Ketan_r /snmp_trap.sh 2>&1 & disown -h ... (1 Reply)
Discussion started by: ketanraut
1 Replies
7. Shell Programming and Scripting
Hello all,
I am facing a weird issue while executing a code below -
#!/bin/bash
cd /wload/baot/home/baotasa0/sandboxes_finance/ext_ukba_bde/pset
sh UKBA_publish.sh UKBA 28082015 3
if
then
echo "Param file conversion for all the areas are completed, please check in your home directory"... (2 Replies)
Discussion started by: ektubbe
2 Replies
LEARN ABOUT DEBIAN
webservice::youtube::videos
WebService::YouTube::Videos(3pm) User Contributed Perl Documentation WebService::YouTube::Videos(3pm) NAME
WebService::YouTube::Videos - Perl interface to youtube.videos.* VERSION
This document describes WebService::YouTube::Videos version 1.0.3 SYNOPSIS
use WebService::YouTube::Videos; my $api = WebService::YouTube::Videos->new( { dev_id => YOUR_DEV_ID } ); # Call API youtube.videos.list_featured my @videos = $api->list_featured; foreach my $video (@videos) { # $video->isa('WebService::YouTube::Video'); } # Call other APIs my @videos = $api->list_by_user($user); my @videos = $api->list_by_tag($tag); my $video = $api->get_details($video_id); # Parse XML my @video = $api->parse_xml($xml); # when $xml contains <video_list> my $video = $api->parse_xml($xml); # when $xml contains <video_details> DESCRIPTION
This is a Perl interface to YouTube REST API. See Developer APIs <http://youtube.com/dev> and Developer API -- REST Interface <http://youtube.com/dev_rest> for details. SUBROUTINES
/METHODS new(\%fields) Creates and returns a new WebService::YouTube::Videos object. %fields can contain parameters enumerated in "ACCESSORS" section. parse_xml($xml) Parses XML and returns the result. $xml should be an object that XML::Simple can understand. get_details( $video_id ) Returns a WebService::YouTube::Video object. $video_id is an ID of the video which you want to get details. See <http://youtube.com/dev_api_ref?m=youtube.videos.get_details> for details. list_by_tag( $tag, \%fields ) Returns an array of WebService::YouTube::Video object. $tag is a keyword string separated by a space. %fields can contain the optional parameters. page 1 <= page per_page per_page <= 100 (default 20) See <http://youtube.com/dev_api_ref?m=youtube.videos.list_by_tag> for details. list_by_user( $user ) Returns an array of WebService::YouTube::Video object. $tag is a keyword string separated by a space. %fields can contain optional parameters. See <http://youtube.com/dev_api_ref?m=youtube.videos.list_by_user> for details. list_featured( ) Returns an array of WebService::YouTube::Video object. See <http://youtube.com/dev_api_ref?m=youtube.videos.list_featured> for details. ACCESSORS dev_id Developer ID ua LWP::UserAgent object DIAGNOSTICS
dev_id is required Developer ID is required when you call API of YouTube. invalid XML The XML is not a YouTube's XML. unknown response The ut_response is neither <video_list> nor <video_details>. CONFIGURATION AND ENVIRONMENT
WebService::YouTube::Videos requires no configuration files or environment variables. DEPENDENCIES
Class::Accessor::Fast, LWP::UserAgent, XML::Simple, WebService::YouTube::Util, WebService::YouTube::Video INCOMPATIBILITIES
None reported. BUGS AND LIMITATIONS
No bugs have been reported. Please report any bugs or feature requests to "bug-webservice-youtube@rt.cpan.org", or through the web interface at <http://rt.cpan.org/NoAuth/ReportBug.html?Queue=WebService-YouTube>. I will be notified, and then you'll automatically be notified of progress on your bug as I make changes. AUTHOR
Hironori Yoshida <yoshida@cpan.org> LICENSE AND COPYRIGHT
This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself. See perlartistic. perl v5.10.1 2010-08-01 WebService::YouTube::Videos(3pm)