Sponsored Content
Full Discussion: wget performance
Operating Systems Linux wget performance Post 302513937 by Corona688 on Thursday 14th of April 2011 11:03:57 AM
Old 04-14-2011
Quote:
Originally Posted by rob171171
I am looking for a way to measure performance metrics of streaming audio/video from a contecnt server, e.g. YouTube for example. Im keen to see if I can look at duration it took for contecnt to download.
I know from the output of wget's log file you can see duration a url is downloaded in.
However I need to get the duration it takes for the streaming content.
Thanks
A file's a file's a file. Things like Youtube and the like work real hard to obscure where the actual URL comes from, though. The only even slightly reliable way I've found to figure that out is to set up your own proxy server, configure your web browser to use it, and watch the URLs it downloads for anything relevant. And even that sometimes doesn't work because when you try and download it by hand, you won't have the same cookies, etc.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

wget -r

I have noticed a lot of expensive books appearing online so I have decided to copy them to CD. I was going to write a program in java to do this, but remembered that wget GNU program some of you guys were talking about. Instead of spending two hours or so writing a program to do this.... (1 Reply)
Discussion started by: photon
1 Replies

2. Shell Programming and Scripting

wget help

i am trying to ftp files/dirs with wget. i am having an issue where the path always takes me to my home dir even when i specify something else. For example: wget -m ftp://USER:PASS@IP_ADDRESS/Path/on/remote/box ...but if that path on the remote box isn't in my home dir it doesn't change to... (0 Replies)
Discussion started by: djembeplayer
0 Replies

3. News, Links, Events and Announcements

Announcing collectl - new performance linux performance monitor

About 4 years ago I wrote this tool inspired by Rob Urban's collect tool for DEC's Tru64 Unix. What makes this tool as different as collect was in its day is its ability to run at a low overhead and collect tons of stuff. I've expanded the general concept and even include data not available in... (0 Replies)
Discussion started by: MarkSeger
0 Replies

4. Shell Programming and Scripting

Performance Metrics using wget

I am looking for a way to measure performance metrics of streaming audio/video from a contecnt server, e.g. YouTube for example. Im keen to see if I can look at duration it took for contecnt to download. I know from the output of wget's log file you can see duration a url is downloaded in.... (5 Replies)
Discussion started by: rob171171
5 Replies

5. Shell Programming and Scripting

wget help?

can someone please help in understanding this shell script? wget --progress=dot:mega --cut-dirs=4 -r -c -nH -np --reject index.html*,icons/*.gif \ http://*****.oz.xxxxx.com:<portnum>/omcsm/releases/dew/${UPGRADE_VERSION}/ (1 Reply)
Discussion started by: dnam9917
1 Replies

6. UNIX for Dummies Questions & Answers

Wget

...... (1 Reply)
Discussion started by: hoo
1 Replies

7. Shell Programming and Scripting

WGET help!

Hi Friends, I have an url like this https://www.unix.com/help/ In this help directory, I have more than 300 directories which contains file or files. So, the 300 directories are like this http://unix.com/help/ dir1 file1 dir2 file2 dir3 file3_1 file3_2... (4 Replies)
Discussion started by: jacobs.smith
4 Replies

8. Red Hat

Wget

If I run the following command wget -r --no-parent --reject "index.html*" 10.11.12.13/backups/ A local directory named 10.11.12.13/backups with the content of web site data is created. What I want to do is have the data placed in a local directory called $HOME/backups. Thanks for... (1 Reply)
Discussion started by: popeye
1 Replies

9. Shell Programming and Scripting

Wget and gz

Can wget be used to goto a site and piped into a .gz extrated command? wget ftp://ftp.ncbi.nlm.nih.gov/pub/clinvar/vcf_GRCh37 | gunzip -d clinvar_20150603.vcf.gz (1 Reply)
Discussion started by: cmccabe
1 Replies

10. Shell Programming and Scripting

Wget - working in browser but cannot download from wget

Hi, I need to download a zip file from my the below US govt link. https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP I only have wget utility installed on the server. When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies
GCAP.1(1p)						User Contributed Perl Documentation						GCAP.1(1p)

NAME
gcap - Youtube closed caption downloader SYNOPSIS
gcap [-i] [-t] [-r <regexp>] [--proxy=<addr> | --no-proxy] [--help] <url> | <video_id> DESCRIPTION
gcap is a command line tool for downloading Youtube closed captions. The downloaded closed captions are saved in SubRip (srt) file format. The srt files are saved as "$videoid_$langid.srt" by default. OPTIONS
--help Print help and exit. --version Print version and exit. -q, --quiet Be quiet. -i, --interactive Open the interactive prompt which can be used to select the items. gcap selects all items by default. See also "INTERACTIVE PROMPT". -t, --title Parse video title and use it in the output filename(s) instead of video ID. The default is no. -r, --regexp=arg Cleanup video title using the specified arg regular expression. The default is "/(w|s)/g". --proxy arg Use arg for HTTP proxy, e.g. "http://foo:1234". Overrides the http_proxy environment setting. --no-proxy Disable use of HTTP proxy. Overrides both "--proxy" and http_proxy environment settings. INTERACTIVE PROMPT
Use the "--interactive" switch to open the prompt. Note that gcap uses (as of 0.1.0) the Umph::Prompt module for this. Once the prompt opens, type "help" to get a list of commands available to the prompt. EXAMPLES
gcap 0QRO3gKj3qw gcap "http://www.youtube.com/watch?v=0QRO3gKj3qw" Both yield the same results. gcap -ti 0QRO3gKj3qw Same as above two but use video title in the filename and choose which of the closed captions should be downloaded. EXIT STATUS
Exits 0 on success, otherwise 1. FILES
$HOME/.gcaprc, for example: echo "--interactive" >> ~/.gcaprc NOTES
Availability The following error message produced by gcap (or the XML::DOM module) typically indicates that the video does not have any closed captions available for it (URL omitted for brewity): Couldn't parsefile [...] with LWP: no element found at line 1, column 0, byte -1 at [...]/XML/Parser.pm [...] http_proxy gcap depends on XML::DOM which uses LWP::UserAgent to download the data. Note that LWP::UserAgent reads http_proxy environment setting. e.g.: env http_proxy=http://foo:1234 gcap video_id WWW
<http://gcap.googlecode.com/> <http://repo.or.cz/w/gcap.git> AUTHOR
Toni Gundogdu <legatvs at sign cpan org> perl v5.12.4 2011-11-15 GCAP.1(1p)
All times are GMT -4. The time now is 06:13 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy