Tried your way but seems like its not working as I want to. It creates the directory paths. All I want to is to download only the .zip and .rar files without the directory paths.
I'm running CentOS 6.4
---------- Post updated at 01:48 PM ---------- Previous update was at 01:16 PM ----------
wget -r -U Mozilla -t 1 -nd -A zip "http://www.xxx.xxx" -e robots=off
I have noticed a lot of expensive books appearing
online so I have decided to copy them to CD.
I was going to write a program in java to do this,
but remembered that wget GNU program some of
you guys were talking about.
Instead of spending two hours or so writing a
program to do this.... (1 Reply)
i am trying to ftp files/dirs with wget. i am having an issue where the path always takes me to my home dir even when i specify something else. For example:
wget -m ftp://USER:PASS@IP_ADDRESS/Path/on/remote/box
...but if that path on the remote box isn't in my home dir it doesn't change to... (0 Replies)
Hi,
i need temperature hourly from a web page
Im using wget to get the web page. I would like to save the page downloaded in a file called page. I check the file everytime i run the wget function but its not saving but instead creates a wx.php file....Each time i run it...a new wx.php file is... (2 Replies)
Hi Friends,
I have an url like this
https://www.unix.com/help/
In this help directory, I have more than 300 directories which contains file or files.
So, the 300 directories are like this
http://unix.com/help/
dir1
file1
dir2
file2
dir3
file3_1
file3_2... (4 Replies)
If I run the following command
wget -r --no-parent --reject "index.html*" 10.11.12.13/backups/
A local directory named 10.11.12.13/backups with the content of web site data is created.
What I want to do is have the data placed in a local directory called $HOME/backups.
Thanks for... (1 Reply)
Can wget be used to goto a site and piped into a .gz extrated command?
wget ftp://ftp.ncbi.nlm.nih.gov/pub/clinvar/vcf_GRCh37 | gunzip -d clinvar_20150603.vcf.gz (1 Reply)
Hi,
I need to download a zip file from my the below US govt link.
https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP
I only have wget utility installed on the server.
When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies
LEARN ABOUT DEBIAN
plack::middleware::deflater
Plack::Middleware::Deflater(3pm) User Contributed Perl Documentation Plack::Middleware::Deflater(3pm)NAME
Plack::Middleware::Deflater - Compress response body with Gzip or Deflate
SYNOPSIS
use Plack::Builder;
builder {
enable sub {
my $app = shift;
sub {
my $env = shift;
my $ua = $env->{HTTP_USER_AGENT} || '';
# Netscape has some problem
$env->{"psgix.compress-only-text/html"} = 1 if $ua =~ m!^Mozilla/4!;
# Netscape 4.06-4.08 have some more problems
$env->{"psgix.no-compress"} = 1 if $ua =~ m!^Mozilla/4.0[678]!;
# MSIE (7|8) masquerades as Netscape, but it is fine
if ( $ua =~ m!MSIE (?:7|8)! ) {
$env->{"psgix.no-compress"} = 0;
$env->{"psgix.compress-only-text/html"} = 0;
}
$app->($env);
}
};
enable "Deflater",
content_type => ['text/css','text/html','text/javascript','application/javascript'],
vary_user_agent => 1;
sub { [200,['Content-Type','text/html'],["OK"]] }
};
DESCRIPTION
Plack::Middleware::Deflater is a middleware to encode your response body in gzip or deflate, based on "Accept-Encoding" HTTP request
header. It would save the bandwidth a little bit but should increase the Plack server load, so ideally you should handle this on the
frontend reverse proxy servers.
This middleware removes "Content-Length" and streams encoded content, which means the server should support HTTP/1.1 chunked response or
downgrade to HTTP/1.0 and closes the connection.
CONFIGURATIONS
content_type
content_type => 'text/html',
content_type => [ 'text/html', 'text/css', 'text/javascript', 'application/javascript', 'application/x-javascript' ]
Content-Type header to apply deflater. if content-type is not defined, Deflater will try to deflate all contents.
vary_user_agent
vary_user_agent => 1
Add "User-Agent" to Vary header.
ENVIRONMENT VALUE
psgix.no-compress
Do not apply deflater
psgix.compress-only-text/html
Apply deflater only if content_type is "text/html"
LICENSE
This software is licensed under the same terms as Perl itself.
AUTHOR
Tatsuhiko Miyagawa
SEE ALSO
Plack, <http://httpd.apache.org/docs/2.2/en/mod/mod_deflate.html>
perl v5.14.2 2012-06-18 Plack::Middleware::Deflater(3pm)