03-24-2014
Wget help
How can I download only *.zip and *.rar files from a website <index> who has multiple directories in root parent directory?
I need wget to crawl every directory and download only zip and rar files. Is there anyway I could do it?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I have noticed a lot of expensive books appearing
online so I have decided to copy them to CD.
I was going to write a program in java to do this,
but remembered that wget GNU program some of
you guys were talking about.
Instead of spending two hours or so writing a
program to do this.... (1 Reply)
Discussion started by: photon
1 Replies
2. Shell Programming and Scripting
i am trying to ftp files/dirs with wget. i am having an issue where the path always takes me to my home dir even when i specify something else. For example:
wget -m ftp://USER:PASS@IP_ADDRESS/Path/on/remote/box
...but if that path on the remote box isn't in my home dir it doesn't change to... (0 Replies)
Discussion started by: djembeplayer
0 Replies
3. Shell Programming and Scripting
Hi,
i need temperature hourly from a web page
Im using wget to get the web page. I would like to save the page downloaded in a file called page. I check the file everytime i run the wget function but its not saving but instead creates a wx.php file....Each time i run it...a new wx.php file is... (2 Replies)
Discussion started by: vadharah
2 Replies
4. Shell Programming and Scripting
Hi
I want to download some files using wget , and want to save in a specified directory. Is there any way to save it.Please suggest me. (1 Reply)
Discussion started by: mnmonu
1 Replies
5. Shell Programming and Scripting
can someone please help in understanding this shell script?
wget --progress=dot:mega --cut-dirs=4 -r -c -nH -np --reject index.html*,icons/*.gif \
http://*****.oz.xxxxx.com:<portnum>/omcsm/releases/dew/${UPGRADE_VERSION}/ (1 Reply)
Discussion started by: dnam9917
1 Replies
6. UNIX for Dummies Questions & Answers
...... (1 Reply)
Discussion started by: hoo
1 Replies
7. Shell Programming and Scripting
Hi Friends,
I have an url like this
https://www.unix.com/help/
In this help directory, I have more than 300 directories which contains file or files.
So, the 300 directories are like this
http://unix.com/help/
dir1
file1
dir2
file2
dir3
file3_1
file3_2... (4 Replies)
Discussion started by: jacobs.smith
4 Replies
8. Red Hat
If I run the following command
wget -r --no-parent --reject "index.html*" 10.11.12.13/backups/
A local directory named 10.11.12.13/backups with the content of web site data is created.
What I want to do is have the data placed in a local directory called $HOME/backups.
Thanks for... (1 Reply)
Discussion started by: popeye
1 Replies
9. Shell Programming and Scripting
Can wget be used to goto a site and piped into a .gz extrated command?
wget ftp://ftp.ncbi.nlm.nih.gov/pub/clinvar/vcf_GRCh37 | gunzip -d clinvar_20150603.vcf.gz (1 Reply)
Discussion started by: cmccabe
1 Replies
10. Shell Programming and Scripting
Hi,
I need to download a zip file from my the below US govt link.
https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP
I only have wget utility installed on the server.
When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies
LEARN ABOUT CENTOS
zipmerge
ZIPMERGE(1) General Commands Manual ZIPMERGE(1)
NAME
zipmerge - merge zip archives
SYNOPSIS
zipmerge [-DhIiSsV] target-zip source-zip Op source-zip ...
DESCRIPTION
zipmerge merges the source zip archives source-zip into the target zip archive target-zip. By default, files in the source zip archives
overwrite existing files of the same name in the target zip archive.
Supported options:
-D Ignore directory components in file name comparisons.
-h Display a short help message and exit.
-I Ignore case in file name comparisons
-i Ask before overwriting files. See also -s.
-S Do not overwrite files that have the same size and CRC32 in both the source and target archives.
-s When -i is given, do not before overwriting files that have the same size and CRC32.
-V Display version information and exit.
EXIT STATUS
zipmerge exits 0 on success and 1 if an error occurred.
SEE ALSO
zipcmp(1), ziptorrent(1), libzip(3)
AUTHORS
Dieter Baron <dillo@giga.or.at> and Thomas Klausner <tk@giga.or.at>
NiH June 4, 2008 ZIPMERGE(1)