09-16-2013
wget respects robots.txt, if it says batch downloading is prohibited then it will not do so.
This User Gave Thanks to Corona688 For This Post:
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hello Everyone,
I'm trying to use wget recursively to download a file.
Only html files are being downloaded, instead of the target file.
I'm trying this for the first time, here's what I've tried:
wget -r -O jdk.bin... (4 Replies)
Discussion started by: thoughts
4 Replies
2. Shell Programming and Scripting
Hi All
I want to download srs8.3.0.1.standard.linux24_EM64T.tar.gz file from the following website :
http://downloads.biowisdomsrs.com/srs83_dist/
But this website contains lots of zipped files
I want to download the above file only discarding other zipped files.
When I am trying the... (1 Reply)
Discussion started by: alphasahoo
1 Replies
3. UNIX and Linux Applications
I need to download the following srs8.3.0.1.standard.linux26_32.tar.gz file from the following website:
http://downloads.biowisdomsrs.com/srs83_dist
There are many gzip files along with the above one in the above site but I want to download the srs8.3.0.1.standard.linux26_32.tar.gz only from... (1 Reply)
Discussion started by: alphasahoo
1 Replies
4. UNIX for Dummies Questions & Answers
Hi
I have 2 files as below
File 1
Chr Start End
chr1 120 130
chr1 140 150
chr2 130 140
File2
Chr Start End Value
chr1 121 128 ABC
chr1 144 149 XYZ
chr2 120 129 PQR
I would like to compare these files using awk; specifically if column 1 of file1 is equal to column 1 of file2... (7 Replies)
Discussion started by: sshetty
7 Replies
5. Shell Programming and Scripting
Hi,
I need to implement below logic to download files daily from a URL.
* Need to check if it is yesterday's file (YYYY-DD-MM.dat)
* If present then download from URL (sample_url/2013-01-28.dat)
* Need to implement wait logic if not present
* if it still not able to find the file... (1 Reply)
Discussion started by: rakesh5300
1 Replies
6. Shell Programming and Scripting
I am running a video download test and automating that. I wanna know how to stop a wget download session when downloads reached 1%
Thanks in advance,
Tamil (11 Replies)
Discussion started by: tamil.pamaran
11 Replies
7. UNIX for Dummies Questions & Answers
Hi,
For an order I requested, the provider has uploaded a tar file in public FTP site which internally has tons of files (compressed) and I need to download files that follows particular pattern which would be few hundreds.
Note: The order can't be requested for files that follows the... (7 Replies)
Discussion started by: Amalan
7 Replies
8. Shell Programming and Scripting
Can a modified command be used to download multiple source codes from specific sites and output each into a separate output file?. All the sites are in a text file (attached):
wget -qO- http://www.genedx.com/test-catalog/available-tests/edar-gene-sequencing/ | cat > output.txt (4 Replies)
Discussion started by: cmccabe
4 Replies
9. Shell Programming and Scripting
Hi,
I need to download a zip file from my the below US govt link.
https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP
I only have wget utility installed on the server.
When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies
10. Shell Programming and Scripting
I am using the below curl command to download a single file from client server and it is working as expected
curl --ftp-ssl -k -u ${USER}:${PASSWD} ftp://${HOST}:${PORT}/path/to/${FILE} --output ${DEST}/${FILE}
let say the client has 3 files hellofile.101, hellofile.102, hellofile.103 and I... (3 Replies)
Discussion started by: r@v!7*7@
3 Replies
xcfa(1) Manual: Xcfa xcfa(1)
NAME
xcfa - GTK+ Implementation of the GNU shell command.
SYNOPSIS
xcfa [OPTION]... [FILE]...
-h, -help
Displays this help section and exits.
-version
Displays the version of the program and exits.
-verbose
Activate verbose mode
-systray
Activate systray mode
DESCRIPTION
Interface contains console tools (cdparanoia, lame, oggenc, ...).
Allows extraction of audio from DVD to .wav format.
Allows extracting audio from CD to formats such as: wav, mp3, flac, ogg, m4a, mpc, ape.
Allows encoding audio to: wav, mp3, flac, ogg, m4a mpc, ape.
Allows encoding the .wma format to: wav, mp3, flac, ogg, m4a mpc, ape.
Allows cutting of files.
Allows management of common file-types before converting.
Allows management of bitrates, frequencies, and channels.
Allows creation of CD covers.
Developed with Gtk2 and Glade and runs under the X window system on the GNU platform.
USAGE
After the first launch, go to the Options tab and modify the settings to your liking.
ADDING THE GPG KEY
With sudo:
$ wget http://download.tuxfamily.org/xcfaudio/download/xcfaudio.key.asc -O - | sudo apt-key add -
Without sudo:
$ su root
[Enter the password for root.]
# wget http://download.tuxfamily.org/xcfaudio/download/xcfaudio.key.asc -O - | apt-key add -
Another solution with root:
# gpg --keyserver subkeys.pgp.net --recv 00B21603DD5C7A79
# gpg --export --armor 00B21603DD5C7A79 | sudo apt-key add -
SOURCES.LIST
Add the following lines to your [ /etc/apt/sources.list ] file for automatic updates:
## Xcfa for i386 and amd64
deb http://download.tuxfamily.org/xcfaudio/xcfa dev contrib
deb-src http://download.tuxfamily.org/xcfaudio/xcfa dev contrib
COMPLEMENTARY PACKAGE INSTALLATION
:
See the Recovery and Complementary package installation guide:
http://www.xcfa.tuxfamily.org/index.php?static2/xcfa
CHANGELOG
Read the ChangeLog file and view the source code.
AUTHOR
XCFA is developed by Claude Bulin (xcfa@tuxfamily.org)
4.3.1 Wed, 23 May 2012 xcfa(1)