06-16-2014
If it's saving index.html, you forgot the --spider.
You can feed wget a list of URL's with awk '{...}' | wget -I - ...
This User Gave Thanks to Corona688 For This Post:
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I'm running Fedora Core 6 as an FTP server on a powerMac G4...
I'm trying to create a script to remove files older than 3 days...
I'm able to find all data older than 3 days but it finds hidden files such as
/home/ftp/goossens/.canna
/home/ftp/goossens/.kde... (4 Replies)
Discussion started by: James_UK
4 Replies
2. Solaris
On Solaris, suppose there is a directory 'dir'.
Log files of size approx 1MB are continuously being
deposited here by scp command. I have a script that scans
this dir every 5 mins and moves away the log files that
have been deposited so far.
How do I design my script so that I pick up *only*... (6 Replies)
Discussion started by: sentak
6 Replies
3. UNIX for Advanced & Expert Users
I'm using wget 1.11.4 on Cygwin 1.5.25.
I'm trying to recursively download a directory tree, which is the root of a javadoc tree.
This is approximately the command line I tried:
wget -x -p -r http://<host>/.../apidoc
When it finished, it seemed like it downloaded... (0 Replies)
Discussion started by: dkarr
0 Replies
4. Shell Programming and Scripting
Can you tell me how to download the directory tree just starting from "project1/" in this URL?
"https://somesite.com/projects/t/project1/"
This command does not seem to do what I want as it downloads also files from the upper hierarchy:
wget --no-check-certificate --http-user=user... (4 Replies)
Discussion started by: majormark
4 Replies
5. Shell Programming and Scripting
Is there a way to customize ls to ignore files ending with ~ and #? (those are Emacs backup and auto-save files). I found -B option, which only ignores ~ files (2 Replies)
Discussion started by: yaroslavvb
2 Replies
6. Shell Programming and Scripting
Hello,
I know find can be prevented from recursing into directories with something like the following...
find . -name .svn -prune -a type d
But how can I completely prevent directories of a certain name (.svn) from being displayed at all, the top level and the children?
I really... (2 Replies)
Discussion started by: nwb123
2 Replies
7. Shell Programming and Scripting
Hello Unix Geeks,
I am in a situation to use wget for crawling a site where the site contains 5 IP addresses. Out of 5, 4 are accessible and 1 is having a problem due to firewall problems.
In this case, my wget is getting stuck with that X.X.X.X and giving up. How can I ignore this IP and... (4 Replies)
Discussion started by: sathyaonnuix
4 Replies
8. Shell Programming and Scripting
Dear All,
I am using find command
find /my_rep/*/RKYPROOF/*/*/WDM/HOME_INT/PWD_DATA -name rk*myguidelines*.pdf -print
The problem i am facing here is find /my_rep/*/
the directory after my_rep could be mice001, mice002 and mice001_PO, mice002_PO
i want to ignore mice***_PO directory... (3 Replies)
Discussion started by: yadavricky
3 Replies
9. Shell Programming and Scripting
i have a cron that mirrors a site periodically
wget -r -nc --passive-ftp ftp://user:pass@123.456.789.0
i want to download this into a directory called /files
but when I do this, it always create a new directory called "123.456.789.0" (the hostname)
it puts it into /files/123.456.789.0
but... (3 Replies)
Discussion started by: vanessafan99
3 Replies
10. UNIX for Advanced & Expert Users
I am using aix. I would like to ignore the /u directory. I tried this but it is not working.
find / -type f -type d \( -path /u \) -prune -o -name '*rpm*' 2>/dev/null
/u/appx/ls.rpm
/u/arch/vim.rpm (4 Replies)
Discussion started by: cokedude
4 Replies
LEARN ABOUT DEBIAN
ketchup
KETCHUP(1) General Commands Manual KETCHUP(1)
NAME
ketchup - Utility to update the kernel source
SYNOPSIS
ketchup [options] <ver>
DESCRIPTION
This tool synchronises a local kernel tree with a desired kernel version and patch set from a kernel.org mirror. The default requires a GPG
key on your keyring, to verify the identity of the patches and source archives. Entire kernel images are not downloaded unless necessary,
so bandwidth is saved. Patches are applied and removed as necessary to attain the requested version.
OPTIONS
-a --archive (~/.ketchup)
cache directory
-d --directory (.)
directory to update
-f --full-tarball
if unpacking a tarball, download the latest
-g --gpg-path (/usr/bin/gpg)
path for GnuPG
-G --no-gpg
disable GPG signature verification
-k --kernel-url (http://www.kernel.org/pub/linux/kernel)
base url for kernel.org mirror
-l --list-trees
list supported trees
-m --show-makefile
output version in makefile <arg>
-n --dry-run
don't download or apply patches
-o --only-dl
don't apply patches
-p --show-previous
output version previous to <arg>
-q --quiet
reduce output
-r --rename-directory
rename updated directory to linux-<v>
-s --show-latest
output the latest version of <arg>
-u --show-url
output URL for <arg>
-w --wget (/usr/bin/wget)
command to use for wget
CONFIGURATION
Ketchup will read files named .ketchuprc in $HOME and in the target kernel directory, with the kernel directory taking precedence.
A .ketchuprc file uses the Python syntax and may set the following variables:
default_tree
The default_tree option specifies the kernel version to work with if one is not given on the command line.
precommand
The precommand option specifies a command to run before synchronising the kernel tree to the required version.
postcommand
The postcommand option specifies a command to run after synchronising the kernel tree to the required version.
AUTHOR
ketchup was written by Matt Mackall <mpm@selenic.com>.
This manual page was written by Baruch Even <baruch@debian.org>, for the Debian project (but may be used by others). Description text taken
from a former packaging attempt of Jack Wasey <debian@jackwasey.com>.
February 16, 2010 KETCHUP(1)