Help with wget recursive


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Help with wget recursive
# 1  
Old 01-20-2010
Help with wget recursive

I want to download every page on a particular website that has: "http://www.website.com/dir/?function=" as the beginning so any page that begins with that will be downloaded, so for example "http://www.website.com/dir/?function=summary&cat=1" and "http://www.website.com/dir/?function=detail&id=1" would be downloaded, etc.

I tried "wget -r http://www.website.com/dir/?function=" but it just starts downloading the entire http://www.website.com/.
# 2  
Old 01-20-2010
try with --no-parent option.
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Wget - working in browser but cannot download from wget

Hi, I need to download a zip file from my the below US govt link. https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP I only have wget utility installed on the server. When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies

2. Shell Programming and Scripting

Recursive Cat?

I have a directory, say "DirA" with a bunch of subfolders 'Sub1, Sub2... etc.' Each subfolder has a number of csv files. I want to delete the top ten rows of each csv file, then concatenate them and save the output as a csv file with the same name as the subfolder. My code currently looks... (4 Replies)
Discussion started by: extnic
4 Replies

3. Shell Programming and Scripting

Help with recursive command

Hi, I need help with recursive function. This is not a part of any homework or classroom related. I am trying to learn unix and working on a question posted on site. basically i have to create a script which does what rm -r does. my code so far: 1 #!/bin/bash 2 3 function recursive... (2 Replies)
Discussion started by: bluebird13
2 Replies

4. Programming

recursive function

Hello forum members, Please wirte a sample program for print the 1 - 100 and 100 -1 using recursive function. Thanks & regards Siva Rangnanath (2 Replies)
Discussion started by: workforsiva
2 Replies

5. Shell Programming and Scripting

Wget recursive with query strings

I am recursively downloading the archive of our emaillist provider with wget, as our provider is shutting down the listserver soon. The list is located at https://listserv.surfnet.nl/archives/umpm-bulletin.html Now I cant make wget save the query-string part of the url, for example... (1 Reply)
Discussion started by: eiland
1 Replies

6. UNIX for Dummies Questions & Answers

Recursive Permissions???

Is there anyway that I can change permissions on a directory and all its sub-directories and files using one single "chmod" command?? (5 Replies)
Discussion started by: the_red_dove
5 Replies

7. Cybersecurity

Recursive SFTP

Hello, I need to transfer files from Serve1 to Server2. Previously I was using scp command. Now I have to use sftp (due to audit issues). The problem with sftp is (atleast to my level of knowledge) we cannot transfer dirs (and files within that dir). Is there a way to solve this? Looks like... (1 Reply)
Discussion started by: MohanTJ
1 Replies

8. UNIX for Dummies Questions & Answers

Recursive grep

Hello, First time post - I have no formal unix training and could use some help with this. I have a list of strings in File1 that I want to use to do a recursive search (grep) under a specific directory. Here is an example of the string I need to search: /directory/dire... (16 Replies)
Discussion started by: upstate_boy
16 Replies

9. Programming

recursive function

Hi everyone, i need your input on this. We can express a function recursivly like this A(n) = (2 n = 0 5 n = 1 A(n − 1) + A(n − 2) % 47 n > 1 How would i go about constructing a recursive function for this?... (1 Reply)
Discussion started by: bebop1111116
1 Replies

10. UNIX for Advanced & Expert Users

recursive sorting

In the ls command, -t option and -R option dont work simultaneously. ls -t ---> lists the files with sorting based on file date ls -R ---> lists the files recursively. How to make utilize both in the same command.? I want to sort the recursive files listing.. (1 Reply)
Discussion started by: fermisoft
1 Replies
Login or Register to Ask a Question