Help with advanced wget


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users Help with advanced wget
# 1  
Old 06-23-2010
Help with advanced wget

Hi All, I am trying to download large no of data using wget. the URLS are saved in a file. I want to want for a few seconds after every URL is downloaded so i saw the option -w with wget but it does not seem to work. Can any one give me a working usage.
Code:
wget -i ../file1t -o ../Outlog.log -N -S -B "http://xyz.com/ -O file.11 -w 2

Thanks, John

Last edited by pludi; 06-23-2010 at 08:14 AM.. Reason: code tags, please...
# 2  
Old 06-24-2010
what is the error you get ? Give some more information.
# 3  
Old 06-24-2010
hey i figured it out.

wget -w 2 -i ../file1t -o ../Outlog.log -N -S -B "http://xyz.com/ -O file.11
This gives a 2 second interval between downloads.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Wget - working in browser but cannot download from wget

Hi, I need to download a zip file from my the below US govt link. https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP I only have wget utility installed on the server. When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies

2. Shell Programming and Scripting

EXPECT - advanced help

Hi, i need to automate installation (console) of product and found except as solution.iam new to expect and know basics of expect. i am struck with the following cases and need help for them to continue: 1) in every screen of installation at the end we have kind of buttons which we need to... (7 Replies)
Discussion started by: sai Harika
7 Replies

3. Programming

Books for advanced C

Simple question , what good book is next step in learning C. I finished with K&R and I want to go to the next step , so if someone has a good book please share title :D I looked for Advanced C programming by example but it is too expansive 400$ on Amazon :( So please tell me (7 Replies)
Discussion started by: solaris_user
7 Replies

4. Shell Programming and Scripting

Advanced printf

I want to print: WELCOME TO MY WORLD Where "WELCOME TO MY WORLD" will be in green (32) and the underline will be in yellow (33). How can i do the above using printf. printf "`tput smul`\033 leaves both the text and the underline in green. (3 Replies)
Discussion started by: proactiveaditya
3 Replies

5. Shell Programming and Scripting

advanced deletion

How can i delete the contents of the directory except one file? (8 Replies)
Discussion started by: proactiveaditya
8 Replies

6. UNIX for Advanced & Expert Users

Advanced I/O

What is Stream Devices and Stream pipes? Explain Advanced I/O ? (1 Reply)
Discussion started by: thangappan
1 Replies

7. Shell Programming and Scripting

Advanced replace

Hello, How can I replace the following with null from a file ";var "d=e";"^x" replace "";var "d=e";"^x"" "" -- filename ; doesnot work nor if I use \ in between. Please advise. Thanks (10 Replies)
Discussion started by: fed.linuxgossip
10 Replies

8. UNIX for Dummies Questions & Answers

Advanced LS?

My goal is simply to output a listing of all files in a directory and all subdirectories, one per line, ****with their full path****. The *** part is what I can't figure out. I can get one on a line and I like having the extra info, so I'm using ls -Rl right now. But what I get is just the... (2 Replies)
Discussion started by: bostonrobot
2 Replies

9. Shell Programming and Scripting

Advanced Getopts

Hi all, I am using getops to get the arguments passed by the command line. However, I need to specify some rules regarding the parameter sent. For eg: I have script called MyScript which accept parameter d, I, E, r, u so the usage should be like this: MyScript So far, I finished... (2 Replies)
Discussion started by: stefan_hery
2 Replies

10. Shell Programming and Scripting

Advanced For loop

Is it possible to code a FOR loop within Bourne/Korn shell of the form: for i in somelist AND j in anotherlist do echo $i $j done Basically I have two "lists", say: listA= "1 2 3 4 5" listB= "a b c d e" I want to step through these lists simultaneously and with one echo... (9 Replies)
Discussion started by: petrk1
9 Replies
Login or Register to Ask a Question