UNIX for Dummies Questions & Answers

Hello Guys,
I am trying to generate static site, I have perl script that wget the url, so the problem is sometimes wget has 500 internal error, this is failing to get that page. So I am thinking of retrying that url with 500 response.
system $command = 'wget ... -i inputfile -o outfile"
Is there a way we can capture the response and retry it or any option within wget to retry after timeout? Help appreciated.

You can not capture the exact error data when

Code:

wget url

returns 500

You should examine the server log files, typically Apache error.log and access.log.

While debugging your server (scripts?) you might consider setting a higher debug level, https://httpd.apache.org/docs/1.3/logs.html

---------- Post updated 23-01-14 at 01:01 AM ---------- Previous update was 22-01-14 at 07:06 PM ----------

And there is a trick, which is not without weird dangers:


Edit http.conf
Instead of logging to /logs

log to /htdocs

Restart server.

Now you may

Code:

wget url/error.log

wget doesn't seem to have any options for 'retry after 500 server error', but you should at least be able to tell that wget has failed by its return code or, failing that, its failure to create a file. A script could handle this but it seems like you're feeding this into some other non-shell system.