Sponsored Content
Top Forums Shell Programming and Scripting help with wget and 404 errors Post 302687329 by Corona688 on Thursday 16th of August 2012 11:04:30 AM
Old 08-16-2012
It's probably to disallow automatic downloading. wget doesn't hide the fact that it's a batch downloader. Try giving it a different user-agent with -U, and make accuscore.com the referer with --referer.
 

8 More Discussions You Might Find Interesting

1. Web Development

mod_rewrite RewriteMap - possible to 404?

In my strenuous efforts to get SEO-friendly urls, I'm using a rewrite map in my apache setup: RewriteEngine on RewriteOptions MaxRedirects=5 RewriteMap seo prg:/Applications/MAMP/htdocs/map.php #map requests for the original file to the new SEO friendly urls RewriteCond... (0 Replies)
Discussion started by: sneakyimp
0 Replies

2. Web Development

HTTP 404 Error Fetches File from Another Server

Has any seen any PHP or other scripting code that will executive on a 404 "File Not Found' error and then fetch the requested file from a different server? (0 Replies)
Discussion started by: Neo
0 Replies

3. Web Development

[.htaccess] Denegar IP Con Error 404

Saludos amigos programadores de Web. Mi Problema es, que necesito denegar una IP desde el fichero .htaccess, pero no con el tipico error 403 (Forbidden). sino con el error 404 (Not found). Para quitarme de encima una IP fija que visita constantemente mi servidor para llenar de Spam mis... (1 Reply)
Discussion started by: Ignacio A
1 Replies

4. Red Hat

HTTP/1.1 404 Not Found error in Web Server

I am running 2 jboss instances with ports 8585 and 8686 in my web server. Now trying to get header using the command curl -s --connect-timeout 360 -m 360 --head http: // localhost:8686/ then i get the following error HTTP/1.1 404 Not Found Server: Apache-Coyote/1.1 Content-Length: 0... (1 Reply)
Discussion started by: hridan
1 Replies

5. Shell Programming and Scripting

Wget - working in browser but cannot download from wget

Hi, I need to download a zip file from my the below US govt link. https://www.sam.gov/SAMPortal/extractfiledownload?role=WW&version=SAM&filename=SAM_PUBLIC_MONTHLY_20160207.ZIP I only have wget utility installed on the server. When I use the below command, I am getting error 403... (2 Replies)
Discussion started by: Prasannag87
2 Replies

6. What is on Your Mind?

New Responsive 404 Page for UNIX.com

Just created (actually, only modified... it was created by ShoutOut) a new responsive 404 "not found" page with the help of ShoutOut free templates. https://www.unix.com/status/404.html Same for 401 and 403 errors. Picture sans animation: ... (2 Replies)
Discussion started by: Neo
2 Replies

7. What is on Your Mind?

YouTube: Search Engine Optimization | How To Fix Soft 404 Errors and A.I. Tales from Google Search

Getting a bit more comfortable making quick YT videos in 4K, here is: Search Engine Optimization | How To Fix Soft 404 Errors and A.I. Tales from Google Search Console https://youtu.be/I6b9T2qcqFo (0 Replies)
Discussion started by: Neo
0 Replies

8. What is on Your Mind?

Google Webmaster Tools Shows Problems with Soft 404 Errors

Well, Sorry, but I cannot seem to fix the problem with the steady decline of ranking for unix.com pages with Google. Google Webmaster Tools show that they are dropping our pages from the indexes more and more because of "Soft 404" errors which started after we moved to the new data center. ... (18 Replies)
Discussion started by: Neo
18 Replies
REFERER2DLF.IN(1)					  LogReport's Lire Documentation					 REFERER2DLF.IN(1)

NAME
referer2dlf - convert referer web server log file to www DLF SYNOPSIS
referer2dlf file DESCRIPTION
referer2dlf converts Referer web server log files to the www DLF. Referer log format was first implemented in the NSCA httpd server. Apache can be configured to log in that format. Note that if you want to log referer information, the combined log format is a better format. REFERER LOG FORMAT
The Referer log format logs the referer information in the following format : I<uri> -> I<document> where the fields have the following meaning: uri The referring URI. This is the content of the Referer request's header which usually reflects the page where the user was before that request. document The local document that was referenced by that URI. This is the requested file without any query string. EXAMPLES
To process a log as produced in the referer logformat: $ referer2dlf < referer.log referer2dlf will be rarely used on its own, but is more likely called by lr_log2report: $ lr_log2report referer < /var/log/httpd/referer.log SEE ALSO
common2dlf(1), combined(2), modgzip2dlf(1) AUTHORS
Joost van Baal <joostvb@logreport.org>, Francis J. Lacoste <flacoste@logreport.org> and Egon Willighagen <egonw@logreport.org>, based on an idea by Edwin Groothuis VERSION
$Id: referer2dlf.in,v 1.10 2006/07/23 13:16:37 vanbaal Exp $ COPYRIGHT
Copyright (C) 2000, 2001 Stichting LogReport Foundation LogReport@LogReport.org This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program (see COPYING); if not, check with http://www.gnu.org/copyleft/gpl.html. Lire 2.1.1 2006-07-23 REFERER2DLF.IN(1)
All times are GMT -4. The time now is 08:37 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy