A script needs to be created to collect all HTTP GET requests containing a particular string
Hi friends,
A script needs to be created to collect all HTTP GET requests containing a particular string say abcd.gif in the url path along with the IP address of the client that issued the request. The source of this data is the web server logs. Also Each script execution should extract client IP address and timestamp and record this either in a file or in a DB.
Logs are like
and capture IP address 10.254.17.140 and timestamp 13/Jul/2012:05:20:49 in a file
Any help will be greatly appreciated
Regards,
Surendra
Moderator's Comments:
Please use code tags next time for your code and data.
Last edited by zaxxon; 07-23-2012 at 10:54 AM..
Reason: code tags, see PM
On a sparc solaris 8 host running sunone webserver 6 I would like to limit the http requests that can be used when port 80 is accessed. We currently have http/1.0 enabled.
For example I would like to remove the http request DELETE.
Regards,
BLP (1 Reply)
Hi folks,
I am trying to build this GUI application that will perform some http requests to a specific server.
Basically I will use curl to "pretend" that it is a browser a sending an http request from a form.
My http knowledge is very low, and the site is tricky, but I think if I could... (3 Replies)
How do i collect Date & Time from Different Directories in a script
The script iam using for a single directory is :
ls -l | grep awk '{print $8}' (2 Replies)
My management is looking for me to sweep my Unix servers and report on (1) how much SAN space has been allocated to each server and (2) how much is used (defined as having a file on those bits). Basically stuff one can get from "df", but they just want SAN totals (not local disks). NAS is exempt.
... (1 Reply)
Hi, I'm newbie in Korn scripting as well as in Unix. I need to have a script to do the following.
1) ssh multiple hosts
-In my case, login credentials are not an issue as all keys authorized by default. Example of host IP (24.35.14.6, 24.35.14.7, 24.35.14.8, 24.35.14.9, ... (2 Replies)
Environmnet: HP-UX B.11.31 U ia64
RDBMS: Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
Question:
When server hangs or node evicts, we open up tickets with Oracle Support and Oracle Support ask for some list of log files.
Currently we can not use the... (2 Replies)
Hi,
I'm trying to write a script to determine the time gap between HTTP PUT and HTTP DELETE requests in the HTTP Servers access log.
Normally client will do HTTP PUT to push content e.g. file_1.txt and 21 seconds later it will do HTTP DELETE, but sometimes the time varies causing some issues... (3 Replies)
I am trying to collect logs from a system in expert mode. Where I login to system and then change mode to expert mode and issue command to collect the log. I have a script which works but It waits for 30 mins even though log collection is complete before that. I have two issues with existing... (4 Replies)
Discussion started by: shunya
4 Replies
LEARN ABOUT DEBIAN
modgzip2dlf
MODGZIP2DLF.IN(1) LogReport's Lire Documentation MODGZIP2DLF.IN(1)NAME
modgzip2dlf - convert Common Log Format with mod_gzip extensions web server log files to DLF
SYNOPSIS
modgzip2dlf file
DESCRIPTION
modgzip2dlf converts web server log file in the common log format with extensions for mod_gzip to www DLF.
mod_gzip is an Apache extension developed by RemoteCommunications, Inc. Sourcecode is free available from
http://www.RemoteCommunications.com/apache/mod_gzip/mod_gzip. More informations can be found at
http://www.RemoteCommunications.com/apache/mod_gzip/mod_gzip_faq.htm.
mod_gzip can log informations about the compression of pages by configuring Apache to log using the 'gzip' format which can be defined as
follows:
LogFormat "%h %l %u %t "%r" %>s %b %{mod_gzip_result}n %{mod_gzip_compression_ratio}n" gzip
MOD_GZIP EXTENSIONS
The mod_gzip extensions adds two fields to the Common Log Format; see common2dlf(1):
gzip_result compression_ratio
gzip_result
The gzip's result code. Usually OK.
compressio_ratio
The ratio by which the content was compressed. A number from 0 to 100.
Log example :
127.0.01 - - [11/03/2001 12:12:01 -0400] "GET / HTTP/1.0" 200 252 "-" "Mozilla/5.0" OK 49
dsl1.myprovider.com - francis [11/03/2001 12:14:01 -0400] "GET /secret/ HTTP/1.0" 200 300 "http://www.example.com/index.html" "Mozilla/5.0" OK 74
EXAMPLES
To process a log as produced in the modgzip logformat:
$ modgzip2dlf < common.log
modgzip2dlf will be rarely used on its own, but is more likely called by lr_log2report:
$ lr_log2report modgzip < /var/log/httpd/common.log
SEE ALSO common2dlf(1), combined(2), referer2dlf(1)AUTHORS
Joost van Baal <joostvb@logreport.org>, Francis J. Lacoste <flacoste@logreport.org> and Egon Willighagen <egonw@logreport.org>, based on an
idea by Edwin Groothuis
VERSION
$Id: modgzip2dlf.in,v 1.10 2006/07/23 13:16:36 vanbaal Exp $
COPYRIGHT
Copyright (C) 2000, 2001 Stichting LogReport Foundation LogReport@LogReport.org
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program (see COPYING); if not, check with
http://www.gnu.org/copyleft/gpl.html.
Lire 2.1.1 2006-07-23 MODGZIP2DLF.IN(1)