Generating apache log reports


 
Thread Tools Search this Thread
Operating Systems Linux Generating apache log reports
# 1  
Old 07-01-2011
Generating apache log reports

Hello all,

I'm trying to find some tool on generating reports based on apache access_log files (of Common format).
I found some of them (awstats, lire/logreport, weblog expert, apache logs viewer, etc..) but they generate some global and general report about the log file.

Also some perl script I found they just show the Top X number of different patterns.

My request is how can I generate some similar report with this output:

IP-s | Total nr. of connections | Number of pages visited | Total time of connection

So basically this is a list with every IP on the log and the respective numbers (connection/pages/time) associated.

Is this possible or can you guide me how to write some script for this?

Thanks.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Cron job scheduled is running once, but reports are generating twice

Team, Hope you all are doing fine I have one admin server which is being used dedicately to run cron jobs on hourly basis, fetching the details from Database which is in a different server.These cronjob are run on every hourly/5 minutes basis depending as per end user requirement.The script... (12 Replies)
Discussion started by: whizkidash
12 Replies

2. UNIX for Advanced & Expert Users

Apache log rotate configuration

HI i was trying to configure logrotate for my apache server and it's not working properly. here is my lodrotate configuration /var/log/httpd/*log { daily missingok notifempty sharedscripts compress delaycompress postrotate /sbin/service httpd... (1 Reply)
Discussion started by: bentech4u
1 Replies

3. Web Development

Apache/2.2.15 custom error log

Hello, I've updated my apache access log to include the x-forward-for IP instead of my client(loadbalancer) ip. However, i can't seem to find a way to do the same for the error logs. Can someone please assist. Thank you. -K (0 Replies)
Discussion started by: kmaq7621
0 Replies

4. Shell Programming and Scripting

Generate a Execution time reports using log files.

Hi Experts, I am having a requirement, where i need to generate a report of the execution time of all the processes. All the processes generate the log files in a log directory and I can get the execution time from the log files. like below is the log file. /home/vikas/log >ls -l... (2 Replies)
Discussion started by: k_vikash
2 Replies

5. Web Development

how to wait after apache log rotation

My solaris server utilize the freeware savelog program to rotate apache logs. One server has become very busy and even after doing a graceful restart it continues to log to the saved gzip log file. Has anyone been able to come up with a way or script to issue a "wait" type command so that the... (2 Replies)
Discussion started by: csross
2 Replies

6. Red Hat

sarg issue while generating reports for squid

I installed sarg from sarg rpm and i am facing issue while generating sarg reports and getting this time different error below sarg -l /var/log/squid/access.log SARG: Records in file: 242332, reading: 0.00% SARG: Records in file: 242332, reading: 2.06% SARG: Records in file: 242332, reading:... (0 Replies)
Discussion started by: mail4vij
0 Replies

7. Shell Programming and Scripting

Generating formatted reports from log files

Given that I have a log file of the format: DATE ID LOG_LEVEL | EVENT 2009-07-23T14:05:11Z T-4030097550 D | MessX 2009-07-23T14:10:44Z T-4030097550 D | MessY 2009-07-23T14:34:08Z T-7298651656 D | MessX 2009-07-23T14:41:00Z T-7298651656 D | MessY 2009-07-23T15:05:10Z T-4030097550 D | MessZ... (5 Replies)
Discussion started by: daccad
5 Replies

8. Shell Programming and Scripting

Apache log file pharsing, need help!!!!

I`m new to shell scripting and I need some help here I`m trying to pharse Apache log and I encountered a problem so I need some help... How to break line into fields having different field separators? let`s say I want to break line into 9 fields and the lines format is: text1 text2... (2 Replies)
Discussion started by: Armisan
2 Replies

9. Shell Programming and Scripting

how to search reports with specified keyword in log

Hi, I have a question with sed/awk. When I handle some log files I want to search all reports with specified keyword. For example, in the log below. abcd efg ===start abc e ===end xyz ===start af f ===end nf ga ===start ab ===end (4 Replies)
Discussion started by: danielnpu
4 Replies

10. Shell Programming and Scripting

generating reports based on time field of network data

hi i have data extracted in the following format ranging around 300000 to 800000 records in a text file , the format is of network data . No. Time Source Destination Protocol 1 1998-06-05 17:20:23.569905 HP_61:aa:c9 HP_61:aa:c9 ... (1 Reply)
Discussion started by: renukaprasadb
1 Replies
Login or Register to Ask a Question
LIRE(7) 						  LogReport's Lire Documentation						   LIRE(7)

NAME
Lire - generate reports from various log files INTRODUCTION
Lire allows one to generate reports from various log files. In this manpage, we give an overview of the Lire documentation. Documentation on installing Lire For installation instructions, read the file INSTALL. This file is shipped with the Lire tarball, lire-version.tar.gz. It is available from the World Wide Web at http://logreport.org/pub/current/INSTALL. Documentation for users Read the Lire README file for a quick start on Lire's usage. This file is shipped with the Lire tarball. If you've installed Lire from a package for your Operating System, it might be installed in a location like /usr/share/doc/lire/README . Read the Lire User's Manual for a more in-depth overview. This manual is available in various formats, and installed in /usr/[local/]share/doc/lire/user-manual* . It is available online, at http://logreport.org/pub/current/doc/user-manual/ . The main Lire commands (lire(1), lr_cron(1), lr_log2mail(1), lr_log2report(1), lr_xml2report(1), ...) should be in your PATH. The usage of these commands is documented in man pages; running e.g. man lr_log2report should show you the lr_log2report manpage. Documentation for developers If you plan to change the Lire internals, or if you are trying to fix a bug, you should consult the Lire Developer's Manual. This document is available in various formats, and installed in /usr/[local/]share/doc/lire/dev-manual* . A lot of Lire Perl modules get installed in the Lire:: namespace in the Perl module hierarchy. Likely, this is something like /usr/[local/]share/perl5/Lire/. Most of these come with their own man page. If you plan to write customized Lire extensions, you should read these manpages. Lire convertors, which take care of log file specific processing, are installed as Perl modules, named something like FooDlfConvertor.pm, and come with their own man page. (Some old-style convertors come with their own script, in /usr/[local/]libexec/lire/convertors/foo2dlf). If you're looking for information, specifically for your log file type, you should look here. If you plan to cooperate with the LogReport team, you might want to take a look at the BUGS file, as distributed with the Lire tarball, too. The file COPYING documents terms and conditions for copying, distribution and modification of Lire. Some extra explanation about this is given in Frequently Asked Question About Lire, online at http://logreport.org/lire/faq.php . Other sources of information Some documentation on Lire and LogReport is not distributed with the Lire tarball. Documentation is available from the LogReport website on http://www.logreport.org/ . It offers mailing list archives on http://www.logreport.org/contact/lists/ . You can get in touch with other Lire users on the Lire mailing lists, see http://logreport.org/contact/lists/ . The LogReport team can be contacted directly too (email, irc, snailmail), see http://logreport.org/contact/ for details. VERSION
This manpage: $Id: lire.pod,v 1.5 2006/07/23 13:16:32 vanbaal Exp $ COPYRIGHT
Copyright (C) 2002, 2003, 2004 Stichting LogReport Foundation LogReport@LogReport.org This manpage is part of Lire. Lire is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version. This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details. You should have received a copy of the GNU General Public License along with this program (see COPYING); if not, check with http://www.gnu.org/copyleft/gpl.html. AUTHOR
Joost van Baal <joostvb@logreport.org> Lire 2.1.1 2006-07-23 LIRE(7)