Login or Register to Ask a Question and Join Our Community


Linux

Generating apache log reports

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Operating Systems Linux Generating apache log reports
# 1  
Old 07-01-2011
Generating apache log reports
Hello all,

I'm trying to find some tool on generating reports based on apache access_log files (of Common format).
I found some of them (awstats, lire/logreport, weblog expert, apache logs viewer, etc..) but they generate some global and general report about the log file.

Also some perl script I found they just show the Top X number of different patterns.

My request is how can I generate some similar report with this output:

IP-s | Total nr. of connections | Number of pages visited | Total time of connection

So basically this is a list with every IP on the log and the respective numbers (connection/pages/time) associated.

Is this possible or can you guide me how to write some script for this?

Thanks.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Cron job scheduled is running once, but reports are generating twice

Team, Hope you all are doing fine I have one admin server which is being used dedicately to run cron jobs on hourly basis, fetching the details from Database which is in a different server.These cronjob are run on every hourly/5 minutes basis depending as per end user requirement.The script... (12 Replies)
Discussion started by: whizkidash
12 Replies

2. UNIX for Advanced & Expert Users

Apache log rotate configuration

HI i was trying to configure logrotate for my apache server and it's not working properly. here is my lodrotate configuration /var/log/httpd/*log { daily missingok notifempty sharedscripts compress delaycompress postrotate /sbin/service httpd... (1 Reply)
Discussion started by: bentech4u
1 Replies

3. Web Development

Apache/2.2.15 custom error log

Hello, I've updated my apache access log to include the x-forward-for IP instead of my client(loadbalancer) ip. However, i can't seem to find a way to do the same for the error logs. Can someone please assist. Thank you. -K (0 Replies)
Discussion started by: kmaq7621
0 Replies

4. Shell Programming and Scripting

Generate a Execution time reports using log files.

Hi Experts, I am having a requirement, where i need to generate a report of the execution time of all the processes. All the processes generate the log files in a log directory and I can get the execution time from the log files. like below is the log file. /home/vikas/log >ls -l... (2 Replies)
Discussion started by: k_vikash
2 Replies

5. Web Development

how to wait after apache log rotation

My solaris server utilize the freeware savelog program to rotate apache logs. One server has become very busy and even after doing a graceful restart it continues to log to the saved gzip log file. Has anyone been able to come up with a way or script to issue a "wait" type command so that the... (2 Replies)
Discussion started by: csross
2 Replies

6. Red Hat

sarg issue while generating reports for squid

I installed sarg from sarg rpm and i am facing issue while generating sarg reports and getting this time different error below sarg -l /var/log/squid/access.log SARG: Records in file: 242332, reading: 0.00% SARG: Records in file: 242332, reading: 2.06% SARG: Records in file: 242332, reading:... (0 Replies)
Discussion started by: mail4vij
0 Replies

7. Shell Programming and Scripting

Generating formatted reports from log files

Given that I have a log file of the format: DATE ID LOG_LEVEL | EVENT 2009-07-23T14:05:11Z T-4030097550 D | MessX 2009-07-23T14:10:44Z T-4030097550 D | MessY 2009-07-23T14:34:08Z T-7298651656 D | MessX 2009-07-23T14:41:00Z T-7298651656 D | MessY 2009-07-23T15:05:10Z T-4030097550 D | MessZ... (5 Replies)
Discussion started by: daccad
5 Replies

8. Shell Programming and Scripting

Apache log file pharsing, need help!!!!

I`m new to shell scripting and I need some help here I`m trying to pharse Apache log and I encountered a problem so I need some help... How to break line into fields having different field separators? let`s say I want to break line into 9 fields and the lines format is: text1 text2... (2 Replies)
Discussion started by: Armisan
2 Replies

9. Shell Programming and Scripting

how to search reports with specified keyword in log

Hi, I have a question with sed/awk. When I handle some log files I want to search all reports with specified keyword. For example, in the log below. abcd efg ===start abc e ===end xyz ===start af f ===end nf ga ===start ab ===end (4 Replies)
Discussion started by: danielnpu
4 Replies

10. Shell Programming and Scripting

generating reports based on time field of network data

hi i have data extracted in the following format ranging around 300000 to 800000 records in a text file , the format is of network data . No. Time Source Destination Protocol 1 1998-06-05 17:20:23.569905 HP_61:aa:c9 HP_61:aa:c9 ... (1 Reply)
Discussion started by: renukaprasadb
1 Replies
Login or Register to Ask a Question

LEARN ABOUT CENTOS

pmdaapache

PMDAAPACHE(1)						      General Commands Manual						     PMDAAPACHE(1)

NAME

       pmdaapache - Apache2 web server performance metrics domain agent (PMDA)

SYNOPSIS

       $PCP_PMDAS_DIR/apache/pmdaapache [-d domain] [-l logfile] [-U username] [-S server] [-P port] [-L location]

DESCRIPTION

       pmdaapache is a Performance Metrics Domain Agent (PMDA) which extracts performance metrics describing the state of an Apache web server.

       The  apache  PMDA  exports metrics that measure the request rate, cumulative request sizes, uptime and various connection states for active
       clients.

       This information is obtained by performing a HTTP request to the server status URL, which must be enabled in the  httpd.conf  configuration
       file.

	    ExtendedStatus on
	    <Location /server-status>
	    SetHandler server-status
	    Order deny,allow
	    Deny from all
	    Allow from localhost
	    </Location>

       A brief description of the pmdaapache command line options follows:

       -d   It	is  absolutely crucial that the performance metrics domain number specified here is unique and consistent.  That is, domain should
	    be different for every PMDA on the one host, and the same domain number should be used for the same PMDA on all hosts.

       -l   Location of the log file.  By default, a log file named apache.log is written in the current directory of pmcd(1) when  pmdaapache	is
	    started,  i.e.   $PCP_LOG_DIR/pmcd	.   If	the log file cannot be created or is not writable, output is written to the standard error
	    instead.

       -S   Query the Apache status information from the named server rather than the local host.

       -P   Query the Apache status information from the given port rather than the default (80).

       -L   Specify an alternative location for finding the server-status page.

       -U   User account under which to run the agent.	The default is the unprivileged "pcp" account in current versions of  PCP,  but  in  older
	    versions the superuser account ("root") was used by default.

INSTALLATION

       If you want access to the names, help text and values for the apache performance metrics, do the following as root:

	    # cd $PCP_PMDAS_DIR/apache
	    # ./Install

       If you want to undo the installation, do the following as root:

	    # cd $PCP_PMDAS_DIR/apache
	    # ./Remove

       pmdaapache  is  launched by pmcd(1) and should never be executed directly.  The Install and Remove scripts notify pmcd(1) when the agent is
       installed or removed.

FILES

       $PCP_PMCDCONF_PATH
		 command line options used to launch pmdaapache
       $PCP_PMDAS_DIR/apache/help
		 default help text file for the apache metrics
       $PCP_PMDAS_DIR/apache/Install
		 installation script for the pmdaapache agent
       $PCP_PMDAS_DIR/apache/Remove
		 undo installation script for the pmdaapache agent
       $PCP_LOG_DIR/pmcd/apache.log
		 default log file for error messages and other information from pmdaapache

PCP ENVIRONMENT

       Environment variables with the prefix PCP_ are used to parameterize the file and directory names used by PCP.  On  each	installation,  the
       file  /etc/pcp.conf contains the local values for these variables.  The $PCP_CONF variable may be used to specify an alternative configura-
       tion file, as described in pcp.conf(5).

SEE ALSO

       PCPIntro(1), httpd(8), pmcd(1), pcp.conf(5) and pcp.env(5).

Performance Co-Pilot							PCP							     PMDAAPACHE(1)