Analysing Log Files?


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Analysing Log Files?
# 1  
Old 06-04-2008
Analysing Log Files?

I'm not sure if this query is relevant to this forum but here goes anyways...

I want analyse log files that do not appear to be of standard format. I have tried using Analog but cannot config it to read the files.

Does anyone have any advice on working with log files taken from a Unix (Solaris) server?

Thanks.
# 2  
Old 06-04-2008
don't know what 'Analog' is, but.... posting a sample log file and defining the term 'analyse' could help.
# 3  
Old 06-04-2008
Analog: WWW logfile analysis

Looks like I have an event log rather than a web log.

Are there tools for examining event logs?
# 4  
Old 06-04-2008
Have a look at the LogFile and LogFormat directives in the httpd.conf, they should tell you what format is used, it many not be unified log format.

EDIT, jut read the last post.


Can you provide a sample event? What is generating the events?
# 5  
Old 06-04-2008
Others might know - I don't.
# 6  
Old 06-04-2008
Usually you work with the tools that come with about every Unix/Linux. Some of them are grep, sort, cut, uniq, sed, awk, and so on.
# 7  
Old 06-04-2008
Quote:
Originally Posted by reborg
Can you provide a sample event? What is generating the events?
Here are the first few lines for the logfile in question:

Quote:
<log4j:event logger="VistaMonitor" timestamp="1212424680270" time="Mon Jun 02 17:38:00 BST 2008" level="INFO" thread="VistaPooledThread-10:101" schema="LMS">
<log4j:message><![CDATA[

Background Job Service: Available number of worker threads: 5
Background Job Service: Number of started jobs per thread: 7879,7180,6922,7145,7969
Background Job Service: Number of completed jobs per thread: 7879,7180,6922,7145,7969
Background Job Service: Number of failed jobs per thread: 0,0,0,0,0
Background Job Service: Total number of pending jobs: 0
Background Job Service: Total number of started jobs: 37095
Background Job Service: Total number of completed jobs: 37095
Background Job Service: Total number of failed jobs: 0
Background Job Service: Completed jobs: 100%

Session: Current user count: 22
Session: Active user sessions in last 5/10/15 minutes: 4/8/9
Session: Average requests/minute for the last 5 minutes: 31
Http Session: Current number of open sessions: 4648
Http Session: High water mark of the total number of open sessions: 24765
Http Session: Total number of sessions opened: 410383
Ideally I would like to get an 'extract' of the Current user count value for each day or hour. I've no idea to go about it.

Someone else has managed to do something similar here:
WebCT Log Analyzer - Main Page

I have contacted them but have not received a reply.

Any ideas how I can setup something the same/similar?

Cheers
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Redirecting log files to null writing junk into log files

Redirecting log files to null writing junk into log files. i have log files which created from below command exec <processname> >$logfile but when it reaches some size i am redirecting to null while process is running like >$logfile manually but after that it writes some junk into... (7 Replies)
Discussion started by: greenworld123
7 Replies

2. Shell Programming and Scripting

Problems in analysing SSH LOG users & time

Attached is the log file that I have generated through the following script: last | head -2 |sed '2q;d' |awk '{ print $1"\t"$2"\t"$3"\t\t"$4"\t"$5"\t"$6"\t"$7"\t"$8"\t" $9"\t"$10"\t"$11}'>>/var/log/logadmin/logtest.txt But now I'm unable to run the following operations on it: 1. Count... (1 Reply)
Discussion started by: Lionking93
1 Replies

3. AIX

Issue with nmon analysing

Dear Experts, Am using nmon analyser version 3.3g, and when i tried analyzing my current nmon file it was done successfully. But the problem is all my old nmon files are compressed. So i uncompressed and analyzed using the same analyzer. but got this error no valid input data! nmon run may... (8 Replies)
Discussion started by: jayadeava
8 Replies

4. Shell Programming and Scripting

How can view log messages between two time frame from /var/log/message or any type of log files

How can view log messages between two time frame from /var/log/message or any type of log files. when logfiles are very big and especially many messages with in few minutes, I would like to display log messages between 5 minute interval. Could you pls give me the command? (1 Reply)
Discussion started by: johnveslin
1 Replies

5. Shell Programming and Scripting

Reading and analysing data in a text file

Hi, I have below type of data in a text file in unix. Emp_Name Emp_Dept Raj 101 Amruta 100 Shilpa 100 Rohit 123 Amol 198 Rosh 101 Gaurav 198 Number of employees can be even more. Need a command or a... (2 Replies)
Discussion started by: rajneesh_kapoor
2 Replies

6. Shell Programming and Scripting

Analysing Mail Logs

Hello, I have a list of e-mails. I need to know, which email-s from that list not use. I want to do this things: - take email address from email list - find this address in mail logs - if, there is no record about this e-mail adress in list, show this e-mail address on screen I did... (0 Replies)
Discussion started by: naezdnik
0 Replies

7. Solaris

Analysing a core dump.

Friends I was trying to analyse a core dump using pstack command in Sol5.9(Sparc) The output is as below. root: pstack core_mumux211_istauth_220_108_1229517198_21922 core 'core_mumux211_istauth_220_108_1229517198_21922' of 21922: istauth fe1afbb8 ttcdrv (c10e0, c1db4, 30ad8, bc950, 0, 0)... (1 Reply)
Discussion started by: efunds
1 Replies

8. HP-UX

Query: Analysing the Core file

Hi, Is there any way to find the mode of the binary file (debug or release) by analyzing the core file generated by that binary on the HPUX11i Platform? (5 Replies)
Discussion started by: Prajakta
5 Replies

9. UNIX for Dummies Questions & Answers

Help analysing progress of a log file

Is it possible to track the progress of a job (informatica) by analysing the progress of it's log file ? I have a long running job, and no way of tracking how far allong it is. Thanks. (4 Replies)
Discussion started by: cosmos328is
4 Replies

10. UNIX for Advanced & Expert Users

Analysing truss log

I am facing the following issue when using db2. The JDBC prepared statement command is sending an incorrect value to the database for search. I did a truss on the app and here is the log. I want to know what is the value that is getting passed. is it possible. 26867/68: send(62,... (2 Replies)
Discussion started by: buytamil
2 Replies
Login or Register to Ask a Question