Logs: getting information from them?


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Logs: getting information from them?
# 1  
Old 10-20-2008
Logs: getting information from them?

I have some log files and would like to 'strip' some information from them.

I would like to take the time:
time="Mon Oct 20 01:36:21 BST 2008"

and another line that occurs under each time stamp.

Does anyone know how I could do this?

Many thanks.
# 2  
Old 10-20-2008
Post some lines of your log files and the desired output.

Regards
# 3  
Old 10-20-2008
Log sample:
Code:
<log4j:event logger="VistaMonitor" timestamp="1224462981632" time="Mon Oct 20 01:36:21 BST 2008" level="INFO" thread="VistaPooledThread-10:10" schema="LMS">
<log4j:message><![CDATA[

Background Job Service:  Available number of worker threads: 5
Background Job Service:  Number of started jobs per thread: 3761,3904,3613,4361,4368
Background Job Service:  Number of completed jobs per thread: 3761,3904,3613,4361,4368
Background Job Service:  Number of failed jobs per thread: 0,0,0,0,0
Background Job Service:  Total number of pending jobs: 0
Background Job Service:  Total number of started jobs: 20007
Background Job Service:  Total number of completed jobs: 20007
Background Job Service:  Total number of failed jobs: 0
Background Job Service:  Completed jobs: 100%

WebCT Session:  Current user count: 2876
WebCT Session:  Active user sessions in last 5/10/15 minutes: 0/0/0
WebCT Session:  Average requests/minute for the last 5 minutes: 0
Http Session:  Current number of open sessions: 36135
Http Session:  High water mark of the total number of open sessions: 55938
Http Session:  Total number of sessions opened: 207368

I would like it to output as:

20-10-08 01:36:21 | 2876
20-10-08 02:36:21 | 666

I just want the date/time and the users (for now).
# 4  
Old 10-20-2008
Use nawk, gawk or /usr/xpg4/bin/awk on Solaris.

Code:
awk -F"\"| " '
BEGIN{
  split("JAN FEB MAR APR MAY JUN JUL AUG SEP OCT NOV DEC", month, " ")
  for (i=1; i<=12; i++) mdigit[month[i]]=i
}
/time=/{s=$11"-"mdigit[toupper($10)]"-"$14" "$12}
/Current user count/{sub(".*: ","");s=s" | "$0;print s}
' logfile

Regards
# 5  
Old 10-20-2008
Thanks.

Not used awk or the others before.

Do I created a script with that in and then run it?
# 6  
Old 10-20-2008
Save the command in a file, make the file executable with chmod 755 file and run it as a shell script.

Code:
#!/bin/sh

awk -F"\"| " '
BEGIN{
  split("JAN FEB MAR APR MAY JUN JUL AUG SEP OCT NOV DEC", month, " ")
  for (i=1; i<=12; i++) mdigit[month[i]]=i
}
/time=/{s=$11"-"mdigit[toupper($10)]"-"$14" "$12}
/Current user count/{sub(".*: ","");s=s" | "$0;print s}
' logfile

Regards
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

If I ran perl script again,old logs should move with today date and new logs should generate.

Appreciate help for the below issue. Im using below code.....I dont want to attach the logs when I ran the perl twice...I just want to take backup with today date and generate new logs...What I need to do for the below scirpt.............. 1)if logs exist it should move the logs with extention... (1 Reply)
Discussion started by: Sanjeev G
1 Replies

2. Shell Programming and Scripting

Pull out information from output logs

My scenario is as follows. 1. I have a reference file with the IP addresses and names $ cat ref.list 10.11.xxx.xxx AA 10.12.xxx.xxx BB 10.13.xxx.xxx CC 10.14.xxx.xxx DD 2. A script runs and gets me one of the IP addresses and puts it in a separate file, for e.g... (2 Replies)
Discussion started by: Nagesh_1985
2 Replies

3. AIX

Apache logs

Hi, I can't seem to find the apache logs in my system. Can anyone assist me on finding them? This was done with a RPM install. I've checked everywhere and even tried a find command with key names like httpd and apache. and i've come up with nothing except my conf files. (2 Replies)
Discussion started by: vpundit
2 Replies

4. UNIX Desktop Questions & Answers

regarding logs

Hi , I am running an application on my windows and it logs are generated at /var/logs and for this i have to go this location and then do tail -f , Is there any command you can advise me so that when I execute this command at this location that logs get displayed fully and as the application... (3 Replies)
Discussion started by: KAREENA18
3 Replies

5. Shell Programming and Scripting

Output from Logs

Hello All, I have created a script to capture logs on every day at every 3 Min.Please find in attach.So my goal is to mail all the logs to myself for pertical date.So can anyone guide me how can i this on the basis of the attached logs. Regards Ankit (0 Replies)
Discussion started by: ajaincv
0 Replies

6. Shell Programming and Scripting

Grep yesterday logs from weblogic logs

Hi, I am trying to write a script which would go search and get the info from the logs based on yesterday timestamp and write yesterday logs in new file. The log file format is as follows: """"""""""""""""""""""""""... (3 Replies)
Discussion started by: harish.parker
3 Replies

7. UNIX for Advanced & Expert Users

logs

Hy, I have a question I have a directory in a unix server, Some of my files have a diffrent access time, from the time i accessed them last, I think some one has copied it,it's not an important file,but none the less,it is my file,It mistakenly had a 777 permission( yes ,I know it is a noob's... (1 Reply)
Discussion started by: lordmod
1 Replies

8. Shell Programming and Scripting

Logs

Hey Guys, i am new into shell programming and i have to do one script which have to record all the commands entered by a specific user. Example of that, i have a system running on unix, several users are using this system, i have to create like a databse which will record every user entered that... (5 Replies)
Discussion started by: charbel
5 Replies

9. UNIX for Dummies Questions & Answers

logs

can i include this command into my crontab file > /var/adm/wtmp to clear the contents on a regular basis ? what about file permissions ? (6 Replies)
Discussion started by: cubicle^dweller
6 Replies

10. UNIX Desktop Questions & Answers

Logs

hi My name is Juan I dont can clear wtmp and similiar files how i do it? thanks (4 Replies)
Discussion started by: jtapia
4 Replies
Login or Register to Ask a Question