Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: parse a log file and remember last line
Top Forums Shell Programming and Scripting parse a log file and remember last line Post 302448624 by raggmopp on Thursday 26th of August 2010 12:34:36 PM
Old 08-26-2010
parse a log file and remember last line
Hi all:

I'm working on a HPUX 11.23 system and I am needing to parse a tomcat-jakarta log file for memory use. Getting the desired data is easy, assuming the log file does not grow. This file grows constantly and I want to check it q 5 min. The next check will pick up from where it left off 5 min ago and read only the new entries looking for the desired pattern. So, read and parse the desired data from the log file, 5 minutes later read the newer entries and parse the desired data. Needs to be a shell (ksh) script so I can pass it off to the users and let them maintain it.

I have seen lots of entries for log analysis and parsing but nothing is really fitting my needs - or I am missing something.

Many thanks
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

remember last visited line in vim

hi, I know we can do this; but dont know how.. I open a file using vim..browse thru it and then say :wq after reaching some line; The next time I open the same file, I want vim to position the cursor on the line where I left last time; anyone? (2 Replies)
Discussion started by: spopuri
2 Replies

2. UNIX for Advanced & Expert Users

how do you parse 1 line at a time of file1 ie. line(n) each line into new file

File 1 <html>ta da....unique file name I want to give file=>343...</html> <html>da ta 234 </html> <html>pa da 542 </html> and so on... File 2 343 234 542 and so on, each line in File 1 one also corresponds with each line in File 2 I have tried several grep, sed, while .. read, do,... (4 Replies)
Discussion started by: web_developer
4 Replies

3. Shell Programming and Scripting

Parse file from 2nd line in shell script

Hi, I need to parse input file from 2nd line. Input file contents are, ABC123;20100913115432;2000000;NO; 04;AAA;09;DDD;601020304;AAAA;1;OPTA1;OPTA2;;; 04;BBB;09;BBB;601020304;BBBB;0;OPTB1;OPTB2;OPTB3;OPTB4;OPTB5; 04;CCC;09;DDD;601020304;CCCC;1;;;;; For each line, 1] I need to check... (17 Replies)
Discussion started by: Poonamol
17 Replies

4. Shell Programming and Scripting

Parse the log file

./abc.sh started at Sun Oct 24 06:42:04 PDT 2010 Message: ======= Summary Report of NAME count ----------------------------------------------------------------- Below is the output of the SQL query :- NAME COUNT... (2 Replies)
Discussion started by: sandy1028
2 Replies

5. Shell Programming and Scripting

Parse configuration file & add line in particular section

Greetings, I recently built a replicated DRBD, Heartbeat, & iSCSI Target Initiator storage server on Ubuntu 10.04 to offer shared storage to server Vmware ESX and Microsoft Clusters. Everything works flawlessly, however I wanted to make a script to create, remove, grow volumes to offer ESX... (6 Replies)
Discussion started by: Aeudian
6 Replies

6. Shell Programming and Scripting

Parse large file on line count (random lines)

I have a file that needs to be parsed into multiple files every time there line contains a number 1. the problem i face is the lines are random and the file size is random. an example is that on line 4, 65, 187, 202 & 209 are number 1's so there has to be file breaks between all those to create 4... (6 Replies)
Discussion started by: darbs121
6 Replies

7. Shell Programming and Scripting

Parse a single line file and store value.

I have a single line file like this : Average Fragmentation Quotient : 3.084121 Now I want to store the value which comes after ":" i,e 3.084121 into a variable. And if this variable crosses above 6 i want to call another script... can any one help me on this... (7 Replies)
Discussion started by: Hyp_Todd
7 Replies

8. Shell Programming and Scripting

SH script to parse string and return multi-line file

Hello all, I have been asked to exercise my shell scripting and it has been 10 plus years since I used to do it so I can not remember hardly anything and ask for your help. What I need to do is copy a line out of a file that can be 10 to 100 characters long, I then need to parse this line into... (3 Replies)
Discussion started by: Alivadoro
3 Replies

9. Shell Programming and Scripting

Parse A Log File

Hello All, Below is the excerpt from my Informatica log file which has 4 blocks of lines (starting with WRITER_1_*_1). Like these my log file will have multiple blocks of same pattern. WRITER_1_*_1> WRT_8161 TARGET BASED COMMIT POINT Thu May 08 09:33:21 2014... (13 Replies)
Discussion started by: Ariean
13 Replies

10. Post Here to Contact Site Administrators and Moderators

Log Out vs Remember Me

Howdy, I clicked the rememberer me when I log in, and evidently I really do not understand what that means. I had hoped that at least it would remember my user name for the next time that I log in. However, when I log out, I see a message about cookies being removed and one other thing that I... (1 Reply)
Discussion started by: danuke
1 Replies

LEARN ABOUT OSF1

cdslinvchk

cdslinvchk(8)						      System Manager's Manual						     cdslinvchk(8)

NAME

       cdslinvchk - Checks the CDSL inventory of the base operating system and layered applications.

SYNOPSIS

       /usr/sbin/cdslinvchk [log_file_path]

OPTIONS

       The path name to a location for the log file.  By default this will be /var/adm/cdsl_check_list.

DESCRIPTION

       Use  the cdslinvchk script to verify the current inventory of Context Dependent Symbolic Links (CDSLs) on a running system.  CDSLs are spe-
       cial symbolic links that enable a system to work in a cluster.  If CDSLs are accidentally removed, your system will not function  correctly
       in  a cluster.  While this is not a problem for stand-alone systems, you may not be able to add the system as a member of a working cluster
       at some future time.  You can run this script at any time or configure it to run at system start-up, or as a cron task.

       When you invoke the script, it checks the CDSLs on the running system against CDSLs of the installed inventory in /usr/.smdb and the  addi-
       tional  entries	in  /var/adm/cdsl_admin.inv, and ensures that each target file exists on the system as a properly-constituted CDSL. If the
       check is successful, the following message is displayed and the script terminates: Successful CDSL inventory check

       If the script finds inconsistencies in the inventory, warning messages are displayed on your terminal and logged to the default log file at
       /var/adm/cdsl_check_list.   You	can specify an alternate location for the log fill if required.  The script locates any modified, missing,
       or replaced CDSLs.  Note that the previous copy of the log file is renamed and retained for reference and is renamed by	appending  to  the
       filename.

       Refer  to  the  System Administration guide for information on recreating any missing or broken CDSLs.  Refer to the hier(5) reference page
       for an inventory of CDSLs.

   MESSAGES
       One or more of the following messages may be displayed and logged to the log file: Unable to create <pathname> report file  --  the  script
       was  not able to create a log file.  Check the target directory and security.  Expected CDSL: <cdsl_pathname> -> <pathname> CDSL Target has
       been modified to: <pathname> CDSL has been replaced with <pathname> CDSL is missing Failed CDSL inventory check. See details in <log file>

FILES

       Additional inventory file entries.  This file will not exist on all systems.  The current and previous log files for inventory  errors  and
       messages

SEE ALSO

       Commands: cron(8)

       Others: hier(5)

       See also the System Administration guide for details of CDSLs

																     cdslinvchk(8)
All times are GMT -4. The time now is 07:58 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy