Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Parsing Log File Based on Date & Error
Top Forums Shell Programming and Scripting Parsing Log File Based on Date & Error Post 302472099 by k1ko on Tuesday 16th of November 2010 12:12:28 PM
Old 11-16-2010
Thank you so much for these - I am very grateful. One more question. How would I store the date of the matching error in the logfile ($logdate) along with the error message?

After finding a matching error I need to Insert into an oracle table like this:

Code:
inserter=`sqlplus -s <<EOF $USERID/$PASSW@$DB
set heading off
set pagesize 0
set tab off
INSERT INTO DB.ERROR(ERR_DATE, ERR_MSG)
VALUES
($logdate,$errormsg);
exit
EOF`


thank you so much for the help though, lifesavers.

---------- Post updated at 01:12 PM ---------- Previous update was at 10:29 AM ----------

So I got this to work perfectly thanks to your help
Code:
awk -v l="$lastdate" '/^....-..-../&&$0>l{d=$0}d&&/Error: 1602[34]/{print d,$0}' $logfile

I want to put this in a DO WHILE loop though and insert the result into a variable so that I can call SQL PLUS to insert into an oracle table. So heres the syntax which i'm trying to do but doesn't seem to be working too well

Code:
while read LINE; do
DATE=`echo $LINE | awk -v l="$lastdate" '/^....-..-../&&$0>l{d=$0}d&&/Error: 1602[34]/{print d}'`
MSG=`echo $LINE | awk -v l="$lastdate" '/^....-..-../&&$0>l{d=$0}d&&/Error: 1602[34]/{print $0}'`
#here i will call sql plus and insert above variables into database
done<$logfile

 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Inserting Date&Time Stamp In Existing Log File

I am trying to insert a line with a date stamp in a file that is used to monitor activity in one of our directories. By doing this, I want to grep that file each day and go to the last entry for each time a error occurred and pull all errors generated if any exist. If error exists I want that error... (3 Replies)
Discussion started by: shephardfamily
3 Replies

2. Shell Programming and Scripting

parsing a system log file via the 'date' command

Hello, I'm trying to update some scripts here that parse our system logs daily. They report information just fine... but they just report too much info. Specifically, if there's been some failed login attempts on several different days (say Monday and Tuesday), when I get the report from... (5 Replies)
Discussion started by: cjones
5 Replies

3. Shell Programming and Scripting

Processing a log file based on date/time input and the date/time on the log file

Hi, I'm trying to accomplish the following and would like some suggestions or possible bash script examples that may work I have a directory that has a list of log files that's periodically dumped from a script that is crontab that are rotated 4 generations. There will be a time stamp that is... (4 Replies)
Discussion started by: primp
4 Replies

4. Shell Programming and Scripting

Finding & Moving Oldest File by Parsing/Sorting Date Info in File Names

I'm trying to write a script that will look in an /exports folder for the oldest export file and move it to a /staging folder. "Oldest" in this case is actually determined by date information embedded in the file names themselves. Also, the script should only move a file from /exports to... (6 Replies)
Discussion started by: nikosey
6 Replies

5. Shell Programming and Scripting

Delete log file entries based on the Date/Timestamp within log file

If a log file is in the following format 28-Jul-10 ::: Log message 28-Jul-10 ::: Log message 29-Jul-10 ::: Log message 30-Jul-10 ::: Log message 31-Jul-10 ::: Log message 31-Jul-10 ::: Log message 1-Aug-10 ::: Log message 1-Aug-10 ::: Log message 2-Aug-10 ::: Log message 2-Aug-10 :::... (3 Replies)
Discussion started by: vikram3.r
3 Replies

6. Shell Programming and Scripting

List Files Based On Time & Date

Hi All, I am using HP Unix. I want to list files which are created 5 minutes before on the same day as well as before today's date. I checked all the forums and the commands provided there does not work on HP Unix. Can you please help me on this? Your help is highly aprreciated. Thanks and... (3 Replies)
Discussion started by: angshuman
3 Replies

7. UNIX for Dummies Questions & Answers

Copy log based on from-date and to-date

Hi all, i go a customer support requirement where i need to scan several files based on from/to date like 1-oct to 2-oct please help... (3 Replies)
Discussion started by: AbhiJ
3 Replies

8. Shell Programming and Scripting

Need Script to ZIP/SAVE & then DELETE Log file & send a mail conformation for any error

ENVIROMENT Linux: RHEL 6.4 Log Path: /usr/iplanet/servers/https-company/logs Log Format: user.log.03-15-2015 I have log4j log rotation enabled rotating files on a daily basis. The rotated logs are NOT compressed & are taking up too much space. I need a script that will run daily that... (1 Reply)
Discussion started by: admin_job_admin
1 Replies

9. UNIX for Dummies Questions & Answers

Log file - Delete duplicate line & keep last date

Hello All ! I need your help on this case, I have a csv file with this: ITEM105;ARI FSR;2016-02-01 08:02;243 ITEM101;ARI FSR;2016-02-01 06:02;240 ITEM032;RNO TLE;2016-02-01 11:03;320 ITEM032;RNO TLE;2016-02-02 05:43;320 ITEM032;RNO TLE;2016-02-01 02:03;320 ITEM032;RNO... (2 Replies)
Discussion started by: vadim-bzh
2 Replies

10. UNIX for Beginners Questions & Answers

Print Error in Console and both Error & Output in Log file - UNIX

I am writing a shell script with 2 run time arguments. During the execution if i got any error, then it needs to redirected to a error file and in console. Also both error and output to be redirected to a log file. But i am facing the below error. #! /bin/sh errExit () { errMsg=`cat... (1 Reply)
Discussion started by: sarathy_a35
1 Replies

LEARN ABOUT NETBSD

ching

CHING(6)							 BSD Games Manual							  CHING(6)

NAME

     ching -- the book of changes and other cookies

SYNOPSIS

     ching [hexagram]

DESCRIPTION

     The I Ching or Book of Changes is an ancient Chinese oracle that has been in use for centuries as a source of wisdom and advice.

     The text of the oracle (as it is sometimes known) consists of sixty-four hexagrams, each symbolized by a particular arrangement of six
     straight (---) and broken (- -) lines.  These lines have values ranging from six through nine, with the even values indicating the broken
     lines.

     Each hexagram consists of two major sections.  The Judgement relates specifically to the matter at hand (e.g., ``It furthers one to have
     somewhere to go.'') while the Image describes the general attributes of the hexagram and how they apply to one's own life (``Thus the
     superior man makes himself strong and untiring.'')

     When any of the lines have the values six or nine, they are moving lines; for each there is an appended judgement which becomes significant.
     Furthermore, the moving lines are inherently unstable and change into their opposites; a second hexagram (and thus an additional judgement)
     is formed.

     Normally, one consults the oracle by fixing the desired question firmly in mind and then casting a set of changes (lines) using yarrow-stalks
     or tossed coins.  The resulting hexagram will be the answer to the question.

     Using an algorithm suggested by S. C. Johnson, the UNIX oracle simply reads a question from the standard input (up to an EOF) and hashes the
     individual characters in combination with the time of day, process id and any other magic numbers which happen to be lying around the system.
     The resulting value is used as the seed of a random number generator which drives a simulated coin-toss divination.  The answer is then piped
     through nroff(1) for formatting and will appear on the standard output.

     For those who wish to remain steadfast in the old traditions, the oracle will also accept the results of a personal divination using, for
     example, coins.  To do this, cast the change and then type the resulting line values as an argument.

     The impatient modern may prefer to settle for Chinese cookies; try fortune(6).

DIAGNOSTICS

     The great prince issues commands,

     Founds states, vests families with fiefs.

     Inferior people should not be employed.

SEE ALSO

     It furthers one to see the great man.

BUGS

     Waiting in the mud

     Brings about the arrival of the enemy.

     If one is not extremely careful,

     Somebody may come up from behind and strike him.

     Misfortune.

BSD
								   May 31, 1993 							       BSD
All times are GMT -4. The time now is 05:25 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy