08-12-2010
shell script that can create, monitor the log files and report the issues for matching pattern
Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted!
1. The problem statement, all variables and given/known data:
Write an automated shell program(s) that can create, monitor the log files and report the issues for matching pattern.
(i) Conditions for creating log files.
Log file is created with date (example 2010_03_27.log). If the log file size is 10 Mb for a particular day then automatically the log file will be rotated with sequence number (example, on a particular day if the log file crossed 10 MB while the data insert ii n progress, the program should rotate the log file with a sequence number YYYY_MM_DD_sequence_number.log)
(ii) Condition for reading the data for pattern matching
The report with matched pattern should be reported at the earliest for effective business decision. The data that is already processed shouldn't be considered for analysis for pattern matching.
Example file with sample data and mattching patterns
file01.log
2010-03-18 24:50:50:500: WorkingThread-1:User_Authorization_Failed session-id-10002033
2010-03-18 24:50:50:550: WorkingThread-1:User_Authentication_Failed session-id-10002033
2010-03-18 24:52:50:500: WorkingThread-1:User_Access_Locked session-id-10002033
Analyze the log for following pattern's:
1. Report number of 'User_Authorization_Failed'
2. Report number of 'User_Authentication_Failed'
3. Report number of 'User_Access_Locked'
2. Relevant commands, code, scripts, algorithms:
3. The attempts at a solution (include all code and scripts):
4. Complete Name of School (University), City (State), Country, Name of Professor, and Course Number (Link to Course):
University of pune, pune, india, sheshan, 312 Unix
Note: Without school/professor/course information, you will be banned if you post here! You must complete the entire template (not just parts of it).
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I'm looking for a way to match a particular string in another string and if a match is found execute some command.
I found the case statement can be used like this;
case word in
)
command ;; ] ...
esac
If my string to find is say "foo" in the string $mystring... (1 Reply)
Discussion started by: paulobrad
1 Replies
2. Shell Programming and Scripting
hi All,
how to find a pattern in the log file & display the above and below line
for example in the log file, i have many lines, whenever i search for "Category" it should display the above line with only few parameter like i want only the location name & department name
Thu Jul 02 11:05:23... (2 Replies)
Discussion started by: rithick256
2 Replies
3. Shell Programming and Scripting
Hi Guru's,
I have to write a shell script which groups file names based upon the certain matching string pattern, then creates the Tar file for that particular group of files and then zips the Tar file created for the respective group of files.
For example, In the given directory these files... (3 Replies)
Discussion started by: rahu_sg
3 Replies
4. Shell Programming and Scripting
Hi,
I need to create a shell script through which i need to populate email addresses in email columns of database table in mysql. Let say if email contains yahoo, hotmail, gtalk than email addresses need to move in their respective columns.
# !/bin/sh
yim="example@yahoo.com"... (3 Replies)
Discussion started by: mirfan
3 Replies
5. Shell Programming and Scripting
Hi,
I am using following command to extract string from a file. String will be after last / (slash).
awk -F\ / '{print $NF}' $FILE
but while appending the output in file in script, it dosent work. File created but of zero size... can anyone please help
`awk -F\\\/ '{print $NF}' $FILE` >... (3 Replies)
Discussion started by: Deei
3 Replies
6. Shell Programming and Scripting
Hi ,
Please help me getting this done.
Write an automated shell program(s) that can create, monitor the log files and report the issues for matching pattern.
(i) Conditions for creating log files.
Log file is created with date (example 2010_03_27.log). If the log file size is 10 Mb for... (1 Reply)
Discussion started by: itian2010
1 Replies
7. Shell Programming and Scripting
Hi friends.. I have many dirs in my working directory. Every dir have thousands of files (.jsp, .java, .xml..., etc). So I am working with an script to find every file recursively within those directories and subdirectories ending with .jsp or .java which contains inside of it, the the pattern... (3 Replies)
Discussion started by: hnux
3 Replies
8. UNIX for Dummies Questions & Answers
Hi,
I have a file f1 wi the following data
f1.txt
========
Report ID
Report Name
-----------------------------------------------------------------
Post Requests : 2 Post successes : 2
=============================================
I need to search for the... (2 Replies)
Discussion started by: RP09
2 Replies
9. Shell Programming and Scripting
Hi
I want to find a line in a file which contains a word and replace the patterns.
Sample file content temp.xml
====================
<applications>
<application>
Name="FirstService"
location="http://my.website.selected/myfirstService/V1.0/myfirst.war"
... (1 Reply)
Discussion started by: sakthi.99it
1 Replies
10. Shell Programming and Scripting
Hi all,
Is Perl included by default in Ubuntu? I'm trying to write a program using as few languages as possible, and since I'm using a few Perl one-liners to do non-greedy matching, it's considered another language, and this is a bad thing.
Basically, I'm using a Perl one-liner to grab XML... (3 Replies)
Discussion started by: Zel2008
3 Replies
evmpost(1) General Commands Manual evmpost(1)
NAME
evmpost - post events to the EVM daemon
SYNOPSIS
msg priority]] | [filename|
DESCRIPTION
The command takes a file or stream of text event sources as input and converts them to binary EVM events. By default, the command then
posts them to the EVM daemon for distribution.
If the option is specified, writes the EVM events to its stream instead of posting them to the daemon. By default, attempts to retrieve
event template information from the EVM daemon and merges the template items and environmental items such as and into the output events.
If the option is used, the output events contain only the items specified in the source.
An event source may contain any number of events. Each event is specified in the manner shown. See the EvmEvent(5) manpage for a more
detailed explanation.
The command recognizes the following data items in an event source:
o
o
o
o
o
o
o
o
o
o
All EVM variable types may be specified except for Refer to EvmEvent(5) for details on data items and variables.
In the event source, each keyword must be accompanied by a corresponding value. The value must be enclosed in double quotes ("") if it
contains white space. The data item keywords that are specified outside the event body are taken as global values. The data item keywords
are included in each of the following events which do not have an explicit value defined for that keyword.
Comments are indicated by a leading character. Blank lines are ignored.
The command builds an EVM event containing the items that are explicitly specified in the source. If the event is posted or if the option
is specified without additional environmental items such as the and template items are inserted into the event automatically.
The rules for posting an event are more stringent than those for an event simply to exist. Therefore, may display an error when trying to
post an an event that cannot be posted, even though the same source is accepted when using the option.
For example, do not post an event if it does not contain a name with at least three components because the daemon rejects it. However,
such an event can exist, and can create it and pass it to The following example fails because it does not contain a name:
The following example is successful, even though it does not display any useful information:
The option can verify event source and template files by piping the output into See evmshow(1).
Options
Does not post the events, but instead passes them directly to
as raw EVM events.
An error occurs if is directed to a terminal device.
When used with the
option, causes event template items and environmental values to be merged with the items included in the source. This is the
default mode.
When used with the
option, inhibits the merging of template items and environmental values.
Posts an administrator's quick message event with the name
and the string msg in a variable data item. If a message contains spaces, the message must be enclosed in quotation marks ("").
The event is used to add a message entry in the event log. This option may be used only by privileged users.
Posts a user's quick message event with the name
and the string msg in a variable data item. If a message contains spaces, the message must be enclosed in quotation marks ("").
The event is used to add a message entry in the event log.
Assigns priority as the for an administrator's or user's quick message. The priority value must be an integer in the range 0-700. If
the priority is not specified, the default of 200 is used.
Operands
filename Read event sources from filename. If filename is omitted, or is specified as event sources are read from
RETURN VALUES
The following exit values are returned:
Successful completion.
An error occurred.
EXAMPLES
o The following example posts an event, provided that a template file containing an event with a matching name has been registered with
the EVM daemon.
o The following example interprets an event template file, and displays a dump of the contents of each event. Environmental items, such
as a timestamp, are not merged into the event. This command checks the syntax and contents of the file.
o The following example shows how is used in a shell script to signal completion of some operation:
o The following example must be run as to post an administrator's message event.
o The following example posts a quick user's message.
o This example posts an event that includes a variable.
If the template for this event contains the following format data item:
then displays this event as:
WARNINGS
The command rejects attempts to output raw events to a terminal device.
Post only events for which you have posting authorization, and for which a template exists.
FILES
Definition of the sockets and protocols used for Internet services
Location of the EVM authorization file
SEE ALSO
Commands
evmget(1), evminfo(1), evmshow(1), evmsort(1), evmwatch(1).
Routines
EvmEventPost(3).
Files
evmdaemon.conf(4), evmtemplate(4), services(4).
Event Management
EVM(5).
EVM Events
EvmEvent(5).
evmpost(1)