08-12-2010
shell script that can create, monitor the log files and report the issues for matching pattern
Use and complete the template provided. The entire template must be completed. If you don't, your post may be deleted!
1. The problem statement, all variables and given/known data:
Write an automated shell program(s) that can create, monitor the log files and report the issues for matching pattern.
(i) Conditions for creating log files.
Log file is created with date (example 2010_03_27.log). If the log file size is 10 Mb for a particular day then automatically the log file will be rotated with sequence number (example, on a particular day if the log file crossed 10 MB while the data insert ii n progress, the program should rotate the log file with a sequence number YYYY_MM_DD_sequence_number.log)
(ii) Condition for reading the data for pattern matching
The report with matched pattern should be reported at the earliest for effective business decision. The data that is already processed shouldn't be considered for analysis for pattern matching.
Example file with sample data and mattching patterns
file01.log
2010-03-18 24:50:50:500: WorkingThread-1:User_Authorization_Failed session-id-10002033
2010-03-18 24:50:50:550: WorkingThread-1:User_Authentication_Failed session-id-10002033
2010-03-18 24:52:50:500: WorkingThread-1:User_Access_Locked session-id-10002033
Analyze the log for following pattern's:
1. Report number of 'User_Authorization_Failed'
2. Report number of 'User_Authentication_Failed'
3. Report number of 'User_Access_Locked'
2. Relevant commands, code, scripts, algorithms:
3. The attempts at a solution (include all code and scripts):
4. Complete Name of School (University), City (State), Country, Name of Professor, and Course Number (Link to Course):
University of pune, pune, india, sheshan, 312 Unix
Note: Without school/professor/course information, you will be banned if you post here! You must complete the entire template (not just parts of it).
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I'm looking for a way to match a particular string in another string and if a match is found execute some command.
I found the case statement can be used like this;
case word in
)
command ;; ] ...
esac
If my string to find is say "foo" in the string $mystring... (1 Reply)
Discussion started by: paulobrad
1 Replies
2. Shell Programming and Scripting
hi All,
how to find a pattern in the log file & display the above and below line
for example in the log file, i have many lines, whenever i search for "Category" it should display the above line with only few parameter like i want only the location name & department name
Thu Jul 02 11:05:23... (2 Replies)
Discussion started by: rithick256
2 Replies
3. Shell Programming and Scripting
Hi Guru's,
I have to write a shell script which groups file names based upon the certain matching string pattern, then creates the Tar file for that particular group of files and then zips the Tar file created for the respective group of files.
For example, In the given directory these files... (3 Replies)
Discussion started by: rahu_sg
3 Replies
4. Shell Programming and Scripting
Hi,
I need to create a shell script through which i need to populate email addresses in email columns of database table in mysql. Let say if email contains yahoo, hotmail, gtalk than email addresses need to move in their respective columns.
# !/bin/sh
yim="example@yahoo.com"... (3 Replies)
Discussion started by: mirfan
3 Replies
5. Shell Programming and Scripting
Hi,
I am using following command to extract string from a file. String will be after last / (slash).
awk -F\ / '{print $NF}' $FILE
but while appending the output in file in script, it dosent work. File created but of zero size... can anyone please help
`awk -F\\\/ '{print $NF}' $FILE` >... (3 Replies)
Discussion started by: Deei
3 Replies
6. Shell Programming and Scripting
Hi ,
Please help me getting this done.
Write an automated shell program(s) that can create, monitor the log files and report the issues for matching pattern.
(i) Conditions for creating log files.
Log file is created with date (example 2010_03_27.log). If the log file size is 10 Mb for... (1 Reply)
Discussion started by: itian2010
1 Replies
7. Shell Programming and Scripting
Hi friends.. I have many dirs in my working directory. Every dir have thousands of files (.jsp, .java, .xml..., etc). So I am working with an script to find every file recursively within those directories and subdirectories ending with .jsp or .java which contains inside of it, the the pattern... (3 Replies)
Discussion started by: hnux
3 Replies
8. UNIX for Dummies Questions & Answers
Hi,
I have a file f1 wi the following data
f1.txt
========
Report ID
Report Name
-----------------------------------------------------------------
Post Requests : 2 Post successes : 2
=============================================
I need to search for the... (2 Replies)
Discussion started by: RP09
2 Replies
9. Shell Programming and Scripting
Hi
I want to find a line in a file which contains a word and replace the patterns.
Sample file content temp.xml
====================
<applications>
<application>
Name="FirstService"
location="http://my.website.selected/myfirstService/V1.0/myfirst.war"
... (1 Reply)
Discussion started by: sakthi.99it
1 Replies
10. Shell Programming and Scripting
Hi all,
Is Perl included by default in Ubuntu? I'm trying to write a program using as few languages as possible, and since I'm using a few Perl one-liners to do non-greedy matching, it's considered another language, and this is a bad thing.
Basically, I'm using a Perl one-liner to grab XML... (3 Replies)
Discussion started by: Zel2008
3 Replies
LEARN ABOUT FREEBSD
debconf-mergetemplate
DEBCONF-MERGETEMPLATE(1) Debconf DEBCONF-MERGETEMPLATE(1)
NAME
debconf-mergetemplate - merge together multiple debconf template files
SYNOPSIS
debconf-mergetemplate [options] [templates.ll ...] templates
DESCRIPTION
Note: This utility is deprecated. You should switch to using po-debconf's po2debconf program.
This program is useful if you have multiple debconf templates files which you want to merge together into one big file. All the specified
files will be read in, merged, and output to standard output.
This can be especially useful if you are dealing with translated template files. In this case, you might have your main template file, plus
several other files provided by the translators. These files will have translated fields in them, and maybe the translators left in the
english versions of the fields they translated, for their reference.
So, you want to merge together all the translated templates files with your main templates file. Any fields that are unique to the
translated files need to be added in to the correct templates, but any fields they have in common should be superseded by the fields in the
main file (which might be more up-to-date).
This program handles that case properly, just list each of the translated templates files, and then your main templates file last.
OPTIONS
--outdated
Merge in even outdated translations. The default is to drop them with a warning message.
--drop-old-templates
If a translation has an entire template that is not in the master file (and thus is probably an old template), drop that entire
template.
SEE ALSO
debconf-getlang(1)
AUTHOR
Joey Hess <joeyh@debian.org>
2012-09-10 DEBCONF-MERGETEMPLATE(1)