Sponsored Content
Top Forums UNIX for Dummies Questions & Answers Script for parsing details in a log file to a seperate file Post 302257744 by pingnagan on Thursday 13th of November 2008 02:12:43 AM
Old 11-13-2008
Script for parsing details in a log file to a seperate file

Hi Experts,

Im a new bee for scripting,

I would ned to do the following via linux shell scripting, I have an application which throws a log file, on each action of a particular work with the application, as sson as the action is done, the log file would vanish or stops updating there, the action apparently invokes another application related.

So now my task would be to see the logfile that is generated each time.

please chk this

My script would have to regularly check the following directory (which will vary with the system name)

/usr/fl/log/*-fsm-server-*/

for a file called

console.txt

That file only exists for as long as the process is running (so your
script will have to poll that directory regularly). It contains
pathnames to the footage being copied.


here the * represents the numbers on each instance,

So i need to poll this directory and check for the latest log file, and grep the essential info............



How im not confusing...............if possible help me out............i shall explain better if needed.Smilie
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Read relevent details from Log File

Hi All, We have requirement to read XML details from large Log File and save in new file name. I have enclosed the sample xml which has start tag <OUTBOUND_MESSAGE xmlns="http://www.abc.com"> and the end tag as </OUTBOUND_MESSAGE> The log file contains many lines with other details which... (6 Replies)
Discussion started by: thinakarmani
6 Replies

2. UNIX for Dummies Questions & Answers

logging SFTP details in a log file...

hi all..... i want to know how to log the details when logging into a server using SFTP......in FTP i used something like (ftp -uv<xxx.srp>>log_file.log) where the details will be logged to log_file...is there any options for doing the same in SFTP....i wanted to display the details abt... (4 Replies)
Discussion started by: santy
4 Replies

3. Shell Programming and Scripting

Shell script for parsing 300mb log file..

am relatively new to Shell scripting. I have written a script for parsing a big file. The logic is: Apart from lot of other useless stuffs, there are many occurances of <abc> and corresponding </abc> tags. (All of them are properly closed) My requirement is to find a particular tag (say... (3 Replies)
Discussion started by: gurpreet470
3 Replies

4. Shell Programming and Scripting

Help with script parsing a log file

I have a large log file, which I want to first use grep to get the specific lines then send it to awk to print out the specific column and if the result is zero, don't do anything. What I have so far is: LOGDIR=/usr/local/oracle/Transcription/log ERRDIR=/home/edixftp/errors #I want to be... (3 Replies)
Discussion started by: mevasquez
3 Replies

5. Shell Programming and Scripting

Script for Parsing Log File

Working on a script that inputs an IP, parses and outputs to another file. A Sample of the log is as follows: I need the script to be able to input IP and print the data in an output file in the following format or something similar: Thanks for any help you can give me! (8 Replies)
Discussion started by: Winsarc
8 Replies

6. Shell Programming and Scripting

Issue with awk script parsing log file

Hello All, I am trying to parse a log file and i got this code from one of the good forum colleagues, However i realised later there is a problem with this awk script, being naive to awk world wanted to see if you guys can help me out. AWK script: awk '$1 ~ "^WRITER_" {p=1;next}... (18 Replies)
Discussion started by: Ariean
18 Replies

7. Shell Programming and Scripting

How to log file processing details to database table usnig UNIX shell script?

we are getting files on daily basis.we need to process these files. i need a unix shell script where we can count 1-The no of files processed 2-No of data/record processed for each files. The script should log these details into a database table. If there is any error while file... (3 Replies)
Discussion started by: Atul kumar
3 Replies

8. Shell Programming and Scripting

Parsing a log file and creating a report script

The log file is huge and lot of information, i would like to parse and make a report . below is the log file looks like: REPORT DATE: Mon Aug 10 04:16:17 CDT 2017 SYSTEN VER: v1.3.0.9 TERMINAL TYPE: prod SYSTEM: nb11cu51 UPTIME: 04:16AM up 182 days 57 mins min MODEL, TYPE, and SN:... (8 Replies)
Discussion started by: amir07
8 Replies

9. UNIX for Beginners Questions & Answers

Fetching address and user details from log file

Hi All, I have a requirement to get the address values from a large log file along with the user details. line1,line2,city,stateCode,postalCode,countryCode. The below code as advised in the earlier post is giving the user data zgrep -B1 "Failed to calculate Tax" log.2018-05-23.gz | grep... (8 Replies)
Discussion started by: nextStep
8 Replies

10. UNIX for Beginners Questions & Answers

Generic script to load file details(ls -ltr) in to a database.

All, I am trying to create a report on the duration of an ETL load from the file arrival to the final dump in to a database for SLA's. Does anyone have any guidance or ideas on how metadata can be extracted; information of a file: like file name, created timestamp, count of records and load... (1 Reply)
Discussion started by: pradeepp
1 Replies
WATCHDOGD(8)						    BSD System Manager's Manual 					      WATCHDOGD(8)

NAME
watchdogd -- watchdog daemon SYNOPSIS
watchdogd [-dnSw] [--debug] [--softtimeout] [--softtimeout-action action] [--pretimeout timeout] [--pretimeout-action action] [-e cmd] [-I file] [-s sleep] [-t timeout] [-T script_timeout] DESCRIPTION
The watchdogd utility interfaces with the kernel's watchdog facility to ensure that the system is in a working state. If watchdogd is unable to interface with the kernel over a specific timeout, the kernel will take actions to assist in debugging or restarting the computer. If -e cmd is specified, watchdogd will attempt to execute this command with system(3), and only if the command returns with a zero exit code will the watchdog be reset. If -e cmd is not specified, the daemon will perform a trivial file system check instead. The -n argument 'dry-run' will cause watchdog not to arm the system watchdog and instead only run the watchdog function and report on fail- ures. This is useful for developing new watchdogd scripts as the system will not reboot if there are problems with the script. The -s sleep argument can be used to control the sleep period between each execution of the check and defaults to 10 seconds. The -t timeout specifies the desired timeout period in seconds. The default timeout is 128 seconds. One possible circumstance which will cause a watchdog timeout is an interrupt storm. If this occurs, watchdogd will no longer execute and thus the kernel's watchdog routines will take action after a configurable timeout. The -T script_timeout specifies the threshold (in seconds) at which the watchdogd will complain that its script has run for too long. If unset script_timeout defaults to the value specified by the -s sleep option. Upon receiving the SIGTERM or SIGINT signals, watchdogd will first instruct the kernel to no longer perform watchdog checks and then will terminate. The watchdogd utility recognizes the following runtime options: -I file Write the process ID of the watchdogd utility in the specified file. -d --debug Do not fork. When this option is specified, watchdogd will not fork into the background at startup. -S Do not send a message to the system logger when the watchdog command takes longer than expected to execute. The default behaviour is to log a warning via the system logger with the LOG_DAEMON facility, and to output a warning to standard error. -w Complain when the watchdog script takes too long. This flag will cause watchdogd to complain when the amount of time to execute the watchdog script exceeds the threshold of 'sleep' option. --pretimeout timeout Set a "pretimeout" watchdog. At "timeout" seconds before the watchdog will fire attempt an action. The action is set by the --pretimeout-action flag. The default is just to log a message (WD_SOFT_LOG) via log(9). --pretimeout-action action Set the timeout action for the pretimeout. See the section Timeout Actions. --softtimeout Instead of arming the various hardware watchdogs, only use a basic software watchdog. The default action is just to log(9) a message (WD_SOFT_LOG). --softtimeout-action action Set the timeout action for the softtimeout. See the section Timeout Actions. Timeout Actions The following timeout actions are available via the --pretimeout-action and --softtimeout-action flags: panic Call panic(9) when the timeout is reached. ddb Enter the kernel debugger via kdb_enter(9) when the timeout is reached. log Log a message using log(9) when the timeout is reached. printf call the kernel printf(9) to display a message to the console and dmesg(8) buffer. Actions can be combined in a comma separated list as so: log,printf which would both printf(9) and log(9) which will send messages both to dmesg(8) and the kernel log(4) device for syslog(8). FILES
/var/run/watchdogd.pid EXAMPLES
Debugging watchdogd and/or your watchdog script. This is a useful recipe for debugging watchdogd and your watchdog script. (Note that ^C works oddly because watchdogd calls system(3) so the first ^C will terminate the "sleep" command.) Explanation of options used: 1. Set Debug on (--debug) 2. Set the watchdog to trip at 30 seconds. (-t 30) 3. Use of a softtimeout: 3.1. Use a softtimeout (do not arm the hardware watchdog). (--softtimeout) 3.2. Set the softtimeout action to do both kernel printf(9) and log(9) when it trips. (--softtimeout-action log,printf) 4. Use of a pre-timeout: 4.1. Set a pre-timeout of 15 seconds (this will later trigger a panic/dump). (--pretimeout 15) 4.2. Set the action to also kernel printf(9) and log(9) when it trips. (--pretimeout-action log,printf) 5. Use of a script: 5.1. Run "sleep 60" as a shell command that acts as the watchdog (-e 'sleep 60') 5.2. Warn us when the script takes longer than 1 second to run (-w) watchdogd --debug -t 30 --softtimeout --softtimeout-action log,printf --pretimeout 15 --pretimeout-action log,printf -e 'sleep 60' -w Production use of example 1. Set hard timeout to 120 seconds (-t 120) 2. Set a panic to happen at 60 seconds (to trigger a crash(8) for dump analysis): 2.1. Use of pre-timeout (--pretimeout 60) 2.2. Specify pre-timeout action (--pretimeout-action log,printf,panic ) 3. Use of a script: 3.1. Run your script (-e '/path/to/your/script 60') 3.2. Log if your script takes a longer than 15 seconds to run time. (-w -T 15) watchdogd -t 120 --pretimeout 60 --pretimeout-action log,printf,panic -e '/path/to/your/script 60' -w -T 15 SEE ALSO
watchdog(4), watchdog(8), watchdog(9) HISTORY
The watchdogd utility appeared in FreeBSD 5.1. AUTHORS
The watchdogd utility and manual page were written by Sean Kelly <smkelly@FreeBSD.org> and Poul-Henning Kamp <phk@FreeBSD.org>. Some contributions made by Jeff Roberson <jeff@FreeBSD.org>. The pretimeout and softtimeout action system was added by Alfred Perlstein <alfred@freebsd.org>. BSD
November 16, 2014 BSD
All times are GMT -4. The time now is 02:48 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy