Sponsored Content
Top Forums Shell Programming and Scripting Archiving or removing few data from log file in real time Post 302907380 by rbatte1 on Friday 27th of June 2014 12:17:45 PM
Old 06-27-2014
Surely cat filename|wc -l adds a process and therefore considerable extra time. Would wc -l filename not be quicker?

Anyhow, is the file being appended to as in-use all the time or is it separate operations. Consider these two (probably not exactly true, but just for an example)
Code:
for i in 1 2 3 4 5
do
   echo "Hello $i" >> filename
   sleep 5
done

versus
Code:
for i in 1 2 3 4 5
do
   echo "Hello $i"
   sleep 5
done >>filename

In the first, you have five discreet "open-append and close" operations. In the second you have one, so in the gaps between the echo statements, the file remains open. If you delete the data and write the file back, where does the subsequent output go? If you rename the file, then the output follows the old file.

Like Corona688 says, we need to know what is generating the messages. It may be that you have to stop that process whilst you manipulate the file, then restart it if there is no signal you can send to get it to switch logs.




Robin
 

7 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

log users real time

hi.... how i can configurator a log file on real time....on unix solaris.... thanks a lot.... Best Regards... (3 Replies)
Discussion started by: chanfle
3 Replies

2. Shell Programming and Scripting

Piped open not real-time - How would one handle live data?

When I run "/etc/myApp" I am presented with continuous output, just about once per second. However when I try to get the information in Perl via a piped open, it waits till the end to give me anything... my code: open (OUTPUT,"/etc/myApp |"); while (<OUTPUT>){ print $_; }... (2 Replies)
Discussion started by: jjinno
2 Replies

3. Shell Programming and Scripting

Real time log file redirect

Hi all, i would like to write the shell script program, it can monitor the access_log "real time" when the access_log writing the line contain "abcdef" the program will be "COPY" this line into a file named "abcdef.txt", do the same thing if the contain "123456" "COPY" it into a file named... (3 Replies)
Discussion started by: eric_wong_ch
3 Replies

4. HP-UX

HP-UX real time audit log writing

Hey all, I have a problem I was hoping to get some help on. So I have my two auditfiles, audfile1 and audfile2 that can be written to, I want to have the text version of them write to an NFS mount that I have set up. So i already know that i can do .secure/etc/audsp audfile1 > //nfsmount/folder/... (5 Replies)
Discussion started by: CleverRiver6
5 Replies

5. Shell Programming and Scripting

[solved] How to see log in real time?

Hi people I have a bash script with a line like this: python example.py >> log & But i can't see anything in the log file while python program is running only if the program ends seems to write the log file. "$ cat log" for example don't show anything until the program ends. Is there... (4 Replies)
Discussion started by: Tieso
4 Replies

6. UNIX for Advanced & Expert Users

How to read a fast written log file at Real time speed?

Hello All, I am building a real time parser for a log file in my application. The log file is continuously written at a very fast pace and gets rolled over every 10 minutes. I have measured the speed and observed that around 1000 lines are written to it every second, each line about 30-40... (7 Replies)
Discussion started by: cool.aquarian
7 Replies

7. Shell Programming and Scripting

Log all the commands input by user at real time in /var/log/messages

Below is my script to log all the command input by any user to /var/log/messages. But I cant achieve the desired output that i want. PLease see below. function log2syslog { declare COMMAND COMMAND=$(fc -ln -0) logger -p local1.notice -t bash -i -- "$USER:$COMMAND" } trap... (12 Replies)
Discussion started by: invinzin21
12 Replies
sleep(1)						      General Commands Manual							  sleep(1)

NAME
sleep - Suspends execution for at least the specified time SYNOPSIS
sleep seconds STANDARDS
Interfaces documented on this reference page conform to industry standards as follows: sleep: XCU5.0 Refer to the standards(5) reference page for more information about industry standards and associated tags. OPTIONS
None OPERANDS
Non-negative integer specifying the number of seconds for which execution is to be suspended. DESCRIPTION
The sleep command suspends execution of a process for at least the interval specified by seconds, which can range from 0 to 2,147,483,647 seconds. Depending on system activity, the actual time of suspension may be longer. See the sleep(3) reference page. [Tru64 UNIX] seconds can be entered as a non-negative decimal, octal, or hexadecimal value. NOTES
If sleep receives a SIGALARM signal before process execution has resumed, sleep takes one of the following actions: Terminates normally with a 0 (zero) exit status. (See the sleep(3) reference page for more information.) Ignores the signal Performs default processing EXIT STATUS
The following exit values are returned: Execution was successfully suspended for at least the requested time, or a SIGALARM signal was received. An error occurred. EXAMPLES
To display a message at 4-minute intervals for 20 minutes, create a shell script called remind containing the following: for i do sleep 240; echo $i sleep 240; echo $i sleep 240; echo $i sleep 240; echo $i sleep 240; echo $i done To display the message Try calling NHK at 4-minute intervals, enter: remind 'Try calling NHK' To run a command at regular intervals, create a shell script containing the following: while true do date sleep 60 done This displays the date and time once a minute. To execute a command after a specified interval, enter the following; (sleep 3600; echo Time's up) & This displays the message "Time's up" after one hour. ENVIRONMENT VARIABLES
The following environment variables affect the execution of sleep: Provides a default value for the internationalization variables that are unset or null. If LANG is unset or null, the corresponding value from the default locale is used. If any of the internationalization vari- ables contain an invalid setting, the utility behaves as if none of the variables had been defined. If set to a non-empty string value, overrides the values of all the other internationalization variables. Determines the locale for the interpretation of sequences of bytes of text data as characters (for example, single-byte as opposed to multibyte characters in arguments). Determines the locale for the for- mat and contents of diagnostic messages written to standard error. Determines the location of message catalogues for the processing of LC_MESSAGES. SEE ALSO
Commands: wait(1) Functions: alarm(3), pause(3), sigaction(2), sleep(3) Standards: standards(5) sleep(1)
All times are GMT -4. The time now is 03:18 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy