How to read a fast written log file at Real time speed?


 
Thread Tools Search this Thread
Top Forums UNIX for Advanced & Expert Users How to read a fast written log file at Real time speed?
# 8  
Old 03-06-2015
This is still not reliable, especially on NFS.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Log all the commands input by user at real time in /var/log/messages

Below is my script to log all the command input by any user to /var/log/messages. But I cant achieve the desired output that i want. PLease see below. function log2syslog { declare COMMAND COMMAND=$(fc -ln -0) logger -p local1.notice -t bash -i -- "$USER:$COMMAND" } trap... (12 Replies)
Discussion started by: invinzin21
12 Replies

2. Shell Programming and Scripting

Archiving or removing few data from log file in real time

Hi, I have a log file that gets updated every second. Currently the size has grown to 20+ GB. I need to have a command/script, that will try to get the actual size of the file and will remove 50% of the data that are in the log file. I don't mind removing the data as the size has grown to huge... (8 Replies)
Discussion started by: Souvik Patra
8 Replies

3. Shell Programming and Scripting

[solved] How to see log in real time?

Hi people I have a bash script with a line like this: python example.py >> log & But i can't see anything in the log file while python program is running only if the program ends seems to write the log file. "$ cat log" for example don't show anything until the program ends. Is there... (4 Replies)
Discussion started by: Tieso
4 Replies

4. HP-UX

HP-UX real time audit log writing

Hey all, I have a problem I was hoping to get some help on. So I have my two auditfiles, audfile1 and audfile2 that can be written to, I want to have the text version of them write to an NFS mount that I have set up. So i already know that i can do .secure/etc/audsp audfile1 > //nfsmount/folder/... (5 Replies)
Discussion started by: CleverRiver6
5 Replies

5. Shell Programming and Scripting

Read/Search file being written to giving error due to timing issues

The following is a piece of code to rename LOG_FILE_NEW to LOG_FILE once you get a result (either RUNNING or SHUTDOWN) RESULT="" sleep 30 while ; do sleep 10 RESULT=`sed -n '/RUNNING/'p ${LOG_FILE_NEW}` if ; then RESULT=`sed -n '/SHUTTING_DOWN/'p ${LOG_FILE_NEW}` fi done mv... (3 Replies)
Discussion started by: sonorous
3 Replies

6. Filesystems, Disks and Memory

data from blktrace: read speed V.S. write speed

I analysed disk performance with blktrace and get some data: read: 8,3 4 2141 2.882115217 3342 Q R 195732187 + 32 8,3 4 2142 2.882116411 3342 G R 195732187 + 32 8,3 4 2144 2.882117647 3342 I R 195732187 + 32 8,3 4 2145 ... (1 Reply)
Discussion started by: W.C.C
1 Replies

7. Programming

Read/Write a fairly large amount of data to a file as fast as possible

Hi, I'm trying to figure out the best solution to the following problem, and I'm not yet that much experienced like you. :-) Basically I have to read a fairly large file, composed of "messages" , in order to display all of them through an user interface (made with QT). The messages that... (3 Replies)
Discussion started by: emitrax
3 Replies

8. Shell Programming and Scripting

Perl or Shell script to read a transaction log in real time

Hello, I have a Apache webserver running on RedHat. Its primary function is a proxy server for users accessing the internet. I have a transaction log that logs every transactions of every users. For users trying to access certain sites/content the transactions goes into a 302 redirect loop and... (2 Replies)
Discussion started by: bruno406
2 Replies

9. Shell Programming and Scripting

Real time log file redirect

Hi all, i would like to write the shell script program, it can monitor the access_log "real time" when the access_log writing the line contain "abcdef" the program will be "COPY" this line into a file named "abcdef.txt", do the same thing if the contain "123456" "COPY" it into a file named... (3 Replies)
Discussion started by: eric_wong_ch
3 Replies

10. UNIX for Dummies Questions & Answers

log users real time

hi.... how i can configurator a log file on real time....on unix solaris.... thanks a lot.... Best Regards... (3 Replies)
Discussion started by: chanfle
3 Replies
Login or Register to Ask a Question
filterlog(8)						      System Manager's Manual						      filterlog(8)

NAME
filterlog - Logs and reports system Correctable Read Data (CRD) memory errors on specific systems. SYNOPSIS
/usr/sbin/filterlog [-l] [-d crdlog] [-d crdlifetime] [-s crdlength #] [-s crdcount #] [-h] OPTIONS
Logs or filters an entry from stdin. This option is used by the binary event-log daemon, binlogd. Dumps the contents of the CRD log file in text format. Errors shown in the file are those recorded by the system since the last boot. Dumps the CRD lifetime log information in text format. Used to set the CRD interval time in minutes. The default is 24 hours. Used to set the CRD interval count. The default is 50. Prints a list of the command option options defined in this reference page. DESCRIPTION
This utility ensures that only genuine memory errors are reported to system log files on certain system types. The command filterlog is called directly by the binary event-log daemon, binlogd to filter system CRD (memory hardware) errors. CRD errors are logged according to user-definable parameters. If it is determined that a genuine memory problem exists, an entry is passed to binlogd. The error will then be written to the system's error log file and can be notified to the user through DECevent. The filterlog utility uses two variables to determine if a CRD error signifies a genuine memory hardware problem -- crdlength and crdcount. If crdcount number of errors occur during crdlength minutes, an entry is passed to binlogd. The default settings are 50 errors in 24 hours (1440 minutes). The filterlog utility reads the /etc/binlog.conf file to determine what log file should be used to record any events. The default log file is /usr/adm/binary.crdlog. SEE ALSO
Commands: binlogd(8), dia(8) (DECevent) filterlog(8)