02-25-2009
Perl or Shell script to read a transaction log in real time
Hello,
I have a Apache webserver running on RedHat. Its primary function is a proxy server for users accessing the internet. I have a transaction log that logs every transactions of every users. For users trying to access certain sites/content the transactions goes into a 302 redirect loop and the browser eventually throws the error. Basically I need a script that will continuously watch the transaction log in real time and if it sees 5 or more consecutive redirect from the same user to to same site then redirect them to a certain site like
http://testsite.com
Below is the transaction log format
sourceIP of the end user <timestamp> content/site being accessed result code
206.40.1.2 [25/Feb/2009:09:13:36 -0600] GET
Google HTTP/1.1" 302
So if the script sees something like below then the last redirect would be
http://testsite.com
206.40.1.2 [25/Feb/2009:09:13:36 -0600] GET
Google HTTP/1.1" 302
206.40.1.2 [25/Feb/2009:09:13:37 -0600] GET
Google HTTP/1.1" 302
206.40.1.2 [25/Feb/2009:09:13:38 -0600] GET
Google HTTP/1.1" 302
206.40.1.2 [25/Feb/2009:09:13:39 -0600] GET
Google HTTP/1.1" 302
206.40.1.2 [25/Feb/2009:09:13:40 -0600] GET
Google HTTP/1.1" 302
Any help would be really appreciated.
Thanks
Bruno
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
hi....
how i can configurator a log file on real time....on unix solaris....
thanks a lot....
Best Regards... (3 Replies)
Discussion started by: chanfle
3 Replies
2. Shell Programming and Scripting
Halo,
Bash Script can get the time of process the trasaction or not?
For example, bash script use to procee the trasaction, like select and checking.. then generate the XML. after it, i need to get the time which to count the process.
Anyone can help me?
Thank you (1 Reply)
Discussion started by: ryanW
1 Replies
3. Shell Programming and Scripting
How can i print the output of a perl script on a unix console and redirect the same in a log file under same directory simultaneously ?
Like in Shell script, we use tee, is there anything in Perl or any other option ? (2 Replies)
Discussion started by: butterfly20
2 Replies
4. Shell Programming and Scripting
Hi,
On the server, we have app log files in this location /app/logs/error.log
On the same server, in a real time, we would like to replicate that into /var/ directory.
if someone has already done this, please share the script.
Thanks in advance. (4 Replies)
Discussion started by: lookinginfo
4 Replies
5. Shell Programming and Scripting
Dear experts,
I have an epoch time input file such as : -
1302451209564
1302483698948
1302485231072
1302490805383
1302519244700
1302492787481
1302505299145
1302506557022
1302532112140
1302501033105
1302511536485
1302512669550
I need the epoch time above to be converted into real... (4 Replies)
Discussion started by: aismann
4 Replies
6. Shell Programming and Scripting
Hi people
I have a bash script with a line like this:
python example.py >> log &
But i can't see anything in the log file while python program is running only if the program ends seems to write the log file.
"$ cat log" for example don't show anything until the program ends.
Is there... (4 Replies)
Discussion started by: Tieso
4 Replies
7. UNIX for Dummies Questions & Answers
I need to check 1 log file, which is logging:
2014-08-18T09:10:39+02:00 user: XXXXX START FEATURE
2014-08-18T09:10:39+02:00 user: XXXXX FINISH FEATURE
I first need to check that the START FEATURE starts and finish on the same time/date for the same user, which is different each time START... (2 Replies)
Discussion started by: TheBest43
2 Replies
8. UNIX for Advanced & Expert Users
Hello All,
I am building a real time parser for a log file in my application.
The log file is continuously written at a very fast pace and gets rolled over every 10 minutes.
I have measured the speed and observed that around 1000 lines are written to it every second, each line about 30-40... (7 Replies)
Discussion started by: cool.aquarian
7 Replies
9. Shell Programming and Scripting
Hello Team,
I need information on how to read one row at time using shell script. For example i have below data.
service-description servername warning critical mountpoint
disk-usage-tmp generic-service test1 80 90 /tmp
disk-usage-var ... (6 Replies)
Discussion started by: ghpradeep
6 Replies
10. Shell Programming and Scripting
Below is my script to log all the command input by any user to /var/log/messages. But I cant achieve the desired output that i want. PLease see below.
function log2syslog
{
declare COMMAND
COMMAND=$(fc -ln -0)
logger -p local1.notice -t bash -i -- "$USER:$COMMAND"
}
trap... (12 Replies)
Discussion started by: invinzin21
12 Replies
nislog(1M) System Administration Commands nislog(1M)
NAME
nislog - display the contents of the NIS+ transaction log
SYNOPSIS
/usr/sbin/nislog [-h num | -t num] [-v] [directory...]
DESCRIPTION
nislog displays the contents of the NIS+ server transaction log on the standard output. This command can be used to track changes in the
namespace. The /var/nis/trans.log file contains the transaction log maintained by the NIS+ server. When updates occur, they are logged to
this file and then propagated to replicas as log transactions. When the log is checkpointed, updates that have been propagated to the
replicas are removed.
The nislog command can only be run on an NIS+ server by superuser. It displays the log entries for that server only.
If directory is not specified, the entire log is searched. Otherwise, only those logs entries that correspond to the specified directories
are displayed.
OPTIONS
-h num Display num transactions from the ``head'' of the log. If the numeric parameter is 0, only the log header is displayed.
-t num Display num transactions from the ``tail'' of the log. If the numeric parameter is 0, only the log header is displayed.
-v Verbose mode.
FILES
/var/nis/trans.log transaction log
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWnisu |
+-----------------------------+-----------------------------+
SEE ALSO
nis+(1), rpc.nisd(1M), nisfiles(4), attributes(5)
NOTES
NIS+ might not be supported in future releases of the SolarisTM Operating Environment. Tools to aid the migration from NIS+ to LDAP are
available in the Solaris 9 operating environment. For more information, visit http://www.sun.com/directory/nisplus/transition.html.
SunOS 5.10 12 Dec 2001 nislog(1M)