So I need to write a script that can parse our logs and give me the amount of daily activity per user on our website. Unfortunately I'm still learning the very basics so please bear with me . Below is an example snippet from a log to give you a basic idea of what each entry in the log basically looks like (the important parts I want extracted bolded and are basically just the date and username):
Code:
blahblahblahblah- 05-26@09:31:26:235 INFO (blahblahblahblah) - myorganization.api.ApiHandler-0>getID(blahblahblahblah:"","user_info":{"username":"joe@somecompany.com","orgid":"blahblahblahblah"
So when somebody is on our site and performs activity, clicking through different pages, etc. an entry like above is written to the log for each bit of activity. In each log there can be several different days depending upon the activity (logs rotate based on size).
This gives me a list of two colums, with the number of instances (and hence user activity) paired with the username. Now I need to associate these with the date so that for any given day it will output the username and activity and day/date, and output that to .csv file. I'm open to any method really, I "think" it shouldn't be too difficult to modify what I have already but then again I'm new to this and not really sure how to do it right
Last edited by Don Cragun; 05-27-2015 at 01:30 AM..
Reason: Get rid of FONT, COLOR, and SIZE tags; add CODE tags.
I am writing a script that will identify the oldest file in a directory. Here's the syntax:
#!/bin/ksh
cd directory
chmod 777 *
ls -r -1t > file1
sed -n -e "1P" < file1 > file2
So my problem is, now I have file2, which contains the name of the oldest file in the directory. How do I use,... (1 Reply)
This script searches for core files and if it finds one, it emails me to let me know.I DONT want it to email me if it doesn't find one but I can't figure out what I need to change or add. Any thoughts? Script below:
/bin/find / -name core -type f -ls -exec file {} \;|/usr/bin/mailx -s... (1 Reply)
Hello
I am working on cleaning up permissions on Oracle mountpoints and datafiles in unix. I am looking for a script or a scripting idea to 1st.
1. grep for owner oracle
2. ensure its a directory owned for oracle
3. chmod 750 on the oracle owned directory.
4. grep for oracle files, etc... (3 Replies)
I'm new to shell scripting and am having a problem trying to do something in C shell. I want to write a script that will input something instead of a user doing it. For example, using the command 'write' the user is supposed to type something to be sent to another user. I want a script to be able... (3 Replies)
I am writing a backup script for AIX 5 and running into a problem where the output isn't being shown in the output log that is being created. Any ideas on how this would be corrected? I have included the script below. The only thing showing up in the file is listed below. I was hoping to capture... (2 Replies)
I'm writing a small script that will run an executable program (sort of like TOP). To exit the executable, you have to enter control C (^c). I'm trying to use a redirect input file to send the ^c but I'm not having any luck. My short script looks like this - /mydirectory/abc.script < abc.in >... (1 Reply)
Folks;
I'm writing a shell script to extract some fields out of a log file & it will run periodically, how can i make it runs starting from where it left of. for example;
if the script will do the extract every 2 days, let's say the first run will extract fields until July 25, 2007 @ 11:15:22... (1 Reply)
folks;
I have a script to remove any files that older than 14 days then move any files that younger than 7 days to another directory. but for some reason it doesn't move the files, when i do it manually it works but not through the script. i tried 2 different ways in writing the move part but it... (6 Replies)
Preview of command prompt
f ---> to start ferret
q----> to stop ferret
asp@nex:~$ f
NOAA/PMEL TMAP
FERRET v6.82
Linux 2.6.18-308.8.2.el5PAE 32-bit - 08/03/12
3-Dec-12 16:44
yes? go my.jnl
yes?column=4/skip=1/type=num,text ............filename.txt
---... (4 Replies)
hi all,
I am writing a script and beginner in shell scripting. I have tried the below script. could you please check and let me know whether the below scirpt is correct.
Unix details : HP Unix
Input file.
cat input.txt | tail -4
HTS40002.W1978.PROM
HTS40003.W1978.PROM... (17 Replies)
Discussion started by: arun888
17 Replies
LEARN ABOUT OPENDARWIN
sar
sar(1) BSD General Commands Manual sar(1)NAME
sar -- system activity reporter
SYNOPSIS
sar [-dgpu] [-n mode] [-o filename] t [n]
sar [-dgpu] [-n mode] [-e time] [-f filename] [-i seconds] [-s time]
DESCRIPTION
The sar command is used to sample and report various cumulative statistic counters maintained by the operating system. It can be invoked in
two different ways.
In the first usage instance, n samples are reported at t second intervals. If n is not specified, only one sample will be captured. When
the -o option is specified, sar will write the binary sampling data to the output file specified by filename.
In the second usage instance, there is no on-going sample interval to specify. This is because the sampling input comes from a previously
recorded, binary activity file. The binary activity file can be specified using the -f filename option. When the -f option isn't used, sar
attempts to open a default binary activity file, /var/log/sa/sadd, where dd represents the current day of the month. The starting and ending
time of the report can be restricted using the -e and -s options. Here, the time field is specified in the form hh[:mm[:ss]]. Finally, the
-i option can be used to select the sampling interval. Only records at least seconds apart will be reported. When the -i option is not
used, all of the previously recorded interval samples are reported.
Due to the nature of on-going sample collection, the data is reported in a verbose mode when more than one sampling option is specified.
Column headers are printed at the beginning of the report and averages are printed when the sar command terminates.
OPTIONS
The following options restrict the sample set that sar reports.
-d Report disk activity.
device The BSD name of the device.
r+w/s The number of reads and writes per second.
blks/s Number of blocks (in device's default blocksize) transferred to a device per second.
-g Report page-out activity.
pgout/s The number of pages paged out per second.
-p Report page-in and page fault activity
pgin/s The number of pages paged in per second.
pflts/s The number of faults that caused a page to be copied in per second.
vflts/s The number of times vm_fault routine has been called.
-n mode Report network activity with modes DEV, EDEV, or PPP. Multiple network modes can be specified.
DEV The DEV mode reports network device statistics. The following information is displayed for each interface.
IFACE The network interface name.
Ipkts/s The number of packets received per second.
Ibytes/s The number of bytes received per second.
Opkts/s The number of packets sent per second.
Obytes/s The number of bytes sent per second.
EDEV The EDEV mode reports network device error statistics. The following information is displayed for each interface.
IFACE The interface name.
Ierrs/s The input errors per second.
Oerrs/s The output errors per second.
Coll/s The collisions that occurred per second.
Drops/s The number of dropped packets per second.
PPP The PPP mode must be specified in order to display ppp connections in the network statistics. This will also turn on the
PPP modify mode in sadc (8) when sampling data is not being read from a file. By default, both the collection and report-
ing of ppp statistics is turned off. See sadc (8).
-u Report CPU activity (default)
%usr, %sys, and %idle
These report the percentage of time running in user mode, system mode and idle.
FILES
/var/log/sa/sadd Default daily activity file that holds the binary sampling data. dd are digits that represent the day of the month.
SEE ALSO sa1(8), sa2(8), sadc(8), iostat(8), vm_stat(1), netstat(1), top(1), sc_usage(1), fs_usage(1)Mac OS X Jul 25, 2003 Mac OS X
05-27-2015
. Below is an example snippet from a log to give you a basic idea of what each entry in the log basically looks like (the important parts I want extracted bolded and are basically just the date and username):