Creating searches?

amatuer_lee_3 · #1 (**permalink**) 05-07-2008

Hello. Could do with some help on where to get started really. If anyone could help me it would be greatly appreciated.

I have been working on this for a while now and I don't really know where to start but I am looking into creating a script that will process website hit files and output statistical information to the screen.

I have all of the hit files already and i have them populated like this:

137.44.2.8 Mon Feb 4 22:02:35 GMT 2008
149.192.2.81 Mon Feb 4 23:22:12 GMT 2008
132.53.17.171 Tue Feb 5 01:56:16 GMT 2008

What i want to do is create script(s) that will:

1. Request from the user a particular time period of interest for them to search all of this information

2. find

(i) the number of hits occurring during the given time period, and

(ii) the number of hits from unique IP addresses (counting two as one)

3. Present this information in table with the headings �page�, �hits� and �unique hits�

Also all the hit files are stored in a hits directory and I want the script to be executed from the parent directory of hits.

Again if anyone can point me in a good direction this would be greatly appreciated.

All i can think of so far is using "if" functions. but this is the first time i have used unix. (im using SUSE10.3 if that helps?) i just really wanted some pointers/solutions.

thanks for your time.

Smiling Dragon · #2 (**permalink**) 05-12-2008

I'd suggest working with perl for this as it's rather good at parsing files and creating nicely formatted reports.

Here's some pseudo-code to help get you going:

Code:

#!/usr/local/bin/do-what-i-want-not-what-i-write
print "Start date to search from: "
read from STDIN to $datestart
print "End date to search up until: "
read from STDIN to $dateend
print "File to search on: "
read from STDIN to $file

$hitcount=0
new array($iplist)

while (read $line from $file) {
  split $line into ($ip,$date)
  if ($date >= $datestart && $date <= $dateend) {
    $iplist[$ip]++
    $hitcount++
  }
}
$hitcount_unique=arraysize($iplist)
print_pretty_report($hitcount,$hitcount_unique)

amatuer_lee_3 · #3 (**permalink**) 05-12-2008

**************Thread Closed *****************************

Other UNIX.COM Threads You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
creating /var/run	csgonan	UNIX for Dummies Questions & Answers	2	04-25-2007 07:11 AM
New Tool Searches and Replaces SCO Code	Neo	News, Links, Events and Announcements	3	08-11-2003 09:37 AM
creating jfs	kburrows	UNIX for Dummies Questions & Answers	6	10-17-2002 01:16 PM
grep: do multiple searches?	sdemba	UNIX for Dummies Questions & Answers	4	03-14-2002 05:32 PM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode