09-23-2009
How to select only the most frequent instances of a variable string in a file?
I've got a web access file that I want to grep (or awk or perl or whatever will work!) out the most frequent instances of unique IP entries. Meaning the file looks something like this:
Quote:
1.1.1.1 home.do
1.1.1.1 home.do/category1
1.1.1.1 home.do/category2
1.1.1.1 home.do/category3
2.2.2.2 home.do
3.3.3.3 home.do
3.3.3.3 home.do/file
4.4.4.4 home.do
4.4.4.4 home.do/category1
4.4.4.4 home.do/category2
4.4.4.4 home.do/category3
I'd like to run a sort or grep (or whatever) that will only select out the lines from IP's that had the most hits......which in this example case would've been the 1.1.1.1 and 4.4.4.4 entries.
So something that sorts the entire file numerically, counts the instances of lines that start with the exact same (IP) number, and then outputs the results of only the MOST frequent occurances. So obviously the matching IP string is going to change each time it's run based on who is hitting the web server. Is this possible??
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello all
Im performing find + grep operation that looks like this :
find . -name "*.dsp" | xargs grep -on Project.lib | grep -v ':0'
and I like to add to this one liner the possibility to replace the string " Project.lib" that found ( more then once in file ) with "Example.lib"
how can I do... (0 Replies)
Discussion started by: umen
0 Replies
2. Shell Programming and Scripting
Hi,
I have a set of files stored in a single directory that I use to set parameters for a physics code, and I would like to streamline the process of updating them all when I change a parameter. For instance, if the files are called A2000p300ini, A2000p300sub, A2000p300run, and the text in each... (3 Replies)
Discussion started by: BlueChris
3 Replies
3. Shell Programming and Scripting
Hi,
I am new to this world of shell programming. I am facing a problem that is :
I have directory which has many sub directories at different depth. say
A/B/C/files
A/B/files
A/B/C/D/files
In this directory structure there exists a file called ".project" in some of the sub... (2 Replies)
Discussion started by: bhaskar_m
2 Replies
4. Programming
Hi
I have written a simple client/server(socket programming) application using TCP/IP. My server code runs on Linux and client is on windows. The concept is that the client request for files(on demand basis) to the server and the server sends it back to the client. As the client is attached to... (3 Replies)
Discussion started by: akilan
3 Replies
5. Shell Programming and Scripting
Hi,
i call my shell like:
my_shell "my project name"
my script:
#!/bin/bash -vx
projectname=$1
sed s/'PROJECT_NAME ='/'PROJECT_NAME = '$projectname/ <test_config_doxy >temp
cp temp test_config_doxy
the following error occurres:
sed s/'PROJECT_NAME ... (2 Replies)
Discussion started by: vivelafete
2 Replies
6. Shell Programming and Scripting
Hi ,
I have below file with 13 columns. I need 2-13 columns seperated by comma and I want to append each row with a string "INSERT INTO xxx" in the begining as 1st column and then a variable "$node" and then $2,$3,$4,$5,$6,$7,$8,$9,$10,$11,$12,$13 and at the end another string " ; COMMIT;"
... (4 Replies)
Discussion started by: Vaddadi
4 Replies
7. Shell Programming and Scripting
Okay -- I hope I ask this correctly.
I'm working on my little shell script to write vendor names and aliases to files from user input. If a user choose to add to a file, he can do that as well. I'm using a select loop for this function to list all the possible files the user can choose from.... (7 Replies)
Discussion started by: Straitsfan
7 Replies
8. Shell Programming and Scripting
Can someone tell me how I can do this?
e.g:
a=$(echo -e wert trewt ertert ertert ertert erttert
erterte
rterter
tertertert
ert)
How do i replace the STRING with $a?
I try this:
sed -i 's/STRING/'"$a"'/g' filename.ext
but this don' t work (2 Replies)
Discussion started by: jforce
2 Replies
9. Shell Programming and Scripting
I have a list of URLs and I want to be able to count the number of instances of addresses ending in a certain TLD and output and sort it like so.
5 bdcc.com
48 zrtzr.com
49 rvo.com
Input is as so
ync.org
sduzj.edu
sduzj.edu
sduzj.edu
sduzj.edu
sduzj.edu
sduzj.edu
sduzj.edu... (1 Reply)
Discussion started by: Pjstaab
1 Replies
10. Shell Programming and Scripting
I am trying to put together an script that will output the most frequent string in a column. This is what I have:
awk '{count++} END {for ( i in count ) print i, count }'
Of course, my script is outputting all different strings and counts. However, I just need the most frequent one (there... (7 Replies)
Discussion started by: Xterra
7 Replies
LEARN ABOUT DEBIAN
mojo::home
Mojo::Home(3pm) User Contributed Perl Documentation Mojo::Home(3pm)
NAME
Mojo::Home - Detect and access the project root directory in Mojo
SYNOPSIS
use Mojo::Home;
my $home = Mojo::Home->new;
$home->detect;
DESCRIPTION
Mojo::Home is a container for home directories.
ATTRIBUTES
Mojo::Home implements the following attributes.
"app_class"
my $class = $home->app_class;
$home = $home->app_class('Foo::Bar');
Application class.
METHODS
Mojo::Home inherits all methods from Mojo::Base and implements the following new ones.
"new"
my $home = Mojo::Home->new;
my $home = Mojo::Home->new('/home/sri/myapp');
Construct a new Mojo::Home object.
"detect"
$home = $home->detect;
$home = $home->detect('My::App');
Detect home directory from the value of the "MOJO_HOME" environment variable or application class.
"lib_dir"
my $path = $home->lib_dir;
Path to "lib" directory of application.
"list_files"
my $files = $home->list_files;
my $files = $home->list_files('foo/bar');
Portably list all files recursively in directory relative to the home diectory.
$home->rel_file($home->list_files('templates/layouts')->[1]);
"mojo_lib_dir"
my $path = $home->mojo_lib_dir;
Path to "lib" directory in which Mojolicious is installed.
"parse"
$home = $home->parse('/home/sri/myapp');
Parse home directory.
"rel_dir"
my $path = $home->rel_dir('foo/bar');
Portably generate an absolute path for a directory relative to the home directory.
"rel_file"
my $path = $home->rel_file('foo/bar.html');
Portably generate an absolute path for a file relative to the home directory.
"slurp_rel_file"
my $string = $home->slurp_rel_file('foo/bar.html');
Portably read all data at once from file relative to the home directory.
my $content = $home->slurp_rel_file($home->list_files('public')->[1]);
"to_string"
my $string = $home->to_string;
my $string = "$home";
Home directory.
SEE ALSO
Mojolicious, Mojolicious::Guides, <http://mojolicio.us>.
perl v5.14.2 2012-09-05 Mojo::Home(3pm)