Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to select only the most frequent instances of a variable string in a file?
Top Forums Shell Programming and Scripting How to select only the most frequent instances of a variable string in a file? Post 302355790 by kevinmccallum on Wednesday 23rd of September 2009 06:40:47 PM
Old 09-23-2009
Thanks for the quick suggestion.......but I can't seem to get that to work. I replaced the access.log file name with my file name. But when I run it, it just hangs with no output. I tried moving the "echo $ip" up higher in the script to be right after the awk (and before the 'do'), but it still wouldn't print out that variable either.

And I can already get the file to sort by IP, since the ip-address is the leading entry in every newline ('sort -n' works).

So now I just need it to scan the entire log, count the number of entries that start with the same IP number, and print out the lines for let's say the Top-5 IP's that appear the most times in the file (5 highest "hitters" of the webserver). Can you provide any further help or advice?? Please.....??
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to replace all string instances found by find+grep

Hello all Im performing find + grep operation that looks like this : find . -name "*.dsp" | xargs grep -on Project.lib | grep -v ':0' and I like to add to this one liner the possibility to replace the string " Project.lib" that found ( more then once in file ) with "Example.lib" how can I do... (0 Replies)
Discussion started by: umen
0 Replies

2. Shell Programming and Scripting

Replacing string in all instances (both filenames and file contents) in a directory

Hi, I have a set of files stored in a single directory that I use to set parameters for a physics code, and I would like to streamline the process of updating them all when I change a parameter. For instance, if the files are called A2000p300ini, A2000p300sub, A2000p300run, and the text in each... (3 Replies)
Discussion started by: BlueChris
3 Replies

3. Shell Programming and Scripting

How to select the path that contains a certain string from a certain file?

Hi, I am new to this world of shell programming. I am facing a problem that is : I have directory which has many sub directories at different depth. say A/B/C/files A/B/files A/B/C/D/files In this directory structure there exists a file called ".project" in some of the sub... (2 Replies)
Discussion started by: bhaskar_m
2 Replies

4. Programming

Optimizing frequent file transfer?

Hi I have written a simple client/server(socket programming) application using TCP/IP. My server code runs on Linux and client is on windows. The concept is that the client request for files(on demand basis) to the server and the server sends it back to the client. As the client is attached to... (3 Replies)
Discussion started by: akilan
3 Replies

5. Shell Programming and Scripting

Using sed to replace a string in file with a string in a variable that contains spaces

Hi, i call my shell like: my_shell "my project name" my script: #!/bin/bash -vx projectname=$1 sed s/'PROJECT_NAME ='/'PROJECT_NAME = '$projectname/ <test_config_doxy >temp cp temp test_config_doxy the following error occurres: sed s/'PROJECT_NAME ... (2 Replies)
Discussion started by: vivelafete
2 Replies

6. Shell Programming and Scripting

Appending string, variable to file at the start and string at end

Hi , I have below file with 13 columns. I need 2-13 columns seperated by comma and I want to append each row with a string "INSERT INTO xxx" in the begining as 1st column and then a variable "$node" and then $2,$3,$4,$5,$6,$7,$8,$9,$10,$11,$12,$13 and at the end another string " ; COMMIT;" ... (4 Replies)
Discussion started by: Vaddadi
4 Replies

7. Shell Programming and Scripting

how to test input variable is a string in a select loop

Okay -- I hope I ask this correctly. I'm working on my little shell script to write vendor names and aliases to files from user input. If a user choose to add to a file, he can do that as well. I'm using a select loop for this function to list all the possible files the user can choose from.... (7 Replies)
Discussion started by: Straitsfan
7 Replies

8. Shell Programming and Scripting

replace (sed?) a string in file with multiple lines (string) from variable

Can someone tell me how I can do this? e.g: a=$(echo -e wert trewt ertert ertert ertert erttert erterte rterter tertertert ert) How do i replace the STRING with $a? I try this: sed -i 's/STRING/'"$a"'/g' filename.ext but this don' t work (2 Replies)
Discussion started by: jforce
2 Replies

9. Shell Programming and Scripting

Counting Instances of a String with AWK

I have a list of URLs and I want to be able to count the number of instances of addresses ending in a certain TLD and output and sort it like so. 5 bdcc.com 48 zrtzr.com 49 rvo.com Input is as so ync.org sduzj.edu sduzj.edu sduzj.edu sduzj.edu sduzj.edu sduzj.edu sduzj.edu... (1 Reply)
Discussion started by: Pjstaab
1 Replies

10. Shell Programming and Scripting

Printing most frequent string in column

I am trying to put together an script that will output the most frequent string in a column. This is what I have: awk '{count++} END {for ( i in count ) print i, count }' Of course, my script is outputting all different strings and counts. However, I just need the most frequent one (there... (7 Replies)
Discussion started by: Xterra
7 Replies

LEARN ABOUT HPUX

kclog

kclog(1M)																 kclog(1M)

NAME

       kclog - manage kernel configuration log file

SYNOPSIS

       config] string] type] name] [count]
       comment

DESCRIPTION

       is  the	administrative command for the HP-UX kernel configuration log file.  The log file is automatically maintained by all of the kernel
       configuration commands (and Any change to any kernel configuration gets logged to this log file, which is located at Note that this file is
       a  plain text file which can be viewed and manipulated using standard Unix file management commands; exists simply for convenience in find-
       ing particular log file entries.

       Under normal usage, prints the last count entries in the log file.  When one of the options is specified, prints  the  last  count  entries
       that match the specified criteria.  If count is not specified, it defaults to 1.

   Options
       will print all entries matching criteria.  If this option is not specified,
		      will only print the last count entries that match the specified criteria.

       will print only log file entries describing changes to the saved
		      kernel  configuration  named config.  If this option is not specified, will print log file entries describing changes to any
		      saved or running kernel configuration.

       will not print any entries.  Instead,
		      will create a new entry, as if a kernel configuration change had been made, containing the specified comment.   This  option
		      is only allowed for users with appropriate privileges.

       will print only log file entries that contain the given
		      string.

       will print only log file entries that refer to a configuration object
		      (module or tunable) of the given name.

       will print only log file entries that refer to configuration objects
		      of the specified type: or

RETURN VALUE

       returns zero for success.  It returns non-zero and prints a diagnostic message if an error occurs.

EXAMPLES

       To see the last three entries in the log:
       To see the last entry for the tunable
       To see the last five entries for module changes:
       To see all entries for module changes:
       To see the last entry mentioning Aberdeen:
WARNINGS

       The format of the log file may be changed without notice.

       Some configuration changes can be made without using the kernel configuration commands.	No log file entries are made for such changes.

       The log file should not be manually edited.  Doing so may cause to behave unpredictably.

SEE ALSO

       kcmodule(1M), kconfig(1M), kctune(1M), kconfig(5).

       available on

																	 kclog(1M)
All times are GMT -4. The time now is 02:43 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy