Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Help with gawk script that aggregates ip address ranges
Top Forums Shell Programming and Scripting Help with gawk script that aggregates ip address ranges Post 302333721 by Ygor on Tuesday 14th of July 2009 02:04:03 AM
Old 07-14-2009
Try...
Code:
BEGIN {
   FS = "."
}
NF == 4 {
   Key = sprintf("%03d.%03d.%03d.%03d", $1, $2, $3, $4)
   Arr[Key] = Key
}
END {
   n = asorti(Arr)
   for (Idx = 1; Idx <= n; Idx++) {
      Curr = substr(Arr[Idx], 1, 11) (substr(Arr[Idx], 13, 3) + 0)
      Prev = substr(Arr[Idx-1], 1, 11) (substr(Arr[Idx-1], 13, 3) + 1)
      Next = substr(Arr[Idx+1], 1, 11) (substr(Arr[Idx+1], 13, 3) - 1)
      if (Curr != Prev && Curr != Next ) {
          print Arr[Idx] "-" Arr[Idx]
      } else if (Curr != Prev && Curr == Next ) {
          printf Arr[Idx] "-"
      } else if (Curr == Prev && Curr != Next ) {
          print Arr[Idx]
      }
   }
}

Tested...
Code:
$ cat file1
#TEXTLINE1
#TEXTLINE2
5.5.5.53
5.5.5.54
5.5.5.55
1.1.1.1
2.2.2.2
1.1.1.2
1.1.1.3
3.3.3.3
4.4.4.4
5.5.5.5
5.5.5.51
5.5.5.52

$ gawk -f a1.awk file1 > file2

$ cat file2
001.001.001.001-001.001.001.003
002.002.002.002-002.002.002.002
003.003.003.003-003.003.003.003
004.004.004.004-004.004.004.004
005.005.005.005-005.005.005.005
005.005.005.051-005.005.005.055

$

Last edited by Ygor; 07-14-2009 at 03:12 AM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

how to use variables and gawk in a script?

Hi, I want to define variables in a shell script and make gawk use them to make some operations Mfn = $(grep " 1 " $fitxer | gawk '{print $2}') Xfn = $(grep " 1 " $fitxer | gawk '{print $3}') Yfn = $(grep " 1 " $fitxer | gawk '{print $4}') Zfn = $(grep " 1 " $fitxer | gawk... (9 Replies)
Discussion started by: pau
9 Replies

2. UNIX for Dummies Questions & Answers

Calculating field using AWK, or GAWK script

Hello all, I'm totally new to UNIX/Linux but I'm taking a course in it at my local JC. My question: I have been tasked with writing a gawk script that will create a nicely formatted report. That part I've done ok on...however, the very last thing that must be done is a calculation of a... (4 Replies)
Discussion started by: Trellot
4 Replies

3. Shell Programming and Scripting

gawk script

Hey guys need your help with an gawk script... here's what I have so far gawk '^d/ {printf "%-20s %-10s %-10s %-10s %-4s%2s %5s\n",$9,$1,$3,$4,$6,$7,$8}' ls.kbr The file ls.kbr is a capture of 'ls-al' What I want gawk to do is: 1) Find only directories (this is working) 2) skip lines... (2 Replies)
Discussion started by: zoo591
2 Replies

4. Shell Programming and Scripting

Issues with filtering duplicate records using gawk script

Hi All, I have huge trade file with milions of trades.I need to remove duplicate records (e.g I have following records) 30/10/2009,trdeId1,..,.. 26/10/2009.tradeId1,..,..,, 30/10/2009,tradeId2,.. In the above case i need to filter duplicate recods and I should get following output.... (2 Replies)
Discussion started by: nmumbarkar
2 Replies

5. Programming

need help with gawk script

hi i've already created this script. When I execute the script it takes the argument and compares it to the 3rd column of the script. What I was wondering if I could get some help with is. I want to add another column to the script and it will be the result of a set number for example, (2000 - 3rd... (3 Replies)
Discussion started by: gengar
3 Replies

6. Windows & DOS: Issues & Discussions

Gawk Script in Windows batch file - Help

Good morning all. I have been running into a problem running a simple gawk script that selects every third line from an input file and writes it to an output file. gawk "NR%3==0" FileIn > FileOut I am attempting to run this command from a batch file at the command line. I have several hundred... (6 Replies)
Discussion started by: 10000springs
6 Replies

7. Shell Programming and Scripting

Help with gawk array, loop in tcsh script

Hi, I'm trying to break a large csv file into smaller files and use unique values for the file names. The shell script i'm using is tcsh and i'm after a gawk one-liner to get the desired outcome. To keep things simple I have the following example with the desired output. fruitlist.csv apples... (6 Replies)
Discussion started by: theflamingmoe
6 Replies

8. Shell Programming and Scripting

Search IP Address in list of ranges -- not working great

I have been struggling with a script to automate some security related activities. I have it pretty much working, all except the search. I have an input file formatted as such: 216.234.246.158 216.234.246.158 `` 24.249.221.22 24.249.221.200 `` 24.249.226.0 ... (4 Replies)
Discussion started by: tsunami4u
4 Replies

9. Shell Programming and Scripting

[BASH] Gawk + MYSQL script

Hello! I've got script to write. It should read databases (names, volumes) from table testdatabase and compares it to actually existing databases in /var/lib/mysql/. If there is no informations about database in table - we should see information "There is no declared informations about database... (1 Reply)
Discussion started by: Zimny
1 Replies

10. Shell Programming and Scripting

Gawk program not working in a script

I've written a very simple gawk program which runs when I execute it at the POSIX shell but the corresponding '.awk' script I wrote doesn't return any data. I'm on an HP-UX running gawk version 3.1. (w/all the defaults) (As you can probably guess I'm a newbie going through the manual and trying... (2 Replies)
Discussion started by: RUCerius
2 Replies

LEARN ABOUT PHP

ale

ALE(1)																	    ALE(1)

NAME

       ale - a synthetic capture engine and renderer

SYNOPSIS

       ale [OPTIONS] original-frame [supplemental-frames ...] output-file

       ale [HELP OPTIONS]

       ale --version

DESCRIPTION

       ALE is a free software synthetic capture engine and renderer accepting, as input, a sequence of image frames, and producing, as output,
       rendered images, registration data, and 3D models (currently experimental).

EXAMPLES

       ale --hu
	   Print the help page on program usage.

       ale 001.ppm 002.ppm 003.ppm out.ppm
	   Render output file out.ppm from inputs 001.ppm, 002.ppm, and 003.ppm.

       ale --scale 2 001.ppm 002.ppm 003.ppm out.png
	   Render output file out.png at 2x scale.

       ale --perturb-upper=0 --trans-load=a.t --projective frame*.png out.png
	   Render output file out.png from inputs frame*.png, using projective transformations as described in the file a.t.

       ale --3dv 0 out.png --projective frame*.png null:
	   Render output file out.png from inputs frame*.png, using a 3D scene model to determine transformations.

       ale --visp last:sinc*lanc:6 sf:0 out/ .jpg in/*.jpg null:
	   Render a video stream from files in/*.jpg to the directory out/, stabilizing to the first frame, with a lanczos-windowed sinc filter.

USAGE

       ale is a wrapper script that calls the executable ale-bin after extracting exposure EXIF information from image files (when the exiftool
       utility is available) and converting from raw formats (when the dcraw utility is available).

       When ale-bin has been linked with ImageMagick, input and output files may be of any kind supported by ImageMagick. Otherwise, only PPM
       files can be read and written by ale-bin.

OPTIONS

       OPTIONS are summarized via built-in help pages (see HELP OPTIONS below). More detailed manuals describing options and internal algorithms
       are available for certain versions of ALE. See SEE ALSO below for more details on other manuals.

HELP OPTIONS

       A listing of available help options can be obtained by invoking ale --hu.

ENVIRONMENT

       The wrapper script ale recognizes the following environment variables:

       ALE_BIN
	   ALE executable to use.

       DCRAW
	   dcraw raw extraction tool to use.

       EXIF_UTILITY
	   EXIF extraction utility to use.

       ALE_COUNT_THREADS
	   Displays statistics on thread counts when set to a non-zero value.

       PAGER
	   Text pager to use (e.g., for displaying help pages).

SEE ALSO

       More detailed manuals for certain versions of ALE are distributed with source packages, and may also be available from:

       http://auricle.dyndns.org/ALE/manuals/

								    03/31/2009								    ALE(1)
All times are GMT -4. The time now is 06:59 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy