Convert ip ranges to CIDR netblock Post: 303027397

Sponsored Content

Top Forums Shell Programming and Scripting Convert ip ranges to CIDR netblock Post 303027397 by vgersh99 on Friday 14th of December 2018 03:53:15 PM

12-14-2018

Moderator

Quote:

Originally Posted by azdps

Thank you vgersh99 for the modified script. I'm using an Intel Celeron N2930 on my OpenBSD box so the timings are definitely different. I appreciative the time you've spent looking into this script. Hopfeuly others can find this beneficial in the future.

I wish I would have posted how I downloaded and parsed the downloaded file which was redirected to a temp file before you refined the script. I'm going to post it now to show you what my downloaded file looks like prior to me processing it using the script and gawk.

ftp -V -o - http://list.iblocklist.com/?list=ydx...chiveformat=gz | gunzip -c | grep -v '#' | sed '/^$/d' | sed 's/.*://' | sed 's/-/ - /' >> temp

Also the awk version that OpenBSD is currenly using is:
awk version 20110810

The version was obtained using the command awk -V

you can get rid of all the grep-s/sed-s and pipe it directly into the modified script (without any temp file).
Good luck.

This User Gave Thanks to vgersh99 For This Post:

vgersh99

View Public Profile for vgersh99

Find all posts by vgersh99

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Get IP list from CIDR

Dear Srs :-) I'm looking for a shell script, that given a network in CIDR format it lists all IPs, for example: Preferredly a shell script, but a Perl, Python, C, etc.. is also welcome :-) I have been looking in sipcalc, ipcalc, etc.. options but this feature is not implemented :-( ...

2. Shell Programming and Scripting

date ranges

Hi, Please anyone help to achive this using perl or unix scripting . This is date in my table 20090224,based on the date need to check the files,If file exist for that date then increment by 1 for that date and check till max date 'i.e.20090301 and push those files . files1_20090224...

3. Programming

How to parse IP range in CIDR format in C

Hello everybody, I'm coding a network program and i need it to "understand" ip ranges, but i don't know how to make to parse an IP CIDR range, let's say "172.16.10.0/24" to work with the specified IP range. I've found a program which does it, but i don't understand the code. Here is the...

4. UNIX for Dummies Questions & Answers

Need help filling in ranges

I have a list of about 200,000 lines in a text file that look like this: 1 1 120 1 80 200 1 150 270 5 50 170 5 100 220 5 300 420 The first column is an identifier, the next 2 columns are a range (always 120 value range) I'm trying fill in the values of those ranges, and remove...

5. Shell Programming and Scripting

Values between ranges

Hi, I have two files file1 chr1_22450_22500 chr2_12300_12350 chr1_34500_34550 file2 11000_13000 15000_19000 33000_44000 If the file 1 ranges fall between file2 ranges then assign the value of file2 in column 2 to file1 output: chr2_12300_12350 11000_13000 chr1_34500_34550 ...

6. Shell Programming and Scripting

How to convert multiple number ranges into sequence?

Looking for a simple way to convert ranges to a numerical sequence that would assign the original value of the range to the individual numbers that are on the range. Thank you given data 13196-13199 0 13200 4 13201 10 13202-13207 3 13208-13210 7 desired...

7. Shell Programming and Scripting

How to change ip addressing format from CIDR notation to netmask and vice versa?

Hi all, I would appreciate if someone could share how to convert CIDR notation to netmask and vice versa. The value below is just an example. it could be different numbers/ip addresses. Initial Output, let say file1.txt Final Output, let say file2.txt

8. Shell Programming and Scripting

Convert ip ranges to CIDR netblocks

Hi, Recently I had to convert a 280K lines of ip ranges to the CIDR notation and generate a file to be used by ipset (netfilter) for ip filtering. Input file: 000.000.000.000 - 000.255.255.255 , 000 , invalid ip 001.000.064.000 - 001.000.127.255 , 000 , XXXXX 001.000.245.123 -...

9. What is on Your Mind?

Blocked A6-Index and Entire AWS Netblock

Weary of seeing our load average go up to 50+, I just did a major block on these networks (stats over a less than 20 min interval): https://www.unix.com/members/1-albums215-picture866.png

LEARN ABOUT DEBIAN

simplify

SIMPLIFY(1)						      General Commands Manual						       SIMPLIFY(1)

NAME

       simplify - a script to simplify a MIME message

SYNOPSIS

       simplify [args ...] < message > othermessage

DESCRIPTION

       This manual page documents briefly the simplify command.  simplify is a Perl script to simplify a MIME message.

       This script never loads the entire message into memory, but does dump it's entire contents to disk once.

OPTIONS

       mime=no
	      Don't use MIME, no HTML mail allowed.

       testing=yes
	      Run in testing mode (suppress randonmess)

       saveall=yes
	      Save all attachments to files.

       temp=/path/to/working/dir/
	      Defaults to /tmp.

       url=http://box/path/
	      URL-prefix for printing paths to attachments

       header=text...
	      Text preceding the attachment URL list.

       textsig=/path/to/file
	      Text signature to append to text parts.

       htmlsig=/path/to/file
	      HTML signature to append to HTML parts.

       If  "saveall"  is yes, then the script will save all attachments to disk so people can access their contents later.  If an URL is specified
       then that automatically implies "saveall=yes".  Without this, the default behavior is to only save text and html parts, and delete them and
       all working directories when the script is finished.

SEE ALSO

       sanitizer(1).  More info on configuration: /usr/share/doc/sanitizer/sanitizer.html

AUTHOR

       Bjarni R. Einarsson <bre@klaki.net>

       This manual page was written by Alberto Gonzalez Iniesta <agi@agi.as> for the Debian GNU/Linux system (but may be used by others).

								   May 14, 2003 						       SIMPLIFY(1)