Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Help with shell script - filter txt file full of ips

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with shell script - filter txt file full of ips
# 1  
Old 07-02-2014
Computer Help with shell script - filter txt file full of ips
Hello again gentlemen.
I would like to make a shell script to 'optimize' a plain text full of IPs.
Let's suppose to have this text file:

Code:
1.192.63.253-1.192.63.253
1.0.234.46/32
1.1.128.0/17
1.116.0.0/14 
1.177.1.157-1.177.1.157 
1.23.22.19
1.192.61.0-1.192.61.99
8.6.6.6

I want to retain all CIDRs, single ips and ranges, like this:

Code:
1.192.61.0-1.192.61.99
1.23.22.19
1.0.234.46/32
1.1.128.0/17
1.116.0.0/14
8.6.6.6

and those other kind of ips:

Code:
1.192.63.253-1.192.63.253
1.177.1.157-1.177.1.157

I want to simply look like this:
Code:
1.192.63.253
1.177.1.157

That's it. Thanks so much for your attention and patience.
Have a nice day. Smilie
Last edited by accolito; 07-02-2014 at 04:28 AM..
# 2  
Old 07-02-2014
Code:
awk '$1==$2 {NF--} 1' FS=- file

# 3  
Old 07-02-2014
Quote:
Originally Posted by CarloM
Code:
awk '$1==$2 {NF--} 1' FS=- file

Thanks CarloM. That worked perfectly Smilie Smilie
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Shell script to filter certain lines from a file

hi~ i need script on AIX. and have a text file following : create aa 1 2 3 from a@a; create bb from b; create cc 3 4 5 6 6 7 from c@c; (7 Replies)
Discussion started by: tomato00
7 Replies

2. Shell Programming and Scripting

Help with Shell Scrip in Masking particular columns in .csv file or .txt file using shell script

Hello Unix Shell Script Experts, I have a script that would mask the columns in .csv file or .txt file. First the script will untar the .zip files from Archive folder and processes into work folder and finally pushes the masked .csv files into Feed folder. Two parameters are passed ... (5 Replies)
Discussion started by: Mahesh G
5 Replies

3. Shell Programming and Scripting

Shell script to filter records in a zip file that contains matching columns from another file

Not sure if this is the correct forum for this question. I have two files. file1.zip, file2 Input: file1.zip col1, col2 , col3 a , b , 0:0:0:0:0:c436:9346:d40b x, y, 0:0:0:0:0:880:39f9:c9a7 m, n , 0:0:0:0:0:80c7:9161:fe00 file2.txt col1 c4:36:93:46:d4:0b... (1 Reply)
Discussion started by: anil.v
1 Replies

4. UNIX for Dummies Questions & Answers

Shell script to read lines in a text file and filter user data Shell Programming and Scripting

sxsaaas (3 Replies)
Discussion started by: VikrantD
3 Replies

5. UNIX for Dummies Questions & Answers

C-Shell script help reading from txt file

I need to write a C-Shell script with these properties: It should accept two arguments on the command line. The first argument is the name of a file which contains a list of names, and the second argument is the name of a directory. For each file in the directory, the script should print the... (1 Reply)
Discussion started by: cerce
1 Replies

6. Shell Programming and Scripting

Shell script to send an email from the txt file

Hi Friends, Could you guys help me out of this problem... I need to send an email to all the users and the email has to be picked from the text file. text file contains the no. of records like: giridhar 224285 847333 giridhar276@gmail.com ramana 84849 33884 venkata.ramana@gmail.com... (6 Replies)
Discussion started by: giridhar276
6 Replies

7. Shell Programming and Scripting

Filter a list of IPs

Hello, I have a dump of IPs (around 2 million) and i need to filter out(delete) 37 IPs from this list. Here is a short list of IPs that i would need deleted 111.111.xxx.xxx 123.123.xxx.xxx 127.x.x.x 98.20.xx.xxx 10.135.xxx.xxx 11.105.xxx.xx 100.100.xxx.xxx 101.xxx.xx.xxx ... (11 Replies)
Discussion started by: senormarquez
11 Replies

8. Shell Programming and Scripting

how do I filter double lines from a txt file

Hi, I have a file with the following: access-list.txt router1 access-list 1 permit any any access-list 1 deny any any router2 access-list 2 permit any any access-list 2 deny any any router3 access-list 3 permit any any access-list 3 deny any any I want to hava an output that... (10 Replies)
Discussion started by: I-1
10 Replies

9. Shell Programming and Scripting

need help--script to filter specific lines from multiple txt files

Hi folks, - I have 800 txt files - those files are cisco router configs router1.txt router2.txt ... router800.txt I want to accomplish the following: - I want to have a seperate file with all the filenames that I want to process - I want a script that goes trough all those... (7 Replies)
Discussion started by: I-1
7 Replies

10. AIX

How to edit txt file by shell script?

What I want to do is just delete some lines from a text file, I know it's easy using copy and redirect function, but what I have to do is edit this file (delete the lines) directly, as new lines may be added to the text file during this period. Can AIX do this ? # cat text 1:line1 2:line2... (3 Replies)
Discussion started by: dupeng
3 Replies
Login or Register to Ask a Question