Help with shell script filtering IPs


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with shell script filtering IPs
# 1  
Old 06-29-2014
Computer Help with shell script filtering IPs

Hello gentlemen.
I would like to create a shell script (no perl or python please) to generate a list with those rules.

Let's suppose I've this text file:

Code:
 a@A:soss(z)1.1.1.1
Opt!o:2.1.9.55
Azxk<ji>rC211.111.9.0-251.11.34.9
  d=211.9.1.3
                  O.Oox 2.1.2.4-51.9.1.33
§°ç11.9.1.9

I would like to retain only numeric ips, here is the final output I would like to obtain:

Code:
1.1.1.1
2.1.9.55
211.111.9.0-251.11.34.9
211.9.1.3
2.1.2.4-51.9.1.33
11.9.1.9

Notes:
1) all '-' s between the Ips are valid and i want to retain them;
2) the list is pretty long (~10mb)
3) sorting and dupes are not important

Can someone help me?
# 2  
Old 06-29-2014
Check if your grep has the -o option (what is your OS?). If so, you could try:
Code:
grep -Eo '([0-9]+\.){3}[0-9]+(-([0-9]+\.){3}[0-9]+)?' file

# 3  
Old 06-29-2014
Apparently works but it removes a lot of valid 'entries': I've removed manually all the entries by myself and the final list is around 14mb. With your grep command the output file is arount 7.8mb (which means half valid entries are removed).
# 4  
Old 06-29-2014
Can you provide examples of valid entries that are removed?
# 5  
Old 06-29-2014
Quote:
Originally Posted by Scrutinizer
Can you provide examples of valid entries that are removed?
Found a couple of lines that has been removed:

38.101.48.170 TEXT HERE:38.101.48.0-38.101.48.255
Erie Eoege e Eeeel:146.20.0.0-146.20.255.255
# 6  
Old 06-29-2014
When I use that with the grep statement, I get:
Code:
38.101.48.170
38.101.48.0-38.101.48.255
146.20.0.0-146.20.255.255

What do you get?
# 7  
Old 06-29-2014
You are right, those lines are infact intact. I'm still in the process of checking what happened... it's not easy to check a 15mb text file... Smilie
Edit: it works, my fault. Thanks so much for help.

Last edited by accolito; 06-29-2014 at 12:16 PM.. Reason: my fault, it works.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Solaris

IPS postinstall script

Hi guys, I'm creating custom package for deploying a bunch of public keys for some root servers we have. I have created script and it works but my problem is how to call this script when I want deploy package with puppet on server? Oracle documentation provided only example for first boot script... (0 Replies)
Discussion started by: solaris_user
0 Replies

2. Shell Programming and Scripting

Shell script filtering

Hi, I have a file contains log information per line: user=test1 group=test1 ctime=1411615875 qtime=1411615875 etime=1411615875 start=1411615876 resources_used.mem=390792kb resources_used.vmem=8844720kb resources_used.walltime=8 How can extract only user=test1 and resources_used.walltime=8: ... (2 Replies)
Discussion started by: hce
2 Replies

3. Shell Programming and Scripting

Help with shell script - filter txt file full of ips

Hello again gentlemen. I would like to make a shell script to 'optimize' a plain text full of IPs. Let's suppose to have this text file: 1.192.63.253-1.192.63.253 1.0.234.46/32 1.1.128.0/17 1.116.0.0/14 1.177.1.157-1.177.1.157 1.23.22.19 1.192.61.0-1.192.61.99 8.6.6.6 I want to... (2 Replies)
Discussion started by: accolito
2 Replies

4. Shell Programming and Scripting

Need help with a script to track IPs

Please tell me the script, if any user ping my pc so leave his ip, mac and other identity on my pc. (1 Reply)
Discussion started by: abhihot95
1 Replies

5. Shell Programming and Scripting

Need help for filtering a file through awk script

Hello Folks, I am working on filtering a file having some special characters. Let's say for an example a file contains person name and phone number based on positions. First 5 characters name and next 10 characters phone number. My task is to , if there is any special character in phone number... (6 Replies)
Discussion started by: dinesh1985
6 Replies

6. Shell Programming and Scripting

script for automatic table filtering

Hello everyone! i I'm trying to write a script that can filter data in a text file. the source file looks like this the result file should look like this As you can see mostly i need to delete fields like _219402757693 and date - time 12.07.2012 8:49:06 i know that it's possible to... (0 Replies)
Discussion started by: o28
0 Replies

7. Programming

need help with shell script filtering files and sort! newbie question?

Hi folks, I would like to get familiar with shell script programing. The first task is: write a shell script that: scans your home-folder + sub-directory for all txt-files that all users of your group are allowed to read and write then output these files sorted by date of last... (4 Replies)
Discussion started by: rollinator
4 Replies

8. UNIX for Dummies Questions & Answers

Filtering using Shell Script

Hello, I am writing a small script which I want to get the values from several files and output the hits result, i.e. week1.hits includes the following, Mon Feb 4 22:02:35 GMT 2008 Tue Feb 5 23:22:12 GMT 2008 Sat Feb 9 01:56:16 GMT 2008 A sample of my script is this, #!/bin/bash ... (0 Replies)
Discussion started by: nitrous642
0 Replies

9. Shell Programming and Scripting

Shell script to ping a range of IPs

Hi Can someone give me a shell script that can ping a range of IPs and return IPs which are not pingable. Range for example say 192.168.0.1 to 192.168.0.50 and whichever are not pingable then return the IP. Thanks for your help (3 Replies)
Discussion started by: tannu
3 Replies

10. Shell Programming and Scripting

Issues with filtering duplicate records using gawk script

Hi All, I have huge trade file with milions of trades.I need to remove duplicate records (e.g I have following records) 30/10/2009,trdeId1,..,.. 26/10/2009.tradeId1,..,..,, 30/10/2009,tradeId2,.. In the above case i need to filter duplicate recods and I should get following output.... (2 Replies)
Discussion started by: nmumbarkar
2 Replies
Login or Register to Ask a Question