How to segregate a section from big file?


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to segregate a section from big file?
# 1  
Old 11-30-2018
How to segregate a section from big file?

Hello,

I need to know all IP range (ip_prefix), associated with us-west-2 region only from this link - https://ip-ranges.amazonaws.com/ip-ranges.json (it can be opened in wordpad for better visibility)
Please suggest, how would I do it. If vi, awk or sed is needed, I have downloaded it on my linux server.

Thanks
# 2  
Old 11-30-2018
With 470 posts in these fora over the last 7 1/2 years, we'd expect that you at least have an idea of how to approach that problem. Would you mind to share this with us?
# 3  
Old 12-01-2018
I am great in scripting and I tried few examples in if and then loop, but failed attempts.
From other blog, I am able to achieve my purpose
PHP Code:
curl https://ip-ranges.amazonaws.com/ip-ranges.json | jq '.prefixes[] | select(.region == "us-west-2")' | more 
# 4  
Old 12-01-2018
I suppose you are reading the following document :
AWS IP Address Ranges - Amazon Web Services

If we look at the example 5 and 6 in the documentation, it is quite close to your requirement.
You do not need to pipe the json parser output to additional shell commands to parse, it should be able to parse JSON format as you wish.
See if this is what you want..
Code:
curl https://ip-ranges.amazonaws.com/ip-ranges.json | jq '.prefixes[] | select (.region=="us-west-2") | .ip_prefix'


This is my first time using the jq tool, the one used is from debian repositories.
Code:
jq --version
jq-1.5-1-a5b5cbe

Regards
Peasant.
This User Gave Thanks to Peasant For This Post:
# 5  
Old 12-01-2018
Quote:
Originally Posted by Peasant
I suppose you are reading the following document :
AWS IP Address Ranges - Amazon Web Services

If we look at the example 5 and 6 in the documentation, it is quite close to your requirement.
Yes, I did, but I was not able to run that command, even if I have configured AWS cli on my computer.
But curl+jq worked very well. Thanks
# 6  
Old 12-01-2018
I was referring to Example 5 and 6 when using jq tool, lower in the documentation, under Linux header.
Be sure to read the documentation carefully and hit specific section which apply to your environment.

Regards
Peasant.
# 7  
Old 12-01-2018
Yes, I got it now. Somehow I skipped this part earlier. Thanks for pointing it out.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Segregate file content using sed backreference

I have some text like EU1BTDAT:ASSGNDD filename='$SEQFILES/SUNIA.PJ008202.CARDLIB/DATECARD' EU1BTDATEST:ASSGNDD filename='$SEQFILES/SUNIA.PJ008202.CARDLIB/DATECARD' EU1CLOSEDATES:ASSGNDD filename='$SEQFILES/SUNIA.PJ008202.CARDLIB/DATECARD' EU1DATED:ASSGNDD... (8 Replies)
Discussion started by: gotamp
8 Replies

2. Shell Programming and Scripting

Segregate by suffixed file names using Korn Shell

I have following files at /dir1 a.csv.20131201 b.csv.20131201 c.csv.20131201 d.csv.20131201 a.csv.20131202 b.csv.20131202 c.csv.20131202 d.csv.20131202 ....................... ....................... ....................... ....................... I need to move these files to... (4 Replies)
Discussion started by: JaisonJ
4 Replies

3. Shell Programming and Scripting

How can i segregate?

I have this file which contains 91886,000,MiniC2-00,1.9.12,aML,en 91886,000,MiniC2-00,1.9.12,aML,en 91886,000,MiniC2-00,1.9.12,aML,en 91886,000,MiniC2-00,1.9.12,aML,en 91886,000,MiniC2-00,1.9.12,aML,en 91886,000,MiniC2-00,1.9.12,aML,en 91886,000,MiniC2-00,3.0,aML,en... (6 Replies)
Discussion started by: nikhil jain
6 Replies

4. Shell Programming and Scripting

Fetch a section from a file

Hi, I have a file like... $cat file1 +++++++++++++++++++ client1 +++++++++++++++++++++++++++++ col1 col2 col3 ------ ----- ----- (0 rows affected) ========================================================= +++++++++++++++++++ client1 +++++++++++++++++++++++++++++ col1 col2 col3... (6 Replies)
Discussion started by: sam05121988
6 Replies

5. Shell Programming and Scripting

Delete a section of a file if...

i have a file as below that has n section : 2006 0101 1236 49.3 L 37.902 48.482 0.0 Teh 5 0.2 2.7LTeh 1 GAP=238 E Iranian Seismological Center, Institute of Geophysics, University of Tehran 6 ... (5 Replies)
Discussion started by: oreka18
5 Replies

6. Shell Programming and Scripting

Extract section of file based on word in section

I have a list of Servers in no particular order as follows: virtualMachines="IIBSBS IIBVICDMS01 IIBVICMA01"And I am generating some output from a pre-existing script that gives me the following (this is a sample output selection). 9/17/2010 8:00:05 PM: Normal backup using VDRBACKUPS... (2 Replies)
Discussion started by: jelloir
2 Replies

7. UNIX for Dummies Questions & Answers

How big is too big a config.log file?

I have a 5000 line config.log file with several "maybe" errors. Any reccomendations on finding solvable problems? (2 Replies)
Discussion started by: NeedLotsofHelp
2 Replies

8. Shell Programming and Scripting

segregate the file based on matching patterns

print 'test' SETUSER 'dbo' go create proc abc as /Some code here/ go SETUSER go print 'test1' SETUSER 'dbo' go Create Procedure xyz as /some code here/ go SETUSER go print 'test2' SETUSER 'dbo' (2 Replies)
Discussion started by: mad_man12
2 Replies

9. Shell Programming and Scripting

cutting a section of a big file

Hi, I have a text file 10giga size. Opening the file with vi takes forever ... Im intersting only with the 100 first records. Is there way to copy those 100 lines to new file (with no need to open the file)? Thanks (6 Replies)
Discussion started by: yoavbe
6 Replies

10. UNIX for Dummies Questions & Answers

How to view a big file(143M big)

1 . Thanks everyone who read the post first. 2 . I have a log file which size is 143M , I can not use vi open it .I can not use xedit open it too. How to view it ? If I want to view 200-300 ,how can I implement it 3 . Thanks (3 Replies)
Discussion started by: chenhao_no1
3 Replies
Login or Register to Ask a Question

Featured Tech Videos