Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Extract all the lines in between of 2 patterns and merge them

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Extract all the lines in between of 2 patterns and merge them
# 1  
Old 11-23-2013
Extract all the lines in between of 2 patterns and merge them
Hi,

I have a file with many lines and need to extract lines between 2 patterns (AAA and BBB) and merge all the in-between lines into single line separated by space.

Code:
$ cat file1
blah blah blah
blah AAA
1
2
3
blah BBB
blah blah blah
blah blah blah
blah blah blah
AAA
5
6
blah blah BBB
blah blah blah

admin@admin-PC /tmp
$

And I tried the below with little success Smilie

Code:
admin@admin-PC /tmp
$ awk '/AAA/{a=1;next}/BBB/{a=0}a' file1
1
2
3
5
6

admin@admin-PC /tmp

But I need the output as below:

Code:
1 2 3
5 6

Please advise, thanks a lot!!
Last edited by prvnrk; 11-23-2013 at 10:05 PM..
# 2  
Old 11-23-2013
Code:
awk '/AAA/ {ok=1;next} /BBB/ {ok=0;print ""; next} {if(ok){printf("%s ", $0) } }' inputfile > newfile

# 3  
Old 11-23-2013
Another approach:
Code:
awk '/AAA/{f=1;next}/BBB/{print s;f=s=""}f{s=s?s OFS $0:$0}' file

# 4  
Old 11-24-2013
Some more awk for given input

Code:
$ awk '/AAA/,/BBB/{printf /^[0-9]/? $0 OFS : /BBB/ ? RS : NULL }' file
1 2 3 
5 6

Code:
$ awk '/AAA/{s=1}s && /^[0-9]/,/^[0-9]/{printf $0 OFS}/BBB/{s=0;printf RS}' file
1 2 3 
5 6

Code:
$ awk '/AAA/{x=1;getline}/BBB/{printf RS;x=0}x{printf $0 OFS}' file
1 2 3 
5 6

Code:
$ awk '/AAA/,/BBB/{printf /BBB/ ? RS : gsub(/[[:alpha:]]/,x) == 0 ? $0 OFS : NULL }' file
1 2 3 
5 6

Last edited by Akshay Hegde; 11-24-2013 at 02:03 AM..
# 5  
Old 11-24-2013
With a trailing space:
Code:
awk '/BBB/{p=0; printf RS}p; /AAA/{p=1}' ORS=" " file


--
@Akshay:
Unless you are printing a constant, it is best to use a format string with printf.
Last edited by Scrutinizer; 11-24-2013 at 06:39 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

How to print lines from a files with specific start and end patterns and pick only the last lines?

Hi, I need to print lines which are matching with start pattern "SELECT" and END PATTERN ";" and only select the last "select" statement including the ";" . I have attached sample input file and the desired input should be as: INPUT FORMAT: SELECT ABCD, DEFGH, DFGHJ, JKLMN, AXCVB,... (5 Replies)
Discussion started by: nani2019
5 Replies

2. UNIX for Beginners Questions & Answers

Delete multiple lines between blank lines containing two patterns

Hi all, I'm looking for a way (sed or awk) to delete multiple lines between blank lines containing two patterns ex: user: alpha parameter_1 = 15 parameter_2 = 1 parameter_3 = 0 user: alpha parameter_1 = 15 parameter_2 = 1 parameter_3 = 0 user: alpha parameter_1 = 16... (3 Replies)
Discussion started by: ce9888
3 Replies

3. Shell Programming and Scripting

Extract lines between patterns

I have a list in the format below, how do I read through the list and extract the lines between the ##START## and ##END##, so i can check for specific values between each ##START## & ##END## pattern ##START## RANDOMTEXT DFGSD SDFSDF ##END## ##START## morestuff sdfggfg sdfsdf... (10 Replies)
Discussion started by: squrcles
10 Replies

4. Debian

Extract Lines Between 2 patterns if exist...

Hello. I am not having luck with sed or awk today. $ echo "$BrackListFinal" DSCF3649-DSCF3651_Brkt DSCF3649.JPG 2014-07-21 13:34:44 On 1 DSCF3649.RAF 2014-07-21 13:34:44 On 1 DSCF3650.JPG 2014-07-21 13:34:45 On 2 DSCF3650.RAF 2014-07-21 13:34:45 On 2... (3 Replies)
Discussion started by: DSommers
3 Replies

5. Shell Programming and Scripting

Find matched patterns in a column of 2 files with different size and merge them

Hi, i have input files like below:- input1 Name Seq_ID NewID Scores MT1 A0QZX3 1.65 277.4 IVO A0QZX3 1.65 244.5 HPO A0QZX3 1.65 240.5 RgP A0Q3PP 5.32 241.0 GX1 LPSZ3S 96.1 216.9 MEL LPSS3X 4.23 204.1 LDD LPSS3X 4.23 100.2 input2 Fac AddName NewID ... (9 Replies)
Discussion started by: redse171
9 Replies

6. Shell Programming and Scripting

Extract line between two patterns

Hi All, I need a script to extract a lines between two patterns.I have done this using grep,cut,tail and head.But its very slow, because my input file contain more than a lakh. COMMAND:XXXXXXXXXXXXXXXXXXXX yyyyy zzzzzz REQUESTSTRING:aaaaaaaaaaaaaaa;11111 222222 333333... (4 Replies)
Discussion started by: rajamohan
4 Replies

7. Shell Programming and Scripting

PERL: extract lines between two patterns

Hello Perl-experts, I am new to perl and need help to solve a problem. I have a table in below format. <Text A> <Pattern1> A Value B Value C Value D Value <Pattern2> <Text B> This table is in file1. I want to extract lines between Pattern1 and Pattern2 and write it into file2.... (11 Replies)
Discussion started by: mnithink
11 Replies

8. Shell Programming and Scripting

Extract certain patterns from file.

Hi All, I tried extracting this pattern using grep but it did not work. What I have is a file which has contents like this: file:///channel/add-adhd.html file:///channel/allergies.html file:///channel/arthritis.html http://mail.yahoo.com/ http://messenger.yahoo.com/... (2 Replies)
Discussion started by: shoaibjameel123
2 Replies

9. Shell Programming and Scripting

Searching patterns in 1 file and deleting all lines with those patterns in 2nd file

Hi Gurus, I have a file say for ex. file1 which has 3500 lines in it which are different account numbers and another file (file2) which has 230000 lines in it. I want to read all the lines in file1 and delete all those lines from file2 which has that same pattern as in file1. I am not quite... (4 Replies)
Discussion started by: toms
4 Replies

10. Shell Programming and Scripting

To extract the string between two patterns

Sample input: Loading File System Networking in nature Closing the System now i need to extract the patterns between the words File and Closing: i.e. sample output: System Networking in Nature Thanks in advance !!!!!!!!!!!!!!!!! (6 Replies)
Discussion started by: aajan
6 Replies
Login or Register to Ask a Question