How to print lines from a files with specific start and end patterns and pick only the last lines?

Login or Register to Ask a Question and Join Our Community

How to print lines from a files with specific start and end patterns and pick only the last lines?

Tags

files, lines, newbies, pattern matching, print, start

Login to Discuss or Reply to this Discussion in Our Community

Top Forums UNIX for Beginners Questions & Answers How to print lines from a files with specific start and end patterns and pick only the last lines?

10-20-2019

Registered User

5, 0

Join Date: Oct 2019

Last Activity: 8 May 2020, 9:16 AM EDT

Posts: 5

Thanks Given: 2

Thanked 0 Times in 0 Posts

How to print lines from a files with specific start and end patterns and pick only the last lines?

Hi, I need to print lines which are matching with start pattern "SELECT" and END PATTERN ";" and only select the last "select" statement including the ";" .
I have attached sample input file and the desired input should be as:

INPUT FORMAT:

Code:

SELECT  
ABCD,
DEFGH,
DFGHJ,
JKLMN,
AXCVB,
DFVBNM,
QWER,
RTU,
TYUI,
IOPL from test1
limit 1;

delete from test2;

SELECT  ABCD,
DEFGH,
DFGHJ,
JKLMN,
AXCVB,
DFVBNM,
QWER,
RTU,
TYUI,
IOPL from test1
limit 1;
create table as SELECT  
ABCD,
DEFGH,
DFGHJ,
JKLMN,
AXCVB,
DFVBNM,
QWER,
RTU,
TYUI,
IOPL from test1
limit 1;

SELECT  ABCD,
DEFGH,
DFGHJ,
JKLMN,
AXCVB,
DFVBNM,
QWER,
RTU,
TYUI,
IOPL from test1
limit 1;


SELECT 
ABCD,
DEFGH,
DFGHJ,
JKLMN,
AXCVB,
DFVBNM,
QWER,
RTU,
TYUI,
IOPL from test1
limit 1;

SELECT  
ABCD,
DEFGH,
from test1
limit 1;

delete from test2;

create table as SELECT  
ABCD,
DEFGH,
DFGHJ,
JKLMN,
AXCVB,
DFVBNM,
QWER,
RTU,
TYUI,
IOPL from test1345
limit 1;

create table as SELECT  ABCD,
DEFGH,
DFGHJ,
JKLMN,
AXCVB,
DFVBNM,
QWER,
RTU,
TYUI,
IOPL from test123
limit 1;

OUTPUT FORMAT

Code:

SELECT  
ABCD,
DEFGH,
from test1
limit 1;

querys.txt.txt (884 Bytes)

Last edited by Scrutinizer; 10-20-2019 at 10:25 PM.. Reason: Code tags

nani2019

View Public Profile for nani2019

Find all posts by nani2019

10-20-2019

Moderator

12,296, 3,792

Join Date: Nov 2008

Last Activity: 1 January 2021, 1:47 AM EST

Location: Amsterdam

Posts: 12,296

Thanks Given: 679

Thanked 3,792 Times in 3,282 Posts

Hi, try:

Code:

awk '$1=="SELECT"{s=$0} END{if(s) print s}' RS= file

This User Gave Thanks to Scrutinizer For This Post:

Scrutinizer

View Public Profile for Scrutinizer

Find all posts by Scrutinizer

10-21-2019

Registered User

5, 0

Join Date: Oct 2019

Last Activity: 8 May 2020, 9:16 AM EDT

Posts: 5

Thanks Given: 2

Thanked 0 Times in 0 Posts

It worked Thanks

nani2019

View Public Profile for nani2019

Find all posts by nani2019

10-21-2019

Registered User

5, 0

Join Date: Oct 2019

Last Activity: 8 May 2020, 9:16 AM EDT

Posts: 5

Thanks Given: 2

Thanked 0 Times in 0 Posts

Hi, Now do i remove the output lines only (staring from start to ; ) from the input file

nani2019

View Public Profile for nani2019

Find all posts by nani2019

10-22-2019

Moderator

3,791, 1,452

Join Date: Oct 2010

Last Activity: 1 August 2020, 1:38 AM EDT

Posts: 3,791

Thanks Given: 183

Thanked 1,452 Times in 1,302 Posts

Try this:

Code:

awk '
$1=="SELECT" {
   printf "%s%s", s, r
   s=$0 RS
   r=""
   next
}
{ r=r $0 RS }
END { 
   gsub(RS"$", "",r)
   printf "%s", r 
}' RS=\; file

This User Gave Thanks to Chubler_XL For This Post:

Chubler_XL

View Public Profile for Chubler_XL

Find all posts by Chubler_XL

10-22-2019

Moderator

3,791, 1,452

Join Date: Oct 2010

Last Activity: 1 August 2020, 1:38 AM EDT

Posts: 3,791

Thanks Given: 183

Thanked 1,452 Times in 1,302 Posts

Another approach is to make two passes of the file, in the first identify the record to be skipped and in the 2nd print everything else:

Code:

awk '
FNR==1 {file++}
file==1 && $1=="SELECT"{skip=FNR}
file==2 && NF && FNR!=skip
' RS=\; ORS=\; file file

Chubler_XL

View Public Profile for Chubler_XL

Find all posts by Chubler_XL

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Selecting text on multiple lines, then removing a beginning and end patterns

I have a file similar to the below. I am selecting only the paragraphs with @inlineifset. I am using the following command sed '/@inlineifset/,/^ *$/!d; s/@inlineifset{mrg, @btpar{@//' $flnm >> $ofln This produces @section Correlations between seismograms,,,,}} ...

2. Shell Programming and Scripting

How to print different multiple lines after two patterns?

Hello, I need to print some lines as explained below, TXT example 1111 2222 3333 4444 5555 6666 7777 8888 6666 9999 1111 2222 3333 4444 5555

3. Shell Programming and Scripting

Match 2 different patterns and print the lines

Hi, i have been trying to extract multiple lines based on two different patterns as below:- file1 @jkm|kdo|aas012|192.2.3.1 blablbalablablkabblablabla sjfdsakfjladfjefhaghfagfkafagkjsghfalhfk fhajkhfadjkhfalhflaffajkgfajkghfajkhgfkf jahfjkhflkhalfdhfwearhahfl @jkm|sdf|wud08q|168.2.1.3...

4. Shell Programming and Scripting

Perl : to print the lines between two patterns

Hello experts, I have a text file from which I need to print all the lines between the patterns. Could anyone please help me with the perl script. names.txt ========= Badger Bald Eagle Bandicoot Bangle Tiger Barnacle Barracuda Basilisk Bass Basset Hound Beetle Beluga...

5. Shell Programming and Scripting

Print all lines between patterns

Hi Gurus, I have a requirement where I need to display all lines between 2 patterns except the line where the first pattern in it. I tried the following command using awk but it is printing all lines except the lines where the 2 patterns exist. awk '/TRANSF_/{ P=1; next } /Busy/ {exit} P'...

6. Shell Programming and Scripting

How to print only lines in between patterns?

Hi, I want to print only lines (green-italic lines) in between first and last strings in column 9. there are different number of lines between each strings. 10 AUGUSTUS exon 4558 4669 . - . 10.g1 10 AUGUSTUS exon 8771 8889 . ...

7. Shell Programming and Scripting

Remove lines between the start string and end string including start and end string Python

Hi, I am trying to remove lines once a string is found till another string is found including the start string and end string. I want to basically grab all the lines starting with color (closing bracket). PS: The line after the closing bracket for color could be anything (currently 'more')....

8. Shell Programming and Scripting

Need to print between patterns AND a few lines before

I need to print out sections (varying numbers of lines) of a file between patterns. That alone is easy enough: sed -n '/START/,/STOP/' I also need the 3 lines BEFORE the start pattern. That alone is easy enough: grep -B3 START But I can't seem to combine the two so that I get everything between the...

9. Shell Programming and Scripting

print lines between 2 matching patterns

Hi Guys, I have file like below, I want to print all lines between test1231233 to its 10 occurrence(till line 41) test1231233 qwe qwe qweq123 test1231233 qwe qwe qweq23 test1231233 qwe qwe qweq123 test1231233 qwe qwe qweq123131

10. Shell Programming and Scripting

Print lines between two repetitive patterns

Hi users I have one file which has number of occurrence of one pattern examples Adjustmenttype,11 xyz 10 dwe 9 abd 13 def 14 Adjustmenttype,11 xyz 24 dwe 34 abd 35 def 11 nmb 12 Adjustmenttype, not eleven .... ... ...

Login or Register to Ask a Question