process text between pattern and print other text


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting process text between pattern and print other text
# 1  
Old 05-07-2009
process text between pattern and print other text

Hi All,


The file has the following.

=========start of file===
This is a file containing employee info

START
name john
id 123
date 12/1/09
END

START
name sam
id 4234
date 12/1/08 resigned
END

Total records 2
Date of extraction: 12-3-09
===end of file========



My requirement is this.

If the text is not between the pattern START and END, then it has be just printed.

If the pattern is between START and END and if the "date" line says "resigned", then I have to remove the entire block of text between START and END. Otherwise I have to have the text between START and END.

For the above file, the required output is with the details of Sam.

=========start of file===
This is a file containing employee info

START
name john
id 123
date 12/1/09
END

Total records 2
Date of extraction: 12-3-09
===end of file========

script using awk is helpful.

Thank you,
Vimala
# 2  
Old 05-07-2009
Try this:

Code:
awk '$0 !~ /START/{print}
$0 ~ /START/
{while ($0 !~ /END/){s=s"\n"$0;getline}s=s"\nEND";
if(s ~ /resigned/){s="";next}else {print s;s=""}}' filename

cheers,
Devaraj Takhellambam
# 3  
Old 05-07-2009
GNU awk
Code:
# awk 'BEGIN{RS=""}!/resigned/' file

# 4  
Old 05-08-2009
Thank you for your help.
HTML Code:
 	awk '$0 !~ /START/{print}
$0 ~ /START/
{while ($0 !~ /END/){s=s"\n"$0;getline}s=s"\nEND";
if(s ~ /resigned/){s="";next}else {print s;s=""}}' filename 
It provided the following output and then hangs. It gave the first line twice. What I want is to remove a block of data between START,END text if text inside the block matches a pattern. The file has many START,END blocks.

==
This is a file containing employee info

This is a file containing employee info

START
name john
id 123
date 12/1/09
END
===

Last edited by vlinet; 05-08-2009 at 01:35 AM..
# 5  
Old 05-08-2009
This worked. Thank you.

Code:
# awk 'BEGIN{RS=""}!/resigned/' file

However, it is missing the blank lines. Is there anyway to get the blank lines as well.

thanks,
Vimala
# 6  
Old 05-08-2009
what blank lines?
# 7  
Old 05-08-2009
The output I get is
===
This is a file containing employee info
START
name john
id 123
date 12/1/09
END
Total records 2
Date of extraction: 12-3-09
===

Whereas the expected output is with the blank lines as it is in the input.
==
This is a file containing employee info

START
name john
id 123
date 12/1/09
END


Total records 2
Date of extraction: 12-3-09
==

Thanks again,
Vimala
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Match text to lines in a file, iterate backwards until text or text substring matches, print to file

hi all, trying this using shell/bash with sed/awk/grep I have two files, one containing one column, the other containing multiple columns (comma delimited). file1.txt abc12345 def12345 ghi54321 ... file2.txt abc1,text1,texta abc,text2,textb def123,text3,textc gh,text4,textd... (6 Replies)
Discussion started by: shogun1970
6 Replies

2. Shell Programming and Scripting

Extract pattern from text

Hi all, I got a txt here and I need to extract all D 8888 44 and D 8888 43 + next field =",g("en")];f._sn&&(f._sn= "og."+f._sn);for(var n in f)l.push("&"),l.push(g(n)),l.push("="),l.push(g(f));l.push("&emsg=");l.push(g(d.name+":"+d.message));var m=l.join("");Ea(m)&&(m=m.substr(0,2E3));c=m;var... (5 Replies)
Discussion started by: stinkefisch
5 Replies

3. Shell Programming and Scripting

Match text and print/pipe only that text

I'm trying to pull an image source url from a html source file. I'm new with regex. I'm in BaSH. I've tried grep -E 'http.*jpg' file which highlights the text, but gives me 2 problems: 1) Results aren't stand alone and can't be piped to another command. (I believe it includes everything in... (5 Replies)
Discussion started by: amx401
5 Replies

4. UNIX for Dummies Questions & Answers

How to create a print filter that print text & image?

Currently, I have a print filter that takes a text file, that convert it into PCL which then gets to a HP printer. This works. Now I need to embedded a image file within the text file. I'm able to convert the image file into PCL and I can cat both files together to into a single document... (1 Reply)
Discussion started by: chedlee88-1
1 Replies

5. Shell Programming and Scripting

copying text from between a pattern and *

Hej all, I have a LS-DYNA keyword file which I want to extract the node coordinates from it to another file for processing and then returning the result coordinates to the same place, the structure of the file is like: Keyword file: 5010497 -266.6623535 -446.2596130 ... (3 Replies)
Discussion started by: Johanni
3 Replies

6. UNIX for Dummies Questions & Answers

print multiple lines from text file based on pattern list

I have a text file with a list of items/patterns: ConsensusfromCGX_alldays_trimmedcollapsedfilteredreadscontiglist(229095contigs)contig12238 ConsensusfromCGX_alldays_trimmedcollapsedfilteredreadscontiglist(229095contigs)contig34624... (1 Reply)
Discussion started by: Oyster
1 Replies

7. Shell Programming and Scripting

How to print text between two pattern in one line?

Hello all, I have one input file like this: List 1 mail a mail b mail c List 2 mail d mail e mail f mail g List 3 mail h mail i And I want something like that by using linux: List 1,mail a,mail b,mail c (4 Replies)
Discussion started by: benitto
4 Replies

8. Shell Programming and Scripting

How to remove all text except pattern

i have nasty html file with 2000+ simbols in 1 row...i need to remove whole the code except title="Some title..." and store those into file with titles (the whole text is in variable text) i've tried something like this: echo $text | sed 's/.*\(title=\".+\"\).*/\1/' > titles.html BUT it does... (13 Replies)
Discussion started by: Lukasito
13 Replies

9. Shell Programming and Scripting

sed: Find start of pattern and extract text to end of line, including the pattern

This is my first post, please be nice. I have tried to google and read different tutorials. The task at hand is: Input file input.txt (example) abc123defhij-E-1234jslo 456ujs-W-abXjklp From this file the task is to grep the -E- and -W- strings that are unique and write a new file... (5 Replies)
Discussion started by: TestTomas
5 Replies

10. Shell Programming and Scripting

Search text from a file and print text and one previous line too

Hi, Please let me know how to find text and print text and its previous line. Please don't get irritated few days back I asked text and next line. I am using HP-UX 11.11 Thanks for your help. (6 Replies)
Discussion started by: kamranjalal
6 Replies
Login or Register to Ask a Question