Extract multiple repeated data from a text file

apjneeraj · #1 (**permalink**) 04-13-2009

Hi,

I need to extract data from a text file in which data has a pattern. I need to extract all repeated pattern and then save it to different files.
example:

input is:

Code:

ST*867*000352214
BPT*00*1000352214*090311
SE*1*1

ST*867*000352215
BPT*00*1000352214*090311
SE*1*2

ST*867*000352216
BPT*00*1000352214*090311
SE*1*3

output is like:

first file:

Code:

ST*867*000352214
BPT*00*1000352214*090311
SE*1*1

second file:

Code:

ST*867*000352215
BPT*00*1000352214*090311
SE*1*2

Third File:

Code:

ST*867*000352216
BPT*00*1000352214*090311
SE*1*3

You see , output is splitted into three different files based on ST-SE segment repeated in the file.

Can anybody please help me to put me close to solution?

Thanks in advance.

Regards,
Neeraj

Franklin52 · #2 (**permalink**) 04-13-2009

Try this:

Code:

awk '/^ST/{++i}{print > "file" i}' textfile

Regards

summer_cherry · #3 (**permalink**) 04-14-2009

seems perl is a good choice to handle it.

Code:

$/="\n\n";
open $fh,"<","a.txt";
while(<$fh>){
	my $tmp=sprintf("%s.txt",$.);
	open my $fh1,">",$tmp;
	print $fh1 $_;
	close $fh1;
}

Whiteboard · #4 (**permalink**) 04-14-2009

Quote:

Originally Posted by Franklin52

Try this:

Code:

awk '/^ST/{++i}{print > "file" i}' textfile

Regards

Please explain your code

Thanks
white

apjneeraj · #5 (**permalink**) 04-14-2009

Thanks all of you.I used the above code and it worked perfectly.

Thanks once again.

Regards
Neeraj

Franklin52 · #6 (**permalink**) 04-14-2009

Quote:

Originally Posted by Whiteboard

Please explain your code

Thanks
white

Code:

awk '/^ST/{++i}{print > "file" i}' textfile

Code:

/^ST/{++i}

If the line begins with ST increase the variable i. The first time the name of the output file is file1, the next time the line begins with ST the name of the output file becomes file2 and so forth.

Code:

{print > "file" i}

Print the line to the file "file"i.

Regards

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
[help]Delete or replace text in multiple file and multiple directory	dzufauzan	Shell Programming and Scripting	16	06-05-2009 12:07 PM
Delete repeated word in text file	vincyoxy	Shell Programming and Scripting	6	03-26-2009 04:10 AM
c program to extract text between two delimiters from some text file	kukretiabhi13	High Level Programming	7	12-03-2008 06:29 PM
How to extract data from a text file	negixx	Shell Programming and Scripting	1	07-19-2005 10:30 PM
Huge (repeated Entry) text files	axl	SUN Solaris	4	07-16-2004 08:05 AM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread:


	Powered by