Remove duplicate text - The UNIX and Linux Forums

		The UNIX and Linux Forums > Top Forums > Shell Programming and Scripting
Remove duplicate text

google unix.com

Shell Programming and Scripting Post questions about KSH, CSH, SH, BASH, PERL, PHP, SED, AWK and OTHER shell scripts and shell scripting languages here.

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
how to remove duplicate lines	fredao	Shell Programming and Scripting	3	12-13-2006 12:51 PM
Remove duplicate	sabercats	Shell Programming and Scripting	2	03-31-2006 01:35 PM
Remove duplicate ???	sabercats	Shell Programming and Scripting	3	03-10-2006 07:06 PM
Remove Duplicate line	Student37	UNIX for Dummies Questions & Answers	1	02-22-2005 03:00 PM
remove duplicate	kazanoova2	Shell Programming and Scripting	4	04-12-2004 01:35 AM


	Powered by

LinkBack

Thread Tools

Search this Thread

Rate Thread

Display Modes

#1 (permalink)

06-07-2008

dejavu88

Registered User

Join Date: May 2008

Posts: 18

Remove duplicate text

Hello,

I have a log file which is generated by a script which looks like this:

Code:

userid: 7
starttime: Sat May 24 23:24:13 CEST 2008
endtime: Sat May 24 23:26:57 CEST 2008
total time spent: 2.73072 minutes / 163.843 seconds
date: Sat Jun 7 16:09:03 CEST 2008

userid: 8
starttime: Sun May 25 00:14:30 CEST 2008
endtime: Sun May 25 00:14:32 CEST 2008
total time spent: 0.0304667 minutes / 1.828 seconds
date: Sat Jun 7 16:10:02 CEST 2008

userid: 9
starttime: Sun May 25 00:14:30 CEST 2008
endtime: Sun May 25 00:14:32 CEST 2008
total time spent: 0.0304667 minutes / 1.828 seconds
date: Sat Jun 7 16:11:01 CEST 2008

Everytime when I run the script, it will increase the userid by one and adds information(start time, end time etc).
Anyone knows if there is an efficient way to remove the whole last block of text when its starttime or endtime or both is duplicate of the previous block?

Thanks in advance.

Bookmarks

« sum | removing comments from file »

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Switch to Hybrid Mode Threaded Mode	Rate This Thread:

Posting Rules
You may not post new threads You may not post replies You may not post attachments You may not edit your posts BB code is On Smilies are On [IMG] code is On HTML code is Off Trackbacks are On Pingbacks are On Refbacks are On Forum Rules

All times are GMT -4. The time now is 04:03 PM.