Remove duplicate occurrences of text pattern

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Remove comments like pattern from text

Hi , We need to remove comment like pattern from a code text. The possible comment expressions are as follows. Input BizComment : Special/*@ Name:bzt_53_3aea640a_51783afa_5d64_0 BizHidden:true @*/ /* lookup Disease Category Therapuetic Class */ a=b;...

2. Shell Programming and Scripting

How to remove duplicate text blocks from a file?

Hi All I have a list of files which will have duplicate list of blocks of text. Following is a sample of the file, I have removed the sensitive information from the file. All the code samples starts from <TR BGCOLOR="white"> and Ends with IP address and two html tags like this. 10.14.22.22...

3. Windows & DOS: Issues & Discussions

Remove duplicate lines from text files.

So, I have text files, one "fail.txt" And one "color.txt" I now want to use a command line (DOS) to remove ANY line that is PRESENT IN BOTH from each text file. Afterwards there shall be no duplicate lines.

4. Shell Programming and Scripting

Remove duplicate line starting with a pattern

HI, I have the below input file /* ----------------- cmdsDlyStartFWJ -----------------*/ UNIX_JOB CMDS065J RUN ANY CMDNAME sleep 5 AGENT CMDSHP USER proddata RUN MON,TUE,WED,THU,FRI DELAYSUB 02:00 /* "Triggers daily file watcher jobs" */ ENVAR...

5. Shell Programming and Scripting

Filter or remove duplicate block of text without distinguishing marks or fields

Hello, Although I have found similar questions, I could not find advice that could help with our problem. The issue: We have several hundreds text files containing repeated blocks of text (I guess back at the time they were prepared like that to optmize printing). The block of texts...

6. Shell Programming and Scripting

Help with remove last text of a file that have specific pattern

Input file matrix-remodelling_associated_8_ aurora_interacting_1_ L20 von_factor_A_domain_1 ATP_containing_3B_ . . Output file matrix-remodelling_associated_8 aurora_interacting_1 L20 von_factor_A_domain_1 ATP_containing_3B . .

7. Shell Programming and Scripting

How to remove all text except pattern

i have nasty html file with 2000+ simbols in 1 row...i need to remove whole the code except title="Some title..." and store those into file with titles (the whole text is in variable text) i've tried something like this: echo $text | sed 's/.*$title=\".+\"$.*/\1/' > titles.html BUT it does...

8. Shell Programming and Scripting

Count the number of occurrences of a pattern between each occurrence of a different pattern

I need to count the number of occurrences of a pattern, say 'key', between each occurrence of a different pattern, say 'lu'. Here's a portion of the text I'm trying to parse: lu S1234L_149_m1_vg.6, part-att 1, vdp-att 1 p-reserver IID 0xdb registrations: key 4156 4353 0000 0000 ...

9. Shell Programming and Scripting

Remove duplicate files based on text string?

Hi I have been struggling with a script for removing duplicate messages from a shared mailbox. I would like to search for duplicate messages based on the “Message-ID” string within the messages files. I have managed to find the duplicate “Message-ID” strings and (if I would like) delete...

10. Shell Programming and Scripting

Remove duplicate text

Hello, I have a log file which is generated by a script which looks like this: userid: 7 starttime: Sat May 24 23:24:13 CEST 2008 endtime: Sat May 24 23:26:57 CEST 2008 total time spent: 2.73072 minutes / 163.843 seconds date: Sat Jun 7 16:09:03 CEST 2008 userid: 8 starttime: Sun May...

LEARN ABOUT HPUX

readmail

readmail(1)						      General Commands Manual						       readmail(1)

NAME

       readmail - read mail from a mail folder or incoming mailbox

SYNOPSIS

       folder] [number-list|pattern]

DESCRIPTION

       The program displays messages from your incoming mailbox or a specified mail folder.

       Within the mail system (see elm(1) with no operands and optionally the or option, displays the appropriate headers and the body of the cur-
       rent message.

       With the number-list operand and no options, displays the corresponding messages and a summary of the headers from your incoming mailbox.

       With the pattern operand and no options, displays the first message that matches the pattern and a summary of the headers from your  incom-
       ing mailbox.

   Options
       supports the following options.

	      Print all messages that match
			     pattern.  If no pattern was specified, this option is ignored.

	      Use file	     folder for the operations instead of the incoming mailbox.

	      Include the entire header of the matched message or messages
			     when displaying their text.  The default is to display the and lines only.

	      Exclude all headers.

	      Put form feeds (
			     between message headers.  This is useful when printing sets of messages.

   Operands
       supports the following operands.

	      number-list    A	blank-separated  list of the ordinal locations of messages in the mail file (i.e., their "message numbers"), up to
			     25 at a time.  The character means the last message in the mail file.  Similarly, represents  every  message  in  the
			     file (i.e.,

			     The message numbers are sorted into ascending order.  Thus, produces the same output as

	      pattern	     A	string that is present in one of the messages.	This pattern can be typed in directly (no quotes) if the words are
			     separated by a single space in the actual message.  The pattern matching is case sensitive, so and  are  not  equiva-
			     lent.  Leading digits (on the first word) are not permitted; however, you can precede them with a space and quote the
			     entire string, if the space occurs in the message, as in .

EXAMPLES

       If you are using to reply to a message from within the mail system, you can insert the text of the current message with the command:

       If you define an alias similar to:

       you can use it with a program such to peruse mail as it arrives, without needing to start a mail system (see newmail(1)).

AUTHOR

       was developed by HP.

FILES

       Incoming mailbox
       Temporary file for

SEE ALSO

       elm(1), newmail(1), vi(1).

																       readmail(1)

Shell Programming and Scripting