Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: finding and removing 2 identical consecutive words in a text
Top Forums Shell Programming and Scripting finding and removing 2 identical consecutive words in a text Post 302518695 by kevintse on Sunday 1st of May 2011 10:12:23 AM
Old 05-01-2011
Quote:
Originally Posted by cocostaec
yes,i know...but sed isn't so efficiently because if we have "apple apples" the firs word will be removed even if this 2 words are not equal
The code I provided does not have this problem, please try it out.
That I said it is not that efficient if your file is large does not necessarily mean that it can be so inefficient that it is not acceptable.Smilie
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Removing identical words in column

I have a file that needs to be cleaned up. Here is the file: Project Project John Project Gary Project Sean Project2 Project2 Lisa Project2 Tyler Project2 Sam Project3 Project3 Mike Project3 Bran I need the o/p to be: Project John Gary Sean Project2 (7 Replies)
Discussion started by: leepet01
7 Replies

2. SuSE

finding and removing block of identical strings

i have a problem in finding block of identical strings...i solved the problem in finding consecutive identical words and now i want to expand the code in order to find and remove consecutive identical block of strings... for example the awk code removing consecutive identical word is:... (2 Replies)
Discussion started by: cocostaec
2 Replies

3. Programming

finding and removing block of identical strings

i have a problem in finding block of identical strings...i solved the problem in finding consecutive identical words and now i want to expand the code in order to find and remove consecutive identical block of strings... for example the awk code removing consecutive identical word is:... (2 Replies)
Discussion started by: cocostaec
2 Replies

4. Shell Programming and Scripting

finding and removing block of identical strings

i have a problem in finding block of identical strings...i solved the problem in finding consecutive identical words and now i want to expand the code in order to find and remove consecutive identical block of strings... for example the awk code removing consecutive identical word is:... (2 Replies)
Discussion started by: cocostaec
2 Replies

5. UNIX for Dummies Questions & Answers

deleting words in list with more than 2 identical adjacent characters

Morning Guys & Gals, I am trying to figure out a way to remove lines from a file that have more than 2 identical characters in sequence.. So if for instance the list would look like ; the output would be ; I can't seem to get my head around perl (among many other... (7 Replies)
Discussion started by: TAPE
7 Replies

6. Shell Programming and Scripting

Finding consecutive same words in a file

Hi All, I tried this but I am having trouble formulating this: I have a file that looks like this (this is a sample file words can be different): network router frame network router computer card host computer card One can see that in this file "network" and "router" occur... (3 Replies)
Discussion started by: shoaibjameel123
3 Replies

7. Shell Programming and Scripting

Removing consecutive lines in a file

We have very large transaction logs that have transactions which start with a line that starts with 'Begin :' and ends with a line that starts with 'End :'. For most transactions there is valid data between those two lines. I am trying to get rid of lines that look like this: Begin :... (11 Replies)
Discussion started by: deneuve01
11 Replies

8. Shell Programming and Scripting

Scan a file in realtime and execute certain commands on encountering 5 consecutive identical lines

Mysql log has something like below: I need a bash shell script that will do the following: 1) The script will scan the mysql.log file constantly in real time (something like tail -F mysql.log) 2) If it encounters 5 consecutive identical lines then it would invoke some commands (say... (4 Replies)
Discussion started by: proactiveaditya
4 Replies

9. Shell Programming and Scripting

Get group of consecutive uppercase words using gawk

Hi I'd like to extract, from a text file, the strings starting with "The Thing" and only composed of words with a capital first letter and apostrophes, like for example: "The Thing I Only" from "those are the The Thing I Only go for whatever." or "The Thing That Are Like Men's Eyewear" ... (7 Replies)
Discussion started by: louisJ
7 Replies

10. UNIX for Beginners Questions & Answers

awk - If field value of consecutive records are the identical print portion of lines

I have some data that looks like this: PXD= ZW< 1,6 QR> QRJ== 1,2(5) QR> QRJ== 4,1(2) QR> QRJ== 4,2 QRB= QRB 4,2 QWM QWM 6,2 R<C ZW< 11,2 R<H= R<J= 6,1 R>H XZJ= 1,2(2) R>H XZJ= 2,6(2) R>H XZJ= 4,1(2) R>H XZJ= 6,2 RDP RDP 1,2 What I would like to do is if fields $1 and $2 are... (5 Replies)
Discussion started by: jvoot
5 Replies

LEARN ABOUT DEBIAN

shanty

SHANTY(1)							      Shanty								 SHANTY(1)

NAME

       Shanty - Makes a PostScript file from an image and some text.

SYNOPSIS

       shanty -i image_file [-t text_file] [-o output_file] [-s paper_size] [-d density] [-m margin] [-b background_color] [-x padding] [-n title]
       [-l orientation] [-rtl] [-btt] [-f font_name] [-altgd]

DESCRIPTION

       Shanty takes a text file and an image (PNG or JPG) and creates a PostScript file where one pixel in the image becomes one character in  the
       PostScript.

OPTIONS

       -i, -image
		 Name of the image to load in. JPG and PNG images are supported. This is the only compulsory field.

       -t, -text Name of the text file to load in, if omitted STDIN is used.

       -o, -output
		 Name of the PostScript file to produce, if omitted STDOUT is used.

       -s, -size Size  of  the	paper  to  work  with.	This  field  should be one of: "a0", "a2", "a3", "a4", "a5", "a6", "letter", "broadsheet",
		 "ledger", "tabloid", "legal", "executive" and "36x36". Default is "a4".

       -d, -density
		 Density of the text. Higher numbers are more dense, default is 1.4.

       -m, -margin
		 The margins of the page in cm. Default is 1.

       -b, -background
		 The colour of a backing rectangle to place behind the text. Colours are specified as "R,G,B" with each value between 0  and  255.
		 "off" means no backing colour. Default is "off".

       -x, -p, -padding
		 Density of the text. Higher numbers are more dense, default is 1.4.

       -n, -title
		 The title of the output to write as meta-data in the PostScript file. Default is "Shanty output".

       -l, -orientation
		 The orientation of the paper, can be "portrait", "landscape" or "auto". Default is "auto".

       -rtl	 Switch to right-to-left text.

       -btt	 Switch to bottom-to-top text.

       -f, -font Specify font. The font name specified must be visible to the not just make a font magically appear. Default is "Courier-Bold".

       -altgd	 If you have problems loading the GD library, try this switch.

HOMEPAGE

       <http://www.codebunny.org/coding/shanty/>

AUTHOR

       Duncan Martin <duncan@codebunny.org>

ACKNOWLEDGEMENTS

       Many thanks to DFB <http://www.cs.nott.ac.uk/~dfb/> and contributors to comp.lang.postscript.

Duncan Martin							  6 October 2006							 SHANTY(1)
All times are GMT -4. The time now is 10:11 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy