Sponsored Content
Top Forums Shell Programming and Scripting finding and removing 2 identical consecutive words in a text Post 302518719 by cocostaec on Sunday 1st of May 2011 01:06:21 PM
Old 05-01-2011
it works fine,thanks but there still is a problem...if the text contain 3 identical consecutive words sed only replace the first one ,the last 2 words remaining intacts...have you any ideas?
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Removing identical words in column

I have a file that needs to be cleaned up. Here is the file: Project Project John Project Gary Project Sean Project2 Project2 Lisa Project2 Tyler Project2 Sam Project3 Project3 Mike Project3 Bran I need the o/p to be: Project John Gary Sean Project2 (7 Replies)
Discussion started by: leepet01
7 Replies

2. SuSE

finding and removing block of identical strings

i have a problem in finding block of identical strings...i solved the problem in finding consecutive identical words and now i want to expand the code in order to find and remove consecutive identical block of strings... for example the awk code removing consecutive identical word is:... (2 Replies)
Discussion started by: cocostaec
2 Replies

3. Programming

finding and removing block of identical strings

i have a problem in finding block of identical strings...i solved the problem in finding consecutive identical words and now i want to expand the code in order to find and remove consecutive identical block of strings... for example the awk code removing consecutive identical word is:... (2 Replies)
Discussion started by: cocostaec
2 Replies

4. Shell Programming and Scripting

finding and removing block of identical strings

i have a problem in finding block of identical strings...i solved the problem in finding consecutive identical words and now i want to expand the code in order to find and remove consecutive identical block of strings... for example the awk code removing consecutive identical word is:... (2 Replies)
Discussion started by: cocostaec
2 Replies

5. UNIX for Dummies Questions & Answers

deleting words in list with more than 2 identical adjacent characters

Morning Guys & Gals, I am trying to figure out a way to remove lines from a file that have more than 2 identical characters in sequence.. So if for instance the list would look like ; the output would be ; I can't seem to get my head around perl (among many other... (7 Replies)
Discussion started by: TAPE
7 Replies

6. Shell Programming and Scripting

Finding consecutive same words in a file

Hi All, I tried this but I am having trouble formulating this: I have a file that looks like this (this is a sample file words can be different): network router frame network router computer card host computer card One can see that in this file "network" and "router" occur... (3 Replies)
Discussion started by: shoaibjameel123
3 Replies

7. Shell Programming and Scripting

Removing consecutive lines in a file

We have very large transaction logs that have transactions which start with a line that starts with 'Begin :' and ends with a line that starts with 'End :'. For most transactions there is valid data between those two lines. I am trying to get rid of lines that look like this: Begin :... (11 Replies)
Discussion started by: deneuve01
11 Replies

8. Shell Programming and Scripting

Scan a file in realtime and execute certain commands on encountering 5 consecutive identical lines

Mysql log has something like below: I need a bash shell script that will do the following: 1) The script will scan the mysql.log file constantly in real time (something like tail -F mysql.log) 2) If it encounters 5 consecutive identical lines then it would invoke some commands (say... (4 Replies)
Discussion started by: proactiveaditya
4 Replies

9. Shell Programming and Scripting

Get group of consecutive uppercase words using gawk

Hi I'd like to extract, from a text file, the strings starting with "The Thing" and only composed of words with a capital first letter and apostrophes, like for example: "The Thing I Only" from "those are the The Thing I Only go for whatever." or "The Thing That Are Like Men's Eyewear" ... (7 Replies)
Discussion started by: louisJ
7 Replies

10. UNIX for Beginners Questions & Answers

awk - If field value of consecutive records are the identical print portion of lines

I have some data that looks like this: PXD= ZW< 1,6 QR> QRJ== 1,2(5) QR> QRJ== 4,1(2) QR> QRJ== 4,2 QRB= QRB 4,2 QWM QWM 6,2 R<C ZW< 11,2 R<H= R<J= 6,1 R>H XZJ= 1,2(2) R>H XZJ= 2,6(2) R>H XZJ= 4,1(2) R>H XZJ= 6,2 RDP RDP 1,2 What I would like to do is if fields $1 and $2 are... (5 Replies)
Discussion started by: jvoot
5 Replies
spell(1)						      General Commands Manual							  spell(1)

Name
       spell, spellin, spellout - check text for spelling errors

Syntax
       spell [-v] [-b] [-x] [-d hlist] [+local-file] [-s hstop] [-h spellhist] [file...]

       spellin [list]

       spellout [-d] list

Description
       The command collects words from the named documents, and looks them up in a spelling list.  Words that are not on the spelling list and are
       not derivable from words on the list (by applying certain inflections, prefixes or suffixes) are printed on the	standard  output.   If	no
       files are specified, words are collected from the standard input.

       The command ignores most and constructions.

       Two  routines help maintain the hash lists used by Both expect a set of words, one per line, from the standard input.  The command combines
       the words from the standard input and the preexisting list file and places a new list on the standard output.  If no list  file	is  speci-
       fied,  a  new  list  is generated.  The command looks up each word from the standard input and prints on the standard output those that are
       missing from (or present on, with option -d) the hashed list file.  For example, to verify that hookey is not on the default spelling list,
       add it to your own private list, and then use it with
       echo  hookey  |	spellout  /usr/dict/hlista
       echo  hookey  |	spellin  /usr/dict/hlista  >  myhlist
       spell  -d  myhlist <filename>

Options
       -v	      Displays words not found in spelling list with all plausible derivations from spelling list.

       -b	      Checks  data  according  to British spelling.  Besides preferring centre, colour, speciality, travelled, this option insists
		      upon -ise instead of -ize in words like standardise.

       -x	      Precedes each word with an equal sign (=) and displays all plausible derivations.

       -d hlist       Specifies the file used for the spelling list.

       -h spellhist   Specifies the file used as the history file.

       -s hstop       Specifies the file used for the stop list.

       +local-file    Removes words found in local-file from the output of the command.  The argument local-file is the name of a file provided by
		      the  user  that contains a sorted list of words, one per line.  With this option, the user can specify a list of words for a
		      particular job that are spelled correctly.

       The auxiliary files used for the spelling list, stop list, and history file may be specified by arguments following  the  -d,  -s,  and	-h
       options.   The  default files are indicated below.  Copies of all output may be accumulated in the history file.  The stop list filters out
       misspellings (for example, thier=thy-y+ier) that would otherwise pass.

Restrictions
       The coverage of the spelling list is uneven; new installations will probably wish to monitor the output for several months to gather  local
       additions.

       The command works only with ASCII text files.

Files
       /usr/dict/hlist[ab] hashed spelling lists, American &			 British, default for -d
       /usr/dict/hstop	   hashed stop list, default for -s
       /dev/null	   history file, default for -h
       /tmp/spell.$$*	   temporary files
       /usr/lib/spell

See Also
       deroff(1), sed(1), sort(1), tee(1)

																	  spell(1)
All times are GMT -4. The time now is 12:50 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy