it works fine,thanks but there still is a problem...if the text contain 3 identical consecutive words sed only replace the first one ,the last 2 words remaining intacts...have you any ideas?
it works fine,thanks but there still is a problem...if the text contain 3 identical consecutive words sed only replace the first one ,the last 2 words remaining intacts...have you any ideas?
OK, I guess you still have more than 2 identical consecutive words spanning multiple lines, and you have to reserve all the newline characters, this can be a challenge, at least with SED.
---------- Post updated at 09:53 PM ---------- Previous update was at 09:44 PM ----------
Quote:
Originally Posted by ahamed101
Kevin, if you don't mind can yo please explain this?
regards,
Ahamed
Code:
sed 's/\b\(.*\)\b\1/\1/g' infile
Hi, ahamed
Well, the Regex I used was quite simple, text marked as red are word boundaries, text marked as dark green is a capture, text marked as pink are back references.
The first \1 references the previous capture, this simply means matching 2 identical consecutive words.
The second \1 is used to replace the matched text, here the replacement part reserves only one of the 2 consecutive words.
I have some data that looks like this:
PXD= ZW< 1,6
QR> QRJ== 1,2(5)
QR> QRJ== 4,1(2)
QR> QRJ== 4,2
QRB= QRB 4,2
QWM QWM 6,2
R<C ZW< 11,2
R<H= R<J= 6,1
R>H XZJ= 1,2(2)
R>H XZJ= 2,6(2)
R>H XZJ= 4,1(2)
R>H XZJ= 6,2
RDP RDP 1,2
What I would like to do is if fields $1 and $2 are... (5 Replies)
Hi
I'd like to extract, from a text file, the strings starting with "The Thing" and only composed of words with a capital first letter and apostrophes, like for example:
"The Thing I Only" from "those are the The Thing I Only go for whatever."
or
"The Thing That Are Like Men's Eyewear" ... (7 Replies)
Mysql log has something like below:
I need a bash shell script that will do the following:
1) The script will scan the mysql.log file constantly in real time (something like tail -F mysql.log)
2) If it encounters 5 consecutive identical lines then it would invoke some commands (say... (4 Replies)
We have very large transaction logs that have transactions which start with a line that starts with 'Begin :' and ends with a line that starts with 'End :'. For most transactions there is valid data between those two lines.
I am trying to get rid of lines that look like this:
Begin :... (11 Replies)
Hi All,
I tried this but I am having trouble formulating this:
I have a file that looks like this (this is a sample file words can be different):
network
router
frame
network
router
computer
card
host
computer
card
One can see that in this file "network" and "router" occur... (3 Replies)
Morning Guys & Gals,
I am trying to figure out a way to remove lines from a file that have more than
2 identical characters in sequence..
So if for instance the list would look like ;
the output would be ;
I can't seem to get my head around perl (among many other... (7 Replies)
i have a problem in finding block of identical strings...i solved the problem in finding consecutive identical words and now i want to expand the code in order to find and remove consecutive identical block of strings...
for example the awk code removing consecutive identical word is:... (2 Replies)
i have a problem in finding block of identical strings...i solved the problem in finding consecutive identical words and now i want to expand the code in order to find and remove consecutive identical block of strings...
for example the awk code removing consecutive identical word is:... (2 Replies)
i have a problem in finding block of identical strings...i solved the problem in finding consecutive identical words and now i want to expand the code in order to find and remove consecutive identical block of strings...
for example the awk code removing consecutive identical word is:... (2 Replies)
I have a file that needs to be cleaned up. Here is the file:
Project
Project John
Project Gary
Project Sean
Project2
Project2 Lisa
Project2 Tyler
Project2 Sam
Project3
Project3 Mike
Project3 Bran
I need the o/p to be:
Project
John
Gary
Sean
Project2 (7 Replies)
05-01-2011
