Login or Register to Ask a Question and Join Our Community


UNIX for Dummies Questions & Answers

Text Editing

 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Text Editing
# 1  
Old 10-19-2006
Text Editing
Hello everybody,

I have a sorted text file. some of the lines appear twice or even more. is there an unix utility that removes the extra appearences?

Thanks,
Ido.
# 2  
Old 10-19-2006
Try uniq command. Check man uniq for more help.
# 3  
Old 10-19-2006
Thanks! Smilie
Ido.
Last edited by ginodii; 10-19-2006 at 09:07 AM..
# 4  
Old 10-19-2006
Quote:
Originally Posted by ginodii
10x!
You are welcome!

Since you are new to these forums, I would recommend you to read the RULES we practice here:

(9) Edit your posts if you see spelling or grammar errors (don't write in cyberchat or cyberpunk style). English only.

Regards,
Tayyab
# 5  
Old 10-19-2006
uniq wont work coz it only removes the repeated line if they come one after the other

if the file is like the following

ab
hjk
jl as
ab

it wont work.

i know its not the ans u want, but i am working on it.
# 6  
Old 10-19-2006
Its okay coz anyway I sort the file in advance...

Thanks,
Ido.
# 7  
Old 10-19-2006
there is some minor defect with this code. i think the logic is ok. someone plz try n debug it. i am doing it in a hurry n hv to go now.

#!/bin/awk -f~
cat bc|while read line
do
x=`wc -l bc|awk '{print $1}'`
for ( k=( NR + 1 ) ; k<=x ; k++ )
{
if /$line/
then
sed 'k d' bc
fi
}
done



error:


awk: syntax error near line 2
awk: bailing out near line 2
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Text editing/manipulation

Hello all. I need to rearrange a very long text file with the following format. The number of lines in each block is variable, but is between 1 and 10. Any hints what command could I use for this? Thank you. SAMPLE 2600 15 3453 159 3970 486 4327 760 4498 ... (3 Replies)
Discussion started by: yirgacheffe
3 Replies

2. UNIX for Dummies Questions & Answers

Editing long text file

Good morning all, I have a machine running IRIX and I need to edit a text file on the terminal that is literally thousands of lines. Does anyone know the most efficient way to edit portions of files like these? Obviously simply using the vi command isn't going to work since I get a too many lines... (1 Reply)
Discussion started by: James C
1 Replies

3. Shell Programming and Scripting

Convert vi editing to text editing

Dear Guru's I'm using Putty and want to edit a file. I know we generally use vi editor to do it. As I'm not good in using vi editor, I want to convert the vi into something like text pad. Is there any option in Putty to do the same ? Thanks for your response. Srini (6 Replies)
Discussion started by: thummi9090
6 Replies

4. Shell Programming and Scripting

Help needed editing text file using the terminal

Hi, I have text file with the header like this tracking_id condition replicate FPKM XLOC_000001 alpha 1 10.3199 XLOC_000001 alpha 0 10.3686 XLOC_000001 alpha 2 15.5619 ... With the first column being genes, the second being the condition, the third... (5 Replies)
Discussion started by: 4galaxy7
5 Replies

5. UNIX for Dummies Questions & Answers

awk text editing

Dear all, I'm starting to learn programming, and I'm having some problem with awk text editing. I'm having a huge text file, and my goal is to print "something" before every 4th row starting from the second row. File example: AAAAA BBBBBB CCCCC DDDDD AAAAAAA BBBBBBBB CCCCCCC... (2 Replies)
Discussion started by: Higgo
2 Replies

6. Programming

Editing a specific liine of text file - C++

Is there any way to erase all the contents of a specific line of a text file and then write something on it? e.g. test.txt.old: qwert asdfg zxcbv=0 test.txt.new qwerty asdfg hello=0 is this possible with C++ ?:confused: (1 Reply)
Discussion started by: hakermania
1 Replies

7. Shell Programming and Scripting

Editing text using AWK

France : 40 : John Persia : 50 : John -----Database What i am trying to achieve is to search for a book, and replave the title with the new title echo -n "Title:" read Title echo -n "Author:" read Author echo "new Title" read NewTitle awk 'BEGIN {... (11 Replies)
Discussion started by: gregarion
11 Replies

8. Shell Programming and Scripting

Text editing script does everything but edit text.

I wrote this script to create and edit a large number of websites based on a template site and a collection of text files which have the relevant strings in them delimited by colons. I run it and the shell doesn't produce any errors, but when it gets to the for loop where it actually has to edit... (2 Replies)
Discussion started by: afroCluster
2 Replies

9. Shell Programming and Scripting

text file editing

Hi, I need some help in text manipulation. I have an input file like this: 7629 "WPCW 19 - CW/AM1, WPCB 40 - FAMN/CORNER, WPCB-DT1 50 - FAMN/CORNER, " W35AW - Various Shopping Pgms W41CF - TBN W47CV - TBN WLLS-LP 49 - AM1 WATCH WPXI 11 N & WPIX 11 CW 1234 "WPCW 19 - CW/AM1,... (26 Replies)
Discussion started by: injeti
26 Replies

10. UNIX for Dummies Questions & Answers

Text editing on iPhone using ed

Hi all, I'm trying to edit a file using ed on an iphone. I am trying to edit a conf file and have managed to get to the directory where the default.conf file is located, however, when I type ed default.conf all i get is a number and then a blank line and a question mark which is why I am... (1 Reply)
Discussion started by: drewcifer
1 Replies
Login or Register to Ask a Question