10-19-2006
uniq wont work coz it only removes the repeated line if they come one after the other
if the file is like the following
ab
hjk
jl as
ab
it wont work.
i know its not the ans u want, but i am working on it.
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi all,
I'm trying to edit a file using ed on an iphone. I am trying to edit a conf file and have managed to get to the directory where the default.conf file is located, however, when I type ed default.conf all i get is a number and then a blank line and a question mark which is why I am... (1 Reply)
Discussion started by: drewcifer
1 Replies
2. Shell Programming and Scripting
Hi, I need some help in text manipulation.
I have an input file like this:
7629 "WPCW 19 - CW/AM1, WPCB 40 - FAMN/CORNER, WPCB-DT1 50 - FAMN/CORNER, "
W35AW - Various Shopping Pgms
W41CF - TBN
W47CV - TBN
WLLS-LP 49 - AM1
WATCH WPXI 11 N & WPIX 11 CW
1234 "WPCW 19 - CW/AM1,... (26 Replies)
Discussion started by: injeti
26 Replies
3. Shell Programming and Scripting
I wrote this script to create and edit a large number of websites based on a template site and a collection of text files which have the relevant strings in them delimited by colons. I run it and the shell doesn't produce any errors, but when it gets to the for loop where it actually has to edit... (2 Replies)
Discussion started by: afroCluster
2 Replies
4. Shell Programming and Scripting
France : 40 : John
Persia : 50 : John -----Database
What i am trying to achieve is to search for a book, and replave the title with the new title
echo -n "Title:"
read Title
echo -n "Author:"
read Author
echo "new Title"
read NewTitle
awk 'BEGIN {... (11 Replies)
Discussion started by: gregarion
11 Replies
5. Programming
Is there any way to erase all the contents of a specific line of a text file and then write something on it?
e.g.
test.txt.old:
qwert
asdfg
zxcbv=0
test.txt.new
qwerty
asdfg
hello=0
is this possible with C++ ?:confused: (1 Reply)
Discussion started by: hakermania
1 Replies
6. UNIX for Dummies Questions & Answers
Dear all,
I'm starting to learn programming, and I'm having some problem with awk text editing.
I'm having a huge text file, and my goal is to print "something" before every 4th row starting from the second row.
File example:
AAAAA
BBBBBB
CCCCC
DDDDD
AAAAAAA
BBBBBBBB
CCCCCCC... (2 Replies)
Discussion started by: Higgo
2 Replies
7. Shell Programming and Scripting
Hi,
I have text file with the header like this
tracking_id condition replicate FPKM
XLOC_000001 alpha 1 10.3199
XLOC_000001 alpha 0 10.3686
XLOC_000001 alpha 2 15.5619
...
With the first column being genes, the second being the condition, the third... (5 Replies)
Discussion started by: 4galaxy7
5 Replies
8. Shell Programming and Scripting
Dear Guru's
I'm using Putty and want to edit a file. I know we generally use vi editor to do it. As I'm not good in using vi editor, I want to convert the vi into something like text pad. Is there any option in Putty to do the same ? Thanks for your response.
Srini (6 Replies)
Discussion started by: thummi9090
6 Replies
9. UNIX for Dummies Questions & Answers
Good morning all, I have a machine running IRIX and I need to edit a text file on the terminal that is literally thousands of lines. Does anyone know the most efficient way to edit portions of files like these? Obviously simply using the vi command isn't going to work since I get a too many lines... (1 Reply)
Discussion started by: James C
1 Replies
10. UNIX for Beginners Questions & Answers
Hello all.
I need to rearrange a very long text file with the following format.
The number of lines in each block is variable, but is between 1 and 10.
Any hints what command could I use for this?
Thank you.
SAMPLE 2600
15 3453 159 3970 486 4327 760 4498
... (3 Replies)
Discussion started by: yirgacheffe
3 Replies
uniq(1) General Commands Manual uniq(1)
NAME
uniq - Removes or lists repeated lines in a file
SYNOPSIS
Current Syntax
uniq [-cdu] [-f fields] [-s chars] [input-file [output-file]]
Obsolescent Syntax
uniq [-cdu] [-fields] [+chars] [input-file [output-file]]
The uniq command reads from the specified input_file, compares adjacent lines, removes the second and succeeding occurrences of a line, and
writes to standard output.
STANDARDS
Interfaces documented on this reference page conform to industry standards as follows:
uniq: XCU5.0
Refer to the standards(5) reference page for more information about industry standards and associated tags.
OPTIONS
Precedes each output line with a count of the number of times each line appears in the file. This option supersedes the -d and -u options.
Displays repeated lines only. Ignores the first fields fields on each input line when doing comparisons, where fields is a positive deci-
mal integer. A field is the maximal string matched by the basic regular expression:
[[:blank:]]*[^[:blank:]]*
If the fields argument specifies more fields than appear on an input line, a null string is used for comparisons. Ignores the spec-
ified number of characters when doing comparisons. The chars argument is a positive decimal integer.
If specified with the -f option, the first chars characters after the first fields fields are ignored. If the chars argument speci-
fies more characters than remain on an input line, uniq uses a null string for comparison. Displays unique lines only. Equivalent
to -f fields. (Obsolescent) Equivalent to -s chars. (Obsolescent)
OPERANDS
A pathname for the input file.
If this operand is omitted or specified as -, then standard input is read. A pathname for the output file.
If this operand is omitted, then standard output is written.
DESCRIPTION
The input_file and output_file arguments must be different files. If the input_file operand is not specified, or if it is -, uniq uses
standard input.
Repeated lines must be on consecutive lines to be found. You can arrange them with the sort command before processing.
EXAMPLES
To delete repeated lines in the following file called fruit and save it to a file named newfruit, enter: uniq fruit newfruit
The file fruit contains the following lines:
apples apples bananas cherries cherries peaches pears
The file newfruit contains the following lines:
apples bananas cherries peaches pears
EXIT STATUS
The following exit values are returned: Successful completion. An error occurred.
ENVIRONMENT VARIABLES
The following environment variables affect the execution of uniq: Provides a default value for the internationalization variables that are
unset or null. If LANG is unset or null, the corresponding value from the default locale is used. If any of the internationalization vari-
ables contain an invalid setting, the utility behaves as if none of the variables had been defined. If set to a non-empty string value,
overrides the values of all the other internationalization variables. Determines the locale for the interpretation of sequences of bytes
of text data as characters (for example, single-byte as opposed to multibyte characters in arguments). Determines the locale for the for-
mat and contents of diagnostic messages written to standard error. Determines the location of message catalogues for the processing of
LC_MESSAGES.
SEE ALSO
Commands: comm(1), sort(1)
Standards: standards(5)
uniq(1)