|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
Numbering duplicates
Post 302340032 by kylle345 on Sunday 2nd of August 2009 02:06:34 AM
08-02-2009
Numbering duplicates
Hi,
I have this large file and sometimes there are duplicates and I want to basically find them and figure how many there are.
So I have a file with multiple columns and the last column (9) has the duplicates.
eg.
yan
tar
tar
man
ban
tan
tub
tub
tub
Basically what I want to do is label non duplicates as "0" and duplicates as "0", "1" and in the case of triplicates "0", "1" and "2"
So the output file will look like this
yan 0
tar 0
tar 1
man 0
ban 0
tan 0
tub 0
tub 1
tub 2
thanks
Kylle
I have this large file and sometimes there are duplicates and I want to basically find them and figure how many there are.
So I have a file with multiple columns and the last column (9) has the duplicates.
eg.
yan
tar
tar
man
ban
tan
tub
tub
tub
Basically what I want to do is label non duplicates as "0" and duplicates as "0", "1" and in the case of triplicates "0", "1" and "2"
So the output file will look like this
yan 0
tar 0
tar 1
man 0
ban 0
tan 0
tub 0
tub 1
tub 2
thanks
Kylle
|
|
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
:confused: How does UNIX handle the numbering of processes? (2 Replies)
Discussion started by: tweety111
2 Replies
2. UNIX for Dummies Questions & Answers
Just a shot question...
how to make 1,2,3,...999
into the form of
001,002,003....999
(3 digits)
Thanks.... (9 Replies)
Discussion started by: biglemon
9 Replies
3. Shell Programming and Scripting
I'm trying to do a script that will look for a log file if it is already there change the name to another name.
I.E
if log.0 is there
rename to log.1
rename log.1 to log.2
rename log.2 to log.3 and so on.
Only thing is I got no idea where or what is the best command to use for this? ... (3 Replies)
Discussion started by: merlin
3 Replies
4. UNIX for Advanced & Expert Users
hello i'm trying to figure out how to number a blank line. For instance this :
sed '/./=' file | sed '/./N; s/\n/ /'
gives me
1 aaaa
2 bbbbbb
4 cccccc
5 ffkkkfff
6 ffsdfdfs
I would like something like this:
1 aaaaa
2
3 bbbbbb
4
5 cccccc
And so... (6 Replies)
Discussion started by: wisher115
6 Replies
5. Shell Programming and Scripting
Hello everyone,
I want get numbered lines from a file. and i can do it with: sed = file.txt | sed "/./N; s/\n/ /" | sed -n "5,7p"
but the output that i get is something similar to:
5 line5
6 line6
7 line7
and i want something like this (with 2points after the number):
5:... (6 Replies)
Discussion started by: vibra
6 Replies
6. UNIX for Dummies Questions & Answers
If I a list of components, is there anyway to number (like automatically have: 1,2,3,...) the rows of my data? (1 Reply)
Discussion started by: cosmologist
1 Replies
7. Shell Programming and Scripting
Hi,
All I need to do is number a file.
The file looks like this
>
JJJJJJJJJJJJJJJJJJJJJ
>
JKJKJKKKKKKJJJ
>
MMMMYKKKJKKK
what I want to do is number it so that theres a numerical value beside the >.
>1
JJJJJJJJJJJJJJJJJJJJJ
>2
JKJKJKKKKKKJJJ (2 Replies)
Discussion started by: kylle345
2 Replies
8. Shell Programming and Scripting
hey
a file called test :
Code:
hey1
hey2
hey3
........
how to :
Code:
1.hey1
2.hey2
3.hey3
.......... (3 Replies)
Discussion started by: eawedat
3 Replies
9. Shell Programming and Scripting
Would it be possible for a script to duplicate a file and incrementally number it?
File in: XXX_007_0580_xxxx_v0016.aep
File out: XXX_007_0580_xxxx_v0017.aep
If someone knows of a way I'd love to see it.
Thanks! (7 Replies)
Discussion started by: scribling
7 Replies
10. Shell Programming and Scripting
I'm not really sure how to explain this but I will try. In the attached file if $4=$4 and $5="-" then the last record is 1 and the one above that is 2, etc...
However, $4=$4 and $5="-" then the first record is 1 and the one below that is 2, etc...
"-" example:
chr10 90694830 90695123... (7 Replies)
Discussion started by: cmccabe
7 Replies
LEARN ABOUT SUSE
bf_tar
BF_TAR(1) BF_TAR(1) NAME
bf_tar - shell script to write a tar file of a bogofilter directory to stdout SYNOPSIS
bf_tar [-r] [-R] bogofilter_directory DESCRIPTION
bf_tar bundles a bogofilter working directory in tar format and copies it to standard output (your console, or where you redirect it, see EXAMPLES below). OPTIONS
The -r option causes bf_tar to remove inactive log files after the archive has been written successfully. The default is to leave log files. The -R option causes bf_tar to remove inactive log files before the archive is written. This may reduce chances that the resulting archive is recoverable should it become damaged. The archive may be smaller though. The default is to leave log files. EXIT STATUS
The script exits with status code 0 if everything went well, and nonzero if it encountered trouble. EXAMPLES
o bf_tar ~/.bogofilter > outfile.tar Writes a standard .tar file containing the essential files from ~/.bogofilter to outfile.tar. o bf_tar ~/.bogofilter | gzip -9 -c > outfile.tar.gz Writes a gzipped .tar.gz file containing the essential files from ~/.bogofilter to outfile.tar.gz. o bf_tar `pwd`/mydirectory > outfile.tar Prepend $(pwd)/ or `pwd`/ if you want to specify an absolute path instead of a relative path. NOTES
This script is meant for use with Berkeley DB based bogofilter versions. This script requires a SUSv2 compliant pax utility. This script expects a SUSv2 compliant shell. Solaris systems should have the SUNWxcu4 package installed (when bogofilter is configured) so that /usr/xpg4/bin/sh can be used. 07/23/2007 BF_TAR(1)