03-26-2004
super quick and dirty way is use the space as your seperator and load each element into a hash.
hashes can only contain unique keys. so if you load up a hash then you are sure to get no duplicates.
then you just spit out each key and reform your line.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi all,
I have a out.log file
CARR|02/26/2006 10:58:30.107|CDxAcct=1405157051
CARR|02/26/2006 11:11:30.107|CDxAcct=1405157051
CARR|02/26/2006 11:18:30.107|CDxAcct=7659579782
CARR|02/26/2006 11:28:30.107|CDxAcct=9534922327
CARR|02/26/2006 11:38:30.107|CDxAcct=9534922327
CARR|02/26/2006... (3 Replies)
Discussion started by: sabercats
3 Replies
2. Shell Programming and Scripting
Hi all,
I have a text file fileA.txt
DXRV|02/28/2006 11:36:49.049|SAC||||CDxAcct=2420991350
DXRV|02/28/2006 11:37:06.404|SAC||||CDxAcct=6070970034
DXRV|02/28/2006 11:37:25.740|SAC||||CDxAcct=2420991350
DXRV|02/28/2006 11:38:32.633|SAC||||CDxAcct=6070970034
DXRV|02/28/2006... (2 Replies)
Discussion started by: sabercats
2 Replies
3. UNIX for Dummies Questions & Answers
Hi,
I have a list of numbers stored in an array as below.
5 7 10 30 30 40 50
Please advise how could I remove the duplicate value in the array ?
Thanks in advance. (5 Replies)
Discussion started by: Rock
5 Replies
4. Shell Programming and Scripting
Hi,
I am tryung to use shell or perl to remove duplicate characters
for example , if I have " I love google" it will become I love ggle"
or even "I loveggle" if removing duplicate white space
Thanks
CC (6 Replies)
Discussion started by: ccp
6 Replies
5. Shell Programming and Scripting
Input file
data_1 10 US
data_1 2 US
data_1 5 UK
data_2 20 ENGLAND
data_2 12 KOREA
data_3 4 CHINA
.
.
data_60 123 US
data_60 23 UK
data_60 45 US
Desired output file
data_1 10 US
data_1 5 UK
data_2 20 ENGLAND
data_2 12 KOREA (2 Replies)
Discussion started by: perl_beginner
2 Replies
6. Shell Programming and Scripting
HI
I have file contains 1000'f of duplicate id's with (upper and lower first character) as below
i/p:
a411532A411532a508661A508661c411532C411532
Requirement: But i need to ignore lowercase id's and need only below id's
o/p:
A411532
A508661
C411532 (9 Replies)
Discussion started by: buzzme
9 Replies
7. Shell Programming and Scripting
Hi ,
I have a pipe seperated file repo.psv where i need to remove duplicates based on the 1st column only. Can anyone help with a Unix script ?
Input:
15277105||Common Stick|ESHR||Common Stock|CYRO AB
15277105||Common Stick|ESHR||Common Stock|CYRO AB
16111278||Common Stick|ESHR||Common... (12 Replies)
Discussion started by: samrat dutta
12 Replies
8. UNIX for Dummies Questions & Answers
Hi,
How can I replace || with space and then remove duplicate from following text?
T111||T222||T444||T222||T555
Thanks in advance (10 Replies)
Discussion started by: tinku981
10 Replies
9. UNIX for Dummies Questions & Answers
Hi
I need this output. Thanks.
Input:
TAZ
YET
FOO
FOO
VAK
TAZ
BAR
Output:
YET
VAK
BAR (10 Replies)
Discussion started by: tara123
10 Replies
10. Shell Programming and Scripting
Hi All,
I am storing the result in the variable result_text using the below code.
result_text=$(printf "$result_text\t\n$name") The result_text is having the below text. Which is having duplicate lines.
file and time for the interval 03:30 - 03:45
file and time for the interval 03:30 - 03:45 ... (4 Replies)
Discussion started by: nalu
4 Replies
LEARN ABOUT CENTOS
fs_newcell
FS_NEWCELL(1) AFS Command Reference FS_NEWCELL(1)
NAME
fs_newcell - Changes the kernel-resident list of a cell's database servers
SYNOPSIS
fs newcell -name <cell name> -servers <primary servers>+
[-linkedcell <linked cell name>] [-help]
fs n -n <cell name> -s <primary servers>+
[-l <linked cell name>] [-h]
DESCRIPTION
The fs newcell command removes the Cache Manager's kernel-resident list of database server machines for the cell specified by the -name
argument and replaces it with the database server machines named by the -servers argument.
Each time the machine reboots, the Cache Manager constructs the kernel list of cells and database server machines by reading the local
/etc/openafs/CellServDB file. This command does not change the CellServDB file, so any changes made with it persist only until the next
reboot, unless the issuer also edits the file. The output of the fs listcells command reflects changes made with this command, because that
command consults the kernel-resident list rather than the CellServDB file.
This command can introduce a completely new cell into the kernel-resident list, but cannot make a cell inaccessible (it is not possible to
remove a cell's entry from the kernel-resident list by providing no values for the -server argument). To make a cell inaccessible, remove
its entry from the CellServDB file and reboot the machine.
If the -name argument names a DCE cell, then the -servers argument names DFS Fileset Location (FL) Server machines. The -linkedcell
argument specifies the name of the AFS cell to link to a DCE cell for the purpose of DFS fileset location.
CAUTIONS
Some commands, such as the aklog or klog.krb5 commands, work correctly only when the information is accurate for a cell in both the
CellServDB file and the kernel-resident list.
OPTIONS
-name <cell name>
Specifies the fully-qualified cell name of the AFS or DCE cell.
-servers <primary servers>+
Specifies the fully-qualified hostnames of all AFS database server machines or DFS Fileset Location (FL) Server machines for the cell
named by the -name argument. If FL Server machines are specified, the local machine must be running the AFS/DFS Migration Toolkit
Protocol Translator.
-linkedcell <linked cell name>
Specifies the name of the AFS cell to link to a DCE cell for the purpose of DFS fileset location.
-help
Prints the online help for this command. All other valid options are ignored.
EXAMPLES
The following example changes the machine's kernel-resident list of database server machines for the ABC Corporation cell to include the
machines "db1.abc.com" and "db2.abc.com":
% fs newcell -name abc.com -servers db1.abc.com db2.abc.com
The following example links the DCE cell "dce.abc.com" to the AFS cell "abc.com". The AFS client contacts the Fileset Location (FL) servers
"db1.dce.abc.com" and "db2.dce.abc.com" for fileset location information as it interprets a DFS pathname.
% fs newcell -name dce.abc.com
-servers db1.dce.abc.com db2.dce.abc.com
-linkedcell abc.com
PRIVILEGE REQUIRED
The issuer must be logged in as the local superuser root.
SEE ALSO
CellServDB(5), fs_listcells(1)
COPYRIGHT
IBM Corporation 2000. <http://www.ibm.com/> All Rights Reserved.
This documentation is covered by the IBM Public License Version 1.0. It was converted from HTML to POD by software written by Chas
Williams and Russ Allbery, based on work by Alf Wachsmann and Elizabeth Cassell.
OpenAFS 2012-03-26 FS_NEWCELL(1)