@vgersh99
Got your script to work but need to add sed '$!s/$/,/' | paste -sd ""
to get my required output. Not sureif thats the best way, but I got it to work. Advice?
i have a text its contain many record, but its written in one line,
i want to remove from that line the duplicate record,
not record have fixed width ex: width = 4
inputfile test.txt =abc cdf abc abc cdf fgh fgh abc abc
i want the outputfile =abc cdf fgh
only those records
can any one help... (4 Replies)
Hi all,
I have a out.log file
CARR|02/26/2006 10:58:30.107|CDxAcct=1405157051
CARR|02/26/2006 11:11:30.107|CDxAcct=1405157051
CARR|02/26/2006 11:18:30.107|CDxAcct=7659579782
CARR|02/26/2006 11:28:30.107|CDxAcct=9534922327
CARR|02/26/2006 11:38:30.107|CDxAcct=9534922327
CARR|02/26/2006... (3 Replies)
Hi all,
I have a text file fileA.txt
DXRV|02/28/2006 11:36:49.049|SAC||||CDxAcct=2420991350
DXRV|02/28/2006 11:37:06.404|SAC||||CDxAcct=6070970034
DXRV|02/28/2006 11:37:25.740|SAC||||CDxAcct=2420991350
DXRV|02/28/2006 11:38:32.633|SAC||||CDxAcct=6070970034
DXRV|02/28/2006... (2 Replies)
Hello,
I have a log file which is generated by a script which looks like this:
userid: 7
starttime: Sat May 24 23:24:13 CEST 2008
endtime: Sat May 24 23:26:57 CEST 2008
total time spent: 2.73072 minutes / 163.843 seconds
date: Sat Jun 7 16:09:03 CEST 2008
userid: 8
starttime: Sun May... (7 Replies)
Hi,
I have a list of numbers stored in an array as below.
5 7 10 30 30 40 50
Please advise how could I remove the duplicate value in the array ?
Thanks in advance. (5 Replies)
Hi,
I am tryung to use shell or perl to remove duplicate characters
for example , if I have " I love google" it will become I love ggle"
or even "I loveggle" if removing duplicate white space
Thanks
CC (6 Replies)
HI
I have file contains 1000'f of duplicate id's with (upper and lower first character) as below
i/p:
a411532A411532a508661A508661c411532C411532
Requirement: But i need to ignore lowercase id's and need only below id's
o/p:
A411532
A508661
C411532 (9 Replies)
Hi ,
I have a pipe seperated file repo.psv where i need to remove duplicates based on the 1st column only. Can anyone help with a Unix script ?
Input:
15277105||Common Stick|ESHR||Common Stock|CYRO AB
15277105||Common Stick|ESHR||Common Stock|CYRO AB
16111278||Common Stick|ESHR||Common... (12 Replies)
Hi,
i am working on a script that would remove records or lines in a flat file. The only difference in the file is the "NOT NULL" word. Please see below example of the input file.
INPUT FILE:>
CREATE a
(
TRIAL_CLIENT NOT NULL VARCHAR2(60),
TRIAL_FUND NOT NULL... (3 Replies)
Discussion started by: reignangel2003
3 Replies
LEARN ABOUT DEBIAN
pilot-dedupe
pilot-dedupe(1) PILOT-LINK pilot-dedupe(1)NAME
pilot-dedupe - Removes duplicate records from any Palm database.
SECTION
pilot-link: Userland conduits
SYNOPSIS
pilot-dedupe [-p|--port <port>] [-q|--quiet] [--version] [-?|--help] [--usage] database ...
DESCRIPTION
pilot-dedupe is used to remove duplicate records from any Palm database.
OPTIONS
Conduit Options
-p, --port lt;port>
Use device file <port> to communicate with the Palm handheld. If this is not specified, pilot-dedupe will look for the $PILOTPORT envi-
ronment variable. If neither are found or supplied, pilot-dedupe will print the usage information.
-q,
--quiet
Suppress 'Hit HotSync button' message
-v, --version
Display version of pilot-dedupe and exit without connecting.
Help Options
-h, --help
Display the help synopsis for pilot-dedupe and exit without connecting.
--usage
Display a brief usage message and exit without connecting.
EXAMPLE
To remove duplicates from the Address and Todo databases:
pilot-dedupe -p /dev/pilot AddressDB ToDoDB
AUTHOR
This manual page was written by Neil Williams <linux@codehelp.co.uk>
REPORTING BUGS
We have an online bug tracker. Using this is the only way to ensure that your bugs are recorded and that we can track them until they are
resolved or closed. Reporting bugs via email, while easy, is not very useful in terms of accountability. Please point your browser to
http://bugs.pilot-link.org: http://bugs.pilot-link.org and report your bugs and issues there.
COPYRIGHT
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MER-
CHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation,
Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301, USA.
SEE ALSO pilot-link(7).
0.12.5 Copyright 1996-2007 FSF pilot-dedupe(1)