Hi Everyone,
I have a flat file of 1000 unique records like following : For eg
Andy,Flower,201-987-0000,12/23/01
Andrew,Smith,101-387-3400,11/12/01
Ani,Ross,401-757-8640,10/4/01
Rich,Finny,245-308-0000,2/27/06
Craig,Ford,842-094-8740,1/3/04
.
.
.
.
.
.
Now I want to duplicate... (9 Replies)
Hi experts,
I am new to scripting. I have a requirement as below.
File1:
A|123|NAME1
A|123|NAME2
B|123|NAME3
File2:
C|123|NAME4
C|123|NAME5
D|123|NAME6
1) I have 2 merge both the files.
2) need to do a sort ( key fields are first and second field)
3) remove all the instances... (3 Replies)
Can any one give me command How to delete duplicate records with out sort.
Suppose if the records like below:
345,bcd,789
123,abc,456
234,abc,456
712,bcd,789
out tput should be
345,bcd,789
123,abc,456
Key for the records is 2nd and 3rd fields.fields are seperated by colon(,). (2 Replies)
Can any one give me command How to delete duplicate records with out sort.
Suppose if the records like below:
345,bcd,789
123,abc,456
234,abc,456
712,bcd,789
out tput should be
345,bcd,789
123,abc,456
Key for the records is 2nd and 3rd fields.fields are seperated by colon(,). (19 Replies)
I want to remove the records based on duplicate. I want to remove if two or more records exists with combination fields. Those records should not come once also
file abc.txt
ABC;123;XYB;HELLO;
ABC;123;HKL;HELLO;
CDE;123;LLKJ;HELLO;
ABC;123;LSDK;HELLO;
CDF;344;SLK;TEST
key fields are... (7 Replies)
Hi frinds,
Need your help.
item , color ,desc
==== ======= ====
1,red ,abc
1,red , a b c
2,blue,x
3,black,y
4,brown,xv
4,brown,x v
4,brown, x v
I have to elemnet the duplicate rows on the basis of item.
the final out put will be
1,red ,abc (6 Replies)
I have a flat file that contains records similar to the following two lines;
1984/11/08 7 700000 123456789 2
1984/11/08 1941/05/19 7 700000 123456789 2
The 123456789 2 represents an account number, this is how I identify the duplicate record.
The ### signs represent... (4 Replies)
Consider my input is
10
10
20
then,
uniq -u will give 20 and uniq -dwill return 10.
But i need the output as ,
10
10
How we can achieve this?
Thanks (4 Replies)
I have 2 files
"File 1" is delimited by ";" and "File 2" is delimited by "|".
File 1 below (3 record shown):
Doc1;03/01/2012;New York;6 Main Street;Mr. Smith 1;Mr. Jones
Doc2;03/01/2012;Syracuse;876 Broadway;John Davis;Barbara Lull
Doc3;03/01/2012;Buffalo;779 Old Windy Road;Charles... (2 Replies)
Gents,
Please give a help
file
--BAD STATUS NOT RESHOOTED--
*** VP 41255/51341 in sw 2973
*** VP 41679/51521 in sw 2973
*** VP 41687/51653 in sw 2973
*** VP 41719/51629 in sw 2976
--BAD COG NOT RESHOOTED--
*** VP 41689/51497 in sw 2974
*** VP 41699/51677 in sw 2974
*** VP... (18 Replies)
Discussion started by: jiam912
18 Replies
LEARN ABOUT DEBIAN
fullquottel
FULLQUOTTEL(1) User Commands FULLQUOTTEL(1)NAME
fullquottel - tool for detecting full quotes in mails or postings
SYNOPSIS
fullquottel [OPTION...] < infile > outfile
DESCRIPTION
fullquottel - tool for detecting full quotes in mails or postings
-t, --scorethreshold=NUMBER
Threshold for final score that discriminates between Goodquottel and Fullquottel (default: 1.5)
--quotechars=CHARS
Chars used for quoting (default: >|#)
-d, --debug
Debug option (prints single test results; default: off)
--ownsigtest=1|0
Turn on/off ownSigTest (default: on)
--ownsigtestscore=NUMBER
Score for ownSigTest (default: 1.0)
-f, --ownsigtestfile=SIGFILE
Signature file to test against (default: ~/.signature)
--mstest=1|0
Turn on/off msTest (Microsoft attribution lines; default: on)
--mstestscore=NUMBER
Score for msTest (default: 1.0)
--mstestthreshold=NUMBER
Threshold for msTest (at or below which line a Microsoft attribution line ist found; default: 2)
--quotedtoalltest=1|0
Turn on/off quotedToAllTest (ratio quoted lines to all; default: on)
--quotedtoalltestscore=NUMBER
Score for quotedToAllTest (default: 1.0)
--quotedtoalltestfactor=NUMBER
Result = score + ratio * FACTOR (default: 0)
--quotedtoalltestthreshold=NUMBER
Ratio threshold for activating quotedToAllTest (default: 0.5)
--bottomquotedtoalltest=1|0
Turn on/off bottomQuotedToAllTest (ratio quoted lines at bottom to all; default: on)
--bottomquotedtoalltestscore=NUMBER
Score for bottomQuotedToAllTest (default: 1.0)
--bottomquotedtoalltestfactor=NUMBER
Result = score + ratio * FACTOR (default: 0)
--bottomquotedtoalltestthreshold=NUMBER
Ratio threshold for activating bottomQuotedToAllTest (default: 0.5)
--bottomquotedtoquotedtest=1|0
Turn on/off bottomQuotedToQuotedTest (ratio quoted lines at bottom to all quoted lines; default: on)
--bottomquotedtoquotedtestscore=NUMBER
Score for bottomQuotedToQuotedTest (default: 1.0)
--bottomquotedtoquotedtestfactor=NUMBER
Result = score + ratio * FACTOR (default: 0)
--bottomquotedtoquotedtestthreshold=NUMBER
Ratio threshold for activating bottomQuotedToQuotedTest (default: 0.5)
--singlebottomquotetest=1|0
Turn on/off singleBottomQuoteTest (only one quote block, and at the bottom; default: on)
--singlebottomquotetestscore=NUMBER
Score for singleBottomQuoteTest (default: 1.0)
HINT: All long options (without leading --) can be used in ~/.fullquottelrc
-?, --help
Give this help list
--usage
Give a short usage message
-V, --version
Print program version
Mandatory or optional arguments to long options are also mandatory or optional for any corresponding short options.
REPORTING BUGS
Report bugs to <toast@toastfreeware.priv.at>.
SEE ALSO
The full documentation for fullquottel is maintained in HTML created by doxygen and can be found in
/usr/share/doc/fullquottel/html/
fullquottel 0.1.2 April 2007 FULLQUOTTEL(1)