hi all
can anyone please let me know if there is a way to find out duplicate rows in a file. i have a file that has hundreds of numbers(all in next row).
i want to find out the numbers that are repeted in the file.
eg.
123434
534
5575
4746767
347624
5575
i want 5575
please help (3 Replies)
I have searched the internet for duplicate row extracting.
All I have seen is extracting good rows or eliminating duplicate rows.
How do I extract duplicate rows from a flat file in unix.
I'm using Korn shell on HP Unix.
For.eg.
FlatFile.txt
========
123:456:678
123:456:678
123:456:876... (5 Replies)
Hi all,
I have written one shell script. The output file of this script is having sql output.
In that file, I want to extract the rows which are having multiple entries(duplicate rows).
For example, the output file will be like the following way.
... (7 Replies)
Hi! I have a file as below:
line1
line2
line2
line3
line3
line3
line4
line4
line4
line4
I would like to extract duplicate lines (not unique, triplicate or quadruplicate lines). Output will be as below:
line2
line2
I would appreciate if anyone can help. Thanks. (4 Replies)
Hi,
In a file, I have to mark duplicate records as 'D' and the latest record alone as 'C'.
In the below file, I have to identify if duplicate records are there or not based on Man_ID, Man_DT, Ship_ID and I have to mark the record with latest Ship_DT as "C" and other as "D" (I have to create... (7 Replies)
Hi,
I have data like below.
SID=D6EB96CC0
HID=9C246D6
CSource=xya
Cappe=1
Versionc=3670
MAR1=STL
MARS2=STL
REQ_BUFFER_ENCODING=UTF-8
REQ_BUFFER_ORIG_ENCODING=UTF-8
RESP_BODY_ENCODING=UTF-8
CON_ID=2713
I want to select
CSource=xya (18 Replies)
Hi All,
I need to extract duplicate rows from a file and write these bad records into another file. And need to have a count of these bad records.
i have a command
awk '
{s++}
END {
for(i in s) {
if(s>1) {
print i
}
}
}' ${TMP_DUPE_RECS}>>${TMP_BAD_DATA_DUPE_RECS}... (5 Replies)
Hello
I have a file like this:
> cat examplefile
ghi|NN603762|eee
mno|NN607265|ttt
pqr|NN613879|yyy
stu|NN615002|uuu
jkl|NN607265|rrr
vwx|NN615002|iii
yzA|NN618555|ooo
def|NN190486|www
BCD|NN628717|ppp
abc|NN190486|qqq
EFG|NN628717|aaa
HIJ|NN628717|sss
>
I can sort the file by... (5 Replies)
Discussion started by: CHoggarth
5 Replies
LEARN ABOUT DEBIAN
sdpa
SDPA(1) General Commands Manual SDPA(1)NAME
SDPA - High-performance software package for SemiDefinite Programs
SYNOPSIS
sdpa DataFile OutputFile [InitialPtFile] [-pt parameters] [-dimacs] [-numThreads numThreads]
sdpa [options] files...
sdpa --version
DESCRIPTION
sdpa - "SDPA (SemiDefinite Programming Algorithm)" is one of the most efficient and stable software packages for solving SDPs based on the
primal-dual interior-point method.
SDP (SemiDefinite Program) is used for financial engineering, machine learning, control theory, sensor network problem, quantum chemistry,
quantum information, combinatorial optimizaiton, polynomial optimization, and so on.
Futher information on SDP and SDPA can be found at
http://sdpa.sourceforge.net/
OPTIONS ---- option type 1 ----
sdpa DataFile OutputFile [InitialPtFile] [-pt parameters] [-dimacs] [-numThreads numThreads]
parameters = 0 default, 1 fast (unstable), 2 slow (stable)
example1-1: sdpa example1.dat example1.result
example1-2: sdpa example1.dat-s example1.result
example1-3: sdpa example1.dat example1.result example1.ini
example1-4: sdpa example1.dat example1.result -pt 2
example1-5: sdpa example1.dat example1.result -dimacs
example1-6: sdpa example1.dat example1.result -numThreads 4
---- option type 2 ----
sdpa [option filename]+
-dd : data dense :: -ds : data sparse
-id : init dense :: -is : init sparse
-o : output :: -p : parameter
-pt : parameters , 0 default, 1 fast (unstable)
2 slow (stable)
example2-1: sdpa -o example1.result -dd example1.dat
example2-2: sdpa -ds example1.dat-s -o example1.result -p param.sdpa
example2-3: sdpa -ds example1.dat-s -o example1.result -pt 2
example2-4: sdpa -ds example1.dat-s -o example1.result -dimacs
example2-5: sdpa -ds example1.dat-s -o example1.result -numThreads 4
---- option type 3 ----
sdpa --version
to print out version and exit.
PARAMETER_FILE
is decided by the following priority
1: The file assigned by '-p' option of 'option type 2'.
For 'option type1', this is skipped.
2: ./param.sdpa
For 'option type2', this is skipped.
3: /usr/share/sdpa/param.sdpa
4: Default parameter
-dimacs
printout dimacs information incurring additional computation cost
-numThreads
number of pthreads for internal computation
AUTHOR
SDPA was written by SDPA Project <sdpa-developers@lists.sourceforge.net>.
This manual page was written by Makoto Yamashita <Makoto.Yamashita@is.titech.ac.jp>.
July 28, 2011 SDPA(1)