I have written one shell script. The output file of this script is having sql output.
In that file, I want to extract the rows which are having multiple entries(duplicate rows).
For example, the output file will be like the following way.
In this output, I want numeric duplicate rows only. Suppose this file is having lines to separate the values, those lines also considered as duplicate rows. So I want only the out put from this file which is having more than one entry and which is related to numbers.
Can anyone please tell me the command?
Thanks in advance.
hi all
can anyone please let me know if there is a way to find out duplicate rows in a file. i have a file that has hundreds of numbers(all in next row).
i want to find out the numbers that are repeted in the file.
eg.
123434
534
5575
4746767
347624
5575
i want 5575
please help (3 Replies)
I have a file content like below.
"0000000","ABLNCYI","BOTH",1049,2058,"XYZ","5711002","","Y","","","","","","","",""
"0000000","ABLNCYI","BOTH",1049,2058,"XYZ","5711002","","Y","","","","","","","",""
"0000000","ABLNCYI","BOTH",1049,2058,"XYZ","5711002","","Y","","","","","","","",""... (5 Replies)
Hi,
I am processing a file and would like to delete duplicate records as indicated by one of its column. e.g.
COL1 COL2 COL3
A 1234 1234
B 3k32 2322
C Xk32 TTT
A NEW XX22
B 3k32 ... (7 Replies)
I have searched the internet for duplicate row extracting.
All I have seen is extracting good rows or eliminating duplicate rows.
How do I extract duplicate rows from a flat file in unix.
I'm using Korn shell on HP Unix.
For.eg.
FlatFile.txt
========
123:456:678
123:456:678
123:456:876... (5 Replies)
Hi,
I have a log file having size of 48mb.
For such a large log file. I want to get the message in a particular format which includes only unique error and exception messages.
The following things to be done :
1) To remove all the date and time from the log file
2) To remove all the... (1 Reply)
Hi! I have a file as below:
line1
line2
line2
line3
line3
line3
line4
line4
line4
line4
I would like to extract duplicate lines (not unique, triplicate or quadruplicate lines). Output will be as below:
line2
line2
I would appreciate if anyone can help. Thanks. (4 Replies)
notes: i am using cygwin and notepad++ only for checking this and my OS is XP.
#!/bin/bash
typeset -i totalvalue=(wc -w /cygdrive/c/cygwinfiles/database.txt)
typeset -i totallines=(wc -l /cygdrive/c/cygwinfiles/database.txt)
typeset -i columnlines=`expr $totalvalue / $totallines`
awk -F' ' -v... (5 Replies)
How can i get the duplicates rows from a file using unix, for example i have data like
a,1
b,2
c,3
d,4
a,1
c,3
e,5
i want output to be like
a,1
c,3 (4 Replies)
Discussion started by: ggupta
4 Replies
LEARN ABOUT SUSE
choptest
CHOPTEST(8C)CHOPTEST(8C)NAME
choptest - HylaFAX page chopping test program
SYNOPSIS
/usr/sbin/choptest [ options ] input.tif
DESCRIPTION
choptest is a program for testing the page chopping support in the HylaFAX software (specifically, in the faxq(8C) program). choptest ana-
lyzes a TIFF/F (TIFF Class F) file with 1-D MH- or 2-D MR-encoded data and reports what the automatic page chopping logic would do if the
file were submitted for transmission. Options are provided for controlling whether choptest checks the last page or all pages of the docu-
ment, and what whitespace threshold to use in deciding if a page should be chopped.
OPTIONS -a Chop all pages in the document. This is equivalent to setting the PageChop configuration parameter to ``all''; c.f. hylafax-
config(5F). By default only the last page of the document is considered.
-t inches Set the minimum whitespace threshold that must be present on a page for it to be chopped. This is equivalent to the Page-
ChopThreshold configuration parameter; c.f. hylafax-config(5F). By default choptest requires that at least 3 inches of trailing
whitespace be present.
EXAMPLES
The following shows a multi-page, high-resolution document. Each page has insufficient whitespace for it to be chopped.
hyla% ./choptest -a ~/tiff/pics/faxix.tif
Chop pages with >=3" of white space at the bottom.
Don't chop, found 67 rows, need 588 rows
Don't chop, found 67 rows, need 588 rows
Don't chop, found 67 rows, need 588 rows
Don't chop, found 53 rows, need 588 rows
Don't chop, found 91 rows, need 588 rows
Don't chop, found 99 rows, need 588 rows
Don't chop, found 47 rows, need 588 rows
SEE ALSO faxq(8C), hylafax-config(5F)
October 3, 1995 CHOPTEST(8C)