I have written one shell script. The output file of this script is having sql output.
In that file, I want to extract the rows which are having multiple entries(duplicate rows).
For example, the output file will be like the following way.
In this output, I want numeric duplicate rows only. Suppose this file is having lines to separate the values, those lines also considered as duplicate rows. So I want only the out put from this file which is having more than one entry and which is related to numbers.
Can anyone please tell me the command?
Thanks in advance.
Regards,
Raghu.
Try this
Code:
#!/bin/ksh
sort $1 > sortedfile
nawk '{ while (getline < sortedfile >0); array[n++]=$0; compare and remove non dup record here}'
hi all
can anyone please let me know if there is a way to find out duplicate rows in a file. i have a file that has hundreds of numbers(all in next row).
i want to find out the numbers that are repeted in the file.
eg.
123434
534
5575
4746767
347624
5575
i want 5575
please help (3 Replies)
I have a file content like below.
"0000000","ABLNCYI","BOTH",1049,2058,"XYZ","5711002","","Y","","","","","","","",""
"0000000","ABLNCYI","BOTH",1049,2058,"XYZ","5711002","","Y","","","","","","","",""
"0000000","ABLNCYI","BOTH",1049,2058,"XYZ","5711002","","Y","","","","","","","",""... (5 Replies)
Hi,
I am processing a file and would like to delete duplicate records as indicated by one of its column. e.g.
COL1 COL2 COL3
A 1234 1234
B 3k32 2322
C Xk32 TTT
A NEW XX22
B 3k32 ... (7 Replies)
I have searched the internet for duplicate row extracting.
All I have seen is extracting good rows or eliminating duplicate rows.
How do I extract duplicate rows from a flat file in unix.
I'm using Korn shell on HP Unix.
For.eg.
FlatFile.txt
========
123:456:678
123:456:678
123:456:876... (5 Replies)
Hi,
I have a log file having size of 48mb.
For such a large log file. I want to get the message in a particular format which includes only unique error and exception messages.
The following things to be done :
1) To remove all the date and time from the log file
2) To remove all the... (1 Reply)
Hi! I have a file as below:
line1
line2
line2
line3
line3
line3
line4
line4
line4
line4
I would like to extract duplicate lines (not unique, triplicate or quadruplicate lines). Output will be as below:
line2
line2
I would appreciate if anyone can help. Thanks. (4 Replies)
notes: i am using cygwin and notepad++ only for checking this and my OS is XP.
#!/bin/bash
typeset -i totalvalue=(wc -w /cygdrive/c/cygwinfiles/database.txt)
typeset -i totallines=(wc -l /cygdrive/c/cygwinfiles/database.txt)
typeset -i columnlines=`expr $totalvalue / $totallines`
awk -F' ' -v... (5 Replies)
How can i get the duplicates rows from a file using unix, for example i have data like
a,1
b,2
c,3
d,4
a,1
c,3
e,5
i want output to be like
a,1
c,3 (4 Replies)
Discussion started by: ggupta
4 Replies
LEARN ABOUT DEBIAN
pfspad
pfspad(1) General Commands Manual pfspad(1)NAME
pfspad - Add borders to a frame in PFS stream
SYNOPSIS
pfspad [--left <columns>] [--right <columns>] [--top <rows>] [--bottom <rows>] [--width <new_width>] [--height <new_height>] [--R <val>]
[--G <val>] [--B <val>] [--Y <val>] [--help]
DESCRIPTION
Add borders to each frame in PFS stream. User specifies size of left, right, top and bottom border or size of an output image. Color of
borders can be specified as well.
OPTIONS --left <columns>, -l <columns>
Width in pixels of the left border.
--right <columns>, -r <columns>
Width in pixels of the right border.
--top <rows>, -t <rows>
Height in pixels of the top border.
--bottom <rows>, -b <rows>
Height in pixels of the bottom border.
--width <new_width>, -W <new_width>
Width of an output image. Note that --width can be mixed with either --left or --right option.
--height <new_height>, -H <new_height>
Height of an output image. Note that --height can be mixed with either --top or --bottom option.
--R <val>, -R <val>, --G <val>, -G <val>, --B <val>, -B <val>
Color of borders in RGB mode. Default color is black, and if some of the components is not specified, its value is set to 0.0.
--Y <val>, -Y <val>
Color of borders in luminance mode.
--help, -h
Print a list of commandline options.
EXAMPLES
pfsin image.hdr | pfspad --left 50 --bottom 20 | pfsout out.hdr
Add 50 columns to the left and 20 rows to the bottom side of image.hdr. Color of borders is default black.
pfsin image.hdr | pfspad --top 20 --height 500 --width 400 --R 1.0 | pfsout out.hdr
Add 20 rows to the top side of image.hdr and create output image out.hdr 500 pixels in height and 400 pixels in width. Color of bor-
ders is set to red.
SEE ALSO pfsin(1)pfsout(1)BUGS
Please report bugs and comments to Dorota Zdrojewska <dzdrojewska@wi.ps.pl>.
pfspad(1)