Find and remove duplicate record and print list Post: 302727639

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to extract duplicate records with associated header record

All, I have a task to search through several hundred files and extract duplicate detail records and keep them grouped with their header record. If no duplicate detail record exists, don't pull the header. For example, an input file could look like this: input.txt HA D1 D2 D2 D3 D4 D4...

2. UNIX for Advanced & Expert Users

How to remove duplicate lines of a record without changing the order

Hi all, I have to remove duplicate lines in a file without chainging the order.for eg if i have a record pqr def abc lmn pqr abc mkh hgf the output should be pqr def abc lmn mkh hgf

3. UNIX for Advanced & Expert Users

Print Full record and substring in that record

I have i got a requirement like below. I have input file which contains following fixed width records. 00000000000088500232007112007111 I need the full record and concatenated with ~ and characters from 1to 5 and concatenated with ~ and charactes from 10 to 15 The out put will be like...

4. Shell Programming and Scripting

Find duplicate filenames and remove in different mount point

Hi Gurus, Do any kind souls encounter have the same script as mentioned here. Find and compare filenames in different mount point and remove duplicates. Thanks a million!!! wanna13e

5. Shell Programming and Scripting

Find x and print its record

Hi all, I have a file containing two fields with 154 rows/records/lines (forgive me, my UNIX terminology is not quite up to par yet). I am trying to read from this list, find a value (lets say 0), then print the record/line/row that value falls on (In this case it would be record/line/row #27)?...

6. Shell Programming and Scripting

Find duplicate based on 'n' fields and mark the duplicate as 'D'

Hi, In a file, I have to mark duplicate records as 'D' and the latest record alone as 'C'. In the below file, I have to identify if duplicate records are there or not based on Man_ID, Man_DT, Ship_ID and I have to mark the record with latest Ship_DT as "C" and other as "D" (I have to create...

7. Shell Programming and Scripting

Find key pattern and print selected lines for each record

Hi, I need help on a complicated file that I am working on. I wanted to extract important info from a very huge file. It is space delimited file. I have hundred thousands of records in this file. An example content of the inputfile as below:- ## ID Ser402 Old; 23...

8. Shell Programming and Scripting

Modifying text file records, find data in one place in the record and print it elsewhere

Hello, I have some text data that is in the form of multi-line records. Each record ends with the string $$$$ and the next record starts on the next line. RDKit 2D 15 14 0 0 0 0 0 0 0 0999 V2000 5.4596 2.1267 0.0000 C 0 0 0 0 0 0 0 0 0 0 0 ...

9. Shell Programming and Scripting

Check/print missing number in a consecutive range and remove duplicate numbers

Hi, In an ideal scenario, I will have a listing of db transaction log that gets copied to a DR site and if I have them all, they will be numbered consecutively like below. 1_79811_01234567.arc 1_79812_01234567.arc 1_79813_01234567.arc 1_79814_01234567.arc 1_79815_01234567.arc...

LEARN ABOUT MINIX

ppmhist

ppmhist(1)                                                    General Commands Manual                                                   ppmhist(1)

NAME

       ppmhist - print a histogram of a portable pixmap

SYNOPSIS

       ppmhist [-hexcolor] [-noheader] [-map] [-nomap] [-sort={frequency,rgb}] [ppmfile]

DESCRIPTION

       Reads  a  PPM  image as input.  Generates a histogram of the colors in the image, i.e. a list of all the colors and how many pixels of each
       color are in the image.

OPTIONS

       -sort={frequency,rgb}
              The -sort option determines the order in which the colors are listed in the output.  frequency means to list them in  order  of  how
              pixels  in the input image have the color, with the most represented colors first.  rgb means to sort them first by the intensity of
              the red component of the color, the of the green, then of the blue, with the least intense first.

              The default is frequency.

       -hexcolor
              Print the color components in hexadecimal.  Default is decimal.

       -noheader
              Do not print the column headings.

       -map   Generates a PPM file of the colormap for the image, with the color histogram as comments.

       -nomap Generates the histogram for human reading.  This is the default.

SEE ALSO

       ppm(5), pgmhist(1), ppmtomap(1), pnmhistmap(1), ppmchange(1)

AUTHOR

       Copyright (C) 1989 by Jef Poskanzer.

                                                                 17 September 2000                                                      ppmhist(1)