Sponsored Content
Full Discussion: Duplicate count in a file
Top Forums Shell Programming and Scripting Duplicate count in a file Post 302288407 by deo_kaustubh on Tuesday 17th of February 2009 06:49:57 AM
Old 02-17-2009
Duplicate count in a file

I have a file like this :

NAME User
------ -----
ABC 90xyz
ABC 90tuv
CDE 90xyz
CDE 90pqr
ERT 90xyz
ERT 90pqr
: :
: :

I need to get the ducplicate count of Users. Like,
90xyz Count : 3
90pqr Count : 2

Thanks in advance.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to count the record count in an EBCDIC file.

How do I get the record count in an EBCDIC file on a Linux Box. :confused: (1 Reply)
Discussion started by: oracle8
1 Replies

2. Shell Programming and Scripting

finding duplicate files by size and finding pattern matching and its count

Hi, I have a challenging task,in which i have to find the duplicate files by its name and size,then i need to take anyone of the file.Then i need to open the file and find for more than one pattern and count of that pattern. Note:These are the samples of two files,but i can have more... (2 Replies)
Discussion started by: jerome Sukumar
2 Replies

3. Shell Programming and Scripting

Getting Sum, Count and Distinct Count of a file

Hi all this is a UNIX question. I have a large flat file with millions of records. col1|col2|col3 1|a|b 2|c|d 3|e|f 3|g|h footer**** I am supposed to calculate the sum of col1 1+2+3+3=9, count of col1 1,2,3,3=4, and distinct count of col1 1,2,3=c3 I would like it if you avoid... (4 Replies)
Discussion started by: singhabhijit
4 Replies

4. Shell Programming and Scripting

Count the delimeter from a file and delete the row if delimeter count doesnt match.

I have a file containing about 5 million rows, in the file there are some records which has extra delimiter at random position. (we dont know the positions), now we have to Count the delimeter from each row and if the count of delimeter is not matching then I want to delete those rows from the... (5 Replies)
Discussion started by: Akumar1
5 Replies

5. UNIX for Dummies Questions & Answers

CSV file:Find duplicates, save original and duplicate records in a new file

Hi Unix gurus, Maybe it is too much to ask for but please take a moment and help me out. A very humble request to you gurus. I'm new to Unix and I have started learning Unix. I have this project which is way to advanced for me. File format: CSV file File has four columns with no header... (8 Replies)
Discussion started by: arvindosu
8 Replies

6. UNIX for Dummies Questions & Answers

deletion of duplicate characters and count

to delete the duplicate characters in a file I used this code cat file.txt|tr -s "" tell the other ways using sed command to count of duplicate characters thanks:) (0 Replies)
Discussion started by: tsurendra
0 Replies

7. Shell Programming and Scripting

Remove duplicate lines from first file comparing second file

Hi, I have two files with below data:: file1:- 123|aaa|ppp 445|fff|yyy 999|ttt|jjj 555|hhh|hhh file2:- 445|fff|yyy 555|hhh|hhh The records present in file1, not present in file 2 should be writtent to the out put file. output:- 123|aaa|ppp 999|ttt|jjj Is there any one line... (3 Replies)
Discussion started by: gani_85
3 Replies

8. Shell Programming and Scripting

Find duplicate based on 'n' fields and mark the duplicate as 'D'

Hi, In a file, I have to mark duplicate records as 'D' and the latest record alone as 'C'. In the below file, I have to identify if duplicate records are there or not based on Man_ID, Man_DT, Ship_ID and I have to mark the record with latest Ship_DT as "C" and other as "D" (I have to create... (7 Replies)
Discussion started by: machomaddy
7 Replies

9. Shell Programming and Scripting

Extract and count number of Duplicate rows

Hi All, I need to extract duplicate rows from a file and write these bad records into another file. And need to have a count of these bad records. i have a command awk ' {s++} END { for(i in s) { if(s>1) { print i } } }' ${TMP_DUPE_RECS}>>${TMP_BAD_DATA_DUPE_RECS}... (5 Replies)
Discussion started by: Arun Mishra
5 Replies

10. Shell Programming and Scripting

Count duplicate lines ignoring certain columns

I have this structure: col1 col2 col3 col4 col5 27 xxx 38 aaa ttt 2 xxx 38 aaa yyy 1 xxx 38 aaa yyy I need to collapse duplicate lines ignoring column 1 and add values of duplicate lines (col1) so it will look like this: col1 col2 col3 col4 col5 27 xxx 38 aaa ttt ... (3 Replies)
Discussion started by: coppuca
3 Replies
TIMETRANS(1p)						User Contributed Perl Documentation					     TIMETRANS(1p)

NAME
timetrans - Converts time into time SYNOPSIS
timetrans [units-options] [-count] DESCRIPTION
timetrans converts time from one type of unit to another. If any of the units options are specified, then timetrans will convert those time units into the number of seconds to which they add up. If given the count option, timetrans will convert that number of seconds into the appropriate number of weeks, days, hours, minutes, and seconds. The converted result is printed out. Units options cannot be specified in the same execution as the count option, and vice versa. timetrans is intended for use with DNSSEC-Tools, for calculating a zone's expiration time. OPTIONS
Units Options The converted value of each unit is totaled and a single result printed. -seconds seconds Count of seconds to convert to seconds. -minutes minutes Count of minutes to convert to seconds. -hours hours Count of hours to convert to seconds. -days days Count of days to convert to seconds. -weeks weeks Count of weeks to convert to seconds. Count Option The specified seconds count is converted to the appropriate number of weeks, days, hours, minutes, and seconds. -count seconds Count of seconds to convert to the appropriate set of units. Other Options timetrans has the following miscellaneous options. -Version Displays the version information for timetrans and the DNSSEC-Tools package. EXAMPLES
Example 1: Converting 5 days into seconds $(42)> timetrans -days 5 432000 Example 2: Converting 2 weeks into seconds $(43)> timetrans -w 2 1209600 Example 3: Converting 8 days and 8 hours into seconds $(44)> timetrans -d 8 -hours 8 720000 Example 4: Converting 1 week, 1 day, and 8 hours into seconds $(46)> timetrans -w 1 -days 1 -h 8 720000 Example 5: Converting 14 weeks, 4 days, 21 hours, 8 minutes, and 8 seconds into seconds $(47)> timetrans -w 14 -d 4 -h 21 -m 8 -s 8 8888888 Example 6: Converting 720000 seconds into time units $(48)> timetrans -c 720000 1 week, 1 day, 8 hours Example 7: Converting 1814421 seconds into time units $(49)> timetrans -c 1814421 3 weeks, 21 seconds Example 8: Converting 8888888 seconds into time units $(50)> timetrans -c 8888888 14 weeks, 4 days, 21 hours, 8 minutes, 8 seconds COPYRIGHT
Copyright 2004-2012 SPARTA, Inc. All rights reserved. See the COPYING file included with the DNSSEC-Tools package for details. AUTHOR
Wayne Morrison, tewok@tislabs.com SEE ALSO
zonesigner(8) Net::DNS::SEC::Tools::timetrans.pm(3) perl v5.14.2 2012-06-21 TIMETRANS(1p)
All times are GMT -4. The time now is 03:36 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy