Sponsored Content
Full Discussion: Duplicate count in a file
Top Forums Shell Programming and Scripting Duplicate count in a file Post 302288407 by deo_kaustubh on Tuesday 17th of February 2009 06:49:57 AM
Old 02-17-2009
Duplicate count in a file

I have a file like this :

NAME User
------ -----
ABC 90xyz
ABC 90tuv
CDE 90xyz
CDE 90pqr
ERT 90xyz
ERT 90pqr
: :
: :

I need to get the ducplicate count of Users. Like,
90xyz Count : 3
90pqr Count : 2

Thanks in advance.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

How to count the record count in an EBCDIC file.

How do I get the record count in an EBCDIC file on a Linux Box. :confused: (1 Reply)
Discussion started by: oracle8
1 Replies

2. Shell Programming and Scripting

finding duplicate files by size and finding pattern matching and its count

Hi, I have a challenging task,in which i have to find the duplicate files by its name and size,then i need to take anyone of the file.Then i need to open the file and find for more than one pattern and count of that pattern. Note:These are the samples of two files,but i can have more... (2 Replies)
Discussion started by: jerome Sukumar
2 Replies

3. Shell Programming and Scripting

Getting Sum, Count and Distinct Count of a file

Hi all this is a UNIX question. I have a large flat file with millions of records. col1|col2|col3 1|a|b 2|c|d 3|e|f 3|g|h footer**** I am supposed to calculate the sum of col1 1+2+3+3=9, count of col1 1,2,3,3=4, and distinct count of col1 1,2,3=c3 I would like it if you avoid... (4 Replies)
Discussion started by: singhabhijit
4 Replies

4. Shell Programming and Scripting

Count the delimeter from a file and delete the row if delimeter count doesnt match.

I have a file containing about 5 million rows, in the file there are some records which has extra delimiter at random position. (we dont know the positions), now we have to Count the delimeter from each row and if the count of delimeter is not matching then I want to delete those rows from the... (5 Replies)
Discussion started by: Akumar1
5 Replies

5. UNIX for Dummies Questions & Answers

CSV file:Find duplicates, save original and duplicate records in a new file

Hi Unix gurus, Maybe it is too much to ask for but please take a moment and help me out. A very humble request to you gurus. I'm new to Unix and I have started learning Unix. I have this project which is way to advanced for me. File format: CSV file File has four columns with no header... (8 Replies)
Discussion started by: arvindosu
8 Replies

6. UNIX for Dummies Questions & Answers

deletion of duplicate characters and count

to delete the duplicate characters in a file I used this code cat file.txt|tr -s "" tell the other ways using sed command to count of duplicate characters thanks:) (0 Replies)
Discussion started by: tsurendra
0 Replies

7. Shell Programming and Scripting

Remove duplicate lines from first file comparing second file

Hi, I have two files with below data:: file1:- 123|aaa|ppp 445|fff|yyy 999|ttt|jjj 555|hhh|hhh file2:- 445|fff|yyy 555|hhh|hhh The records present in file1, not present in file 2 should be writtent to the out put file. output:- 123|aaa|ppp 999|ttt|jjj Is there any one line... (3 Replies)
Discussion started by: gani_85
3 Replies

8. Shell Programming and Scripting

Find duplicate based on 'n' fields and mark the duplicate as 'D'

Hi, In a file, I have to mark duplicate records as 'D' and the latest record alone as 'C'. In the below file, I have to identify if duplicate records are there or not based on Man_ID, Man_DT, Ship_ID and I have to mark the record with latest Ship_DT as "C" and other as "D" (I have to create... (7 Replies)
Discussion started by: machomaddy
7 Replies

9. Shell Programming and Scripting

Extract and count number of Duplicate rows

Hi All, I need to extract duplicate rows from a file and write these bad records into another file. And need to have a count of these bad records. i have a command awk ' {s++} END { for(i in s) { if(s>1) { print i } } }' ${TMP_DUPE_RECS}>>${TMP_BAD_DATA_DUPE_RECS}... (5 Replies)
Discussion started by: Arun Mishra
5 Replies

10. Shell Programming and Scripting

Count duplicate lines ignoring certain columns

I have this structure: col1 col2 col3 col4 col5 27 xxx 38 aaa ttt 2 xxx 38 aaa yyy 1 xxx 38 aaa yyy I need to collapse duplicate lines ignoring column 1 and add values of duplicate lines (col1) so it will look like this: col1 col2 col3 col4 col5 27 xxx 38 aaa ttt ... (3 Replies)
Discussion started by: coppuca
3 Replies
dtfilsys(file formats)													    dtfilsys(file formats)

NAME
dtfilsys -- CDE file system; directory tree structure DESCRIPTION
The CDE file system is divided into three parts: the root system, /usr/dt, the configuration directory, /etc/dt, and the temporary direc- tory, /var/dt. The root system, /usr/dt, is a read-only directory. It contains all the files that comprise the CDE. The configuration directory, /etc/dt, is the directory CDE applications will search to locate configuration files that have been modified by the system administrator. Default versions of these configuration files are typically located in /usr/dt. The temporary directory, /var/dt, contains temporary information or information that varies in size and existence. Below is a diagram of the directory tree structure for CDE. /etc/dt/appconfig/appmanager/<Lang> /help/<Lang> /icons/<Lang> /types/<Lang> /backdrops/<Lang> /config /palettes/<Lang> /usr/dt/app-defaults/<Lang> /appconfig/appmanager/<Lang> /help/<Lang> /icons/<Lang> /types/<Lang> /bin /config /lib /share/backdrops/<Lang> /include /examples /man /palettes/<Lang> /var/dt/appconfig/appmanager $HOME/.dt/appmanager /help /icons /palettes /sessions /types The following guidelines apply to the contents of these directories: /usr/dt This directory is for use by the CDE system. Applications should never create files in this directory although they may read and execute them. /usr/dt/app-defaults/<Lang> This directory contains the localized versions of the app-defaults files for the CDE clients. /usr/dt/appconfig/appmanager/<Lang> This directory contains the localized versions of the actions files used by the Application Manager. /usr/dt/appconfig/help/<Lang> This directory contains the localized versions of the CDE help volumes and help files. /usr/dt/appconfig/icons/<Lang> This directory contains the localized versions of the icons used by the CDE clients. /usr/dt/appconfig/types/<Lang> This directory contains the localized versions of the actions and data types used by the CDE clients. /usr/dt/bin This directory contains the CDE clients. /usr/dt/config This directory contains default configuration files. /usr/dt/lib This directory contains the shared libraries used by the CDE clients. /usr/dt/share This directory contains CDE elements, typically ASCII files, that are independent of the architecture. /usr/dt/share/backdrops/<Lang> This directory contains the localized versions of the backdrops used by the window manager workspaces and by the Style Manager. /usr/dt/share/examples This directory contains examples of CDE functionality. /usr/dt/share/include This directory is part of the developmewnt environment and includes header files associated with CDE. /usr/dt/share/man This directory contains the man pages for the CDE clients. /usr/dt/share/palettes/<Lang> This directory contains the localized versions of the palettes used by the Style Manager to determine the color scheme. /etc/dt This directory is specified as the CDE configuration directory. /etc/dt/appconfig This directory is used to hold system-administrator defined configuration files /etc/dt/appconfig/appmanager/<Lang> This directory is used to hold system-administrator defined configuration files for the Application Manager. /etc/dt/appconfig/help/<Lang> This directory is used to hold system-administrator defined configuration files for the Help system. /etc/dt/appconfig/icons/<Lang> This directory is used to hold system-administrator defined configuration files for icons. /etc/dt/appconfig/types/<Lang> This directory is used to hold system-administrator defined configuration files for the action and filetype database. /etc/dt/backdrops/<Lang> This directory contains backdrops provided by the system administrator. /etc/dt/config This directory is to contain modified versions of the CDE configuration files (installed in /usr/dt/config). /etc/dt/palettes/<Lang> This directory contains palettes provided by the system administrator. /var/dt This directory is used by CDE for some log files, temporary files, and files that vary in size. /var/dt/appconfig/appmanager This directory is created at login and is used by the Application Manager. $HOME/.dt This directory contains information specific to the user. $HOME/.dt/appmanager This directory is used to hold user-defined configuration files for the Application Manager. $HOME/.dt/backdrops This directory is used to hold user-customized backdrops for the Style Manager. $HOME/.dt/help This directory is used to hold user-defined configuration files for the Help system. $HOME/.dt/icons This directory is used to hold user-defined configuration files for icons. $HOME/.dt/palettes This directory is used to hold user-customized palettes for the Style Manager. $HOME/.dt/sessions This directory is used to store session information between CDE sessions. $HOME/.dt/tmp This directory is used to hold temporary information. $HOME/.dt/types This directory is used to hold user-defined configuration files for the action and filetypes database. The Minimum Runtime Environment The minimum environment required for a system to support CDE consists of the following files and directories: /usr/dt/app-defaults/C/ tpad Dtksh Dtterm /usr/dt/appconfig/tttypes/ types.xdr /usr/dt/bin/ dsdm dtaction dtappgather dtappintegrate dtexec dtksh dtpad dtspcd dtterm suid_exec rpc.ttdbserver tt_type_comp ttsession SEE ALSO
dtenvvar(5) dtfilsys(file formats)
All times are GMT -4. The time now is 06:05 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy