|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
Duplicate count in a file
Post 302288416 by Whiteboard on Tuesday 17th of February 2009 07:42:25 AM
02-17-2009
|
|
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
How do I get the record count in an EBCDIC file on a Linux Box. :confused: (1 Reply)
Discussion started by: oracle8
1 Replies
2. Shell Programming and Scripting
Hi,
I have a challenging task,in which i have to find the duplicate files by its name and size,then i need to take anyone of the file.Then i need to open the file and find for more than one pattern and count of that pattern.
Note:These are the samples of two files,but i can have more... (2 Replies)
Discussion started by: jerome Sukumar
2 Replies
3. Shell Programming and Scripting
Hi all this is a UNIX question.
I have a large flat file with millions of records.
col1|col2|col3
1|a|b
2|c|d
3|e|f
3|g|h
footer****
I am supposed to calculate the sum of col1 1+2+3+3=9, count of col1 1,2,3,3=4, and distinct count of col1 1,2,3=c3
I would like it if you avoid... (4 Replies)
Discussion started by: singhabhijit
4 Replies
4. Shell Programming and Scripting
I have a file containing about 5 million rows, in the file there are some records which has extra delimiter at random position. (we dont know the positions), now we have to Count the delimeter from each row and if the count of delimeter is not matching then I want to delete those rows from the... (5 Replies)
Discussion started by: Akumar1
5 Replies
5. UNIX for Dummies Questions & Answers
Hi Unix gurus,
Maybe it is too much to ask for but please take a moment and help me out. A very humble request to you gurus. I'm new to Unix and I have started learning Unix. I have this project which is way to advanced for me.
File format: CSV file
File has four columns with no header... (8 Replies)
Discussion started by: arvindosu
8 Replies
6. UNIX for Dummies Questions & Answers
to delete the duplicate characters in a file I used this code
cat file.txt|tr -s ""
tell the other ways using sed
command to count of duplicate characters
thanks:) (0 Replies)
Discussion started by: tsurendra
0 Replies
7. Shell Programming and Scripting
Hi,
I have two files with below data::
file1:-
123|aaa|ppp
445|fff|yyy
999|ttt|jjj
555|hhh|hhh
file2:-
445|fff|yyy
555|hhh|hhh
The records present in file1, not present in file 2 should be writtent to the out put file.
output:-
123|aaa|ppp
999|ttt|jjj
Is there any one line... (3 Replies)
Discussion started by: gani_85
3 Replies
8. Shell Programming and Scripting
Hi,
In a file, I have to mark duplicate records as 'D' and the latest record alone as 'C'.
In the below file, I have to identify if duplicate records are there or not based on Man_ID, Man_DT, Ship_ID and I have to mark the record with latest Ship_DT as "C" and other as "D" (I have to create... (7 Replies)
Discussion started by: machomaddy
7 Replies
9. Shell Programming and Scripting
Hi All,
I need to extract duplicate rows from a file and write these bad records into another file. And need to have a count of these bad records.
i have a command
awk '
{s++}
END {
for(i in s) {
if(s>1) {
print i
}
}
}' ${TMP_DUPE_RECS}>>${TMP_BAD_DATA_DUPE_RECS}... (5 Replies)
Discussion started by: Arun Mishra
5 Replies
10. Shell Programming and Scripting
I have this structure:
col1 col2 col3 col4 col5
27 xxx 38 aaa ttt
2 xxx 38 aaa yyy
1 xxx 38 aaa yyy
I need to collapse duplicate lines ignoring column 1 and add values of duplicate lines (col1) so it will look like this:
col1 col2 col3 col4 col5
27 xxx 38 aaa ttt ... (3 Replies)
Discussion started by: coppuca
3 Replies
LEARN ABOUT OSF1
sysman_intro
sysman_intro(8) System Manager's Manual sysman_intro(8) NAME
sysman_intro - Introduction of SysMan applications DESCRIPTION
SysMan is a suite of applications for managing Tru64 UNIX systems. The SysMan applications provide a simple, easy to use, graphical user interface (GUI) for common system management tasks including installation and configuration. When you follow the installation instructions in the Installation Guide, the installation GUI, Installation Setup, is displayed automati- cally. To help you prepare the system for general use, the Tru64 UNIX: System Setup checklist is displayed when you log in as root for the first time after performing an installation. SysMan applications and help are available from the Application Manager (tool drawer) icon on the CDE front panel, or from the SysMan Applications panel above the SysMan Station icon on the root CDE window. For additional information, see the Welcome to SysMan help volume by performing the following procedure: Click on the Application Manager icon (the file drawer) on the CDE front panel. Double click on the System_Admin application group icon. Double click on the Welcome to SysMan icon. If you are not running CDE, but have installed it, you can open the Welcome to Sysman help volume by entering the following sequence of commands at the command line: /bin/sh PATH=$PATH:/usr/dt/bin export PATH DTHELPSEARCHPATH=/usr/dt/appconfig/help/C/%H export DTHELPSEARCH- PATH DTUSERSESSION=${USER}-`uname -n`-0 export DTUSERSESSION dthelpgen -dir $HOME/.dt/help/$DTUSERSESSION dthelpview -helpVolume browser SEE ALSO
Commands: bttape(8), bindconfig(8), diskconfig(8), dxaccounts(8), dxadvfs(8), dxarchiver(8), dxdw(8), dxfileshare(8), dxhosts(8), dxkernel- tuner(8), dxlicenses(8), dxlsm(8), dxpower(8), dxpresto(8), dxproctuner(8), dxshutdown(8), dxsysinfo(8), mailconfig(8), mailusradm(8), net- config(8), nfsconfig(8), printconfig(8), sysman(8), System Administration Release Notes Installation Guide Technical Overview X Window System Administrator's Guide Network Administration Common Desktop Environment: User's Guide CDE Companion Common Desktop Environment: Advanced User's and System Administrator's Guide Common Desktop Environment: Programmer's Overview Common Desktop Environment: Programmer's Guide Common Desktop Environment: Help System Author's and Programmer's Guide Common Desktop Environment: Style Guide and Certification Checklist OSF/Motif Style Guide sysman_intro(8)