Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Help with uniq command

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with uniq command
# 1  
Old 02-27-2009
Help with uniq command
I call....

Code:
cat 1.txt | uniq -c

Sample of whats in 1.txt

Code:
vmstat
cd
exit
w
cd
cd
cd
newgrp
xinit
f
cd
cd
cd
rlogin
rlogin
cd
cd
cd
rlogin
rlogin

On a file but the output is not really "unique". I want all the output to be just each word with the number of times beside it, but I get this....

Code:
 2 cd
      1 lp
      4 exec
      1 cd
      1 f
      2 cd
      1 w
      1 vmstat
      1 qu
      2 exec
      1 cd
      1 exit
      2 exec
      1 pwd
      1 vmstat
      1 cd
      1 exit
      1 w
      3 cd
      1 newgrp

Help?
# 2  
Old 02-27-2009
Code:
sort 1.txt | uniq -c

# 3  
Old 02-27-2009
Quote:
Originally Posted by Bandit390
I call....

Code:
cat 1.txt | uniq -c


UUOC
Quote:

Sample of whats in 1.txt

Code:
vmstat
cd
exit
...
rlogin

On a file but the output is not really "unique". I want all the output to be just each word with the number of times beside it, but I get this....

Code:
      2 cd
      1 lp
...
      3 cd
      1 newgrp

Help?

The input to uniq must be sorted. It only deals with consecutive duplicate lines.

This awk script will do it without sorting:

Code:
awk '
{
 ++count[$0]
 line[NR] = $0
}
END {
while ( ++n <= NR ) {
   if ( x[line[n]]++ == 0 ) printf "%7d %s\n", count[line[n]], line[n]
  }
}
' "$FILE"

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Trying to find the distinct lines using uniq command

Platform :Oracle Linux 6.4 Shell : bash The below file has 7 lines , some of them are duplicates. There are only 3 distinct lines. But why is the uniq command still showing 7 ? I just want the distinct lines to be returned. $ cat test.txt SELECT FC.COORD_SET_ID FROM OM_ORDER_FLOW F, -... (2 Replies)
Discussion started by: kraljic
2 Replies

2. Shell Programming and Scripting

cat and uniq command

Hello i have tried to retrieve a distinct list of data from a file with a command combination but the uniq command line is not filtering the fields repeated. Can someone help me ? here is the file input 3837734|LAUNCH TEST01 3837735|LAUNCH TEST01 3837736|LAUNCH TEST01 3837737|LAUNCH... (4 Replies)
Discussion started by: ade05fr
4 Replies

3. Shell Programming and Scripting

Addition as part of uniq command

Dear Friends, I want to know if it is possible to perform addition as part of uniq command. Input: 213.64.56.208 1 213.64.56.208 2 213.64.56.208 3 213.46.27.204 10 213.46.27.204 20 213.46.27.204 30 The above input should be converted as follows 213.64.56.208 6 213.46.27.204 60 ... (4 Replies)
Discussion started by: tamil.pamaran
4 Replies

4. UNIX for Dummies Questions & Answers

Re: How To Use UNIQ UNIX Command On single Column

Hi , Can You Please let Know How use unix uniq command on a single column for deleting records from file with Below Structure.Pipe Delimter File . Source Name | Account_Id A | 101 B... (2 Replies)
Discussion started by: anudeepkumar123
2 Replies

5. UNIX for Advanced & Expert Users

uniq command

at which situation uniq command fails. How to delete/remove duplicate lines in an unix file (1 Reply)
Discussion started by: tp2115
1 Replies

6. Shell Programming and Scripting

Uniq Command?

Hello, I have a file with a list of car makes and specific information for each make. An example is: @Audi:Warranty @Audi:Pricing @Audi:Colors @Acura:Warranty @Acura:Pricing @Acura:Colors and so on through a bunch of makes. I need to make a list in a selection box of just one name of... (12 Replies)
Discussion started by: macbb1117
12 Replies

7. UNIX for Dummies Questions & Answers

Several file comparison not uniq or comm command

When comparing several files is there a way to find values unique to each file? File1 a b c d File2 a b t File 3 a (3 Replies)
Discussion started by: dr_sabz
3 Replies

8. UNIX for Dummies Questions & Answers

Uniq command behaving odd

My file has k s j v l k a s f l k s a d f j l a s (3 Replies)
Discussion started by: phoenix_nebula
3 Replies

9. UNIX for Dummies Questions & Answers

Difference between plain "uniq" and "uniq -u"

Dear all, It's not entirely clear to me from manpage the difference between them. Why we still need "-u" flag? - monkfan (3 Replies)
Discussion started by: monkfan
3 Replies

10. UNIX for Dummies Questions & Answers

uniq command???

HI, Please tell the usage of uniq command in UNIX with example Thanks (2 Replies)
Discussion started by: skyineyes
2 Replies
Login or Register to Ask a Question