Counting and sort


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Counting and sort
# 1  
Old 05-23-2006
Data Counting and sort

Hello friends,

I have the following data:

abc-xyz
abc = 0-999
xyz = 0-999

and there are 10000 lines or more:

Example of data file:

123000
123001
123004
123005
123004
123004
123008
123008
123008
123008
246599
246700
246999
246999
246999
246999
246999
246888
246881
246999
357001
357888
357999
357999
357999
357999
357999
357999
357999
357999

I am looking for a script which will count the number of times the same number repeat. My result from the given data above should be:

123000 1
123001 1
123004 3
123005 1
123008 4
246599 1
246700 1
246881 1
246888 1
246999 6
357001 1
357888 1
357999 8

Thanks!
# 2  
Old 05-23-2006
I'm not sure what the
Quote:
abc-xyz
abc = 0-999
xyz = 0-999
has to do with anything. but for your column of numbers try:
Code:
awk '
      {arr[$0]++}
      END { for(i in arr) 
              { print $i, arrr[i] }
      } '  filename > newfilename

# 3  
Old 05-23-2006
Data

Thanks for the help. It is not working: data range :0-999999

Data sample:

123000
123001
123004
123005
123004
123004
123008
123008
123008
123008
246599
246700
246999
246999
246999
246999
246999
246888
246881
246999
357001
357888
357999
357999
357999
357999
357999
357999
357999
357999

Expect data result from the script:

123000 1
123001 1
123004 3
123005 1
123008 4
246599 1
246700 1
246881 1
246888 1
246999 6
357001 1
357888 1
357999 8


Thanks!
# 4  
Old 05-23-2006
Code:
uniq -c myfile.txt

yields:

1 123000
1 123001
1 123004
1 123005
2 123004
4 123008
1 246599
1 246700
5 246999
1 246888
1 246881
1 246999
1 357001
1 357888
8 357999

If you really need to have the results like:

357888 1
357999 8

you can use a simple awk script:

Code:
uniq -c myfile.txt | awk '{print $2, $1}'

# 5  
Old 05-23-2006
There were just a couple of typos in Jim's solution, here is what he intended to post.

Code:
awk '
      {arr[$0]++}
      END { for(i in arr) 
              { print i, arr[i] }
      } '  filename > newfilename

 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Use sort to sort numerical column

How to sort the following output based on lowest to highest BE? The following sort does not work. $ sort -t. -k1,1n -k2,2n bfd.txt BE31.116 0s 0s DOWN DAMP BE31.116 0s 0s DOWN DAMP BE31.117 0s 0s ... (7 Replies)
Discussion started by: sand1234
7 Replies

2. UNIX for Beginners Questions & Answers

Difference of Sort -n -k2 -k3 & Sort -n -k2,3

Hi, Could anyone kindly show me a link or explain the difference between sort -n -k2 -k3 & sort -n -k2,3 Also, if I like to remove the row with repetition at both $2 and $3, Can I safely use sort -u -k2 -k3 Example; 100 20 30 100 20 30 So, both $2 and $3 are same and I... (2 Replies)
Discussion started by: Indra2011
2 Replies

3. Shell Programming and Scripting

Sort help: How to sort collected 'file list' by date stamp :

Hi Experts, I have a filelist collected from another server , now want to sort the output using date/time stamp filed. - Filed 6, 7,8 are showing the date/time/stamp. Here is the input: #---------------------------------------------------------------------- -rw------- 1 root ... (3 Replies)
Discussion started by: rveri
3 Replies

4. Shell Programming and Scripting

Help with sort word and general numeric sort at the same time

Input file: 100%ABC2 3.44E-12 USA A2M%H02579 0E0 UK 100%ABC2 5.34E-8 UK 100%ABC2 3.25E-12 USA A2M%H02579 5E-45 UK Output file: 100%ABC2 3.44E-12 USA 100%ABC2 3.25E-12 USA 100%ABC2 5.34E-8 UK A2M%H02579 0E0 UK A2M%H02579 5E-45 UK Code try: sort -k1,1 -g -k2 -r input.txt... (2 Replies)
Discussion started by: perl_beginner
2 Replies

5. Shell Programming and Scripting

Alternate to sort --random-sort

sort --random-sort The full command is path=`find /testdir -maxdepth 1 -mindepth 1 -type d | ***Some sort of sort function*** | head -1` I have a list I want to randomly sort. It works fine in ubuntu but on a 'osx lion' sort dosen't have the --random-sort option. I don't want to... (5 Replies)
Discussion started by: digitalviking
5 Replies

6. Shell Programming and Scripting

Help to sort out... Possible use of sort command

I have an input like 4.3.6.66 4.3.6.67 4.3.6.70 4.3.6.25 4.3.6.15 4.3.6.54 4.3.6.44 4.3.6.34 4.3.6.24 4.3.6.14 4.3.6.53 4.3.6.43 4.3.6.49 4.3.6.33 4.3.6.52 4.3.6.19 4.3.6.58 4.3.6.42 (5 Replies)
Discussion started by: dnam9917
5 Replies

7. Shell Programming and Scripting

Is it Possible to sort a list of hexadecimal numbers using "sort" command?

Hello Everybody :) !!!. i have question in mind, is it possible to sort a list of hexadecimal numbers using "sort" command? (9 Replies)
Discussion started by: Kesavan
9 Replies

8. UNIX for Advanced & Expert Users

Script to sort the files and append the extension .sort to the sorted version of the file

Hello all - I am to this forum and fairly new in learning unix and finding some difficulty in preparing a small shell script. I am trying to make script to sort all the files given by user as input (either the exact full name of the file or say the files matching the criteria like all files... (3 Replies)
Discussion started by: pankaj80
3 Replies

9. Shell Programming and Scripting

How to Sort Floating Numbers Using the Sort Command?

Hi to all. I'm trying to sort this with the Unix command sort. user1:12345678:3.5:2.5:8:1:2:3 user2:12345679:4.5:3.5:8:1:3:2 user3:12345687:5.5:2.5:6:1:3:2 user4:12345670:5.5:2.5:5:3:2:1 user5:12345671:2.5:5.5:7:2:3:1 I need to get this: user3:12345687:5.5:2.5:6:1:3:2... (7 Replies)
Discussion started by: daniel.gbaena
7 Replies

10. Shell Programming and Scripting

Counting

Hi, I want to count how many rows are in a file for a specific column. eg. K NM K NM K NM K JK K NM K JK K NM so the file is tab-delimited. I want to count how many rows are in column 2 and how many NMs there are. I used awk awk '{OFS="\t"}; {count++} {print i,... (3 Replies)
Discussion started by: phil_heath
3 Replies
Login or Register to Ask a Question