Shell Programming and Scripting

Hi guys

First of all a salute to this wonderful platform which has helped me many a times. Im now faced with something that I cannot solve.

I have data like this

Code:

11:14:18 0.46975
11:14:18 0.07558
11:14:18 0.00020
11:14:18 0.00120
11:14:18 0.25879
11:14:19 0.00974
11:14:19 0.05656
11:14:19 0.00030
11:14:19 0.00639
11:14:19 0.01767
11:14:19 0.00215

I need to count the number of times the event happens every second. Here is an ex output

Code:

11:14:18 5
11:14:19 6

The first column is a time scale, so i need it to go till 60 then increment the minute count, and once minutes is 60 increment the hour count.

Someone please help me out here

Code:

uniq -c -w8 infile

EDIT: Although you might need to filter the output, come to think of it.

An awk alternative:

Code:

awk '{counts[$1]++} END {for (i in counts) {print i, counts[i]}}' infile

wow! thanks. perfect

Code:

 
perl -lane '$a{$F[0]}++}{foreach (keys %a){print "$_  $a{$_}"}' input

Hi getmmg
The perl script threw output in random order, any way to have it in the same order as in input?

Thanks

---------- Post updated at 11:35 AM ---------- Previous update was at 11:33 AM ----------

Hi,
could you tell me which among these two you think would be faster?? I have to run this on a huge data set.

Time them! Put a subset of the data (500K lines or whatever) in a file and run them on that with time at the start of the command (e.g. time uniq -c -w8 file > /dev/null).

fwiw, awk seems to run fastest on my system on a random file - but that probably has the same issue with output order.

Code:

$ nawk '{print $1|"sort|uniq -c"}' infile