Search Results

Yep it was a typo, sorry! Thanks for your help. Will let you know if I have any further issues! Thanks again :)

Hey! that worked and took no time to compute :) Doing some more testing but I think its fine. Thanks! Just a quick question, if the user inputs are 2 and 10 (not 0) will it still use 2*10 as the...

Hi,

Your' correct, you've assumed it to be relative to the previous group. What I need is that the 3rd column should give a count of unique/different IPs within that sampling interval (original...

Hey!

Trying running it on this:

899787600 78.169.38.0
899787601 52.72.7.0
899787601 52.72.7.0
899787601 154.225.0.0
899787602 118.82.0.0
899787602 252.184.37.0
899787603 211.20.38.0...

Hey! Using 0 as the second input works fine but somehow its disturbing the calculations of column 3. Further, I need to run this on a large dataset (~35 million entries), so can you also suggest...

Hey! Thanks for your effort, really appreciate that! I still have to test it but it looks like it will be fine. Just a quick comment/question from top of my head. If I had to make the history period...

Hey!

Thanks for the reply! I realize I wasn't clear enough, my apologies for the confusion. I will try and explain the problem again.

If you have a look at post #2 and #9 of the thread, the...

Hi!

I would to add another user input parameter (to script provided by Agama posted on 08-10-11) i.e. history period (ranging from no history to everything till the sampling interval) in...

Thanks! I am trying to optimize it as the input files are pretty big (~2GB)

Cheers,

its the no. of new IPs in the current interval as compared to the previous interval.

Okay..the input file is in the following format
# Epoch Time IP Address

899726401 112.254.1.0 20
899726401 112.254.1.0 10
899726402 154.162.38.0 30
...

Okay. I have a file with three columns. Time-stamp, IP Address and Bytes. Time-stamp is in epoch and there are multiple entries for same time-stamp, each representing a packet.

I need a awk/sed...

Its still not solving my purpose, but thanks anyways!

The third column it prints is incorrect.

I am looking for a solution which integrates the above script given by agama and your previous solution ...

its not adding the byte-value of the first line. And the thread I was referring to is at
...

If possible can you have a quick look at the thread "Counting entries in a file" and help me out with an integrated solution.

Cheers,

Yes, input file is already sorted by epoch number. Its just that there are multiple entries for the same epoch number.

Yes, you are right, the outputs first-column would be even number if input...

its should give:

2 150
3 90 (only because after first 2 secs the file had just 1 sec of data left)

in other cases its should continue to process data for every 2 seconds and add the bytes for...

Hi,

I have a large log file in the following format.

Epoch-Time Bytes
899726401 20
899726401 30
899726402 40
899726402 ...

I have another column to the input file and would like to sum-up and print the entries of that column for the user specified time interval. For e.g. if the user specifies 5 second as the input, the...

Can you modify it to compute the 'new IPs in the current bin compared to the ENTIRE HISTORY upto that interval instead of just the previous interval' ?

Cheers,

It works:b:

Can you give a brief explanation ? I am new to awk.

Hi,

In place of "number of unique IPs" for that timeinterval, if I would like to calculate "number of NEW IPs (comparing the IPs in the current time interval to the IPs in the previous time...

Hi,

I am looking for a sed/awk script to join two large (~300 M) single column files (one is sorted and the other is not sorted) side-by-side. I have a shell script but its taking ages to do the...

Cheers :b: