|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
dont have a clue again- flying bat data new logger
Post 302502991 by cmp260 on Wednesday 9th of March 2011 11:37:39 AM
03-09-2011
Hi, I tested the grep above but unsure how to really use it and nothing seemed to happen. Ill have to read a manual on grep I thingk.
what I need as output is a file with, as a minimum, the following on each line of text:
date of each day, the maximum count of bats out for each day, the time of that maximum count
e.g.
22/12/2011, 313, 21:00 or similar
"nice to have" but not necesary, any or all of the follwing:
average speed of flight( so I can see when in the year the baby bats start to emerge)
time of first evening flight,
time of last morning flight,
during what 20 minute time did most bats go out
not needed as output: ip address, ticks, pin (althought the ticks and pin will have to be used to caclulate the others)
each full transit by a bat is either an in or an out
bit zero is the first port which is triggered by the beams. bit 1 is the secont port which is triggerd by the beams. -however... to make it "fun", the state of the ports is also recorded as a zero or a one - there is only one state per line of text
sometimes bats will break one beam by turning in the lightbox this obv screws things up and makes it more difficult. thus we need to search for definite patterns and ignore all others.
it might help at this stage to confuse the issue more and explain how it is planned to get daily total counts:
these bat species do a weird thing called "light sampling" where they go in and out multiple times until the conditons are right and finally leave to forage for the night. Obv, this causes a total screw up if you just simply count the total number exiting - you end up with an order of magnitude more bats than actually exist in the roost. To eliminate this as best as possible we need to total the ins and outs until a peak number is arrived at as follows:
If we set "out" = +1 (plus one) and "in" = -1 (minus one)
thus:
dinrection total
out +1 1
out +1 2
out +1 3
out +1 4
in -1 3
in -1 2
out +1 3
etc. this way at some point in each evening there is a maximum in the total column which will
more or less equate to the total number in the roost
does this make sense? is it possible to do?
what I need as output is a file with, as a minimum, the following on each line of text:
date of each day, the maximum count of bats out for each day, the time of that maximum count
e.g.
22/12/2011, 313, 21:00 or similar
"nice to have" but not necesary, any or all of the follwing:
average speed of flight( so I can see when in the year the baby bats start to emerge)
time of first evening flight,
time of last morning flight,
during what 20 minute time did most bats go out
not needed as output: ip address, ticks, pin (althought the ticks and pin will have to be used to caclulate the others)
each full transit by a bat is either an in or an out
bit zero is the first port which is triggered by the beams. bit 1 is the secont port which is triggerd by the beams. -however... to make it "fun", the state of the ports is also recorded as a zero or a one - there is only one state per line of text
sometimes bats will break one beam by turning in the lightbox this obv screws things up and makes it more difficult. thus we need to search for definite patterns and ignore all others.
it might help at this stage to confuse the issue more and explain how it is planned to get daily total counts:
these bat species do a weird thing called "light sampling" where they go in and out multiple times until the conditons are right and finally leave to forage for the night. Obv, this causes a total screw up if you just simply count the total number exiting - you end up with an order of magnitude more bats than actually exist in the roost. To eliminate this as best as possible we need to total the ins and outs until a peak number is arrived at as follows:
If we set "out" = +1 (plus one) and "in" = -1 (minus one)
thus:
dinrection total
out +1 1
out +1 2
out +1 3
out +1 4
in -1 3
in -1 2
out +1 3
etc. this way at some point in each evening there is a maximum in the total column which will
more or less equate to the total number in the roostdoes this make sense? is it possible to do?
Last edited by cmp260; 03-10-2011 at 01:56 PM..
|
|
3 More Discussions You Might Find Interesting
1. Programming
hi, I need to know how to lock a file. I used the following code, but after executing the program the file 'write.txt' remined empty, and I have no idea why.Maybe I'm not using the corresponding syntax for blocking a file. But I deleted then the blocking part and the problem persisted.
see to... (2 Replies)
Discussion started by: atticus
2 Replies
2. Solaris
df shows that the filesystem is filling up and the usage is 94%.
However when I actually traverse to the directory I du shows only about
10% of the space occupied!
Below is the output of df and du:
>>>df -kh
/cbmdata/00 470M 393M 29M 94% /cbmdata/00
>>>/cbmdata/00>... (3 Replies)
Discussion started by: zombiezparadize
3 Replies
3. Shell Programming and Scripting
Hi, Im not a unix person but need to analyse some data.
This is bat data (animals) from large roosts using data loggers.
I think AWK is probably the best thing to use but dont really know so any help appreciated.
(python, grep) whichever it is, I'll have to learn it!
here is an example of... (27 Replies)
Discussion started by: cmp260
27 Replies
LEARN ABOUT CENTOS
histo
HISTO(1) General Commands Manual HISTO(1) NAME
histo - compute 1-dimensional histogram of N data columns SYNOPSIS
histo [-c][-p] xmin xmax nbins histo [-c][-p] imin imax DESCRIPTION
Histo bins columnular data on the standard input between the given minimum and maximum values. If three command line arguments are given, the third is taken as the number of data bins between the first two real numbers. If only two arguments are given, they are both assumed to be integers, and the number of data bins will be equal to their difference plus one. The bins are always of equal size. The output is N+1 columns of data (for N columns input), where the first column is the centroid of each division, and each row corresponds to the frequencies for each column around that value. If the -c option is present, then histo computes the cumulative histogram for each column instead of the straight frequencies. The upper value of each bin is printed also instead of the centroid. This may be useful in computing percentiles, for example. Values below the minimum specified are still counted in the cumulative total. The -p option tells histo to report the percentage of the total number of input lines rather than the absolute counts. In the case of a cumulative total, this yields the percentile values directly. Values above the maximum are counted as well as values below in this case. All input data is interpreted as real values, and columns must be white-space separated. If any value is less than the minimum or greater than the maximum, it will be ignored unless the -c option is specified. EXAMPLE
To count data values between -1 and 1 in 50 bins: histo -1 1 50 < input.dat To count frequencies of integers between 0 and 255: histo 0 255 < input.dat AUTHOR
Greg Ward SEE ALSO
cnt(1), neaten(1), rcalc(1), rlam(1), tabfunc(1), total(1) RADIANCE
9/6/96 HISTO(1)