|
|
Sponsored Content
Top Forums
Shell Programming and Scripting
dont have a clue again- flying bat data new logger
Post 302502991 by cmp260 on Wednesday 9th of March 2011 11:37:39 AM
03-09-2011
Hi, I tested the grep above but unsure how to really use it and nothing seemed to happen. Ill have to read a manual on grep I thingk.
what I need as output is a file with, as a minimum, the following on each line of text:
date of each day, the maximum count of bats out for each day, the time of that maximum count
e.g.
22/12/2011, 313, 21:00 or similar
"nice to have" but not necesary, any or all of the follwing:
average speed of flight( so I can see when in the year the baby bats start to emerge)
time of first evening flight,
time of last morning flight,
during what 20 minute time did most bats go out
not needed as output: ip address, ticks, pin (althought the ticks and pin will have to be used to caclulate the others)
each full transit by a bat is either an in or an out
bit zero is the first port which is triggered by the beams. bit 1 is the secont port which is triggerd by the beams. -however... to make it "fun", the state of the ports is also recorded as a zero or a one - there is only one state per line of text
sometimes bats will break one beam by turning in the lightbox this obv screws things up and makes it more difficult. thus we need to search for definite patterns and ignore all others.
it might help at this stage to confuse the issue more and explain how it is planned to get daily total counts:
these bat species do a weird thing called "light sampling" where they go in and out multiple times until the conditons are right and finally leave to forage for the night. Obv, this causes a total screw up if you just simply count the total number exiting - you end up with an order of magnitude more bats than actually exist in the roost. To eliminate this as best as possible we need to total the ins and outs until a peak number is arrived at as follows:
If we set "out" = +1 (plus one) and "in" = -1 (minus one)
thus:
dinrection total
out +1 1
out +1 2
out +1 3
out +1 4
in -1 3
in -1 2
out +1 3
etc. this way at some point in each evening there is a maximum in the total column which will
more or less equate to the total number in the roost
does this make sense? is it possible to do?
what I need as output is a file with, as a minimum, the following on each line of text:
date of each day, the maximum count of bats out for each day, the time of that maximum count
e.g.
22/12/2011, 313, 21:00 or similar
"nice to have" but not necesary, any or all of the follwing:
average speed of flight( so I can see when in the year the baby bats start to emerge)
time of first evening flight,
time of last morning flight,
during what 20 minute time did most bats go out
not needed as output: ip address, ticks, pin (althought the ticks and pin will have to be used to caclulate the others)
each full transit by a bat is either an in or an out
bit zero is the first port which is triggered by the beams. bit 1 is the secont port which is triggerd by the beams. -however... to make it "fun", the state of the ports is also recorded as a zero or a one - there is only one state per line of text
sometimes bats will break one beam by turning in the lightbox this obv screws things up and makes it more difficult. thus we need to search for definite patterns and ignore all others.
it might help at this stage to confuse the issue more and explain how it is planned to get daily total counts:
these bat species do a weird thing called "light sampling" where they go in and out multiple times until the conditons are right and finally leave to forage for the night. Obv, this causes a total screw up if you just simply count the total number exiting - you end up with an order of magnitude more bats than actually exist in the roost. To eliminate this as best as possible we need to total the ins and outs until a peak number is arrived at as follows:
If we set "out" = +1 (plus one) and "in" = -1 (minus one)
thus:
dinrection total
out +1 1
out +1 2
out +1 3
out +1 4
in -1 3
in -1 2
out +1 3
etc. this way at some point in each evening there is a maximum in the total column which will
more or less equate to the total number in the roostdoes this make sense? is it possible to do?
Last edited by cmp260; 03-10-2011 at 01:56 PM..
|
|
3 More Discussions You Might Find Interesting
1. Programming
hi, I need to know how to lock a file. I used the following code, but after executing the program the file 'write.txt' remined empty, and I have no idea why.Maybe I'm not using the corresponding syntax for blocking a file. But I deleted then the blocking part and the problem persisted.
see to... (2 Replies)
Discussion started by: atticus
2 Replies
2. Solaris
df shows that the filesystem is filling up and the usage is 94%.
However when I actually traverse to the directory I du shows only about
10% of the space occupied!
Below is the output of df and du:
>>>df -kh
/cbmdata/00 470M 393M 29M 94% /cbmdata/00
>>>/cbmdata/00>... (3 Replies)
Discussion started by: zombiezparadize
3 Replies
3. Shell Programming and Scripting
Hi, Im not a unix person but need to analyse some data.
This is bat data (animals) from large roosts using data loggers.
I think AWK is probably the best thing to use but dont really know so any help appreciated.
(python, grep) whichever it is, I'll have to learn it!
here is an example of... (27 Replies)
Discussion started by: cmp260
27 Replies
LEARN ABOUT DEBIAN
mysqmail-postfix-logger
mysqmail-postfix-logger(8) System Manager's Manual mysqmail-postfix-logger(8) NAME
mysqmail-postfix-logger - logs smtp traffic to a mysql database SYNOPSIS
mysqmail-postfix-logger subprogram [ args ... ] DESCRIPTION
mysqmail-postfix-logger reads the syslog using tail -F and for each lines, does an action in a selected table in the selected mysql server (configuration done using /etc/mysqmail.conf). All messages that have been delivered are marqued as so in the from and in the to field of the smtp traffic table. mysqmail-postfix-logger uses a table corresponding to this one: CREATE TABLE IF NOT EXISTS smtp_logs ( id int(11) NOT NULL auto_increment, newmsg_id bigint(20) default NULL, bounce_qp int(11) default NULL, bytes int(11) NOT NULL default '0', sender_user varchar(128) NOT NULL default '', sender_domain varchar(128) NOT NULL default '', delivery_id bigint(20) default NULL, delivery_user varchar(128) NOT NULL default '', delivery_domain varchar(128) NOT NULL default '', delivery_success enum('yes','no') NOT NULL default 'no', time_stamp timestamp(14) NOT NULL, PRIMARY KEY (id), UNIQUE KEY bounce_qp (bounce_qp), UNIQUE KEY newmsg_id (newmsg_id), KEY sender_domain (sender_domain), KEY delivery_domain (delivery_domain) ) TYPE=MyISAM; VERSION
This documentation describes mysqmail-postfix-logger version 0.1.4. See http://gplhost.com/softwares-mysqmail.html for updates. SEE ALSO
syslog(3), logger(8) mysqmail-postfix-logger(8)