Sponsored Content
Top Forums Shell Programming and Scripting dont have a clue again- flying bat data new logger Post 302502879 by cmp260 on Wednesday 9th of March 2011 06:37:05 AM
Old 03-09-2011
dont have a clue again- flying bat data new logger

hi,

this is related to this thread https://www.unix.com/shell-programmin...-bat-data.html

using another type of logger (ipcas ipether232) which produces csv data but not seperated into differnt folders. I need to work out how to get daily stats on bat transits (note: a bats day is 4pm to 9am)

to recap: there are two infrared beams which must both be blocked for a valid transit and direction -if only one at a time blocked it is not a bat -it is an insect.
here are valid transits:
# One direction
1,1 #Block 1
0,1 #Block 0
1,0 #Unblock 1
0,0 #Unblock 0

# Other dir
0,1 #Block 0
1,1 #Block 1
0,0 #Unblock 0
0,1 #Unblock 1
here is a sample of counts for 3 days from the logger. Note, there is a lot of bogus data at the start of day one.

Code:
ID,EventTicks,date,EventTime,IPAddress,Pin,State
 1028,634352038023594000,08/03/2011,17:56:42,192.168.0.9,1,1
 1029,634352038023657000,08/03/2011,17:56:42,192.168.0.9,1,0
 1030,634352038023672000,08/03/2011,17:56:42,192.168.0.9,0,1
 1031,634352038023682000,08/03/2011,17:56:42,192.168.0.9,0,0
 1032,634352038032558000,08/03/2011,17:56:43,192.168.0.9,0,1
 1033,634352038032572000,08/03/2011,17:56:43,192.168.0.9,1,1
 1034,634352038032583000,08/03/2011,17:56:43,192.168.0.9,0,0
 1035,634352038033666000,08/03/2011,17:56:43,192.168.0.9,1,0
 1036,634352038043948000,08/03/2011,17:56:44,192.168.0.9,1,1
 1037,634352038043963000,08/03/2011,17:56:44,192.168.0.9,0,1
 1038,634352038043976000,08/03/2011,17:56:44,192.168.0.9,1,0
 1039,634352038043986000,08/03/2011,17:56:44,192.168.0.9,0,0
 1040,634352038050399000,08/03/2011,17:56:45,192.168.0.9,0,1
 1041,634352038050413000,08/03/2011,17:56:45,192.168.0.9,0,0
 1042,634352038050424000,08/03/2011,17:56:45,192.168.0.9,1,1
 1043,634352038050434000,08/03/2011,17:56:45,192.168.0.9,1,0
 1044,634352038060781000,08/03/2011,17:56:46,192.168.0.9,1,1
 1045,634352038060795000,08/03/2011,17:56:46,192.168.0.9,0,1
 1046,634352038060807000,08/03/2011,17:56:46,192.168.0.9,1,0
 1047,634352038060816000,08/03/2011,17:56:46,192.168.0.9,0,0
 1048,634352038079731000,08/03/2011,17:56:48,192.168.0.9,0,1
 1049,634352038079745000,08/03/2011,17:56:48,192.168.0.9,1,1
 1050,634352038079755000,08/03/2011,17:56:48,192.168.0.9,0,0
 1051,634352038079765000,08/03/2011,17:56:48,192.168.0.9,1,0
 1052,634352038103921000,08/03/2011,17:56:50,192.168.0.9,1,1
 1053,634352038103935000,08/03/2011,17:56:50,192.168.0.9,0,1
 1054,634352038103945000,08/03/2011,17:56:50,192.168.0.9,1,0
 1055,634352038103955000,08/03/2011,17:56:50,192.168.0.9,0,0
 1056,634352038124383000,08/03/2011,17:56:52,192.168.0.9,0,1
 1057,634352038124397000,08/03/2011,17:56:52,192.168.0.9,1,1
 1058,634352038124407000,08/03/2011,17:56:52,192.168.0.9,0,0
 1059,634352038124417000,08/03/2011,17:56:52,192.168.0.9,1,0
 1060,634352038150085000,08/03/2011,17:56:55,192.168.0.9,1,1
 1061,634352038150099000,08/03/2011,17:56:55,192.168.0.9,0,1
 1062,634352038150110000,08/03/2011,17:56:55,192.168.0.9,1,0
 1063,634352038150120000,08/03/2011,17:56:55,192.168.0.9,0,0
 1064,634352038169538000,08/03/2011,17:56:57,192.168.0.9,1,1
 1065,634352038169553000,08/03/2011,17:56:57,192.168.0.9,0,1
 1066,634352038169563000,08/03/2011,17:56:57,192.168.0.9,1,0
 1067,634352038169573000,08/03/2011,17:56:57,192.168.0.9,0,0
 1068,634352038187480000,08/03/2011,17:56:59,192.168.0.9,1,1
 1069,634352038187494000,08/03/2011,17:56:59,192.168.0.9,0,1
 1070,634352038187505000,08/03/2011,17:56:59,192.168.0.9,1,0
 1071,634352038187514000,08/03/2011,17:56:59,192.168.0.9,0,0
 1072,634352038204111000,08/03/2011,17:57:00,192.168.0.9,1,1
 1073,634352038204125000,08/03/2011,17:57:00,192.168.0.9,1,0
 1074,634352038204136000,08/03/2011,17:57:00,192.168.0.9,0,1
 1075,634352038204146000,08/03/2011,17:57:00,192.168.0.9,0,0
 1076,634352038221145000,08/03/2011,17:57:02,192.168.0.9,1,1
 1077,634352038221160000,08/03/2011,17:57:02,192.168.0.9,0,1
 1078,634352038222355000,08/03/2011,17:57:02,192.168.0.9,1,0
 1079,634352038222366000,08/03/2011,17:57:02,192.168.0.9,0,0
 1080,634352038300773000,08/03/2011,17:57:10,192.168.0.9,1,1
 1081,634352038300788000,08/03/2011,17:57:10,192.168.0.9,0,1
 1082,634352038300798000,08/03/2011,17:57:10,192.168.0.9,1,0
 1083,634352038300809000,08/03/2011,17:57:10,192.168.0.9,0,0
 1084,634352038316296000,08/03/2011,17:57:12,192.168.0.9,1,1
 1085,634352038316311000,08/03/2011,17:57:12,192.168.0.9,0,1
 1086,634352038316322000,08/03/2011,17:57:12,192.168.0.9,1,0
 1087,634352038316331000,08/03/2011,17:57:12,192.168.0.9,0,0
 1088,634352038506698000,08/03/2011,17:57:31,192.168.0.9,1,1
 1089,634352038506713000,08/03/2011,17:57:31,192.168.0.9,0,1
 1090,634352038507807000,08/03/2011,17:57:31,192.168.0.9,1,0
 1091,634352038507818000,08/03/2011,17:57:31,192.168.0.9,0,0
 1092,634352038520910000,08/03/2011,17:57:32,192.168.0.9,0,1
 1093,634352038520924000,08/03/2011,17:57:32,192.168.0.9,1,1
 1094,634352038520935000,08/03/2011,17:57:32,192.168.0.9,0,0
 1095,634352038522018000,08/03/2011,17:57:32,192.168.0.9,1,0
 1096,634352038531997000,08/03/2011,17:57:33,192.168.0.9,1,1
 1097,634352038532010000,08/03/2011,17:57:33,192.168.0.9,0,1
 1098,634352038533025000,08/03/2011,17:57:33,192.168.0.9,1,0
 1099,634352038533035000,08/03/2011,17:57:33,192.168.0.9,0,0
 1100,634352038546714000,08/03/2011,17:57:35,192.168.0.9,0,1
 1101,634352038546727000,08/03/2011,17:57:35,192.168.0.9,1,1
 1102,634352038546737000,08/03/2011,17:57:35,192.168.0.9,0,0
 1103,634352038548024000,08/03/2011,17:57:35,192.168.0.9,1,0
 1104,634352038556995000,08/03/2011,17:57:36,192.168.0.9,1,1
 1105,634352038557009000,08/03/2011,17:57:36,192.168.0.9,0,1
 1106,634352038557019000,08/03/2011,17:57:36,192.168.0.9,1,0
 1107,634352038558305000,08/03/2011,17:57:36,192.168.0.9,0,0
 1108,634352038568788000,08/03/2011,17:57:37,192.168.0.9,0,1
 1109,634352038568801000,08/03/2011,17:57:37,192.168.0.9,1,1
 1110,634352038568811000,08/03/2011,17:57:37,192.168.0.9,0,0
 1111,634352038569997000,08/03/2011,17:57:37,192.168.0.9,1,0
 1112,634352038578666000,08/03/2011,17:57:38,192.168.0.9,1,1
 1113,634352038578680000,08/03/2011,17:57:38,192.168.0.9,0,1
 1114,634352038578690000,08/03/2011,17:57:38,192.168.0.9,1,0
 1115,634352038578699000,08/03/2011,17:57:38,192.168.0.9,0,0
 1116,634352038589148000,08/03/2011,17:57:39,192.168.0.9,0,1
 1117,634352038589161000,08/03/2011,17:57:39,192.168.0.9,1,1
 1118,634352038589171000,08/03/2011,17:57:39,192.168.0.9,0,0
 1119,634352038590458000,08/03/2011,17:57:39,192.168.0.9,1,0
 1120,634352038615960000,08/03/2011,17:57:42,192.168.0.9,0,1
 1121,634352038615974000,08/03/2011,17:57:42,192.168.0.9,1,1
 1122,634352038615984000,08/03/2011,17:57:42,192.168.0.9,0,0
 1123,634352038615994000,08/03/2011,17:57:42,192.168.0.9,1,0
 1124,634352038630374000,08/03/2011,17:57:43,192.168.0.9,0,1
 1125,634352038630389000,08/03/2011,17:57:43,192.168.0.9,1,1
 1126,634352038630399000,08/03/2011,17:57:43,192.168.0.9,0,0
 1127,634352038630408000,08/03/2011,17:57:43,192.168.0.9,1,0
 1128,634352038645191000,08/03/2011,17:57:45,192.168.0.9,0,1
 1129,634352038645204000,08/03/2011,17:57:45,192.168.0.9,1,1
 1130,634352038645214000,08/03/2011,17:57:45,192.168.0.9,0,0
 1131,634352038645223000,08/03/2011,17:57:45,192.168.0.9,1,0
 1132,634352038657891000,08/03/2011,17:57:46,192.168.0.9,1,1
 1133,634352038657905000,08/03/2011,17:57:46,192.168.0.9,0,1
 1134,634352038657915000,08/03/2011,17:57:46,192.168.0.9,1,0
 1135,634352038657924000,08/03/2011,17:57:46,192.168.0.9,0,0
 1136,634352038671397000,08/03/2011,17:57:47,192.168.0.9,1,1
 1137,634352038671411000,08/03/2011,17:57:47,192.168.0.9,0,1
 1138,634352038671421000,08/03/2011,17:57:47,192.168.0.9,1,0
 1139,634352038672506000,08/03/2011,17:57:47,192.168.0.9,0,0
 1140,634352038684501000,08/03/2011,17:57:48,192.168.0.9,1,1
 1141,634352038684514000,08/03/2011,17:57:48,192.168.0.9,0,1
 1142,634352038684524000,08/03/2011,17:57:48,192.168.0.9,1,0
 1143,634352038316311000,09/03/2011,17:57:12,192.168.0.9,0,1
 1144,634352038316322000,09/03/2011,17:57:12,192.168.0.9,1,0
 1145,634352038316331000,09/03/2011,17:57:12,192.168.0.9,0,0
 1146,634352038506698000,09/03/2011,17:57:31,192.168.0.9,1,1
 1147,634352038506713000,09/03/2011,17:57:31,192.168.0.9,0,1
 1148,634352038507807000,09/03/2011,17:57:31,192.168.0.9,1,0
 1149,634352038507818000,09/03/2011,17:57:31,192.168.0.9,0,0
 1150,634352038520910000,09/03/2011,17:57:32,192.168.0.9,0,1
 1151,634352038520924000,09/03/2011,17:57:32,192.168.0.9,1,1
 1152,634352038520935000,09/03/2011,17:57:32,192.168.0.9,0,0
 1153,634352038522018000,09/03/2011,17:57:32,192.168.0.9,1,0
 1154,634352038531997000,09/03/2011,17:57:33,192.168.0.9,1,1
 1155,634352038532010000,09/03/2011,17:57:33,192.168.0.9,0,1
 1156,634352038533025000,09/03/2011,17:57:33,192.168.0.9,1,0
 1157,634352038533035000,09/03/2011,17:57:33,192.168.0.9,0,0
 1158,634352038546714000,09/03/2011,17:57:35,192.168.0.9,0,1
 1159,634352038546727000,09/03/2011,17:57:35,192.168.0.9,1,1
 1160,634352038546737000,09/03/2011,17:57:35,192.168.0.9,0,0
 1161,634352038548024000,09/03/2011,17:57:35,192.168.0.9,1,0
 1162,634352038556995000,09/03/2011,17:57:36,192.168.0.9,1,1
 1163,634352038557009000,09/03/2011,17:57:36,192.168.0.9,0,1
 1164,634352038557019000,09/03/2011,17:57:36,192.168.0.9,1,0
 1165,634352038558305000,09/03/2011,17:57:36,192.168.0.9,0,0
 1166,634352038568788000,09/03/2011,17:57:37,192.168.0.9,0,1
 1167,634352038568801000,09/03/2011,17:57:37,192.168.0.9,1,1
 1168,634352038568811000,09/03/2011,17:57:37,192.168.0.9,0,0
 1169,634352038569997000,09/03/2011,17:57:37,192.168.0.9,1,0
 1170,634352038578666000,09/03/2011,17:57:38,192.168.0.9,1,1
 1171,634352038578680000,09/03/2011,17:57:38,192.168.0.9,0,1
 1172,634352038578690000,09/03/2011,17:57:38,192.168.0.9,1,0
 1173,634352038578699000,09/03/2011,17:57:38,192.168.0.9,0,0
 1174,634352038589148000,09/03/2011,17:57:39,192.168.0.9,0,1
 1175,634352038589161000,09/03/2011,17:57:39,192.168.0.9,1,1
 1176,634352038589171000,09/03/2011,17:57:39,192.168.0.9,0,0
 1177,634352038590458000,09/03/2011,17:57:39,192.168.0.9,1,0
 1178,634352038615960000,09/03/2011,17:57:42,192.168.0.9,0,1
 1179,634352038615974000,09/03/2011,17:57:42,192.168.0.9,1,1
 1180,634352038615984000,09/03/2011,17:57:42,192.168.0.9,0,0
 1181,634352038615994000,09/03/2011,17:57:42,192.168.0.9,1,0
 1182,634352038630374000,09/03/2011,17:57:43,192.168.0.9,0,1
 1183,634352038630389000,09/03/2011,17:57:43,192.168.0.9,1,1
 1184,634352038630399000,09/03/2011,17:57:43,192.168.0.9,0,0
 1185,634352038630408000,09/03/2011,17:57:43,192.168.0.9,1,0
 1186,634352038645191000,09/03/2011,17:57:45,192.168.0.9,0,1
 1187,634352038645204000,09/03/2011,17:57:45,192.168.0.9,1,1
 1188,634352038645214000,09/03/2011,17:57:45,192.168.0.9,0,0
 1189,634352038645223000,09/03/2011,17:57:45,192.168.0.9,1,0
 1190,634352038657891000,09/03/2011,17:57:46,192.168.0.9,1,1
 1191,634352038657905000,09/03/2011,17:57:46,192.168.0.9,0,1
 1192,634352038657915000,09/03/2011,17:57:46,192.168.0.9,1,0
 1193,634352038657924000,09/03/2011,17:57:46,192.168.0.9,0,0
 1194,634352038671397000,09/03/2011,17:57:47,192.168.0.9,1,1
 1195,634352038671411000,09/03/2011,17:57:47,192.168.0.9,0,1
 1196,634352038671421000,09/03/2011,17:57:47,192.168.0.9,1,0
 1197,634352038672506000,09/03/2011,17:57:47,192.168.0.9,0,0
 1198,634352038684501000,09/03/2011,17:57:48,192.168.0.9,1,1
 1199,634352038684514000,09/03/2011,17:57:48,192.168.0.9,0,1
 1200,634352038684524000,09/03/2011,17:57:48,192.168.0.9,1,0
 1201,634352038316311000,09/03/2011,17:57:12,192.168.0.9,0,1
 1202,634352038316322000,09/03/2011,17:57:12,192.168.0.9,1,0
 1203,634352038316331000,09/03/2011,17:57:12,192.168.0.9,0,0
 1204,634352038506698000,09/03/2011,17:57:31,192.168.0.9,1,1
 1205,634352038506713000,09/03/2011,17:57:31,192.168.0.9,0,1
 1206,634352038507807000,09/03/2011,17:57:31,192.168.0.9,1,0
 1207,634352038507818000,09/03/2011,17:57:31,192.168.0.9,0,0
 1208,634352038520910000,09/03/2011,17:57:32,192.168.0.9,0,1
 1209,634352038520924000,09/03/2011,17:57:32,192.168.0.9,1,1
 1210,634352038520935000,09/03/2011,17:57:32,192.168.0.9,0,0
 1211,634352038522018000,09/03/2011,17:57:32,192.168.0.9,1,0
 1212,634352038531997000,09/03/2011,17:57:33,192.168.0.9,1,1
 1213,634352038532010000,09/03/2011,17:57:33,192.168.0.9,0,1
 1214,634352038533025000,09/03/2011,17:57:33,192.168.0.9,1,0
 1215,634352038533035000,09/03/2011,17:57:33,192.168.0.9,0,0
 1216,634352038546714000,09/03/2011,17:57:35,192.168.0.9,0,1
 1217,634352038546727000,09/03/2011,17:57:35,192.168.0.9,1,1
 1218,634352038546737000,09/03/2011,17:57:35,192.168.0.9,0,0
 1219,634352038548024000,09/03/2011,17:57:35,192.168.0.9,1,0
 1220,634352038556995000,09/03/2011,17:57:36,192.168.0.9,1,1
 1221,634352038557009000,09/03/2011,17:57:36,192.168.0.9,0,1
 1222,634352038557019000,09/03/2011,17:57:36,192.168.0.9,1,0
 1223,634352038558305000,09/03/2011,17:57:36,192.168.0.9,0,0
 1224,634352038568788000,09/03/2011,17:57:37,192.168.0.9,0,1
 1225,634352038568801000,09/03/2011,17:57:37,192.168.0.9,1,1
 1226,634352038568811000,09/03/2011,17:57:37,192.168.0.9,0,0
 1227,634352038569997000,09/03/2011,17:57:37,192.168.0.9,1,0
 1228,634352038578666000,09/03/2011,17:57:38,192.168.0.9,1,1
 1229,634352038578680000,09/03/2011,17:57:38,192.168.0.9,0,1
 1230,634352038578690000,09/03/2011,17:57:38,192.168.0.9,1,0
 1231,634352038578699000,09/03/2011,17:57:38,192.168.0.9,0,0
 1232,634352038589148000,09/03/2011,17:57:39,192.168.0.9,0,1
 1233,634352038589161000,09/03/2011,17:57:39,192.168.0.9,1,1
 1234,634352038589171000,09/03/2011,17:57:39,192.168.0.9,0,0
 1235,634352038590458000,09/03/2011,17:57:39,192.168.0.9,1,0
 1236,634352038615960000,09/03/2011,17:57:42,192.168.0.9,0,1
 1237,634352038615974000,09/03/2011,17:57:42,192.168.0.9,1,1
 1238,634352038615984000,09/03/2011,17:57:42,192.168.0.9,0,0
 1239,634352038615994000,09/03/2011,17:57:42,192.168.0.9,1,0
 1240,634352038630374000,09/03/2011,17:57:43,192.168.0.9,0,1
 1241,634352038630389000,09/03/2011,17:57:43,192.168.0.9,1,1
 1242,634352038630399000,09/03/2011,17:57:43,192.168.0.9,0,0
 1243,634352038630408000,09/03/2011,17:57:43,192.168.0.9,1,0
 1244,634352038645191000,09/03/2011,17:57:45,192.168.0.9,0,1
 1245,634352038645204000,09/03/2011,17:57:45,192.168.0.9,1,1
 1246,634352038645214000,09/03/2011,17:57:45,192.168.0.9,0,0
 1247,634352038645223000,09/03/2011,17:57:45,192.168.0.9,1,0
 1248,634352038657891000,09/03/2011,17:57:46,192.168.0.9,1,1
 1249,634352038657905000,09/03/2011,17:57:46,192.168.0.9,0,1
 1250,634352038657915000,09/03/2011,17:57:46,192.168.0.9,1,0
 1251,634352038657924000,09/03/2011,17:57:46,192.168.0.9,0,0
 1252,634352038671397000,09/03/2011,17:57:47,192.168.0.9,1,1
 1253,634352038671411000,09/03/2011,17:57:47,192.168.0.9,0,1
 1254,634352038671421000,09/03/2011,17:57:47,192.168.0.9,1,0
 1255,634352038672506000,09/03/2011,17:57:47,192.168.0.9,0,0
 1256,634352038684501000,09/03/2011,17:57:48,192.168.0.9,1,1
 1257,634352038684514000,09/03/2011,17:57:48,192.168.0.9,0,1
 1258,634352038684524000,09/03/2011,17:57:48,192.168.0.9,1,0
 1259,634352038630374000,10/03/2011,17:57:43,192.168.0.9,0,1
 1260,634352038630389000,10/03/2011,17:57:43,192.168.0.9,1,1
 1261,634352038630399000,10/03/2011,17:57:43,192.168.0.9,0,0
 1262,634352038630408000,10/03/2011,17:57:43,192.168.0.9,1,0
 1263,634352038645191000,10/03/2011,17:57:45,192.168.0.9,0,1
 1264,634352038645204000,10/03/2011,17:57:45,192.168.0.9,1,1
 1265,634352038645214000,10/03/2011,17:57:45,192.168.0.9,0,0
 1266,634352038645223000,10/03/2011,17:57:45,192.168.0.9,1,0
 1267,634352038657891000,10/03/2011,17:57:46,192.168.0.9,1,1
 1268,634352038657905000,10/03/2011,17:57:46,192.168.0.9,0,1
 1269,634352038657915000,10/03/2011,17:57:46,192.168.0.9,1,0
 1270,634352038657924000,10/03/2011,17:57:46,192.168.0.9,0,0
 1271,634352038671397000,10/03/2011,17:57:47,192.168.0.9,1,1
 1272,634352038671411000,10/03/2011,17:57:47,192.168.0.9,0,1
 1273,634352038671421000,10/03/2011,17:57:47,192.168.0.9,1,0
 1274,634352038672506000,10/03/2011,17:57:47,192.168.0.9,0,0
 1275,634352038684501000,10/03/2011,17:57:48,192.168.0.9,1,1
 1276,634352038684514000,10/03/2011,17:57:48,192.168.0.9,0,1
 1277,634352038684524000,10/03/2011,17:57:48,192.168.0.9,1,0

many thanksSmilie in advance if you decide to assist.
cp
 

3 More Discussions You Might Find Interesting

1. Programming

I have no clue what's the point - fcntl() ?

hi, I need to know how to lock a file. I used the following code, but after executing the program the file 'write.txt' remined empty, and I have no idea why.Maybe I'm not using the corresponding syntax for blocking a file. But I deleted then the blocking part and the problem persisted. see to... (2 Replies)
Discussion started by: atticus
2 Replies

2. Solaris

Filesystem filling up and no clue as to why!

df shows that the filesystem is filling up and the usage is 94%. However when I actually traverse to the directory I du shows only about 10% of the space occupied! Below is the output of df and du: >>>df -kh /cbmdata/00 470M 393M 29M 94% /cbmdata/00 >>>/cbmdata/00>... (3 Replies)
Discussion started by: zombiezparadize
3 Replies

3. Shell Programming and Scripting

Dont have a clue which program to use to process flying bat data

Hi, Im not a unix person but need to analyse some data. This is bat data (animals) from large roosts using data loggers. I think AWK is probably the best thing to use but dont really know so any help appreciated. (python, grep) whichever it is, I'll have to learn it! here is an example of... (27 Replies)
Discussion started by: cmp260
27 Replies
All times are GMT -4. The time now is 01:42 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy