On Time-Series Analysis with Strict Determinism


 
Thread Tools Search this Thread
Special Forums News, Links, Events and Announcements Complex Event Processing RSS News On Time-Series Analysis with Strict Determinism
# 1  
Old 03-30-2008
On Time-Series Analysis with Strict Determinism

Greg Reemler
Sun, 30 Mar 2008 03:24:06 +0000

Like the predictable ebb and flow of ocean tides, we see the rise, falling and passing away*of*lively*debates*about event procesing languages (EPLs).** For example,*you might*recall that*Louis Lovas, Progress Apama, *did an excellent job in his post, Bending the Nail, where he described why SQL or Extended SQL is not the optimal EPL for event processing.**
A few of us in the “SQL is not necessarily*the best EPL” choir started singing with Louis which motivated a counter voice the choir*with the post,*Fair and unfair criticism of an SQL EP*approach*only to have the same author counter*that post with, One down side to an SQL EP*approach.***
Many technologists, including some of my team members at Techrotech,*enjoy focusing on*linear*event processing problems with strict determinism, for example, processing a stream of market data and looking for opportunties to enter or exit the market (algo trading).*** These same technologists*tend*champion event processing problems that are basic transformations of*simple streams of time-series data.**
Many of the so-called CEP*cybertrading examples (I would argue that*these are*simple event processing, not complex event processing examples)*are not rooted in event processing*scenarios that require looking for causal linkages between seemingly unrelated events; for example, debugging complex distributed systems or detecting fraud over long periods of time where sliding time windows on continuous streaming data are only a part of the solution in the uncertain world of* cloudy event-causality relationships.
Time-series analysis with strict determinism are interesting, but I would not go so far at to call this*processing*”complex event processing” relative to the myriad challenging complex*problems in the real-world.
Image Image Image Image Image Image Image Image


Source...
Login or Register to Ask a Question

Previous Thread | Next Thread

8 More Discussions You Might Find Interesting

1. Programming

Resample time series data with replacement any way to do this in awk or just bash script

I have some time series data that I need to resample or downsample at some specific time intervals. The firs column is time in decimal hours. I am tryiong to resample this data every 3 minutse. So I need a data value ever 0.05. Here is the example data and as you can see, there time slot for 0.1500... (3 Replies)
Discussion started by: malandisa
3 Replies

2. Shell Programming and Scripting

Log Analysis with AWK with Time difference

I would like to write a shell script that calculated the time difference bettween the log entries. If the time difference is higher as 200 sec. print the complette lines out. My Problem is, i am unable to jump in the next line and calculate the time difference. Thank you for your Help. ... (5 Replies)
Discussion started by: fabian3010
5 Replies

3. Shell Programming and Scripting

Date and time range extraction via Awk or analysis script?

Hello does anyone know of an awk that will extract log file entries between a specific date and time range, eg: awk '/15\/Dec\/2010:16:10:00/, /15\/Dec\/2010:16:15:00/' access_log but one that works? Or a free command line log file analysis tool/script? I'd like to be able to view... (2 Replies)
Discussion started by: competitions
2 Replies

4. Shell Programming and Scripting

New PERL guru's help on strict.pm

I opened strict.pm and found some not understandable stuff, please let me know if you have any Idea on the same. 1) Line 23 => $bits |= (what is $= here how it affect the statement) 2) Line 36 => $^H (what is that I haven't found any statement on this in google) 3) Line 41 =>... (3 Replies)
Discussion started by: jatanig
3 Replies

5. Shell Programming and Scripting

Perl strict

What is the sake of using `use strict;` in perl codes? and how can avoid it?.TnX. (8 Replies)
Discussion started by: Zaxon
8 Replies

6. UNIX for Dummies Questions & Answers

Iterate a min/max awk script over time-series temperature data

I'm trying to iterate a UNIX awk script that returns min/max temperature data for each day from a monthly weather data file (01_weath.dat). The temperature data is held in $5. The temps are reported each minute so each day contains 1440 temperature enteries. The below code has gotten me as far as... (5 Replies)
Discussion started by: jgourley
5 Replies

7. Shell Programming and Scripting

calculate the average of time series data using AWK

Hi, I have two time series data (below) merged into a file. t1 and t2 are in unit of second I want to calculate the average of V1 every second and count how many times "1" in V2 is occur within a second Input File: t1 V1 t2 V2 10.000000... (5 Replies)
Discussion started by: nica
5 Replies

8. Shell Programming and Scripting

Strict Argument

Im trying to write a bash script that has an if statment that when the user enters ONLY that exact argument, will echo what follows that conditon. For example: for file in $1 do if then Var1=$(cat hello | egrep "that pattern" | awk '{ print $NF }') cat $Var1 fi done Basically,... (3 Replies)
Discussion started by: oxoxo
3 Replies
Login or Register to Ask a Question