Mythbusters: Event Stream Processing v. Complex Event Processing, DEBS 2007, Toronto, June 20, 2007, Tim Bass

1. Mythbusters: Event Stream Processing v. Complex Event Processing DEBS 2007, Toronto June 20, 2007 Tim Bass

2. Our Agenda Event Processing Reference Architecture An Illustrative Survey of Steams and Clouds Wrap-Up

3. A Vocabulary of Confusion (Work in Progress) Resource Management Data Fusion Sensor Fusion Information Fusion Tracking Data Mining Correlation Planning Complex Event Processing Processing Management Sensor Management Control Estimation Event Stream Processing Adapted from: Steinberg, A., & Bowman, C., CRC Press, 2001

4. Clouds from Thermal Streams Ref: www.paragliding.gr/cd-rom/aerology.htm

5. Dust Clouds and Streams Ref: http://narn.physics.auburn.edu/research/dusty/images/stream.jpg

6. Gulf Stream

7. Ocean Currents as Streams

8. Weather Data as a Cloud http://meiyu.atmphys.howard.edu/hu-lead/picture/cloud.png

9. Business Events as Clouds David Luckham

18. POSET (A,R) : SET (A) and Relationship (R) Partially ordered. Linearly ordered by time. A chain of events. Partially ordered Many incomparable chains of events. Linearly ordered by time. A chain of events. Relationship R Event cloud Set of all banking systems Event stream Set of all log file entries in a single banking application Event cloud Set of all stock trades in NASDAQ for a single day. Event stream Set of all stock trades for GOOG within a 5 minute time window Abstraction Set A

19. CEP Clouds and ESP Streams A Stream is a Special Case of a Cloud. Market Data from NASDAQ Sales Investor Sentiment San Ysidro Border Crossings Homeland Security Tylenol OTC Sales Global Epidemiology Tracking RFID Information Logistics / Supply Chain EOG Financial Transactions Insider Trading / Fraud Alerts from Firewall or IDS Enterprise Security / SEM Temp Data from Station Zulu Weather Web Traffic Session Extraction Network Management EVENT STREAMS EVENT CLOUDS

21. Our Agenda Event Processing Reference Architecture An Illustrative Survey of Steams and Clouds Wrap-Up

22. Data Clouds -> Actionable Knowledge 22 Impact Assessment Situational Assessment Relationship of Events Identify Events Location, Times and Rates of Events of Interest Existence of Possible Event of Interest Data/Event Cloud Analysis of Situation & Plans Contextual and Causal Analysis Causal Analysis, Bayesian Belief Networks, NNs, Correlation, State Estimation, Classification Use of Distributed Sensors for Estimations Raw Sensor Data (Passive and Active) Adapted from: Waltz, E. & Llinas, J., Multisensor Data Fusion, 1990 HIGH LOW MED

23. Functional Reference Architecture 24 EVENT PRE-PROCESSING EVENT SOURCES EXTERNAL . . . LEVEL ONE EVENT TRACKING Visualization, BAM, User Interaction Functional Reference Architecture for CEP DB MANAGEMENT Historical Data Profiles & Patterns DISTRIBUTED LOCAL EVENT SERVICES . . EVENT PROFILES . . DATA BASES . . OTHER DATA LEVEL TWO SITUATION DETECTION LEVEL THREE PREDICTIVE ANALYSIS LEVEL FOUR ADAPTIVE BPM Adapted from JDL: Steinberg, A., & Bowman, C., Handbook of Multisensor Data Fusion, CRC Press, 2001

24. AI, Agents and Blackboards 22 EVENT CLOUD (DISTRIBUTED DATA SET) KS KS KS KS KS KS KS KS KS KS KS KS KS KS Adapted from: Engelmore, R. S., Morgan, A.J., & and Nii, H. P., Blackboard Systems, 1988 & Luckham, D., The Power of Events, 2002

26. Processing Patterns Business / Scientific Context Inference Processing Techniques Processing Patterns for Event Processing

30. Myths Mythbusted ESP and CEP are One in the Same Rules are the Brains of CEP

32. Thank You! Tim Bass The Complex Event Processing Blog - eventprocessing.wordpress.com www.silkroad.com

38. Gallery of Posets Produced by the package Posets.nb

39. Posets Illustrated http://www.math.unc.edu/Faculty/rap/DCLook.html