WSO2's API Vision: Unifying Control, Empowering Developers
Acunu Analytics
1. Acunu Analytics
Simple, powerful, real-time
Andrew Byde
Principal Scientist
Tuesday, 27 March 2012
2. Making big data useful
How do we turn this ...
time page session id duration
... ... ... ...
14:58:03.234 /index.html 248.180.3.40 898
14:58:03.234 /csi/csi/council/freedom.html 248.180.3.40 1234
14:58:03.234 /docs/access/chapter8.txt 99.1.10.178 52
... ... ... ...
x billions
Tuesday, 27 March 2012
3. MY
Introduction
into this...
Tuesday, 27 March 2012
18. Acunu Analytics
Pre-assembled queries, e.g. ...
21:00 all→1345 :00→45 :01→62 :02→87 ...
for 22:00-23:00, 22:00 all→3222 :00→22 :00→19 :02→105 ...
group by minute ... ...
click all→229 user01→2 user14→12 user99→7 ...
group all by user, open all→354 user01→4 user04→8 user56→17 ...
where category=click ...
count all click, 22:00 all→1905 ...
∅ all→87315 click→239 open→355 ...
group all by category
Tuesday, 27 March 2012
19. Summary
• Simple, real-time, incremental analytics
• work done on ingest
• sum, count, distinct, avg, stddev, min-max etc
• time + hierarchy bucketing
• efficient ‘group’ semantics
• works with Apache Cassandra
Tuesday, 27 March 2012