Humans are much better than computers at detecting unknown patterns in a visual data set, but, like computers we have our shortcomings. We need to optimize inputs for humans so they are fast and efficient in detecting patterns, especially with the coming data tsunami.

1. Can Skynet Beat Humans in
Signal Detection?
Kyle Redinger, Co-Founder @VividCortex

2. Background
Database Performance Management
Measure ‘All the Things’ in 1-Second Detail

3. Your Mandate
Manage 300x more data
with 1.5x more people.

4. Signal Detection Theory
Humans
process up to
500GB of data
per second.

5. Find the Outliers

6. Signal Detection
Easy
Hard

7. Easy Signal Detection
% Correct
Response Time
1
1000
0.95
900
0.9
800
0.85
700
0.8
600
0.75
500
0.7
400
0.65
300
0.6
200
Set Size
Set Size
Easy signals are always easy,
regardless of set size.

8. Hard Signal Detection
% Correct
Response Time
1
1000
0.95
900
0.9
800
0.85
700
0.8
600
0.75
500
0.7
400
0.65
300
0.6
200
Set Size
Set Size
Hard signals get harder
as set size increases.

9. Signal Detection in Use
Upper Control Limit
Lowe Control Limit
Statistical Process Controls are “Easy”

10. Signal Detection in Systems
1-Second CPU over 5 Minutes
What’s the cause?

11. Looking at Work
In a database,
a query is work.
But, I have 300
query classes.
Crap.

12. CPU
Graph Everything
Query Execution Time

13. Reduce Data
CPU
Zoom & Remove the Obvious
1/10th of Data Points
Query Execution Time

14. Man vs Machine
Man
Machine

15. Man vs Machine
Man
Machine
Non-linear increasing CPU
Statistically significant

16. Man vs Machine
Man
Machine
Non-linear increasing CPU
Statistically significant
Pattern!
Pattern!
Pattern!
Not model friendly

17. Shortcomings
Elephants
in the
room?

18. Shortcomings
Humans
lose with a
known
pattern

19. Key Thoughts
Our brains do much better with fewer
distractors, so eliminate them!
With unknown patterns, humans
find signals faster than computers.

20. Thanks
Remember: Less is more.
@kyleredinger
http://www.flickr.com/photos/danielproulx/3524826318/
http://www.sciencedirect.com/science/article/pii/S0896627301003920
http://www.himandus.net/elefunteria/eday/puzzles/hunt_24.html
http://www.federaljack.com/terminator-robots-a-reality/