Developers are leading the charge to turn consumer behavior into profitable solutions. By accessing and analyzing the explosion of data from consumer activities, any developer can create the personalized, relevant products and services that customers demand and merchants urgently need. Brian will discuss how to acquire, store, and mine information, and how to design analytics-focused software and build data-driven software engines.
7. Data Warehouse +
Behavioral
Data Warehouse
Semi-Structured
SQL++
Structured
SQL
Low End Enterprise-class System
Contextual-Complex Analytics
Deep, Seasonal, Consumable Data Sets
Production Data Warehousing
Large Concurrent User-base
Enterprise-class System
Unstructured
Java/C++/Pig/Hive
Structure the Unstructured
Detect Patterns
Commodity Hardware System
8+PB 60+PB 40+PB
Hadoop
Analyze & Report
Discover & Explore
11. Designing for the Unknown
>85% of analytical workload is NEW & Unknown
The metrics you know are cheap
The metrics you don’t know are expensive – but high in potential ROI
Exploration & Testing are core pillars of an analytics-driven
organization
21. Toys and Hobbies
ATC > Artist trading card in ART
ATC > Automatic Tool Change in Business and Industrial
22. German Compound Words
• German compound words can be arbitrarily created and extremely long
Adidastrainingsanzug (Adidas track suit)
Rindfleischetikettierungsüberwachungsaufgabenübertragungsgesetz
(beef labeling regulation & delegation of supervision law)
• Syntactically, words can be combined and split in many ways.
• Some words shouldn’t be de-compounded.
beiden (both) – bei(at) den(the)
• Too many candidates for
Granitpflastersteine (granite paving stones)
Granit(granite) pflastersteine(cobblestones)
Granit(granite) pflaster(paving/band-aid) steine(stones)
• Binding characters
Hochzeitsschuhe (grammatically correct, 593 hits on ebay.de)
Hochzeitschuhe (129 hits on ebay.de).
23. Synonyms
derived
from
top
queries
in
item
query
clusters
texas
instruments
ba
ii
plus
/
ba
ii
plus
brighton
handbag
brighton
purse
lenovo
x200
thinkpad
x200
king
bedspread
king
coverlet
rockabilly
dress
swing
dress
1963
ford
falcon
63
falcon
jessica
simpson
hair
extensions
jessica
simpson
hairdo
Abbrevia7ons/acronym
derived
from
query
transi7ons
stanford
ky
stanford
kentucky
dc
sub
dc
subwoofer
snowboard
helmet
l
snowboard
helmet
large
motorcycle
cam
motorcycle
camera
diamond
amp
diamond
amplifier