This talk was given by Bhaskar Ghosh (Senior Director of Engineering, LinkedIn Data Infrastructure), at the Yale Oct 2012 Symposium on Big Data, in honor of Martin Schultz.
12. LinkedIn Recommendation Engine
Recom- People Jobs Groups
mendation
Entities … Ads
Companies
Searches
be interested in
Referral Center
People Browse
Similar Profiles
Similar Groups
Jobs You May
Jobs Browse
Browse Map
TalentMatch
Similar Jobs
News
Groups
GYML
Events
Map
Map
… and more
Products
A/B
API
Recom-
Behavior Collaborative
mendation Popularity User Feedback
Types
Analysis Filtering
Shared, (R-T) Feature Extraction, Entity (R-T) matching computations
Dynamic, Resolution & Enrichment
Unified Offline data munging (hadoop)
Core
Service
15. LinkedIn Data Infrastructure: Sample Stack
Infra challenges in 3-phase Some off-the-shelf.
ecosystem are diverse, Significant investment in
complex and specific home-grown, deep and
interesting platforms
15