SlideShare a Scribd company logo
1 of 20
Download to read offline
Cegeka AI/ML Competence Center




  Recommendation
  engines
  Theory and intro to




                                 Georgian Micsa
Georgian Micsa
●   Software engineer with 6+ years of experience, mainly Java but also
    JavaScript and .NET
●   Interested on OOD, architecture and agile software development
    methodologies
●   Currently working as Senior Java Developer @ Cegeka
●   georgian.micsa@gmail.com
●   http://ro.linkedin.com/in/georgianmicsa
What is it?
●   Recommender/recommendation system/engine/platform
●   A subclass of information filtering system
●   Predict the 'rating' or 'preference' that a user would give to a new item
    (music, books, movies, people or groups etc)
●   Can use a model built from the characteristics of an item (content-based
    approaches)
●   Can use the user's social environment (collaborative filtering approaches)
Examples

●   Amazon.com
    ○   Recommend additional books
    ○   Frequently bought together books
    ○   Implemented using a sparse matrix of book cooccurrences
●   Pandora Radio
    ○   Plays music with similar characteristics
    ○   Content based filtering based on properties of song/artist
    ○   Based also on user's feedback
    ○   Users emphasize or deemphasize certain characteristics
Examples 2

●   Last.fm
    ○   Collaborative filtering
    ○   Recommends songs by observing the tracks played by user and
        comparing to behaviour of other users
    ○   Suggests songs played by users with similar interests
●   Netflix
    ○   Predictions of movies
    ○   Hybrid approach
    ○   Collaborative filtering based on user`s previous ratings and watching
        behaviours (compared to other users)
    ○   Content based filtering based on characteristics of movies
Collaborative filtering
●   Collect and analyze a large amount of information on users’ behaviors,
    activities or preferences
●   Predict what users will like based on their similarity to other users
●   It does not rely on the content of the items
●   Measures user similarity or item similarity
●   Many algorithms:
    ○   the k-nearest neighborhood (k-NN)
    ○   the Pearson Correlation
    ○   etc.
Collaborative filtering 2
●   Build a model from user's profile collecting explicit and implicit data
●   Explicit data:
    ○   Asking a user to rate an item on a sliding scale.
    ○   Rank a collection of items from favorite to least favorite.
    ○   Presenting two items to a user and asking him/her to choose the
        better one of them.
    ○   Asking a user to create a list of items that he/she likes.
●   Implicit data:
    ○   Observing the items that a user views in an online store.
    ○   Analyzing item/user viewing times
    ○   Keeping a record of the items that a user purchases online.
    ○   Obtaining a list of items that a user has listened to or watched
    ○   Analyzing the user's social network and discovering similar likes and
        dislikes
Collaborative filtering 3
●   Collaborative filtering approaches often suffer from three problems:
    ○   Cold Start: needs a large amount of existing data on a user in order
        to make accurate recommendations
    ○   Scalability: a large amount of computation power is often necessary
        to calculate recommendations.
    ○   Sparsity: The number of items sold on major e-commerce sites is
        extremely large. The most active users will only have rated a small
        subset of the overall database. Thus, even the most popular items
        have very few ratings.
Content-based filtering
●   Based on information about and characteristics of the items
●   Try to recommend items that are similar to those that a user liked in the
    past (or is examining in the present)
●   Use an item profile (a set of discrete attributes and features)
●   Content-based profile of users based on a weighted vector of item
    features
●   The weights denote the importance of each feature to the user
●   To compute the weights:
    ○   average values of the rated item vector
    ○   Bayesian Classifiers, cluster analysis, decision trees, and artificial
        neural networks
Content-based filtering 2
●   Can collect feedback from user to assign higher or lower weights on the
    importance of certain attributes
●   Cross-content recommendation: music, videos, products, discussions etc.
    from different services can be recommended based on news browsing.
●   Popular for movie recommendations: Internet Movie Database, See This
    Next etc.
Hybrid Recommender Systems
●   Combines collaborative filtering and content-based filtering
●   Implemented in several ways:
    ○   by making content-based and collaborative-based predictions
        separately and then combining them
    ○   by adding content-based capabilities to a collaborative-based
        approach (and vice versa)
    ○   by unifying the approaches into one model
●   Studies have shown that hybrid methods can provide more accurate
    recommendations than pure approaches
●   Overcome cold start and the sparsity problems
●   Netflix and See This Next
What is Apache Mahout?
●   A scalable Machine Learning library
●   Apache License
●   Scalable to reasonably large datasets (core algorithms implemented in
    Map/Reduce, runnable on Hadoop)
●   Distributed and non-distributed algorithms
●   Community
●   Usecases
    •   Clustering (group items that are topically related)
    •   Classification (learn to assign categories to documents)
    •   Frequent Itemset Mining (find items that appear together)
    •   Recommendation Mining (find items a user might like)
Non-distributed recommenders
●   Non-distributed, non Hadoop, collaborative recommender algorithms
●   Java or external server which exposes recommendation logic to your
    application via web services and HTTP
●   Key interfaces:
    ○   DataModel: CSV files or database
    ○   UserSimilarity: computes similarity between users
    ○   ItemSimilarity: computes similarity between items
    ○   UserNeighborhood: used for similarity of users
    ○   Recommender: produces recommendations
●   Different implementations based on your needs
●   Input in this format: UserId,ItemId,[Preference or Rating]
●   Preference is not needed in case of associations (pages viewed by users)
User-based recommender example
DataModel model = new FileDataModel(new File("data.txt"));

UserSimilarity userSimilarity = new PearsonCorrelationSimilarity(model);
// Optional:
userSimilarity.setPreferenceInferrer(new AveragingPreferenceInferrer());

UserNeighborhood neighborhood =
         new NearestNUserNeighborhood(3, userSimilarity, model);
Recommender recommender =
    new GenericUserBasedRecommender(model, neighborhood, userSimilarity);

Recommender cachingRecommender = new CachingRecommender(recommender);

List<RecommendedItem> recommendations =
         cachingRecommender.recommend(1234, 10);
Item-based recommender example
DataModel model = new FileDataModel(new File("data.txt"));
// Construct the list of pre-computed correlations
Collection<GenericItemSimilarity.ItemItemSimilarity> correlations = ...;
ItemSimilarity itemSimilarity = new GenericItemSimilarity(correlations);

Recommender recommender =
     new GenericItemBasedRecommender(model, itemSimilarity);

Recommender cachingRecommender = new CachingRecommender(recommender);

List<RecommendedItem> recommendations =
       cachingRecommender.recommend(1234, 10);
Recommender evaluation
For preference data models:
DataModel myModel = ...;
RecommenderBuilder builder = new RecommenderBuilder() {
     public Recommender buildRecommender(DataModel model) {
       // build and return the Recommender to evaluate here
     }
};
RecommenderEvaluator evaluator =
     new AverageAbsoluteDifferenceRecommenderEvaluator();

double evaluation = evaluator.evaluate(builder, myModel, 0.9, 1.0);


For boolean data models, precision and recall can be computed.
Distributed Item Based
●   Mahout offers 2 Hadoop Map/Reduce jobs aimed to support Itembased
    Collaborative Filtering
●   org.apache.mahout.cf.taste.hadoop.similarity.item.ItemSimilarityJob
    ○   computes all similar items
    ○   input is a CSV file with theformat userID,itemID,value
    ○   output is a file of itemIDs with their associated similarity value
    ○   different configuration options: eg. similarity measure to use (co
        occurrence, Euclidian distance, Pearson correlation, etc.)
●   org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
    ○   Completely distributed itembased recommender
    ○   input is a CSV file with the format userID,itemID,value
    ○   output is a file of userIDs with associated recommended itemIDs and
        their scores
    ○   also configuration options
Mahout tips
●   Start with non-distributed recommenders
●   100M user-item associations can be handled by a modern server with 4GB
    of heap available as a real-time recommender
●   Over this scale distributed algorithms make sense
●   Data can be sampled, noisy and old data can be pruned
●   Ratings: GenericItemBasedRecommender and
    PearsonCorrelationSimilarity
●   Preferences: GenericBooleanPrefItemBasedRecommender and
    LogLikelihoodSimilarity
●   Content-based item-item similarity => your own ItemSimilarity
Mahout tips 2
●   CSV files
    ○   FileDataModel
    ○   push new files periodically
●   Database
    ○   XXXJDBCDataModel
    ○   ReloadFromJDBCDataModel
●   Offline or live recommendations?
    ○   Distributed algorithms => Offline periodical computations
    ○   Data is pushed periodically as CSV files or in DB
    ○   SlopeOneRecommender deals with updates quickly
    ○   Real time update of the DataModel and refresh recommander after
        some events (user rates an item etc.)
References

●   http://en.wikipedia.org/wiki/Recommender_system
●   https://cwiki.apache.org/confluence/display/MAHOUT/Mahout+Wiki
●   http://www.ibm.com/developerworks/java/library/j-mahout/
●   http://www.slideshare.net/sscdotopen/mahoutcf
●   http://www.philippeadjiman.com/blog/2009/11/11/flexible-
    collaborative-filtering-in-java-with-mahout-taste/

More Related Content

What's hot

Recommender systems: Content-based and collaborative filtering
Recommender systems: Content-based and collaborative filteringRecommender systems: Content-based and collaborative filtering
Recommender systems: Content-based and collaborative filteringViet-Trung TRAN
 
Recommender Systems (Machine Learning Summer School 2014 @ CMU)
Recommender Systems (Machine Learning Summer School 2014 @ CMU)Recommender Systems (Machine Learning Summer School 2014 @ CMU)
Recommender Systems (Machine Learning Summer School 2014 @ CMU)Xavier Amatriain
 
Recent advances in deep recommender systems
Recent advances in deep recommender systemsRecent advances in deep recommender systems
Recent advances in deep recommender systemsNAVER Engineering
 
Recommendation Systems Basics
Recommendation Systems BasicsRecommendation Systems Basics
Recommendation Systems BasicsJarin Tasnim Khan
 
Learning a Personalized Homepage
Learning a Personalized HomepageLearning a Personalized Homepage
Learning a Personalized HomepageJustin Basilico
 
Calibrated Recommendations
Calibrated RecommendationsCalibrated Recommendations
Calibrated RecommendationsHarald Steck
 
Collaborative Filtering 1: User-based CF
Collaborative Filtering 1: User-based CFCollaborative Filtering 1: User-based CF
Collaborative Filtering 1: User-based CFYusuke Yamamoto
 
Recommender Systems: Advances in Collaborative Filtering
Recommender Systems: Advances in Collaborative FilteringRecommender Systems: Advances in Collaborative Filtering
Recommender Systems: Advances in Collaborative FilteringChangsung Moon
 
Recommendation system
Recommendation system Recommendation system
Recommendation system Vikrant Arya
 
Recommendation System Explained
Recommendation System ExplainedRecommendation System Explained
Recommendation System ExplainedCrossing Minds
 
Recommendation Systems
Recommendation SystemsRecommendation Systems
Recommendation SystemsRobin Reni
 
How to build a recommender system?
How to build a recommender system?How to build a recommender system?
How to build a recommender system?blueace
 
Past, Present & Future of Recommender Systems: An Industry Perspective
Past, Present & Future of Recommender Systems: An Industry PerspectivePast, Present & Future of Recommender Systems: An Industry Perspective
Past, Present & Future of Recommender Systems: An Industry PerspectiveJustin Basilico
 
Deep Learning for Recommender Systems
Deep Learning for Recommender SystemsDeep Learning for Recommender Systems
Deep Learning for Recommender SystemsJustin Basilico
 
Boston ML - Architecting Recommender Systems
Boston ML - Architecting Recommender SystemsBoston ML - Architecting Recommender Systems
Boston ML - Architecting Recommender SystemsJames Kirk
 
Crafting Recommenders: the Shallow and the Deep of it!
Crafting Recommenders: the Shallow and the Deep of it! Crafting Recommenders: the Shallow and the Deep of it!
Crafting Recommenders: the Shallow and the Deep of it! Sudeep Das, Ph.D.
 
Personalized Page Generation for Browsing Recommendations
Personalized Page Generation for Browsing RecommendationsPersonalized Page Generation for Browsing Recommendations
Personalized Page Generation for Browsing RecommendationsJustin Basilico
 

What's hot (20)

Recommender systems: Content-based and collaborative filtering
Recommender systems: Content-based and collaborative filteringRecommender systems: Content-based and collaborative filtering
Recommender systems: Content-based and collaborative filtering
 
Recommender Systems (Machine Learning Summer School 2014 @ CMU)
Recommender Systems (Machine Learning Summer School 2014 @ CMU)Recommender Systems (Machine Learning Summer School 2014 @ CMU)
Recommender Systems (Machine Learning Summer School 2014 @ CMU)
 
Recommender Systems
Recommender SystemsRecommender Systems
Recommender Systems
 
Recent advances in deep recommender systems
Recent advances in deep recommender systemsRecent advances in deep recommender systems
Recent advances in deep recommender systems
 
Recommendation Systems Basics
Recommendation Systems BasicsRecommendation Systems Basics
Recommendation Systems Basics
 
Learning a Personalized Homepage
Learning a Personalized HomepageLearning a Personalized Homepage
Learning a Personalized Homepage
 
Calibrated Recommendations
Calibrated RecommendationsCalibrated Recommendations
Calibrated Recommendations
 
Collaborative Filtering 1: User-based CF
Collaborative Filtering 1: User-based CFCollaborative Filtering 1: User-based CF
Collaborative Filtering 1: User-based CF
 
Recommender Systems: Advances in Collaborative Filtering
Recommender Systems: Advances in Collaborative FilteringRecommender Systems: Advances in Collaborative Filtering
Recommender Systems: Advances in Collaborative Filtering
 
Recommendation system
Recommendation system Recommendation system
Recommendation system
 
Recommendation System Explained
Recommendation System ExplainedRecommendation System Explained
Recommendation System Explained
 
Recommender Systems
Recommender SystemsRecommender Systems
Recommender Systems
 
Recommendation Systems
Recommendation SystemsRecommendation Systems
Recommendation Systems
 
How to build a recommender system?
How to build a recommender system?How to build a recommender system?
How to build a recommender system?
 
Content based filtering
Content based filteringContent based filtering
Content based filtering
 
Past, Present & Future of Recommender Systems: An Industry Perspective
Past, Present & Future of Recommender Systems: An Industry PerspectivePast, Present & Future of Recommender Systems: An Industry Perspective
Past, Present & Future of Recommender Systems: An Industry Perspective
 
Deep Learning for Recommender Systems
Deep Learning for Recommender SystemsDeep Learning for Recommender Systems
Deep Learning for Recommender Systems
 
Boston ML - Architecting Recommender Systems
Boston ML - Architecting Recommender SystemsBoston ML - Architecting Recommender Systems
Boston ML - Architecting Recommender Systems
 
Crafting Recommenders: the Shallow and the Deep of it!
Crafting Recommenders: the Shallow and the Deep of it! Crafting Recommenders: the Shallow and the Deep of it!
Crafting Recommenders: the Shallow and the Deep of it!
 
Personalized Page Generation for Browsing Recommendations
Personalized Page Generation for Browsing RecommendationsPersonalized Page Generation for Browsing Recommendations
Personalized Page Generation for Browsing Recommendations
 

Viewers also liked

A content based movie recommender system for mobile application
A content based movie recommender system for mobile applicationA content based movie recommender system for mobile application
A content based movie recommender system for mobile applicationArafat X
 
Building a Recommendation Engine - An example of a product recommendation engine
Building a Recommendation Engine - An example of a product recommendation engineBuilding a Recommendation Engine - An example of a product recommendation engine
Building a Recommendation Engine - An example of a product recommendation engineNYC Predictive Analytics
 
Movie Recommendation engine
Movie Recommendation engineMovie Recommendation engine
Movie Recommendation engineJayesh Lahori
 
Business Intelligence Services
Business Intelligence ServicesBusiness Intelligence Services
Business Intelligence ServicesRachid Mouchaouche
 
Project Progress Report - Recommender Systems for Social Networks
Project Progress Report - Recommender Systems for Social NetworksProject Progress Report - Recommender Systems for Social Networks
Project Progress Report - Recommender Systems for Social Networksamirhhz
 
Book Recommendation System using Data Mining for the University of Hong Kong ...
Book Recommendation System using Data Mining for the University of Hong Kong ...Book Recommendation System using Data Mining for the University of Hong Kong ...
Book Recommendation System using Data Mining for the University of Hong Kong ...CITE
 
Recommendation Engine Project Presentation
Recommendation Engine Project PresentationRecommendation Engine Project Presentation
Recommendation Engine Project Presentation19Divya
 
Business use of Social Media and Impact on Enterprise Architecture
Business use of Social Media and Impact on Enterprise ArchitectureBusiness use of Social Media and Impact on Enterprise Architecture
Business use of Social Media and Impact on Enterprise ArchitectureNUS-ISS
 
Recommender Systems in E-Commerce
Recommender Systems in E-CommerceRecommender Systems in E-Commerce
Recommender Systems in E-CommerceRoger Chen
 
Collaborative Filtering and Recommender Systems By Navisro Analytics
Collaborative Filtering and Recommender Systems By Navisro AnalyticsCollaborative Filtering and Recommender Systems By Navisro Analytics
Collaborative Filtering and Recommender Systems By Navisro AnalyticsNavisro Analytics
 
Recommendation at Netflix Scale
Recommendation at Netflix ScaleRecommendation at Netflix Scale
Recommendation at Netflix ScaleJustin Basilico
 
Recommender Systems
Recommender SystemsRecommender Systems
Recommender SystemsT212
 
Summary, Conclusions and Recommendations
Summary, Conclusions and RecommendationsSummary, Conclusions and Recommendations
Summary, Conclusions and RecommendationsRoqui Malijan
 
Buidling large scale recommendation engine
Buidling large scale recommendation engineBuidling large scale recommendation engine
Buidling large scale recommendation engineKeeyong Han
 
Collaborative Filtering Recommendation System
Collaborative Filtering Recommendation SystemCollaborative Filtering Recommendation System
Collaborative Filtering Recommendation SystemMilind Gokhale
 
Report Writing - Conclusions & Recommendations sections
Report Writing - Conclusions & Recommendations sectionsReport Writing - Conclusions & Recommendations sections
Report Writing - Conclusions & Recommendations sectionsSherrie Lee
 

Viewers also liked (18)

A content based movie recommender system for mobile application
A content based movie recommender system for mobile applicationA content based movie recommender system for mobile application
A content based movie recommender system for mobile application
 
Building a Recommendation Engine - An example of a product recommendation engine
Building a Recommendation Engine - An example of a product recommendation engineBuilding a Recommendation Engine - An example of a product recommendation engine
Building a Recommendation Engine - An example of a product recommendation engine
 
Recommender Systems
Recommender SystemsRecommender Systems
Recommender Systems
 
Movie Recommendation engine
Movie Recommendation engineMovie Recommendation engine
Movie Recommendation engine
 
Business Intelligence Services
Business Intelligence ServicesBusiness Intelligence Services
Business Intelligence Services
 
Project Progress Report - Recommender Systems for Social Networks
Project Progress Report - Recommender Systems for Social NetworksProject Progress Report - Recommender Systems for Social Networks
Project Progress Report - Recommender Systems for Social Networks
 
Book Recommendation System using Data Mining for the University of Hong Kong ...
Book Recommendation System using Data Mining for the University of Hong Kong ...Book Recommendation System using Data Mining for the University of Hong Kong ...
Book Recommendation System using Data Mining for the University of Hong Kong ...
 
Recommendation Engine Project Presentation
Recommendation Engine Project PresentationRecommendation Engine Project Presentation
Recommendation Engine Project Presentation
 
Collaborative filtering
Collaborative filteringCollaborative filtering
Collaborative filtering
 
Business use of Social Media and Impact on Enterprise Architecture
Business use of Social Media and Impact on Enterprise ArchitectureBusiness use of Social Media and Impact on Enterprise Architecture
Business use of Social Media and Impact on Enterprise Architecture
 
Recommender Systems in E-Commerce
Recommender Systems in E-CommerceRecommender Systems in E-Commerce
Recommender Systems in E-Commerce
 
Collaborative Filtering and Recommender Systems By Navisro Analytics
Collaborative Filtering and Recommender Systems By Navisro AnalyticsCollaborative Filtering and Recommender Systems By Navisro Analytics
Collaborative Filtering and Recommender Systems By Navisro Analytics
 
Recommendation at Netflix Scale
Recommendation at Netflix ScaleRecommendation at Netflix Scale
Recommendation at Netflix Scale
 
Recommender Systems
Recommender SystemsRecommender Systems
Recommender Systems
 
Summary, Conclusions and Recommendations
Summary, Conclusions and RecommendationsSummary, Conclusions and Recommendations
Summary, Conclusions and Recommendations
 
Buidling large scale recommendation engine
Buidling large scale recommendation engineBuidling large scale recommendation engine
Buidling large scale recommendation engine
 
Collaborative Filtering Recommendation System
Collaborative Filtering Recommendation SystemCollaborative Filtering Recommendation System
Collaborative Filtering Recommendation System
 
Report Writing - Conclusions & Recommendations sections
Report Writing - Conclusions & Recommendations sectionsReport Writing - Conclusions & Recommendations sections
Report Writing - Conclusions & Recommendations sections
 

Similar to Recommendation engines

Building a Recommender systems by Vivek Murugesan - Technical Architect at Cr...
Building a Recommender systems by Vivek Murugesan - Technical Architect at Cr...Building a Recommender systems by Vivek Murugesan - Technical Architect at Cr...
Building a Recommender systems by Vivek Murugesan - Technical Architect at Cr...Rajasekar Nonburaj
 
Recommandation systems -
Recommandation systems - Recommandation systems -
Recommandation systems - Yousef Fadila
 
Introduction to Recommendation Systems
Introduction to Recommendation SystemsIntroduction to Recommendation Systems
Introduction to Recommendation SystemsZia Babar
 
Recommender.system.presentation.pjug.01.21.2014
Recommender.system.presentation.pjug.01.21.2014Recommender.system.presentation.pjug.01.21.2014
Recommender.system.presentation.pjug.01.21.2014rpbrehm
 
Recommendation Systems
Recommendation SystemsRecommendation Systems
Recommendation SystemsHilary Aben
 
Tag based recommender system
Tag based recommender systemTag based recommender system
Tag based recommender systemKaren Li
 
Introduction to Recommendation Systems (Vietnam Web Submit)
Introduction to Recommendation Systems (Vietnam Web Submit)Introduction to Recommendation Systems (Vietnam Web Submit)
Introduction to Recommendation Systems (Vietnam Web Submit)Trieu Nguyen
 
SDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the whySDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the whyKorea Sdec
 
Modern Perspectives on Recommender Systems and their Applications in Mendeley
Modern Perspectives on Recommender Systems and their Applications in MendeleyModern Perspectives on Recommender Systems and their Applications in Mendeley
Modern Perspectives on Recommender Systems and their Applications in MendeleyKris Jack
 
recommendation system techunique and issue
recommendation system techunique and issuerecommendation system techunique and issue
recommendation system techunique and issueNutanBhor
 
Architecting AI Solutions in Azure for Business
Architecting AI Solutions in Azure for BusinessArchitecting AI Solutions in Azure for Business
Architecting AI Solutions in Azure for BusinessIvo Andreev
 
Overview of recommender system
Overview of recommender systemOverview of recommender system
Overview of recommender systemStanley Wang
 
Recommender Systems In Industry
Recommender Systems In IndustryRecommender Systems In Industry
Recommender Systems In IndustryXavier Amatriain
 
REAL-TIME RECOMMENDATION SYSTEMS
REAL-TIME RECOMMENDATION SYSTEMS REAL-TIME RECOMMENDATION SYSTEMS
REAL-TIME RECOMMENDATION SYSTEMS BigDataCloud
 
3e recommendation engines_meetup
3e recommendation engines_meetup3e recommendation engines_meetup
3e recommendation engines_meetupPranab Ghosh
 
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022
Real-Time Recommendations  with Hopsworks and OpenSearch - MLOps World 2022Real-Time Recommendations  with Hopsworks and OpenSearch - MLOps World 2022
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022Jim Dowling
 
Recommender systems
Recommender systemsRecommender systems
Recommender systemsTamer Rezk
 

Similar to Recommendation engines (20)

Building a Recommender systems by Vivek Murugesan - Technical Architect at Cr...
Building a Recommender systems by Vivek Murugesan - Technical Architect at Cr...Building a Recommender systems by Vivek Murugesan - Technical Architect at Cr...
Building a Recommender systems by Vivek Murugesan - Technical Architect at Cr...
 
Recommender systems
Recommender systemsRecommender systems
Recommender systems
 
Recommandation systems -
Recommandation systems - Recommandation systems -
Recommandation systems -
 
Introduction to Recommendation Systems
Introduction to Recommendation SystemsIntroduction to Recommendation Systems
Introduction to Recommendation Systems
 
Recommender.system.presentation.pjug.01.21.2014
Recommender.system.presentation.pjug.01.21.2014Recommender.system.presentation.pjug.01.21.2014
Recommender.system.presentation.pjug.01.21.2014
 
Mahout
MahoutMahout
Mahout
 
Recommendation Systems
Recommendation SystemsRecommendation Systems
Recommendation Systems
 
Tag based recommender system
Tag based recommender systemTag based recommender system
Tag based recommender system
 
Introduction to Recommendation Systems (Vietnam Web Submit)
Introduction to Recommendation Systems (Vietnam Web Submit)Introduction to Recommendation Systems (Vietnam Web Submit)
Introduction to Recommendation Systems (Vietnam Web Submit)
 
SDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the whySDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the why
 
Modern Perspectives on Recommender Systems and their Applications in Mendeley
Modern Perspectives on Recommender Systems and their Applications in MendeleyModern Perspectives on Recommender Systems and their Applications in Mendeley
Modern Perspectives on Recommender Systems and their Applications in Mendeley
 
recommendation system techunique and issue
recommendation system techunique and issuerecommendation system techunique and issue
recommendation system techunique and issue
 
Architecting AI Solutions in Azure for Business
Architecting AI Solutions in Azure for BusinessArchitecting AI Solutions in Azure for Business
Architecting AI Solutions in Azure for Business
 
Overview of recommender system
Overview of recommender systemOverview of recommender system
Overview of recommender system
 
Recommender Systems In Industry
Recommender Systems In IndustryRecommender Systems In Industry
Recommender Systems In Industry
 
REAL-TIME RECOMMENDATION SYSTEMS
REAL-TIME RECOMMENDATION SYSTEMS REAL-TIME RECOMMENDATION SYSTEMS
REAL-TIME RECOMMENDATION SYSTEMS
 
3e recommendation engines_meetup
3e recommendation engines_meetup3e recommendation engines_meetup
3e recommendation engines_meetup
 
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022
Real-Time Recommendations  with Hopsworks and OpenSearch - MLOps World 2022Real-Time Recommendations  with Hopsworks and OpenSearch - MLOps World 2022
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022
 
Recommender systems
Recommender systemsRecommender systems
Recommender systems
 
Web usage mining
Web usage miningWeb usage mining
Web usage mining
 

Recently uploaded

activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1DianaGray10
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfinfogdgmi
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfDianaGray10
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxUdaiappa Ramachandran
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?IES VE
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Adtran
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 

Recently uploaded (20)

activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1UiPath Platform: The Backend Engine Powering Your Automation - Session 1
UiPath Platform: The Backend Engine Powering Your Automation - Session 1
 
Videogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdfVideogame localization & technology_ how to enhance the power of translation.pdf
Videogame localization & technology_ how to enhance the power of translation.pdf
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdfUiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
UiPath Solutions Management Preview - Northern CA Chapter - March 22.pdf
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
Building AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptxBuilding AI-Driven Apps Using Semantic Kernel.pptx
Building AI-Driven Apps Using Semantic Kernel.pptx
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™Meet the new FSP 3000 M-Flex800™
Meet the new FSP 3000 M-Flex800™
 
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 

Recommendation engines

  • 1. Cegeka AI/ML Competence Center Recommendation engines Theory and intro to Georgian Micsa
  • 2. Georgian Micsa ● Software engineer with 6+ years of experience, mainly Java but also JavaScript and .NET ● Interested on OOD, architecture and agile software development methodologies ● Currently working as Senior Java Developer @ Cegeka ● georgian.micsa@gmail.com ● http://ro.linkedin.com/in/georgianmicsa
  • 3. What is it? ● Recommender/recommendation system/engine/platform ● A subclass of information filtering system ● Predict the 'rating' or 'preference' that a user would give to a new item (music, books, movies, people or groups etc) ● Can use a model built from the characteristics of an item (content-based approaches) ● Can use the user's social environment (collaborative filtering approaches)
  • 4. Examples ● Amazon.com ○ Recommend additional books ○ Frequently bought together books ○ Implemented using a sparse matrix of book cooccurrences ● Pandora Radio ○ Plays music with similar characteristics ○ Content based filtering based on properties of song/artist ○ Based also on user's feedback ○ Users emphasize or deemphasize certain characteristics
  • 5. Examples 2 ● Last.fm ○ Collaborative filtering ○ Recommends songs by observing the tracks played by user and comparing to behaviour of other users ○ Suggests songs played by users with similar interests ● Netflix ○ Predictions of movies ○ Hybrid approach ○ Collaborative filtering based on user`s previous ratings and watching behaviours (compared to other users) ○ Content based filtering based on characteristics of movies
  • 6. Collaborative filtering ● Collect and analyze a large amount of information on users’ behaviors, activities or preferences ● Predict what users will like based on their similarity to other users ● It does not rely on the content of the items ● Measures user similarity or item similarity ● Many algorithms: ○ the k-nearest neighborhood (k-NN) ○ the Pearson Correlation ○ etc.
  • 7. Collaborative filtering 2 ● Build a model from user's profile collecting explicit and implicit data ● Explicit data: ○ Asking a user to rate an item on a sliding scale. ○ Rank a collection of items from favorite to least favorite. ○ Presenting two items to a user and asking him/her to choose the better one of them. ○ Asking a user to create a list of items that he/she likes. ● Implicit data: ○ Observing the items that a user views in an online store. ○ Analyzing item/user viewing times ○ Keeping a record of the items that a user purchases online. ○ Obtaining a list of items that a user has listened to or watched ○ Analyzing the user's social network and discovering similar likes and dislikes
  • 8. Collaborative filtering 3 ● Collaborative filtering approaches often suffer from three problems: ○ Cold Start: needs a large amount of existing data on a user in order to make accurate recommendations ○ Scalability: a large amount of computation power is often necessary to calculate recommendations. ○ Sparsity: The number of items sold on major e-commerce sites is extremely large. The most active users will only have rated a small subset of the overall database. Thus, even the most popular items have very few ratings.
  • 9. Content-based filtering ● Based on information about and characteristics of the items ● Try to recommend items that are similar to those that a user liked in the past (or is examining in the present) ● Use an item profile (a set of discrete attributes and features) ● Content-based profile of users based on a weighted vector of item features ● The weights denote the importance of each feature to the user ● To compute the weights: ○ average values of the rated item vector ○ Bayesian Classifiers, cluster analysis, decision trees, and artificial neural networks
  • 10. Content-based filtering 2 ● Can collect feedback from user to assign higher or lower weights on the importance of certain attributes ● Cross-content recommendation: music, videos, products, discussions etc. from different services can be recommended based on news browsing. ● Popular for movie recommendations: Internet Movie Database, See This Next etc.
  • 11. Hybrid Recommender Systems ● Combines collaborative filtering and content-based filtering ● Implemented in several ways: ○ by making content-based and collaborative-based predictions separately and then combining them ○ by adding content-based capabilities to a collaborative-based approach (and vice versa) ○ by unifying the approaches into one model ● Studies have shown that hybrid methods can provide more accurate recommendations than pure approaches ● Overcome cold start and the sparsity problems ● Netflix and See This Next
  • 12. What is Apache Mahout? ● A scalable Machine Learning library ● Apache License ● Scalable to reasonably large datasets (core algorithms implemented in Map/Reduce, runnable on Hadoop) ● Distributed and non-distributed algorithms ● Community ● Usecases • Clustering (group items that are topically related) • Classification (learn to assign categories to documents) • Frequent Itemset Mining (find items that appear together) • Recommendation Mining (find items a user might like)
  • 13. Non-distributed recommenders ● Non-distributed, non Hadoop, collaborative recommender algorithms ● Java or external server which exposes recommendation logic to your application via web services and HTTP ● Key interfaces: ○ DataModel: CSV files or database ○ UserSimilarity: computes similarity between users ○ ItemSimilarity: computes similarity between items ○ UserNeighborhood: used for similarity of users ○ Recommender: produces recommendations ● Different implementations based on your needs ● Input in this format: UserId,ItemId,[Preference or Rating] ● Preference is not needed in case of associations (pages viewed by users)
  • 14. User-based recommender example DataModel model = new FileDataModel(new File("data.txt")); UserSimilarity userSimilarity = new PearsonCorrelationSimilarity(model); // Optional: userSimilarity.setPreferenceInferrer(new AveragingPreferenceInferrer()); UserNeighborhood neighborhood = new NearestNUserNeighborhood(3, userSimilarity, model); Recommender recommender = new GenericUserBasedRecommender(model, neighborhood, userSimilarity); Recommender cachingRecommender = new CachingRecommender(recommender); List<RecommendedItem> recommendations = cachingRecommender.recommend(1234, 10);
  • 15. Item-based recommender example DataModel model = new FileDataModel(new File("data.txt")); // Construct the list of pre-computed correlations Collection<GenericItemSimilarity.ItemItemSimilarity> correlations = ...; ItemSimilarity itemSimilarity = new GenericItemSimilarity(correlations); Recommender recommender = new GenericItemBasedRecommender(model, itemSimilarity); Recommender cachingRecommender = new CachingRecommender(recommender); List<RecommendedItem> recommendations = cachingRecommender.recommend(1234, 10);
  • 16. Recommender evaluation For preference data models: DataModel myModel = ...; RecommenderBuilder builder = new RecommenderBuilder() { public Recommender buildRecommender(DataModel model) { // build and return the Recommender to evaluate here } }; RecommenderEvaluator evaluator = new AverageAbsoluteDifferenceRecommenderEvaluator(); double evaluation = evaluator.evaluate(builder, myModel, 0.9, 1.0); For boolean data models, precision and recall can be computed.
  • 17. Distributed Item Based ● Mahout offers 2 Hadoop Map/Reduce jobs aimed to support Itembased Collaborative Filtering ● org.apache.mahout.cf.taste.hadoop.similarity.item.ItemSimilarityJob ○ computes all similar items ○ input is a CSV file with theformat userID,itemID,value ○ output is a file of itemIDs with their associated similarity value ○ different configuration options: eg. similarity measure to use (co occurrence, Euclidian distance, Pearson correlation, etc.) ● org.apache.mahout.cf.taste.hadoop.item.RecommenderJob ○ Completely distributed itembased recommender ○ input is a CSV file with the format userID,itemID,value ○ output is a file of userIDs with associated recommended itemIDs and their scores ○ also configuration options
  • 18. Mahout tips ● Start with non-distributed recommenders ● 100M user-item associations can be handled by a modern server with 4GB of heap available as a real-time recommender ● Over this scale distributed algorithms make sense ● Data can be sampled, noisy and old data can be pruned ● Ratings: GenericItemBasedRecommender and PearsonCorrelationSimilarity ● Preferences: GenericBooleanPrefItemBasedRecommender and LogLikelihoodSimilarity ● Content-based item-item similarity => your own ItemSimilarity
  • 19. Mahout tips 2 ● CSV files ○ FileDataModel ○ push new files periodically ● Database ○ XXXJDBCDataModel ○ ReloadFromJDBCDataModel ● Offline or live recommendations? ○ Distributed algorithms => Offline periodical computations ○ Data is pushed periodically as CSV files or in DB ○ SlopeOneRecommender deals with updates quickly ○ Real time update of the DataModel and refresh recommander after some events (user rates an item etc.)
  • 20. References ● http://en.wikipedia.org/wiki/Recommender_system ● https://cwiki.apache.org/confluence/display/MAHOUT/Mahout+Wiki ● http://www.ibm.com/developerworks/java/library/j-mahout/ ● http://www.slideshare.net/sscdotopen/mahoutcf ● http://www.philippeadjiman.com/blog/2009/11/11/flexible- collaborative-filtering-in-java-with-mahout-taste/