I like it... I like it Not

•Download as ODP, PDF•

6 likes•1,164 views

Presenting our work analyzing natural noise in user ratings for recommender systems. This presentation was done in the UMAP 2009 conference in Trento, Italy

Technology Business Entertainment & Humor

I like it... I like it not ,[object Object],[object Object],[object Object],[object Object]

Recommender Systems are everywhere ,[object Object],[object Object],[object Object],[object Object]

The Netflix Prize ,[object Object],[object Object],[object Object],[object Object]

But, is there a limit to RS accuracy? ,[object Object]

The Magic Barrier ,[object Object],[object Object],[object Object],[object Object],[object Object]

Our related research questions ,[object Object],[object Object],[object Object]

Experimental Setup (I) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Experimental Setup (II) ,[object Object],[object Object],[object Object],[object Object],[object Object]

Comparison to Netflix Data ,[object Object]

Test-retest Stability and Reliability ,[object Object],[object Object],[object Object],[object Object]

Analysis of User Inconsistencies ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Impacting Variables (I) ,[object Object],[object Object],[object Object],[object Object],[object Object]

Impacting Variables (II) ,[object Object],[object Object],[object Object],[object Object]

Impacting Variables (and III) ,[object Object],[object Object],[object Object],[object Object]

Long-term Errors and Stability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Conclusions ,[object Object],[object Object],[object Object],[object Object]

I like it... I like it not ,[object Object],[object Object]

Viewers also liked

Multilevel Audio Descriptors @WWW09 develtrack

Xavier Amatriain

Software Frameworks for Music Information Retrieval

Xavier Amatriain

Agile Science

Xavier Amatriain

Google cau-chuyen-than-ky david-vise-mark-malseed

Calvin Nguyen

Cikm 2013 - Beyond Data From User Information to Business Value

Xavier Amatriain

10 more lessons learned from building Machine Learning systems

Xavier Amatriain

10 more lessons learned from building Machine Learning systems - MLConf

Xavier Amatriain

Viewers also liked (7)

Multilevel Audio Descriptors @WWW09 develtrack

Software Frameworks for Music Information Retrieval

Agile Science

Google cau-chuyen-than-ky david-vise-mark-malseed

Cikm 2013 - Beyond Data From User Information to Business Value

10 more lessons learned from building Machine Learning systems

10 more lessons learned from building Machine Learning systems - MLConf

Similar to I like it... I like it Not

The Wisdom of the Few @SIGIR09

Xavier Amatriain

Interleaving is an online evaluation approach for information retrieval systems that compares the effectiveness of ranking functions in interpreting the users’ implicit feedback. Previous work such as Hofmann et al. (2011) has evaluated the most promising interleaved methods at the time, on uniform distributions of queries. In the real world, usually, there is an unbalanced distribution of repeated queries that follows a long-tailed users’ search demand curve. This paper first aims to reproduce the Team Draft Interleaving accuracy evaluation on uniform query distributions and then focuses on assessing how this method generalises to long-tailed real-world scenarios. The replicability work raised interesting considerations on how the winning ranking function for each query should impact the overall winner for the entire evaluation. Based on what was observed, we propose that not all the queries should contribute to the final decision in equal proportion. As a result of these insights, we designed two variations of the ∆AB score winner estimator that assign to each query a credit based on statistical hypothesis testing. To reproduce, replicate and extend the original work, we have developed from scratch a system that simulates a search engine and users’ interactions from datasets from the industry. Our experiments confirm our intuition and show that our methods are promising in terms of accuracy, sensitivity, and robustness to noise.

Stat-weight Improving the Estimator of Interleaved Methods Outcomes with Stat...

Sease

Trust and Recommender Systems

zhayefei

Multiple objectives in Collaborative Filtering (RecSys 2010)

Tamas Jambor

Telefonica Lunch Seminar

Neal Lathia

Responding to the introduction of the Net Promoter score in a large organisation through the establishment of an operationalised testing program that covers, usability, product features, and importantly, service experience. Large companies need to have a particular emphasis on service experiences as these tend to be very polarising and emotive. This case study shows how Telstra, with help from consultancy U1 Group, created a program to ensure that product and service development processes create user experiences that result in advocacy.

UX Australia - voice of customer in the product lifecycle

darthbunny

Movie recommendation Engine using Artificial Intelligence

Harivamshi D

Need for Speed: How to Performance Test the right way by Annie Bhaumik

QA or the Highway

Jump-start your machine learning project by using the crowd to build your training set. Before you can train your machine learning algorithm, you need to take your raw inputs and label, annotate, or tag them to build your ground truth. Learn how to use the Amazon Mechanical Turk marketplace to perform these tasks. We share Amazon's best practices, developed while training our own machine learning algorithms, and walk you through quickly getting affordable and high-quality training data.

AWS re:Invent 2016: Getting to Ground Truth with Amazon Mechanical Turk (MAC201)

Amazon Web Services

Regressioin mini case

veesingh

Discover the Future of Entertainment: Dive into the world of movie recommendation systems in our engaging presentation. Join us as we explore the power of cutting-edge technology and data analytics to enhance user experiences in the entertainment industry. Our journey begins with data collection and cleaning, followed by a fascinating peek into the importance of movie recommendation systems. Uncover the Problem: Have you ever felt overwhelmed by the sheer number of movie choices on streaming platforms like Netflix and Amazon Prime? Our project addresses this very challenge by simplifying your movie selection process. A Glimpse into the Timeline: Journey with us through the phases of data collection, preprocessing, and basic exploratory data analysis. Witness the transformation of raw data into actionable insights. Cosine Similarity Revealed: Delve into the heart of our recommendation system as we explain the concept of Cosine Similarity, the mathematical foundation behind our recommendations. Pros and Cons Explored: Explore the pros and cons of movie recommendation systems, from personalized user experiences and increased engagement to challenges like the 'Cold Start Problem' and privacy concerns.

Movie Recommendation System_final.pptx

Sridharkadiri2

Lessons learnt at building recommendation services at industry scale

Domonkos Tikk

Neural Network Model

Eric Esajian

Better service monitoring through histograms

Fred Moyer

Soft quality & standards

Prince Bhanwra

Soft quality & standards

Prince Bhanwra

Performance evaluation of IR models

Nisha Arankandath

This project proposed a similarity measurement which is focusing on recommendation performance under the cold start problem [The problem which occurs in the recommendation for newly comer items and users, which doesn't have any recognition in the system] and also perfectly suitable for sparse data set. This technique solves the problem of the cold start in recommender system as well as improves the performance of recommendation to the users.

A new similarity measurement based on hellinger distance for collaborating fi...

Prabhu Kumar

acmsigtalkshare-121023190142-phpapp01.pptx

dongchangim30

A04 Sample Size

Leanleaders.org

Similar to I like it... I like it Not (20)

The Wisdom of the Few @SIGIR09

Stat-weight Improving the Estimator of Interleaved Methods Outcomes with Stat...

Trust and Recommender Systems

Multiple objectives in Collaborative Filtering (RecSys 2010)

Telefonica Lunch Seminar

UX Australia - voice of customer in the product lifecycle

Movie recommendation Engine using Artificial Intelligence

Need for Speed: How to Performance Test the right way by Annie Bhaumik

AWS re:Invent 2016: Getting to Ground Truth with Amazon Mechanical Turk (MAC201)

Regressioin mini case

Movie Recommendation System_final.pptx

Lessons learnt at building recommendation services at industry scale

Neural Network Model

Better service monitoring through histograms

Soft quality & standards

Performance evaluation of IR models

A new similarity measurement based on hellinger distance for collaborating fi...

acmsigtalkshare-121023190142-phpapp01.pptx

A04 Sample Size

More from Xavier Amatriain

Healthcare is different from any other application domain, or is it not? While it is true that there are specific aspects, such as high stakes decisions and a complex regulatory framework, that make healthcare somewhat different, it is also the case that many of the lessons learned from building data-driven products in other domains translate remarcably well into healthcare. This is particularly so because healthcare is also a user facing domain, where users can be both patients or healthcare professionals. Given that data has shown to improve user experience while ensuring quality and scalability, few would argue that healthcare cannot benefit from being much more data-driven than it has traditionally been. In this talk, I described how this experience building impactful data and AI solutions into user facing products for decades can be leveraged to revolutionize telehealth. At Curai, we combine approaches such as state-of-the-art large language models with expert systems in areas such as NLP, vision, and automated diagnosis to augment and scale doctors, and to improve user experience and healthcare outcomes. We will see some of those applications while analyzing the role of data and ML algorithms in making them possible.

Data/AI driven product development: from video streaming to telehealth

Xavier Amatriain

AI-driven product innovation: from Recommender Systems to COVID-19

Xavier Amatriain

With half of the world’s population lacking access to healthcare services, and 30% of the adult population in the US having inadequate health insurance coverage to get even basic access to services, it should have been clear that a pandemic like COVID-19 would strain the global healthcare system way over its maximum capacity. In this context, many are trying to embrace and encourage the use of telehealth as a way to provide safe and convenient access to care. However, telehealth in itself can not scale to cover all our needs unless we improve scalability and efficiency through AI and automation. In this talk, we will describe how our work on combining latest AI advances with medical experts and online access has the potential to change the landscape in healthcare access and provide 24/7 quality healthcare. Combining areas such as NLP, vision, and automatic diagnosis we can augment and scale doctors. We will describe our work on combining expert systems with deep learning to build state-of-the-art medical diagnostic models that are also able to model the unknowns. We will also show our work on using language models for medical Q&A . More importantly, we will describe how those approaches have been used to address the urgent and immediate needs of the current pandemic.

AI for COVID-19 - Q42020 update

Xavier Amatriain

AI for COVID-19: An online virtual care approach

Xavier Amatriain

Lessons learned from building practical deep learning systems

Xavier Amatriain

AI for healthcare: Scaling Access and Quality of Care for Everyone

Xavier Amatriain

Towards online universal quality healthcare through AI

Xavier Amatriain

From one to zero: Going smaller as a growth strategy

Xavier Amatriain

Learning to speak medicine

Xavier Amatriain

ML to cure the world

Xavier Amatriain

Recommender Systems In Industry

Xavier Amatriain

Medical advice as a Recommender System

Xavier Amatriain

Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...

Xavier Amatriain

Past present and future of Recommender Systems: an Industry Perspective

Xavier Amatriain

Deep learning has accomplished impressive feats in areas such as voice recognition, image processing, and natural language processing. Deep learning enthusiasts have rushed to predict that this family of algorithms is likely to take over most other applications in the near future. This focus on deep architectures seems to have cast a shadow over more “traditional” machine learning and data science approaches, leaving researchers and practitioners alike wondering whether there is any point in investing in feature engineering or simpler models. In this talk, I will go over what deep learning can and cannot do for you, both now and in the near future. I will also describe how different approaches will continue to be needed, and why their demand will likely grow despite the rise of deep learning. I will support my claims not only by looking at recent publications, but also by using practical examples drawn from my experience at companies at the forefront of machine learning applications, such as Quora.

Staying Shallow & Lean in a Deep Learning World

Xavier Amatriain

Machine Learning for Q&A Sites: The Quora Example

Xavier Amatriain

BIG2016- Lessons Learned from building real-life user-focused Big Data systems

Xavier Amatriain

Strata 2016 - Lessons Learned from building real-life Machine Learning Systems

Xavier Amatriain

Keynote for the ACM Intelligent User Interface conference in 2016 in Sonoma, CA. I start with the past by talking about the Recommender Problem, and the Netflix Prize. Then I go into the Present and the Future by talking about approaches that go beyond rating prediction and ranking and by finishing with some of the most important lessons learned over the years. Throughout my talk I put special emphasis on the relation between algorithms and the User Interface.

Past, present, and future of Recommender Systems: an industry perspective

Xavier Amatriain

Barcelona ML Meetup - Lessons Learned

Xavier Amatriain

More from Xavier Amatriain (20)

Data/AI driven product development: from video streaming to telehealth

AI-driven product innovation: from Recommender Systems to COVID-19

AI for COVID-19 - Q42020 update

AI for COVID-19: An online virtual care approach

Lessons learned from building practical deep learning systems

AI for healthcare: Scaling Access and Quality of Care for Everyone

Towards online universal quality healthcare through AI

From one to zero: Going smaller as a growth strategy

Learning to speak medicine

ML to cure the world

Recommender Systems In Industry

Medical advice as a Recommender System

Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...

Past present and future of Recommender Systems: an Industry Perspective

Staying Shallow & Lean in a Deep Learning World

Machine Learning for Q&A Sites: The Quora Example

BIG2016- Lessons Learned from building real-life user-focused Big Data systems

Strata 2016 - Lessons Learned from building real-life Machine Learning Systems

Past, present, and future of Recommender Systems: an industry perspective

Barcelona ML Meetup - Lessons Learned

Recently uploaded

Manulife - Insurer Transformation Award 2024

The Digital Insurer

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

ICT role in 21st century education and its challenges

rafiqahmad00786416

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

CNIC Information System with Pakdata Cf In Pakistan

danishmna97

Dubai, often portrayed as a shimmering oasis in the desert, faces its own set of challenges, including the occasional threat of flooding. Despite its reputation for opulence and modernity, the emirate is not immune to the forces of nature. In recent years, Dubai has experienced sporadic but significant floods, testing the resilience of its infrastructure and communities. Among the critical lifelines in this bustling metropolis is the Dubai International Airport, a bustling hub that connects the city to the world. This article explores the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Orbitshub

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

MS Copilot expands with MS Graph connectors

Nanddeep Nachan

The action of the next cyber saga takes place in the mystical lands of the Asia-Pacific region, where the main characters began their digital activities in the middle of 2021 and qualitatively strengthened it in 2022. Corporate espionage, document theft, audio recordings, and data leaks from messaging platforms were all a matter of one day for Dark Pink. Their geographical focus may have started in the Asia-Pacific region, but their ambitions knew no bounds, targeting a European government ministry in a bold move to expand their portfolio. Their victim profile was as diverse as a UN meeting, targeting military organizations, government agencies, and even a religious organization. Because discrimination is not a fashionable agenda. In the world of cybercrime, they serve as a reminder that sometimes the most serious threats come in the most unassuming packages with a pink bow.

Cyberprint. Dark Pink Apt Group [EN].pdf

Overkill Security

When you’re building (micro)services, you have lots of framework options. Spring Boot is no doubt a popular choice. But there’s more! Take Quarkus, a framework that’s considered the rising star for Kubernetes-native Java. It always depends on what's best for your situation, but how to choose the best solution if you're comparing 2 frameworks? Both Spring Boot and Quarkus have their positives and negatives. Let us compare the two by live coding a couple of common use cases in Spring Boot and Quarkus. After this talk, you’ll be ready to get started with Quarkus yourself, and know when to select Quarkus or Spring Boot.

Spring Boot vs Quarkus the ultimate battle - DevoxxUK

Jago de Vreede

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

Dubai, known for its towering skyscrapers, luxurious lifestyle, and relentless pursuit of innovation, often finds itself in the global spotlight. However, amidst the glitz and glamour, the emirate faces its own set of challenges, including the occasional threat of flooding. In recent years, Dubai has experienced sporadic but significant floods, disrupting normalcy and posing unique challenges to its infrastructure. Among the critical nodes in this bustling metropolis is the Dubai International Airport, a vital hub connecting the world. This article delves into the intersection of Dubai flood events and the resilience demonstrated by the Dubai International Airport in the face of such challenges.

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

Orbitshub

💥 You’re lucky! We’ve found two different (lead) developers that are willing to share their valuable lessons learned about using UiPath Document Understanding! Based on recent implementations in appealing use cases at Partou and SPIE. Don’t expect fancy videos or slide decks, but real and practical experiences that will help you with your own implementations. 📕 Topics that will be addressed: • Training the ML-model by humans: do or don't? • Rule-based versus AI extractors • Tips for finding use cases • How to start 👨‍🏫👨‍💻 Speakers: o Dion Morskieft, RPA Product Owner @Partou o Jack Klein-Schiphorst, Automation Developer @Tacstone Technology

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

UiPathCommunity

Architecting Cloud Native Applications

WSO2

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

Recently uploaded (20)

Manulife - Insurer Transformation Award 2024

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

presentation ICT roal in 21st century education

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

ICT role in 21st century education and its challenges

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

CNIC Information System with Pakdata Cf In Pakistan

Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...

Corporate and higher education May webinar.pptx

Axa Assurance Maroc - Insurer Innovation Award 2024

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

MS Copilot expands with MS Graph connectors

Cyberprint. Dark Pink Apt Group [EN].pdf

Spring Boot vs Quarkus the ultimate battle - DevoxxUK

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam

Architecting Cloud Native Applications

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

2024: Domino Containers - The Next Step. News from the Domino Container commu...