SlideShare a Scribd company logo
1 of 15
Download to read offline
UNDERSTANDING DEJA REVIEWERS
Eric Gilbert & Karrie Karahalios   University of Illinois
WHAT’S IN IT FOR DEJA REVIEWERS?
THE REVIEWS
overview


98,191 Amazon.com reviews
from 200 bestselling products
belonging to 15 product categories
COMPUTATIONAL METHOD
n-gram & sentiment centrality


 “Our family loves the Wii Fit, but my son loves it most.”


       deja score = similarity to centroid &
                     similarity to running sentiment
        centroid = statistically representative n-grams
                     normalized to Google 1T corpus
THE INTERVIEWS
overview


20 interviews
from 200 invitations extended
conducted via email, phone & IM
THE PROBLEM OF SCALE
a common refrain


If there's 5, 10, I'll read those. If there's
50 or 60, I'll skim some titles. If a title
looks like it has some wit or humor, I
might read that one. That’s about it.
— P13
AMATEUR DEJA REVIEWERS
catharsis


I was so moved by this documentary,
and as a wolf advocate, I wanted a few
others to know about it … I don't care if
I write the rst review or the 5,000th.
It's cathartic for me.
— P3
AMATEUR DEJA REVIEWERS
why be unique?


I'm sure that other reviewers noted the
same features that appealed to me and my
kids. A completely unique review wouldn't
serve any real purpose, would it?
— P5
PRO DEJA REVIEWERS
hate mail




One said we were trying to “sti e dissent.”

Another warned us that she does not write
“just to see my own words on the internet.”
PRO DEJA REVIEWERS
above the din


[Do you read other reviews?] Absolutely
not … I do not condone plagiarism and
would never base my opinion on another
reviewer’s thoughts. I believe this alone
has led me to be rated highly.
— P7
PRO DEJA REVIEWERS
building a brand


I am trying to build a name for myself …
If every other person on earth has said
something similar that is ne, it in no
way diminishes the value of my personal
opinion.
— P19
RESULTS
summary


universal problem of scale
amateurs: ok as a brick in the wall; visceral reactions
pros: special bricks in the wall; cerebral reviews
NUDGEMENTAL COMMUNITIES
early sketch
UNDERSTANDING DEJA REVIEWERS
Eric Gilbert & Karrie Karahalios   University of Illinois

More Related Content

Viewers also liked

The Network in the Garden: CHI 08
The Network in the Garden: CHI 08The Network in the Garden: CHI 08
The Network in the Garden: CHI 08eegilbert
 
Staff Tech Training 20 minute version
Staff Tech Training 20 minute versionStaff Tech Training 20 minute version
Staff Tech Training 20 minute versionBald Geek In Md
 
Demystifying & Integrating Web 2.0 at the Metropolitan Museum of Art
Demystifying & Integrating Web 2.0 at the Metropolitan Museum of ArtDemystifying & Integrating Web 2.0 at the Metropolitan Museum of Art
Demystifying & Integrating Web 2.0 at the Metropolitan Museum of ArtJennie Pu
 
When Web Calling, Video, and Libraries Collide
When Web Calling, Video, and Libraries CollideWhen Web Calling, Video, and Libraries Collide
When Web Calling, Video, and Libraries Collidechar booth
 
Integrating RSS Into Your Web Site - CIL2008
Integrating RSS Into Your Web Site - CIL2008Integrating RSS Into Your Web Site - CIL2008
Integrating RSS Into Your Web Site - CIL2008Michael Sauers
 
Leading Technology in Libraries
Leading Technology in LibrariesLeading Technology in Libraries
Leading Technology in LibrariesGina Millsap
 
Predicting Tie Strength With Social Media
Predicting Tie Strength With Social MediaPredicting Tie Strength With Social Media
Predicting Tie Strength With Social Mediaeegilbert
 

Viewers also liked (7)

The Network in the Garden: CHI 08
The Network in the Garden: CHI 08The Network in the Garden: CHI 08
The Network in the Garden: CHI 08
 
Staff Tech Training 20 minute version
Staff Tech Training 20 minute versionStaff Tech Training 20 minute version
Staff Tech Training 20 minute version
 
Demystifying & Integrating Web 2.0 at the Metropolitan Museum of Art
Demystifying & Integrating Web 2.0 at the Metropolitan Museum of ArtDemystifying & Integrating Web 2.0 at the Metropolitan Museum of Art
Demystifying & Integrating Web 2.0 at the Metropolitan Museum of Art
 
When Web Calling, Video, and Libraries Collide
When Web Calling, Video, and Libraries CollideWhen Web Calling, Video, and Libraries Collide
When Web Calling, Video, and Libraries Collide
 
Integrating RSS Into Your Web Site - CIL2008
Integrating RSS Into Your Web Site - CIL2008Integrating RSS Into Your Web Site - CIL2008
Integrating RSS Into Your Web Site - CIL2008
 
Leading Technology in Libraries
Leading Technology in LibrariesLeading Technology in Libraries
Leading Technology in Libraries
 
Predicting Tie Strength With Social Media
Predicting Tie Strength With Social MediaPredicting Tie Strength With Social Media
Predicting Tie Strength With Social Media
 

Similar to Understanding Deja Reviewers

Research unit 3
 Research unit 3 Research unit 3
Research unit 3Sam Fulton
 
"Yes, and...": What Agencies Can Learn from Improv
"Yes, and...": What Agencies Can Learn from Improv"Yes, and...": What Agencies Can Learn from Improv
"Yes, and...": What Agencies Can Learn from ImprovYoung & Rubicam
 
How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...
How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...
How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...Kaitlin Zhang
 
How To Find A Business Name In 12 Happy Steps
How To Find A Business Name In 12 Happy StepsHow To Find A Business Name In 12 Happy Steps
How To Find A Business Name In 12 Happy StepsTwentyTwo Agency
 

Similar to Understanding Deja Reviewers (6)

Media question 4
Media question 4Media question 4
Media question 4
 
Research unit 3
 Research unit 3 Research unit 3
Research unit 3
 
"Yes, and...": What Agencies Can Learn from Improv
"Yes, and...": What Agencies Can Learn from Improv"Yes, and...": What Agencies Can Learn from Improv
"Yes, and...": What Agencies Can Learn from Improv
 
How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...
How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...
How to Write Elevator Pitches - Personal Branding for Entrepreneurs Kaitlin Z...
 
How To Find A Business Name In 12 Happy Steps
How To Find A Business Name In 12 Happy StepsHow To Find A Business Name In 12 Happy Steps
How To Find A Business Name In 12 Happy Steps
 
Validity
ValidityValidity
Validity
 

Recently uploaded

Designing for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastDesigning for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastUXDXConf
 
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeFree and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeCzechDreamin
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftshyamraj55
 
AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101vincent683379
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfSrushith Repakula
 
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024Stephanie Beckett
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...CzechDreamin
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceSamy Fodil
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCzechDreamin
 
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka DoktorováCzechDreamin
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfFIDO Alliance
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaCzechDreamin
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераMark Opanasiuk
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon
 
The UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, OcadoThe UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, OcadoUXDXConf
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?Mark Billinghurst
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutesconfluent
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxDavid Michel
 
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...CzechDreamin
 
Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge
 

Recently uploaded (20)

Designing for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastDesigning for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at Comcast
 
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeFree and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoft
 
AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101AI presentation and introduction - Retrieval Augmented Generation RAG 101
AI presentation and introduction - Retrieval Augmented Generation RAG 101
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024What's New in Teams Calling, Meetings and Devices April 2024
What's New in Teams Calling, Meetings and Devices April 2024
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
 
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджера
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdf
 
The UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, OcadoThe UX of Automation by AJ King, Senior UX Researcher, Ocado
The UX of Automation by AJ King, Senior UX Researcher, Ocado
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
SOQL 201 for Admins & Developers: Slice & Dice Your Org’s Data With Aggregate...
 
Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024
 

Understanding Deja Reviewers

  • 1. UNDERSTANDING DEJA REVIEWERS Eric Gilbert & Karrie Karahalios University of Illinois
  • 2. WHAT’S IN IT FOR DEJA REVIEWERS?
  • 3. THE REVIEWS overview 98,191 Amazon.com reviews from 200 bestselling products belonging to 15 product categories
  • 4. COMPUTATIONAL METHOD n-gram & sentiment centrality “Our family loves the Wii Fit, but my son loves it most.” deja score = similarity to centroid & similarity to running sentiment centroid = statistically representative n-grams normalized to Google 1T corpus
  • 5.
  • 6. THE INTERVIEWS overview 20 interviews from 200 invitations extended conducted via email, phone & IM
  • 7. THE PROBLEM OF SCALE a common refrain If there's 5, 10, I'll read those. If there's 50 or 60, I'll skim some titles. If a title looks like it has some wit or humor, I might read that one. That’s about it. — P13
  • 8. AMATEUR DEJA REVIEWERS catharsis I was so moved by this documentary, and as a wolf advocate, I wanted a few others to know about it … I don't care if I write the rst review or the 5,000th. It's cathartic for me. — P3
  • 9. AMATEUR DEJA REVIEWERS why be unique? I'm sure that other reviewers noted the same features that appealed to me and my kids. A completely unique review wouldn't serve any real purpose, would it? — P5
  • 10. PRO DEJA REVIEWERS hate mail One said we were trying to “sti e dissent.” Another warned us that she does not write “just to see my own words on the internet.”
  • 11. PRO DEJA REVIEWERS above the din [Do you read other reviews?] Absolutely not … I do not condone plagiarism and would never base my opinion on another reviewer’s thoughts. I believe this alone has led me to be rated highly. — P7
  • 12. PRO DEJA REVIEWERS building a brand I am trying to build a name for myself … If every other person on earth has said something similar that is ne, it in no way diminishes the value of my personal opinion. — P19
  • 13. RESULTS summary universal problem of scale amateurs: ok as a brick in the wall; visceral reactions pros: special bricks in the wall; cerebral reviews
  • 15. UNDERSTANDING DEJA REVIEWERS Eric Gilbert & Karrie Karahalios University of Illinois