SlideShare una empresa de Scribd logo
1 de 28
Introducing Amazon
Mechanical Turk
A Brief Overview of What, Why, and How
John Hoskins
Agenda
What is Mechanical Turk?
When would you use it?
How are others using it - Case Studies
How – Implementation options
What is
Mechanical Turk?
Mechanical Turk is a
   Marketplace.
Mechanical Turk is a
         marketplace for work.
Mechanical Turk gives businesses and developers access
to an on-demand, scalable workforce.
  •   Flexibility: Scale your workforce up and down quickly
  •   Accuracy: Get high quality, efficient and cost effective results.
  •   Price: Pay only when you are satisfied with the results.
  •   Speed: Start receiving results in minutes
How it works:.
“Design & Publish”      “Validate,
                        Pay & Go”
Workforce
500,000 Workers
190+ Countries
Who are the Workers?
•   Workers are global
•   Workers represent numerous skill sets
•   24X7 Follow the sun availability

Managing Your Workforce
•   You can choose who is allowed to work on your assignments
•   Can narrow to US based (i.e. when you need western culture competence)
•   Leverage qualifications to find your best Workers
When would you use
 Mechanical Turk?
Business Challenges
Our Community is generating 10,000 comments per day
– how can we eliminate SPAM?
We pull information from hundreds of sources – how do
we normalize and cleanse?
We have thousands of legacy assets – how do we make
them searchable?
Our heuristics need jump started – how can I generate
thousands of reference data points fast?
We need to add a new attribute to our data?
Business Challenges
Requires Human Judgment: Recognition, Reasoning,
Context, Prior Knowledge

Cannot be completely solved algorithmically

Has unpredictable fluctuations in volume
How are businesses using it?
   Data Management                     Categorization
       Data Verification                   Classification
       Data Entry & Collection             Tagging
       Data De-duplication                 Keywords
       Algorithm Training                  Sentiment Analysis


   Content & Media                     Business Services
       Moderate Photos & Content           Search Relevancy
       Content Creation & Editing          Data Gathering
       Transcription
                                            Enhancement
How are others using
 Mechanical Turk?
Search Enhancement
Make your assets more discoverable
• Categorize them into your search tree
• Add descriptions, attributes and keywords
• Enhance listing data


How it works:
Item description
                     Workers select
    is sent to                          Items are placed     Content is more
                    the best category
Mechanical Turk                         in that branch of   easily discovered
                    and sub-category
  for review by                          the search tree     through search
                       for the item
     Workers
Data Handling
Resolve Data conflicts directly in your business process
•   Remove duplicates
•   Normalize data entries
•   Resolve conflicts and collisions
•   Enhance entries

How it works:
   Business
                    Items flagged for
Process Ingests                           Workers review    Business
                     conflict are sent
Data Elements                            item and resolve    Process
                      to Mechanical
 from multiple                                conflict      continues
                           Turk
    sources
How to apply your task to
   Mechanical Turk?
Your Project  Tasks
“Working Backwards”
•   What are the business results that you want?
•   How will you use those results?
•   What format do the results need to be in?
•   Which tasks benefits from human intelligence?

Break your overall project into smaller “tasks”
• Consolidate like items and processes

Define instructions for each task
Example Workflow
Content Moderation with API integration
The Key components of your HIT
Instruction
• Guidelines for how to do
  a HIT


Data                         What kind of dress is this?
• “batch” concept                 Cocktail

                                  Sun dress

Question(s)                       Bridal dress
Work Catalog
               Workers
               discover
               available HITs
               through the
               listings catalog
               Name of
               Requester, Na
               me of
               HIT, Price and
               Qualifications
               are displayed
HIT Example
              Specific
              instructions on
              what to do –
              and how to do it
              Providing as
              much
              information as
              available
Adjudication Strategies
Leverage different methods of determining the correct answer
by designing for accuracy in your HIT:
• Multiple Choice
    • Plurality
    • Known Answers (“Gold Standards”)
• Free-form
    • Multiple HIT Workflow’s where a new Worker “edits” or “grades”
      previous Worker submissions

• Creative Tasks
    • Bonus Payments
Your Workers
Identify and manage your best Workers
                           • All available Workers
             All Workers   • 500,000 +
                           • 24x7, 365

                           • Any Worker who
                             completes a HIT
            Your Workers   • Evaluate performance on
                             your HITS

            Your Trusted   • Your best Workers with
                             proven quality and
              Workers        availability
Balances & Levers
Leverage market dynamics to optimize speed, price and accuracy to
meet your business needs.


                             Speed



                     Price

                                Accuracy
Requester access:
                                        Apps & Solution
     Web UI              API & CLT
                                          Providers
• Easy Access        • Programmatic    • Experts at
• Create HITS in       Access            Workflow design
  HTML               • Multiple SDKS   • They do the
• Upload and         • Massive scale     training and
  manage data via                        management of
  CSV                                    Workers for
                                         specific kinds of
                                         tasks
Self Service Applications
Mechanical Turk supports a robust ecosystem of providers
that have built or can build solutions to meet your needs.
Custom Solution Providers
Advantages of Mechanical Turk
                  Gives you access to an on-demand workforce
  Eliminates      100% Efficiency
Staffing Issues   Maintain the flexibility your business demands
                  Use only the capacity you need, when you need it
    Lowers        Converts a fixed cost into a variable cost
     Costs        Significantly reduces ongoing headcount expenses
                  Offers a pay-as-you-go staffing model
                  Eliminates lead time of interviewing and staffing
 Reduces work
                  Work gets done faster, by working in parallel
turnaround time
                  Work continues around the globe, around the clock
Thank you.
John Hoskins
hoskins@amazon.com
206.266.8105

     @amazonmturk

     Facebook.com/amazonmturk
     mechanicalturk.typepad.com

Más contenido relacionado

Destacado

Eicosanoids - power point presentaion
Eicosanoids - power point presentaionEicosanoids - power point presentaion
Eicosanoids - power point presentaion
Namrata Chhabra
 
Human resource management within coca cola
Human resource management within coca colaHuman resource management within coca cola
Human resource management within coca cola
Nevroz Gösterici
 
Hr policies at coca cola
Hr policies at coca colaHr policies at coca cola
Hr policies at coca cola
Saran Chandran
 
Company presentation - Amazon
Company presentation - AmazonCompany presentation - Amazon
Company presentation - Amazon
Indushekar Reddy
 
Training and development ppt
Training and development pptTraining and development ppt
Training and development ppt
firdaus-zailani
 
Amazon ppt
Amazon pptAmazon ppt
Amazon ppt
aftabssm
 

Destacado (20)

HRM in Coca Cola
HRM in Coca ColaHRM in Coca Cola
HRM in Coca Cola
 
Introduction to Amazon Mechanical Turk
Introduction to Amazon Mechanical TurkIntroduction to Amazon Mechanical Turk
Introduction to Amazon Mechanical Turk
 
HRM process of coca cola beverages of pakistan ltd.
HRM process of coca cola beverages of pakistan ltd.HRM process of coca cola beverages of pakistan ltd.
HRM process of coca cola beverages of pakistan ltd.
 
Amazon.com - Company Analysis (OD & HRM)
Amazon.com - Company Analysis (OD & HRM)Amazon.com - Company Analysis (OD & HRM)
Amazon.com - Company Analysis (OD & HRM)
 
Amazon.com Business Model
Amazon.com Business ModelAmazon.com Business Model
Amazon.com Business Model
 
Amazon - Brand Management
Amazon - Brand ManagementAmazon - Brand Management
Amazon - Brand Management
 
Eicosanoids - power point presentaion
Eicosanoids - power point presentaionEicosanoids - power point presentaion
Eicosanoids - power point presentaion
 
Strategic human resource management at COCA COLA BEVERAGES PAKISTAN LIMITED
Strategic human resource management at COCA COLA BEVERAGES PAKISTAN LIMITED Strategic human resource management at COCA COLA BEVERAGES PAKISTAN LIMITED
Strategic human resource management at COCA COLA BEVERAGES PAKISTAN LIMITED
 
Human resource management within coca cola
Human resource management within coca colaHuman resource management within coca cola
Human resource management within coca cola
 
Presentation on Amazon
Presentation on AmazonPresentation on Amazon
Presentation on Amazon
 
HR presentation oc COCA COLA
HR presentation oc COCA COLA HR presentation oc COCA COLA
HR presentation oc COCA COLA
 
Amazon: Strategic Management
Amazon: Strategic ManagementAmazon: Strategic Management
Amazon: Strategic Management
 
Hr policies at coca cola
Hr policies at coca colaHr policies at coca cola
Hr policies at coca cola
 
Company presentation - Amazon
Company presentation - AmazonCompany presentation - Amazon
Company presentation - Amazon
 
Training and development slides (2)
Training and development slides (2)Training and development slides (2)
Training and development slides (2)
 
Training and development ppt
Training and development pptTraining and development ppt
Training and development ppt
 
Amazon ppt
Amazon pptAmazon ppt
Amazon ppt
 
Amazon.com Strategic Analysis
Amazon.com Strategic AnalysisAmazon.com Strategic Analysis
Amazon.com Strategic Analysis
 
training & development ppt
training & development ppttraining & development ppt
training & development ppt
 
Amazon Business Model
Amazon Business ModelAmazon Business Model
Amazon Business Model
 

Similar a Amazon Mechanical Turk Overview

Getting Started with Amazon Mechanical Turk - AWS Summit 2012 - NYC
Getting Started with Amazon Mechanical Turk - AWS Summit 2012 - NYCGetting Started with Amazon Mechanical Turk - AWS Summit 2012 - NYC
Getting Started with Amazon Mechanical Turk - AWS Summit 2012 - NYC
Amazon Web Services
 
AWS Summit 2011: Amazon Mechanical Turk for Enterprises
AWS Summit 2011: Amazon Mechanical Turk for EnterprisesAWS Summit 2011: Amazon Mechanical Turk for Enterprises
AWS Summit 2011: Amazon Mechanical Turk for Enterprises
Amazon Web Services
 

Similar a Amazon Mechanical Turk Overview (20)

Getting Started with Amazon Mechanical Turk - AWS Summit 2012 - NYC
Getting Started with Amazon Mechanical Turk - AWS Summit 2012 - NYCGetting Started with Amazon Mechanical Turk - AWS Summit 2012 - NYC
Getting Started with Amazon Mechanical Turk - AWS Summit 2012 - NYC
 
The ProPricer Proven Performance
The ProPricer Proven PerformanceThe ProPricer Proven Performance
The ProPricer Proven Performance
 
General Presentation
General PresentationGeneral Presentation
General Presentation
 
Dashlane Mission Teams
Dashlane Mission TeamsDashlane Mission Teams
Dashlane Mission Teams
 
Social Media Use Cases - Webinar
Social Media Use Cases - Webinar Social Media Use Cases - Webinar
Social Media Use Cases - Webinar
 
xRM4Legal 2011 in the Cloud
xRM4Legal 2011 in the CloudxRM4Legal 2011 in the Cloud
xRM4Legal 2011 in the Cloud
 
Behind the Curtain: Real-world HR Tech Implementations and What You Need to ...
Behind the Curtain: Real-world HR Tech Implementations and What You Need to  ...Behind the Curtain: Real-world HR Tech Implementations and What You Need to  ...
Behind the Curtain: Real-world HR Tech Implementations and What You Need to ...
 
How to plan your Modern Workplace Project - SPS Denver October 2018
How to plan your Modern Workplace Project - SPS Denver October 2018How to plan your Modern Workplace Project - SPS Denver October 2018
How to plan your Modern Workplace Project - SPS Denver October 2018
 
AWS Summit 2011: Amazon Mechanical Turk for Enterprises
AWS Summit 2011: Amazon Mechanical Turk for EnterprisesAWS Summit 2011: Amazon Mechanical Turk for Enterprises
AWS Summit 2011: Amazon Mechanical Turk for Enterprises
 
Re-engineered Job Postings
Re-engineered Job PostingsRe-engineered Job Postings
Re-engineered Job Postings
 
AWS re:Invent 2016: Leverage the Power of the Crowd To Work with Amazon Mecha...
AWS re:Invent 2016: Leverage the Power of the Crowd To Work with Amazon Mecha...AWS re:Invent 2016: Leverage the Power of the Crowd To Work with Amazon Mecha...
AWS re:Invent 2016: Leverage the Power of the Crowd To Work with Amazon Mecha...
 
Now that you've sold it how do you build it - XMPie Users Conference XUG 202...
Now that you've sold it how do you build it  - XMPie Users Conference XUG 202...Now that you've sold it how do you build it  - XMPie Users Conference XUG 202...
Now that you've sold it how do you build it - XMPie Users Conference XUG 202...
 
Talent Centric Presentation
Talent Centric PresentationTalent Centric Presentation
Talent Centric Presentation
 
HR Cloud Cleanup: How To Effectively Connect HR Cloud Applications To Save Ti...
HR Cloud Cleanup: How To Effectively Connect HR Cloud Applications To Save Ti...HR Cloud Cleanup: How To Effectively Connect HR Cloud Applications To Save Ti...
HR Cloud Cleanup: How To Effectively Connect HR Cloud Applications To Save Ti...
 
De-Mystifying ROI Calculation for SharePoint
De-Mystifying ROI Calculation for SharePointDe-Mystifying ROI Calculation for SharePoint
De-Mystifying ROI Calculation for SharePoint
 
Field report: Rapid application development
Field report: Rapid application developmentField report: Rapid application development
Field report: Rapid application development
 
About Us | Taction Software
About Us | Taction Software About Us | Taction Software
About Us | Taction Software
 
Talent Alpha: Unleashing talent of the global tech workforce
Talent Alpha: Unleashing talent of the global tech workforceTalent Alpha: Unleashing talent of the global tech workforce
Talent Alpha: Unleashing talent of the global tech workforce
 
Optimizing Innovation: Modular Toolchains that Enable Digital Transformations
Optimizing Innovation: Modular Toolchains that Enable Digital TransformationsOptimizing Innovation: Modular Toolchains that Enable Digital Transformations
Optimizing Innovation: Modular Toolchains that Enable Digital Transformations
 
Optimizing Innovation- Modular Toolchains that Enable Digital Transformations
Optimizing Innovation-  Modular Toolchains that Enable Digital TransformationsOptimizing Innovation-  Modular Toolchains that Enable Digital Transformations
Optimizing Innovation- Modular Toolchains that Enable Digital Transformations
 

Último

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 

Último (20)

2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 

Amazon Mechanical Turk Overview

  • 1. Introducing Amazon Mechanical Turk A Brief Overview of What, Why, and How John Hoskins
  • 2. Agenda What is Mechanical Turk? When would you use it? How are others using it - Case Studies How – Implementation options
  • 4. Mechanical Turk is a Marketplace.
  • 5. Mechanical Turk is a marketplace for work. Mechanical Turk gives businesses and developers access to an on-demand, scalable workforce. • Flexibility: Scale your workforce up and down quickly • Accuracy: Get high quality, efficient and cost effective results. • Price: Pay only when you are satisfied with the results. • Speed: Start receiving results in minutes
  • 6. How it works:. “Design & Publish” “Validate, Pay & Go”
  • 7. Workforce 500,000 Workers 190+ Countries Who are the Workers? • Workers are global • Workers represent numerous skill sets • 24X7 Follow the sun availability Managing Your Workforce • You can choose who is allowed to work on your assignments • Can narrow to US based (i.e. when you need western culture competence) • Leverage qualifications to find your best Workers
  • 8. When would you use Mechanical Turk?
  • 9. Business Challenges Our Community is generating 10,000 comments per day – how can we eliminate SPAM? We pull information from hundreds of sources – how do we normalize and cleanse? We have thousands of legacy assets – how do we make them searchable? Our heuristics need jump started – how can I generate thousands of reference data points fast? We need to add a new attribute to our data?
  • 10. Business Challenges Requires Human Judgment: Recognition, Reasoning, Context, Prior Knowledge Cannot be completely solved algorithmically Has unpredictable fluctuations in volume
  • 11. How are businesses using it?  Data Management  Categorization  Data Verification  Classification  Data Entry & Collection  Tagging  Data De-duplication  Keywords  Algorithm Training  Sentiment Analysis  Content & Media  Business Services  Moderate Photos & Content  Search Relevancy  Content Creation & Editing  Data Gathering  Transcription  Enhancement
  • 12. How are others using Mechanical Turk?
  • 13. Search Enhancement Make your assets more discoverable • Categorize them into your search tree • Add descriptions, attributes and keywords • Enhance listing data How it works: Item description Workers select is sent to Items are placed Content is more the best category Mechanical Turk in that branch of easily discovered and sub-category for review by the search tree through search for the item Workers
  • 14. Data Handling Resolve Data conflicts directly in your business process • Remove duplicates • Normalize data entries • Resolve conflicts and collisions • Enhance entries How it works: Business Items flagged for Process Ingests Workers review Business conflict are sent Data Elements item and resolve Process to Mechanical from multiple conflict continues Turk sources
  • 15. How to apply your task to Mechanical Turk?
  • 16. Your Project  Tasks “Working Backwards” • What are the business results that you want? • How will you use those results? • What format do the results need to be in? • Which tasks benefits from human intelligence? Break your overall project into smaller “tasks” • Consolidate like items and processes Define instructions for each task
  • 17. Example Workflow Content Moderation with API integration
  • 18. The Key components of your HIT Instruction • Guidelines for how to do a HIT Data What kind of dress is this? • “batch” concept Cocktail Sun dress Question(s) Bridal dress
  • 19. Work Catalog Workers discover available HITs through the listings catalog Name of Requester, Na me of HIT, Price and Qualifications are displayed
  • 20. HIT Example Specific instructions on what to do – and how to do it Providing as much information as available
  • 21. Adjudication Strategies Leverage different methods of determining the correct answer by designing for accuracy in your HIT: • Multiple Choice • Plurality • Known Answers (“Gold Standards”) • Free-form • Multiple HIT Workflow’s where a new Worker “edits” or “grades” previous Worker submissions • Creative Tasks • Bonus Payments
  • 22. Your Workers Identify and manage your best Workers • All available Workers All Workers • 500,000 + • 24x7, 365 • Any Worker who completes a HIT Your Workers • Evaluate performance on your HITS Your Trusted • Your best Workers with proven quality and Workers availability
  • 23. Balances & Levers Leverage market dynamics to optimize speed, price and accuracy to meet your business needs. Speed Price Accuracy
  • 24. Requester access: Apps & Solution Web UI API & CLT Providers • Easy Access • Programmatic • Experts at • Create HITS in Access Workflow design HTML • Multiple SDKS • They do the • Upload and • Massive scale training and manage data via management of CSV Workers for specific kinds of tasks
  • 25. Self Service Applications Mechanical Turk supports a robust ecosystem of providers that have built or can build solutions to meet your needs.
  • 27. Advantages of Mechanical Turk Gives you access to an on-demand workforce Eliminates 100% Efficiency Staffing Issues Maintain the flexibility your business demands Use only the capacity you need, when you need it Lowers Converts a fixed cost into a variable cost Costs Significantly reduces ongoing headcount expenses Offers a pay-as-you-go staffing model Eliminates lead time of interviewing and staffing Reduces work Work gets done faster, by working in parallel turnaround time Work continues around the globe, around the clock
  • 28. Thank you. John Hoskins hoskins@amazon.com 206.266.8105 @amazonmturk Facebook.com/amazonmturk mechanicalturk.typepad.com

Notas del editor

  1. Amazon Mechanical TurkIt is a marketplace for work. In a traditional marketplace, like the Amazon.com retail site that you’re probably already familiar with, there are buyers who spend money to purchase products and there are sellers who make money by selling their products. This is true in the Amazon Mechanical Turk Marketplace as well. Businesses, or Requesters as they are called on Mechanical Turk are creating an offer for work. Mechanical Turk Workers accept and execute the offer, sell their work, and earn money when the transaction is complete. And just like in the Amazon.com retail experience, Amazon Mechanical Turk takes care of all of the transaction details including getting the work “listed” on the site so Workers see it when they browse for Work as well as completing the payment transaction when work is submitted and approved by you, the Requester. Let’s talk in a bit more detail about how it works.
  2. Requesters design HITs, Human intelligence tasks. These HITs are composed of Assignments which are published to the Mechanical Turk Marketplace catalog. Workers search for and select tasks to complete and submit their assignments to Requesters.Requesters approve or reject the results and pay Workers.
  3. Think of the Workers like customers. They are a large group of individuals, conditioned to come to the marketplace and search for work on a regular basis. The scale and scope of this group is what makes it powerful.
  4. Mechanical Turk is ideal for tasks that require a human assessment – things that require recognition or reasoning. Context and prior knowledge.Many of our customers use Mechanical Turk in conjunction with an algorithmic process – in areas where the process can’t make a judgment with high confidence – the 80/20 rule where the 20% that doesn’t have a clear answer is sent to a human for resolution.Mechanical Turk, like all of Amazon’s web service is scalable – in both directions, scale up to meet peaks, and back off when resources aren’t needed. Avoid paying for idle work capacity to meet peak demand.
  5. A large media company has an archive of photos with very cryptic descriptions. They need to categorize them into a taxonomy that helps customers find what they are looking for easily. This requires that a human look at every photo and place it into the proper category. The company sends the photo to Mechanical Turk where a worker views it and places it into the proper category and sub-category. Is it a landscape, person, object, etc.
  6. A large business listing service receives daily data feeds from many sources. In order to apply that data to the proper business, they have to resolve which business the information belongs and in what sequence. Their internal process is able to resolve approximately 80% of the incoming data – what do they do for the other 20%? They create a task on Mechanical Turk to have a human look at the information and make a judgment on its resolution. Given the answer – the ingestion process continues.
  7. Begin with a projectDefine the goals and key components of your project. For example, your goal might be to clean your business listing database so that you have accurate information for consumers. The sub-components of your project might be to categorize the businesses by listing type (i.e., restaurant or service) and verify that the related address and phone number are current. Break it into tasks and design your HITBreak the project into individual tasks so that many Workers can work in parallel to get your project done faster. For example, if you have 1,000 listings to verify, each listing would be an individual task.Next, design your Human Intelligence Tasks (HITs) by writing crisp and clear instructions, identifying the specific outputs and inputs desired and how much you will pay to have work completed.
  8. Mechanical Turk offers a business process that ensures 100% worker productivity and keeping the cost per submitted work order, (HIT) to the lowest level. Mturk relieves businesses from having to staff to peaks and realizing employee downtime as demand lessens. Businesses avoid the fully burdened costs of a permanent workforce. Also, a workforce that performs at a 70-75% productivity range.