SlideShare una empresa de Scribd logo
1 de 44
Introduction to Text Analytics
October 2, 2013
Dr. Stuart Shulman
Phone No.: +1-413-345-8939
E-mail: stu.shulman@visioncritical.com
The Value Proposition
Our solution helps users easily discover information to:
• streamline business processes
• increase ROI & create new business opportunities
• identify positive and negative trends
• discover unique, rare or unexpected information
How Do These Tools Help Analysts?
What This Means forAnalysis
The Core Methods
Coding and Classifying Text Data
Iteration and Re-Use Are Critical Techniques
Measure Everything Starting With Human Agreement
The Core DiscoverTextApproach
An Indispensable Role for Humans
Innovation Happens in Groups
“CoderRank” – A LifetimeAccuracy Measurement
Vision Critical Patent Pending – “Enhanced Machine Learning”
Five Essential Tools for TextAnalytics
1. Search
2. Filtering on Metadata
3. Human Coding
4. Automated Clustering
5. Machine Classification
A Social Media Use Case
Sifting and Sorting Relevant Data
Great Researchers Demand Transparent Tools
The HMC is a Leading Edge Gnip Customer
Gnip Data Streams and Search Filters
Fair Warning
This part of the presentation contains strong and
potentially quite
offensive, inappropriate, disturbing, or just
completely stupid language.
Studying Media Campaign Effects
Create Custom Machine Classifiers
Yes
No
No
Search is Fundamental for Purposive Sampling
Defined Search Speeds Up Discovery
Tumblr. – “The Wild West of the Internet”
Stupid Stuff People Do & Tweet
redacted
redacted
Are These Tweets Just Social Garbage?
redacted
redacted
Signs of Health Fear Engagement
redacted
redacted
An IdeaScreen Use Case
Concept Testing Data
Raw VoC Data: AFortune 500 Tech Company
Near Duplicate Clusters Can Be Interesting
Two Naturally Occurring Clusters of Free Text
Wherever Humans Go in Numbers, There Are Clusters
1st Wave of Human Coding Blazes a Trail
A„Simple‟ Coding Scheme with No Coder Training
Filtering Based on Classifier Scores
Testing Coder Agreement on a Small Sample
Measuring Inter-CoderAgreement
Validation of Coders & Codes
TextAnalytics is a Series Buckets & Datasets
Breaking Down Concerns by Subtype
Breaking Down Advocacy by Pro and Con
A New Vision Critical Front End
The First Preview of the New Release
The New VC Front End for DiscoverText
Coding Items to Train a Classifier
Leverage Item Metadata While Coding or Filtering
Code Items in a List View

Más contenido relacionado

Destacado

Narciso.it il bello degli uomini
Narciso.it il bello degli uominiNarciso.it il bello degli uomini
Narciso.it il bello degli uomini
ciorci
 
Software As-A-Service Company Presentation
Software As-A-Service Company PresentationSoftware As-A-Service Company Presentation
Software As-A-Service Company Presentation
Ferdinand Kjærulff
 
Final draft corrected pdf
Final draft corrected pdfFinal draft corrected pdf
Final draft corrected pdf
Denis Mpagaze
 

Destacado (18)

Vlanr Apps
Vlanr AppsVlanr Apps
Vlanr Apps
 
Brown act
Brown actBrown act
Brown act
 
Narciso.it il bello degli uomini
Narciso.it il bello degli uominiNarciso.it il bello degli uomini
Narciso.it il bello degli uomini
 
Krauthammer Corporate Presentation
Krauthammer Corporate PresentationKrauthammer Corporate Presentation
Krauthammer Corporate Presentation
 
Pdf radar1
Pdf radar1Pdf radar1
Pdf radar1
 
Alt solunum yolu enfeksi̇yonlarinda opti̇mal örnek alim yerleri̇
Alt solunum yolu enfeksi̇yonlarinda  opti̇mal örnek alim yerleri̇Alt solunum yolu enfeksi̇yonlarinda  opti̇mal örnek alim yerleri̇
Alt solunum yolu enfeksi̇yonlarinda opti̇mal örnek alim yerleri̇
 
Carole Croella
Carole CroellaCarole Croella
Carole Croella
 
Usa credit
Usa creditUsa credit
Usa credit
 
Software As-A-Service Company Presentation
Software As-A-Service Company PresentationSoftware As-A-Service Company Presentation
Software As-A-Service Company Presentation
 
CodersTrust Pitch Deck
CodersTrust Pitch DeckCodersTrust Pitch Deck
CodersTrust Pitch Deck
 
Final draft corrected pdf
Final draft corrected pdfFinal draft corrected pdf
Final draft corrected pdf
 
Virus antiguos
Virus antiguosVirus antiguos
Virus antiguos
 
Plenum 1
Plenum 1Plenum 1
Plenum 1
 
Kulliyyah briefing 7_th_dec_2010_edited-1
Kulliyyah briefing 7_th_dec_2010_edited-1Kulliyyah briefing 7_th_dec_2010_edited-1
Kulliyyah briefing 7_th_dec_2010_edited-1
 
Trip planner
Trip plannerTrip planner
Trip planner
 
Qut presentation 9 may 2012
Qut presentation 9 may 2012Qut presentation 9 may 2012
Qut presentation 9 may 2012
 
Scis2014_presen
Scis2014_presenScis2014_presen
Scis2014_presen
 
Presentació treball: Va de llengua
Presentació treball: Va de llenguaPresentació treball: Va de llengua
Presentació treball: Va de llengua
 

Similar a Summit slide loop ny

Juliette Melton - Mobile User Experience Research
Juliette Melton - Mobile User Experience ResearchJuliette Melton - Mobile User Experience Research
Juliette Melton - Mobile User Experience Research
Web Directions
 
ODSC East 2017: Data Science Models For Good
ODSC East 2017: Data Science Models For GoodODSC East 2017: Data Science Models For Good
ODSC East 2017: Data Science Models For Good
Karry Lu
 
Getting started in ds (july 17) atlanta
Getting started in ds (july 17)   atlantaGetting started in ds (july 17)   atlanta
Getting started in ds (july 17) atlanta
Thinkful
 

Similar a Summit slide loop ny (20)

Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...
Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...
Text Analytics: From Colored Pens and Crumbly Papers to Custom Machine Classi...
 
CoderRank: Creating Gold Standards
CoderRank: Creating Gold StandardsCoderRank: Creating Gold Standards
CoderRank: Creating Gold Standards
 
Qual, Mixed, Machine and Everything in Between
Qual, Mixed, Machine and Everything in BetweenQual, Mixed, Machine and Everything in Between
Qual, Mixed, Machine and Everything in Between
 
Future of text analysis forrester briefing
Future of text analysis   forrester briefingFuture of text analysis   forrester briefing
Future of text analysis forrester briefing
 
Data sci sd-11.6.17
Data sci sd-11.6.17Data sci sd-11.6.17
Data sci sd-11.6.17
 
Classification with R
Classification with RClassification with R
Classification with R
 
D92-198gstindspdx
D92-198gstindspdxD92-198gstindspdx
D92-198gstindspdx
 
RAPIDE
RAPIDERAPIDE
RAPIDE
 
Juliette Melton - Mobile User Experience Research
Juliette Melton - Mobile User Experience ResearchJuliette Melton - Mobile User Experience Research
Juliette Melton - Mobile User Experience Research
 
DiscoverText Product Overview
DiscoverText Product OverviewDiscoverText Product Overview
DiscoverText Product Overview
 
Data Science Workshop - day 1
Data Science Workshop - day 1Data Science Workshop - day 1
Data Science Workshop - day 1
 
ODSC East 2017: Data Science Models For Good
ODSC East 2017: Data Science Models For GoodODSC East 2017: Data Science Models For Good
ODSC East 2017: Data Science Models For Good
 
Bio IT World 2019 - AI For Healthcare - Simon Taylor, Lucidworks
Bio IT World 2019 - AI For Healthcare - Simon Taylor, LucidworksBio IT World 2019 - AI For Healthcare - Simon Taylor, Lucidworks
Bio IT World 2019 - AI For Healthcare - Simon Taylor, Lucidworks
 
Getstarteddssd12717sd
Getstarteddssd12717sdGetstarteddssd12717sd
Getstarteddssd12717sd
 
Pingar - The Future of Text Analytics
Pingar - The Future of Text AnalyticsPingar - The Future of Text Analytics
Pingar - The Future of Text Analytics
 
Getting started in ds (july 17) atlanta
Getting started in ds (july 17)   atlantaGetting started in ds (july 17)   atlanta
Getting started in ds (july 17) atlanta
 
Deck 92-146 (3)
Deck 92-146 (3)Deck 92-146 (3)
Deck 92-146 (3)
 
How to create a taxonomy for management buy-in
How to create a taxonomy for management buy-inHow to create a taxonomy for management buy-in
How to create a taxonomy for management buy-in
 
Startds9.19.17sd
Startds9.19.17sdStartds9.19.17sd
Startds9.19.17sd
 
AI, Search, and the Disruption of Knowledge Management
AI, Search, and the Disruption of Knowledge ManagementAI, Search, and the Disruption of Knowledge Management
AI, Search, and the Disruption of Knowledge Management
 

Más de Stuart Shulman

Text Analytics for Social Data Using DiscoverText & Sifter
 Text Analytics for Social Data Using DiscoverText & Sifter Text Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & Sifter
Stuart Shulman
 

Más de Stuart Shulman (14)

Fear and loathing on the social campaign trail
Fear and loathing on the social campaign trailFear and loathing on the social campaign trail
Fear and loathing on the social campaign trail
 
Fear and Loathing on the Social Campaign Trail
Fear and Loathing on the Social Campaign TrailFear and Loathing on the Social Campaign Trail
Fear and Loathing on the Social Campaign Trail
 
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!
Texifter Presentation at Boston New Technology’s #BNT77 Startup Showcase!
 
Text Analytics for Social Data Using DiscoverText & Sifter
 Text Analytics for Social Data Using DiscoverText & Sifter Text Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & Sifter
 
Text Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & SifterText Analytics for Social Data Using DiscoverText & Sifter
Text Analytics for Social Data Using DiscoverText & Sifter
 
Twitter for Research
Twitter for ResearchTwitter for Research
Twitter for Research
 
Sifting Social Data: Word Sense Disambiguation Using Machine Learning
Sifting Social Data: Word Sense Disambiguation Using Machine LearningSifting Social Data: Word Sense Disambiguation Using Machine Learning
Sifting Social Data: Word Sense Disambiguation Using Machine Learning
 
CAQDAS 2014 Pecha Kucha - Stuart Shulman
CAQDAS 2014 Pecha Kucha - Stuart ShulmanCAQDAS 2014 Pecha Kucha - Stuart Shulman
CAQDAS 2014 Pecha Kucha - Stuart Shulman
 
Measuring reliability and validity in human coding and machine classification
Measuring reliability and validity in human coding and machine classificationMeasuring reliability and validity in human coding and machine classification
Measuring reliability and validity in human coding and machine classification
 
Technology for Citizen Voices
Technology for Citizen VoicesTechnology for Citizen Voices
Technology for Citizen Voices
 
DiscoverText: Tools for Text
DiscoverText: Tools for TextDiscoverText: Tools for Text
DiscoverText: Tools for Text
 
Citizen Voices in a Networked Age of #BigData
Citizen Voices in a Networked Age of #BigDataCitizen Voices in a Networked Age of #BigData
Citizen Voices in a Networked Age of #BigData
 
Importing bulk outlook email into DiscoverText - the .pst file upload
Importing bulk outlook email into DiscoverText - the .pst file uploadImporting bulk outlook email into DiscoverText - the .pst file upload
Importing bulk outlook email into DiscoverText - the .pst file upload
 
Texifter
TexifterTexifter
Texifter
 

Último

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Último (20)

Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 

Summit slide loop ny