SlideShare una empresa de Scribd logo
1 de 15
TEXT ANALYZER:
A NEW WAY TO SEARCH,
FROM JSTOR LABS
DPLAfest 2017
20 April 2017
Alex Humphreys
@abhumphreys
JSTOR Labs works with partner publishers, libraries and
labs to create tools for researchers, teachers and students
that are immediately useful – and a little bit magical.
INTRODUCING…
www.jstor.org/analyze
UNDER THE HOOD
1. Extract Text
a. From many textual
formats (pdf, word, et
al)
b. OCR, if needed (e.g. a
picture of a page in a
magazine)
2. Identify Terms
a. Topics: JSTOR
Thesaurus & an LDA
Topic Model
b. Entities: Alchemy
(Watson), OpenCalais,
Stanford, Apache
3. Generate Results
a. TF-IDF to select 5 terms
b. “OR” search
c. Relevance ranked based
on “equalizer”
HOW WE BUILT IT
The Design Squiggle, by Damien Newman:
http://cargocollective.com/central/The-Design-Squiggle/
THE SEED…
The Design Squiggle, by Damien Newman:
http://cargocollective.com/central/The-Design-Squiggle/
CONCEPT TESTING...
The Design Squiggle, by Damien Newman:
http://cargocollective.com/central/The-Design-Squiggle/
ITERATING ON
INTERACTION DESIGN
The Design Squiggle, by Damien Newman:
http://cargocollective.com/central/The-Design-Squiggle/
RELEASE AS A JSTOR BETA…
The Design Squiggle, by Damien Newman:
http://cargocollective.com/central/The-Design-Squiggle/
WE’RE STILL REFINING...
The Design Squiggle, by Damien Newman:
http://cargocollective.com/central/The-Design-Squiggle/
THANK YOU!
For more information:
web: labs.jstor.org
email: alex.humphreys@ithaka.org
twitter: @abhumphreys
APPENDIX
(OPEN IN CASE OF NO
INTERNET CONNECTION)
Text Analyzer: a New Way to Search from JSTOR Labs
Text Analyzer: a New Way to Search from JSTOR Labs
Text Analyzer: a New Way to Search from JSTOR Labs

Más contenido relacionado

Más de Alex Humphreys

Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...
Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...
Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...
Alex Humphreys
 
JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...
JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...
JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...
Alex Humphreys
 

Más de Alex Humphreys (20)

The Case for Applied Digital Humanities in Scholarly Communications
The Case for Applied Digital Humanities in Scholarly CommunicationsThe Case for Applied Digital Humanities in Scholarly Communications
The Case for Applied Digital Humanities in Scholarly Communications
 
Your Chocolate, My Peanut Butter: JSTOR Labs' Content Mashups - NFAIS Webinar...
Your Chocolate, My Peanut Butter: JSTOR Labs' Content Mashups - NFAIS Webinar...Your Chocolate, My Peanut Butter: JSTOR Labs' Content Mashups - NFAIS Webinar...
Your Chocolate, My Peanut Butter: JSTOR Labs' Content Mashups - NFAIS Webinar...
 
Creating a New Way to Search - CNI Fall 2017
Creating a New Way to Search - CNI Fall 2017Creating a New Way to Search - CNI Fall 2017
Creating a New Way to Search - CNI Fall 2017
 
How JSTOR Labs Applies (Some) Methods & Tools from Digital Scholarship - SSP ...
How JSTOR Labs Applies (Some) Methods & Tools from Digital Scholarship - SSP ...How JSTOR Labs Applies (Some) Methods & Tools from Digital Scholarship - SSP ...
How JSTOR Labs Applies (Some) Methods & Tools from Digital Scholarship - SSP ...
 
How JSTOR Labs Thinks about Change - German Studies Association 2017 Annual C...
How JSTOR Labs Thinks about Change - German Studies Association 2017 Annual C...How JSTOR Labs Thinks about Change - German Studies Association 2017 Annual C...
How JSTOR Labs Thinks about Change - German Studies Association 2017 Annual C...
 
Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...
Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...
Reimagining the Monograph - guest lecture at the Kluge Center of the Library ...
 
On Beyond Keyword Search: The Thinking Behind JSTOR Labs' Text Analyzer - NFA...
On Beyond Keyword Search: The Thinking Behind JSTOR Labs' Text Analyzer - NFA...On Beyond Keyword Search: The Thinking Behind JSTOR Labs' Text Analyzer - NFA...
On Beyond Keyword Search: The Thinking Behind JSTOR Labs' Text Analyzer - NFA...
 
Reimagining the Monograph - AAUP 2017 Annual Meeting
Reimagining the Monograph - AAUP 2017 Annual MeetingReimagining the Monograph - AAUP 2017 Annual Meeting
Reimagining the Monograph - AAUP 2017 Annual Meeting
 
Introduction to JSTOR Labs: What We Do & How We Do It
Introduction to JSTOR Labs: What We Do & How We Do ItIntroduction to JSTOR Labs: What We Do & How We Do It
Introduction to JSTOR Labs: What We Do & How We Do It
 
Reimagining the Digital Monograph: Improving the Discovery and Use of Scholar...
Reimagining the Digital Monograph: Improving the Discovery and Use of Scholar...Reimagining the Digital Monograph: Improving the Discovery and Use of Scholar...
Reimagining the Digital Monograph: Improving the Discovery and Use of Scholar...
 
ACRL 2017: Unlocking the Value of the Monograph
ACRL 2017: Unlocking the Value of the MonographACRL 2017: Unlocking the Value of the Monograph
ACRL 2017: Unlocking the Value of the Monograph
 
Building Your Next Great Product by Talking to Users Each Step of the Way
Building Your Next Great Product by Talking to Users Each Step of the WayBuilding Your Next Great Product by Talking to Users Each Step of the Way
Building Your Next Great Product by Talking to Users Each Step of the Way
 
Design Jam: Brainstorm Innovative Ideas by Focusing on the User - AAUP 2016
Design Jam: Brainstorm Innovative Ideas by Focusing on the User - AAUP 2016Design Jam: Brainstorm Innovative Ideas by Focusing on the User - AAUP 2016
Design Jam: Brainstorm Innovative Ideas by Focusing on the User - AAUP 2016
 
JSTOR Sustainabilty: Supporting Multidisciplinary Researchers
JSTOR Sustainabilty: Supporting Multidisciplinary ResearchersJSTOR Sustainabilty: Supporting Multidisciplinary Researchers
JSTOR Sustainabilty: Supporting Multidisciplinary Researchers
 
Of Libraries and Labs: Effecting User-Driven Innovation
Of Libraries and Labs: Effecting User-Driven InnovationOf Libraries and Labs: Effecting User-Driven Innovation
Of Libraries and Labs: Effecting User-Driven Innovation
 
Understanding Shakespeare: What We've Learned (So Far) - RSA 2016
Understanding Shakespeare: What We've Learned (So Far) - RSA 2016Understanding Shakespeare: What We've Learned (So Far) - RSA 2016
Understanding Shakespeare: What We've Learned (So Far) - RSA 2016
 
JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...
JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...
JSTOR Sustainability: Creating a Multidisciplinary Map for Researchers - ASEH...
 
Learning Lean: Using Flash Builds to Learn from Your Users
Learning Lean: Using Flash Builds to Learn from Your UsersLearning Lean: Using Flash Builds to Learn from Your Users
Learning Lean: Using Flash Builds to Learn from Your Users
 
Of Libraries and Labs: Effecting User-Driven Innovation - RLUK Members Mtg 2015
Of Libraries and Labs: Effecting User-Driven Innovation - RLUK Members Mtg 2015Of Libraries and Labs: Effecting User-Driven Innovation - RLUK Members Mtg 2015
Of Libraries and Labs: Effecting User-Driven Innovation - RLUK Members Mtg 2015
 
Really, Really Rapid Prototyping: Flash Builds and User-Driven Innovation - N...
Really, Really Rapid Prototyping: Flash Builds and User-Driven Innovation - N...Really, Really Rapid Prototyping: Flash Builds and User-Driven Innovation - N...
Really, Really Rapid Prototyping: Flash Builds and User-Driven Innovation - N...
 

Último

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 

Último (20)

Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Micro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdfMicro-Scholarship, What it is, How can it help me.pdf
Micro-Scholarship, What it is, How can it help me.pdf
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 

Text Analyzer: a New Way to Search from JSTOR Labs

  • 1. TEXT ANALYZER: A NEW WAY TO SEARCH, FROM JSTOR LABS DPLAfest 2017 20 April 2017 Alex Humphreys @abhumphreys
  • 2. JSTOR Labs works with partner publishers, libraries and labs to create tools for researchers, teachers and students that are immediately useful – and a little bit magical.
  • 4. UNDER THE HOOD 1. Extract Text a. From many textual formats (pdf, word, et al) b. OCR, if needed (e.g. a picture of a page in a magazine) 2. Identify Terms a. Topics: JSTOR Thesaurus & an LDA Topic Model b. Entities: Alchemy (Watson), OpenCalais, Stanford, Apache 3. Generate Results a. TF-IDF to select 5 terms b. “OR” search c. Relevance ranked based on “equalizer”
  • 5. HOW WE BUILT IT The Design Squiggle, by Damien Newman: http://cargocollective.com/central/The-Design-Squiggle/
  • 6. THE SEED… The Design Squiggle, by Damien Newman: http://cargocollective.com/central/The-Design-Squiggle/
  • 7. CONCEPT TESTING... The Design Squiggle, by Damien Newman: http://cargocollective.com/central/The-Design-Squiggle/
  • 8. ITERATING ON INTERACTION DESIGN The Design Squiggle, by Damien Newman: http://cargocollective.com/central/The-Design-Squiggle/
  • 9. RELEASE AS A JSTOR BETA… The Design Squiggle, by Damien Newman: http://cargocollective.com/central/The-Design-Squiggle/
  • 10. WE’RE STILL REFINING... The Design Squiggle, by Damien Newman: http://cargocollective.com/central/The-Design-Squiggle/
  • 11. THANK YOU! For more information: web: labs.jstor.org email: alex.humphreys@ithaka.org twitter: @abhumphreys
  • 12. APPENDIX (OPEN IN CASE OF NO INTERNET CONNECTION)