SlideShare una empresa de Scribd logo
1 de 20
1
The Evolution of Search and the Union with
Big Data
Kamran Khan
President & CEO
16th November 2017
2
Agenda
• About Search Technologies
• Changes in the Search Space Over the Past Decade
• Search & Big Data Case Studies
• Making Implementations Easier
• Closing Remarks
3
Search Technologies: Who We Are
The leading independent IT services firm specializing in the design,
implementation, and management of enterprise search and big
data search solutions.
4
200+ People 800+ Customers
5
FY05 FY06 FY07 FY08 FY09 FY10 FY11 FY12 FY13 FY14 FY15 FY16
Profitable
$32M – FY16
6
Consolidation
7
8
The Rise of Open Source
9
Search Can Power Big Data Analytics
Our Vision
“You know, people today think that search and big data are separate but in
two or three years, everyone will wonder why we ever thought that.”
- Doug Cutting
“Search is very good at finding interesting things buried under mounds of
information. It can provide access across a wide variety of content types and a
flexible, and intuitive interface for exploring data.”
- Darin Stewart
10
Forrester Validates Search Market Evolution
• Modern search is about
knowledge, not keywords
• New data types and sources
• New query methods
• New methods to display results
• Search applications enable new
use cases
• VS. simple standalone search
*Forrester Wave: Big Data Search and Knowledge Discovery Solutions Q3 2015
11
12
Insider Threat Detection
Insider Threat Detection
13
14
15
Big Data in 2025
Per Year Growth Estimates
1-17 PB/Year 1 EB/Year 1-2 EB/Year
2-40 EB/Year
Ref: Big Data Astronomical or Genomical ©2015 Stephens et al
16
17
18
Components in the ST Enterprise Search Stack
• Open Source Search Engine
– Elasticsearch or Solr
• No-SQL Database
• Content Processing
• Staging Repository
• Node.JS Application Server
• Angular & Bootstrap End-User
Interface
• Admin User Interface
The ST Enterprise Search Stack
Search UI
Search Engine
Node.JS
Content Processing
Staging Repository
No-SQL
DB
Admin
UI
19
Big Data
The Open Source Search Stack
API Server (Node.JS)
Web
Browser
Search Engine (Elasticsearch or Solr) No-SQL
Database
Mobile
Web
Apps
Staging Repository (Node.JS)
Aspire
SharePoint
File
Shares
RDBMS
Apps
Data
Warehouse
Other
Sources
Big Data
Framework
• Entire Stack
runs inside
Cloudera
• Replace search
engine with
Cloudera
Search
HBase
Cloudera Search
20
Thank you!
Come visit us at Booth 200
@SearchTechCorp
www.searchtechnologies.com
Visit our partners:
Sinequa: Booth #106
Hitachi: Booth #208

Más contenido relacionado

La actualidad más candente

II-SDV 2015, 20 - 21 April, in Nice
II-SDV 2015, 20 - 21 April, in NiceII-SDV 2015, 20 - 21 April, in Nice
II-SDV 2015, 20 - 21 April, in Nice
Dr. Haxel Consult
 
Scaling Box-Search: Gearing up for Petabyte Scale - Shubhro Roy & Anthony Urb...
Scaling Box-Search: Gearing up for Petabyte Scale - Shubhro Roy & Anthony Urb...Scaling Box-Search: Gearing up for Petabyte Scale - Shubhro Roy & Anthony Urb...
Scaling Box-Search: Gearing up for Petabyte Scale - Shubhro Roy & Anthony Urb...
Lucidworks
 
MAAK KENNIS MET HET NIEUWSTE GENERATIE DATA MANAGEMENT PLATFORM - Big Data Ex...
MAAK KENNIS MET HET NIEUWSTE GENERATIE DATA MANAGEMENT PLATFORM - Big Data Ex...MAAK KENNIS MET HET NIEUWSTE GENERATIE DATA MANAGEMENT PLATFORM - Big Data Ex...
MAAK KENNIS MET HET NIEUWSTE GENERATIE DATA MANAGEMENT PLATFORM - Big Data Ex...
webwinkelvakdag
 

La actualidad más candente (20)

Lju Lazarevic
Lju LazarevicLju Lazarevic
Lju Lazarevic
 
Enterprise Search - Introduction
Enterprise Search - IntroductionEnterprise Search - Introduction
Enterprise Search - Introduction
 
II-SDV 2015, 20 - 21 April, in Nice
II-SDV 2015, 20 - 21 April, in NiceII-SDV 2015, 20 - 21 April, in Nice
II-SDV 2015, 20 - 21 April, in Nice
 
II-SDV 2016 - QWAM Content Intelligence
II-SDV 2016 - QWAM Content IntelligenceII-SDV 2016 - QWAM Content Intelligence
II-SDV 2016 - QWAM Content Intelligence
 
Ben Gardner | Delivering a Linked Data warehouse and integrating across the w...
Ben Gardner | Delivering a Linked Data warehouse and integrating across the w...Ben Gardner | Delivering a Linked Data warehouse and integrating across the w...
Ben Gardner | Delivering a Linked Data warehouse and integrating across the w...
 
Building on Multi-Model Databases
Building on Multi-Model DatabasesBuilding on Multi-Model Databases
Building on Multi-Model Databases
 
Sustainability Investment Research Using Cognitive Analytics
Sustainability Investment Research Using Cognitive AnalyticsSustainability Investment Research Using Cognitive Analytics
Sustainability Investment Research Using Cognitive Analytics
 
Scaling Box-Search: Gearing up for Petabyte Scale - Shubhro Roy & Anthony Urb...
Scaling Box-Search: Gearing up for Petabyte Scale - Shubhro Roy & Anthony Urb...Scaling Box-Search: Gearing up for Petabyte Scale - Shubhro Roy & Anthony Urb...
Scaling Box-Search: Gearing up for Petabyte Scale - Shubhro Roy & Anthony Urb...
 
AnzoGraph DB - SPARQL 101
AnzoGraph DB - SPARQL 101AnzoGraph DB - SPARQL 101
AnzoGraph DB - SPARQL 101
 
AzureDay - Introduction Big Data Analytics.
AzureDay  - Introduction Big Data Analytics.AzureDay  - Introduction Big Data Analytics.
AzureDay - Introduction Big Data Analytics.
 
Large Scale Graph Processing & Machine Learning Algorithms for Payment Fraud ...
Large Scale Graph Processing & Machine Learning Algorithms for Payment Fraud ...Large Scale Graph Processing & Machine Learning Algorithms for Payment Fraud ...
Large Scale Graph Processing & Machine Learning Algorithms for Payment Fraud ...
 
Choosing the Right Graph Database to Succeed in Your Project
Choosing the Right Graph Database to Succeed in Your ProjectChoosing the Right Graph Database to Succeed in Your Project
Choosing the Right Graph Database to Succeed in Your Project
 
Cortana Analytics Workshop: Azure Data Catalog
Cortana Analytics Workshop: Azure Data CatalogCortana Analytics Workshop: Azure Data Catalog
Cortana Analytics Workshop: Azure Data Catalog
 
Building the Inform Semantic Publishing Ecosystem: from Author to Audience
Building the Inform Semantic Publishing Ecosystem: from Author to AudienceBuilding the Inform Semantic Publishing Ecosystem: from Author to Audience
Building the Inform Semantic Publishing Ecosystem: from Author to Audience
 
Budapest Data Forum 2017 - BigQuery, Looker And Big Data Analytics At Petabyt...
Budapest Data Forum 2017 - BigQuery, Looker And Big Data Analytics At Petabyt...Budapest Data Forum 2017 - BigQuery, Looker And Big Data Analytics At Petabyt...
Budapest Data Forum 2017 - BigQuery, Looker And Big Data Analytics At Petabyt...
 
Self-service consumption Data Catalog
Self-service consumption Data CatalogSelf-service consumption Data Catalog
Self-service consumption Data Catalog
 
MAAK KENNIS MET HET NIEUWSTE GENERATIE DATA MANAGEMENT PLATFORM - Big Data Ex...
MAAK KENNIS MET HET NIEUWSTE GENERATIE DATA MANAGEMENT PLATFORM - Big Data Ex...MAAK KENNIS MET HET NIEUWSTE GENERATIE DATA MANAGEMENT PLATFORM - Big Data Ex...
MAAK KENNIS MET HET NIEUWSTE GENERATIE DATA MANAGEMENT PLATFORM - Big Data Ex...
 
How Verizon Uses Disruptive Developments for Organized Progress
How Verizon Uses Disruptive Developments for Organized ProgressHow Verizon Uses Disruptive Developments for Organized Progress
How Verizon Uses Disruptive Developments for Organized Progress
 
Joe Pairman | Multiplying the Power of Taxonomy with Granular, Structured Con...
Joe Pairman | Multiplying the Power of Taxonomy with Granular, Structured Con...Joe Pairman | Multiplying the Power of Taxonomy with Granular, Structured Con...
Joe Pairman | Multiplying the Power of Taxonomy with Granular, Structured Con...
 
Graph databases and the #panamapapers
Graph databases and the #panamapapersGraph databases and the #panamapapers
Graph databases and the #panamapapers
 

Similar a The Evolution of Search and Big Data

Séminaire Big Data Alter Way - Elasticsearch - octobre 2014
Séminaire Big Data Alter Way - Elasticsearch - octobre 2014Séminaire Big Data Alter Way - Elasticsearch - octobre 2014
Séminaire Big Data Alter Way - Elasticsearch - octobre 2014
ALTER WAY
 

Similar a The Evolution of Search and Big Data (20)

Big Data Evolution
Big Data EvolutionBig Data Evolution
Big Data Evolution
 
Analytical Innovation: How to Build the Next Generation Data Platform
Analytical Innovation: How to Build the Next Generation Data PlatformAnalytical Innovation: How to Build the Next Generation Data Platform
Analytical Innovation: How to Build the Next Generation Data Platform
 
Architecting Data For The Modern Enterprise - Data Summit 2017, Closing Keynote
Architecting Data For The Modern Enterprise - Data Summit 2017, Closing KeynoteArchitecting Data For The Modern Enterprise - Data Summit 2017, Closing Keynote
Architecting Data For The Modern Enterprise - Data Summit 2017, Closing Keynote
 
The Enterprise Search Market in a Nutshell
The Enterprise Search Market in a NutshellThe Enterprise Search Market in a Nutshell
The Enterprise Search Market in a Nutshell
 
Séminaire Big Data Alter Way - Elasticsearch - octobre 2014
Séminaire Big Data Alter Way - Elasticsearch - octobre 2014Séminaire Big Data Alter Way - Elasticsearch - octobre 2014
Séminaire Big Data Alter Way - Elasticsearch - octobre 2014
 
Big data by Mithlesh sadh
Big data by Mithlesh sadhBig data by Mithlesh sadh
Big data by Mithlesh sadh
 
Denodo DataFest 2016: Metadata and Data: Search and Exploration
Denodo DataFest 2016: Metadata and Data: Search and ExplorationDenodo DataFest 2016: Metadata and Data: Search and Exploration
Denodo DataFest 2016: Metadata and Data: Search and Exploration
 
Big Data Management: What's New, What's Different, and What You Need To Know
Big Data Management: What's New, What's Different, and What You Need To KnowBig Data Management: What's New, What's Different, and What You Need To Know
Big Data Management: What's New, What's Different, and What You Need To Know
 
BigData.pptx
BigData.pptxBigData.pptx
BigData.pptx
 
Self-Service Data Analysis, Data Wrangling, Data Munging, and Data Modeling –...
Self-Service Data Analysis, Data Wrangling, Data Munging, and Data Modeling –...Self-Service Data Analysis, Data Wrangling, Data Munging, and Data Modeling –...
Self-Service Data Analysis, Data Wrangling, Data Munging, and Data Modeling –...
 
The Emerging Role of the Data Lake
The Emerging Role of the Data LakeThe Emerging Role of the Data Lake
The Emerging Role of the Data Lake
 
Transforming Data Management and Time to Insight with Anzo Smart Data Lake®
Transforming Data Management and Time to Insight with Anzo Smart Data Lake®Transforming Data Management and Time to Insight with Anzo Smart Data Lake®
Transforming Data Management and Time to Insight with Anzo Smart Data Lake®
 
Denodo’s Data Catalog: Bridging the Gap between Data and Business (APAC)
Denodo’s Data Catalog: Bridging the Gap between Data and Business (APAC)Denodo’s Data Catalog: Bridging the Gap between Data and Business (APAC)
Denodo’s Data Catalog: Bridging the Gap between Data and Business (APAC)
 
Semantics and Machine Learning
Semantics and Machine LearningSemantics and Machine Learning
Semantics and Machine Learning
 
Big Data Landscape 2018
Big Data Landscape 2018Big Data Landscape 2018
Big Data Landscape 2018
 
CSIRO investing in the future of data - John Morrissey
CSIRO investing in the future of data - John Morrissey CSIRO investing in the future of data - John Morrissey
CSIRO investing in the future of data - John Morrissey
 
Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016
 
Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016Frank Bien Opening Keynote - Join 2016
Frank Bien Opening Keynote - Join 2016
 
BigData-Challenges.pptx
BigData-Challenges.pptxBigData-Challenges.pptx
BigData-Challenges.pptx
 
Big data
Big dataBig data
Big data
 

Último

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Último (20)

DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 

The Evolution of Search and Big Data

  • 1. 1 The Evolution of Search and the Union with Big Data Kamran Khan President & CEO 16th November 2017
  • 2. 2 Agenda • About Search Technologies • Changes in the Search Space Over the Past Decade • Search & Big Data Case Studies • Making Implementations Easier • Closing Remarks
  • 3. 3 Search Technologies: Who We Are The leading independent IT services firm specializing in the design, implementation, and management of enterprise search and big data search solutions.
  • 4. 4 200+ People 800+ Customers
  • 5. 5 FY05 FY06 FY07 FY08 FY09 FY10 FY11 FY12 FY13 FY14 FY15 FY16 Profitable $32M – FY16
  • 7. 7
  • 8. 8 The Rise of Open Source
  • 9. 9 Search Can Power Big Data Analytics Our Vision “You know, people today think that search and big data are separate but in two or three years, everyone will wonder why we ever thought that.” - Doug Cutting “Search is very good at finding interesting things buried under mounds of information. It can provide access across a wide variety of content types and a flexible, and intuitive interface for exploring data.” - Darin Stewart
  • 10. 10 Forrester Validates Search Market Evolution • Modern search is about knowledge, not keywords • New data types and sources • New query methods • New methods to display results • Search applications enable new use cases • VS. simple standalone search *Forrester Wave: Big Data Search and Knowledge Discovery Solutions Q3 2015
  • 11. 11
  • 13. 13
  • 14. 14
  • 15. 15 Big Data in 2025 Per Year Growth Estimates 1-17 PB/Year 1 EB/Year 1-2 EB/Year 2-40 EB/Year Ref: Big Data Astronomical or Genomical ©2015 Stephens et al
  • 16. 16
  • 17. 17
  • 18. 18 Components in the ST Enterprise Search Stack • Open Source Search Engine – Elasticsearch or Solr • No-SQL Database • Content Processing • Staging Repository • Node.JS Application Server • Angular & Bootstrap End-User Interface • Admin User Interface The ST Enterprise Search Stack Search UI Search Engine Node.JS Content Processing Staging Repository No-SQL DB Admin UI
  • 19. 19 Big Data The Open Source Search Stack API Server (Node.JS) Web Browser Search Engine (Elasticsearch or Solr) No-SQL Database Mobile Web Apps Staging Repository (Node.JS) Aspire SharePoint File Shares RDBMS Apps Data Warehouse Other Sources Big Data Framework • Entire Stack runs inside Cloudera • Replace search engine with Cloudera Search HBase Cloudera Search
  • 20. 20 Thank you! Come visit us at Booth 200 @SearchTechCorp www.searchtechnologies.com Visit our partners: Sinequa: Booth #106 Hitachi: Booth #208