SlideShare una empresa de Scribd logo
1 de 16
Using LWE/Solr/Lucene for eCom Grant Ingersoll, Lucid Imagination @gsingers Apache Solr and Lucene and their logos are trademarks of the Apache Software Foundation
Difference Makers Case Study 1: Relevance Matters Large Electronics Manufacturer Top selling product on page 10 for a search by product name Case Study 2: Don’t Overthink it Large Online Retailer Simply adding auto-suggest added millions to bottom line at very little cost Case Study 3: Test, Test, Test Amazon Recommendation System http://glinden.blogspot.com/2006/04/early-amazon-shopping-cart.html 3
Topics The Stack Knowing Users ,[object Object]
Minimum Features for eCom
Extended FeaturesNot Just Search What’s Missing? What’s Next? 4
eCom Stack Choices 5 Apache Solr and Lucene and their logos are trademarks of the Apache Software Foundation
Users: Get to Know Them! Audience Poll: How many of you are developers? How many of the developers know what the top 10 queries are on your site? How many of the non-developers know? Your users represent 100% of your opportunity to sell your products ;-) Shouldn’t you know what they are searching for? 6
Search Analytics “If you can’t measure it, you can’t manage it” Attributed to Peter Drucker, however, see * Ultimately, it’s all about conversion May not be the best measure for judging search Is there One Right Answer on your Site or Multiple? Known Item search vs Keyword/Category 7 *http://edkless.com/2009/06/peter-drucker-and-time-sheets/
Useful Metrics Mean Reciprocal Rank or Precision @ 10 Known Item vs. Keyword/Category “Show me the money” -- Top Product Analysis Identity Search - If your top product is named X and someone searches for X, is X on the first page?  Is it number 1? Is a top product underperforming as it relates to search? Top X Queries and Query Terms Zero Results and % of Zero Results Avg. # of facets/filters/spellchecks clicked per session Avg # of searches per user session Auto-suggest usage 8
Minimum Search Features High Quality Relevance for keyword and known item search P@10 or MRR close to 1 Sub-second response time under load All achievable in LWE/Solr/Lucene 9
Faceting LWE/Solr support faceting by: Field Date/Number Ranges Pivot (“what if” faceting) Hierarchical (via domain modeling) Dynamic (via Carrot^2) Single and multi-select faceting supported Facet by Function In Development https://issues.apache.org/jira/browse/SOLR-1581 http://wiki.apache.org/solr/SimpleFacetParameters 10
More Features Extensible Language Analysis Multilingual Support Synonyms Overrides on a per-word basis Pluggable Framework Frequent/Incremental Updates How often do you update your index? Near Real Time (IndexReader.open() ) Column Stride Fields (4.0) 11
Relevance Controls Function Queries Ratings/Reviews Margin/Inventory/Price/Location Can Sort by Functions …/solr/browse?q=ipod&bf=price Editorial Controls (QueryElevationComponent) Fine grained controls …/solr/elevate?q=YYYY&enableElevation=true Landing Pages (if done in search…) Implement: Docs with field that is filtered on or a separate index/core Editorial Controls Click Scoring (LWE only) Popularity based ranking 12
Beyond the Search Box Many eCom sites actually power all navigation by the search engine Many other tools in the Stack to help users discover content Auto Suggest Spell Checking More Like This Spatial 13
Complementary Tools Apache Mahout Recommendation Systems Crude Solr/Mahout Rec Integration at https://github.com/gsingers/ApacheCon2010 Classifiers/Clustering User Analysis, Content Analysis, etc. Social  BazaarVoice, etc. Business Rules Engine Drools or others 14
What’s Missing? UI Controls for non-devs: Synonyms (LWE has UI/REST support) Facets (Field support in LWE) Relevance Control (LWE REST API Support) Business Rules Integration Deeper Taxonomy Support More performance reports (LWE has some) Facet Management tools  Labels Sort order other than Count or Alphabetical Editorial facet control 15

Más contenido relacionado

Más de lucenerevolution

Building Client-side Search Applications with Solr
Building Client-side Search Applications with SolrBuilding Client-side Search Applications with Solr
Building Client-side Search Applications with Solrlucenerevolution
 
Integrate Solr with real-time stream processing applications
Integrate Solr with real-time stream processing applicationsIntegrate Solr with real-time stream processing applications
Integrate Solr with real-time stream processing applicationslucenerevolution
 
Scaling Solr with SolrCloud
Scaling Solr with SolrCloudScaling Solr with SolrCloud
Scaling Solr with SolrCloudlucenerevolution
 
Administering and Monitoring SolrCloud Clusters
Administering and Monitoring SolrCloud ClustersAdministering and Monitoring SolrCloud Clusters
Administering and Monitoring SolrCloud Clusterslucenerevolution
 
Implementing a Custom Search Syntax using Solr, Lucene, and Parboiled
Implementing a Custom Search Syntax using Solr, Lucene, and ParboiledImplementing a Custom Search Syntax using Solr, Lucene, and Parboiled
Implementing a Custom Search Syntax using Solr, Lucene, and Parboiledlucenerevolution
 
Using Solr to Search and Analyze Logs
Using Solr to Search and Analyze Logs Using Solr to Search and Analyze Logs
Using Solr to Search and Analyze Logs lucenerevolution
 
Enhancing relevancy through personalization & semantic search
Enhancing relevancy through personalization & semantic searchEnhancing relevancy through personalization & semantic search
Enhancing relevancy through personalization & semantic searchlucenerevolution
 
Real-time Inverted Search in the Cloud Using Lucene and Storm
Real-time Inverted Search in the Cloud Using Lucene and StormReal-time Inverted Search in the Cloud Using Lucene and Storm
Real-time Inverted Search in the Cloud Using Lucene and Stormlucenerevolution
 
Solr's Admin UI - Where does the data come from?
Solr's Admin UI - Where does the data come from?Solr's Admin UI - Where does the data come from?
Solr's Admin UI - Where does the data come from?lucenerevolution
 
Schemaless Solr and the Solr Schema REST API
Schemaless Solr and the Solr Schema REST APISchemaless Solr and the Solr Schema REST API
Schemaless Solr and the Solr Schema REST APIlucenerevolution
 
High Performance JSON Search and Relational Faceted Browsing with Lucene
High Performance JSON Search and Relational Faceted Browsing with LuceneHigh Performance JSON Search and Relational Faceted Browsing with Lucene
High Performance JSON Search and Relational Faceted Browsing with Lucenelucenerevolution
 
Text Classification with Lucene/Solr, Apache Hadoop and LibSVM
Text Classification with Lucene/Solr, Apache Hadoop and LibSVMText Classification with Lucene/Solr, Apache Hadoop and LibSVM
Text Classification with Lucene/Solr, Apache Hadoop and LibSVMlucenerevolution
 
Faceted Search with Lucene
Faceted Search with LuceneFaceted Search with Lucene
Faceted Search with Lucenelucenerevolution
 
Recent Additions to Lucene Arsenal
Recent Additions to Lucene ArsenalRecent Additions to Lucene Arsenal
Recent Additions to Lucene Arsenallucenerevolution
 
Turning search upside down
Turning search upside downTurning search upside down
Turning search upside downlucenerevolution
 
Spellchecking in Trovit: Implementing a Contextual Multi-language Spellchecke...
Spellchecking in Trovit: Implementing a Contextual Multi-language Spellchecke...Spellchecking in Trovit: Implementing a Contextual Multi-language Spellchecke...
Spellchecking in Trovit: Implementing a Contextual Multi-language Spellchecke...lucenerevolution
 
Shrinking the haystack wes caldwell - final
Shrinking the haystack   wes caldwell - finalShrinking the haystack   wes caldwell - final
Shrinking the haystack wes caldwell - finallucenerevolution
 
The First Class Integration of Solr with Hadoop
The First Class Integration of Solr with HadoopThe First Class Integration of Solr with Hadoop
The First Class Integration of Solr with Hadooplucenerevolution
 
A Novel methodology for handling Document Level Security in Search Based Appl...
A Novel methodology for handling Document Level Security in Search Based Appl...A Novel methodology for handling Document Level Security in Search Based Appl...
A Novel methodology for handling Document Level Security in Search Based Appl...lucenerevolution
 

Más de lucenerevolution (20)

Search at Twitter
Search at TwitterSearch at Twitter
Search at Twitter
 
Building Client-side Search Applications with Solr
Building Client-side Search Applications with SolrBuilding Client-side Search Applications with Solr
Building Client-side Search Applications with Solr
 
Integrate Solr with real-time stream processing applications
Integrate Solr with real-time stream processing applicationsIntegrate Solr with real-time stream processing applications
Integrate Solr with real-time stream processing applications
 
Scaling Solr with SolrCloud
Scaling Solr with SolrCloudScaling Solr with SolrCloud
Scaling Solr with SolrCloud
 
Administering and Monitoring SolrCloud Clusters
Administering and Monitoring SolrCloud ClustersAdministering and Monitoring SolrCloud Clusters
Administering and Monitoring SolrCloud Clusters
 
Implementing a Custom Search Syntax using Solr, Lucene, and Parboiled
Implementing a Custom Search Syntax using Solr, Lucene, and ParboiledImplementing a Custom Search Syntax using Solr, Lucene, and Parboiled
Implementing a Custom Search Syntax using Solr, Lucene, and Parboiled
 
Using Solr to Search and Analyze Logs
Using Solr to Search and Analyze Logs Using Solr to Search and Analyze Logs
Using Solr to Search and Analyze Logs
 
Enhancing relevancy through personalization & semantic search
Enhancing relevancy through personalization & semantic searchEnhancing relevancy through personalization & semantic search
Enhancing relevancy through personalization & semantic search
 
Real-time Inverted Search in the Cloud Using Lucene and Storm
Real-time Inverted Search in the Cloud Using Lucene and StormReal-time Inverted Search in the Cloud Using Lucene and Storm
Real-time Inverted Search in the Cloud Using Lucene and Storm
 
Solr's Admin UI - Where does the data come from?
Solr's Admin UI - Where does the data come from?Solr's Admin UI - Where does the data come from?
Solr's Admin UI - Where does the data come from?
 
Schemaless Solr and the Solr Schema REST API
Schemaless Solr and the Solr Schema REST APISchemaless Solr and the Solr Schema REST API
Schemaless Solr and the Solr Schema REST API
 
High Performance JSON Search and Relational Faceted Browsing with Lucene
High Performance JSON Search and Relational Faceted Browsing with LuceneHigh Performance JSON Search and Relational Faceted Browsing with Lucene
High Performance JSON Search and Relational Faceted Browsing with Lucene
 
Text Classification with Lucene/Solr, Apache Hadoop and LibSVM
Text Classification with Lucene/Solr, Apache Hadoop and LibSVMText Classification with Lucene/Solr, Apache Hadoop and LibSVM
Text Classification with Lucene/Solr, Apache Hadoop and LibSVM
 
Faceted Search with Lucene
Faceted Search with LuceneFaceted Search with Lucene
Faceted Search with Lucene
 
Recent Additions to Lucene Arsenal
Recent Additions to Lucene ArsenalRecent Additions to Lucene Arsenal
Recent Additions to Lucene Arsenal
 
Turning search upside down
Turning search upside downTurning search upside down
Turning search upside down
 
Spellchecking in Trovit: Implementing a Contextual Multi-language Spellchecke...
Spellchecking in Trovit: Implementing a Contextual Multi-language Spellchecke...Spellchecking in Trovit: Implementing a Contextual Multi-language Spellchecke...
Spellchecking in Trovit: Implementing a Contextual Multi-language Spellchecke...
 
Shrinking the haystack wes caldwell - final
Shrinking the haystack   wes caldwell - finalShrinking the haystack   wes caldwell - final
Shrinking the haystack wes caldwell - final
 
The First Class Integration of Solr with Hadoop
The First Class Integration of Solr with HadoopThe First Class Integration of Solr with Hadoop
The First Class Integration of Solr with Hadoop
 
A Novel methodology for handling Document Level Security in Search Based Appl...
A Novel methodology for handling Document Level Security in Search Based Appl...A Novel methodology for handling Document Level Security in Search Based Appl...
A Novel methodology for handling Document Level Security in Search Based Appl...
 

Último

TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 

Último (20)

TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 

Using lwe solr lucene for e com - By Grant Ingersoll

  • 1. Using LWE/Solr/Lucene for eCom Grant Ingersoll, Lucid Imagination @gsingers Apache Solr and Lucene and their logos are trademarks of the Apache Software Foundation
  • 2. Difference Makers Case Study 1: Relevance Matters Large Electronics Manufacturer Top selling product on page 10 for a search by product name Case Study 2: Don’t Overthink it Large Online Retailer Simply adding auto-suggest added millions to bottom line at very little cost Case Study 3: Test, Test, Test Amazon Recommendation System http://glinden.blogspot.com/2006/04/early-amazon-shopping-cart.html 3
  • 3.
  • 5. Extended FeaturesNot Just Search What’s Missing? What’s Next? 4
  • 6. eCom Stack Choices 5 Apache Solr and Lucene and their logos are trademarks of the Apache Software Foundation
  • 7. Users: Get to Know Them! Audience Poll: How many of you are developers? How many of the developers know what the top 10 queries are on your site? How many of the non-developers know? Your users represent 100% of your opportunity to sell your products ;-) Shouldn’t you know what they are searching for? 6
  • 8. Search Analytics “If you can’t measure it, you can’t manage it” Attributed to Peter Drucker, however, see * Ultimately, it’s all about conversion May not be the best measure for judging search Is there One Right Answer on your Site or Multiple? Known Item search vs Keyword/Category 7 *http://edkless.com/2009/06/peter-drucker-and-time-sheets/
  • 9. Useful Metrics Mean Reciprocal Rank or Precision @ 10 Known Item vs. Keyword/Category “Show me the money” -- Top Product Analysis Identity Search - If your top product is named X and someone searches for X, is X on the first page? Is it number 1? Is a top product underperforming as it relates to search? Top X Queries and Query Terms Zero Results and % of Zero Results Avg. # of facets/filters/spellchecks clicked per session Avg # of searches per user session Auto-suggest usage 8
  • 10. Minimum Search Features High Quality Relevance for keyword and known item search P@10 or MRR close to 1 Sub-second response time under load All achievable in LWE/Solr/Lucene 9
  • 11. Faceting LWE/Solr support faceting by: Field Date/Number Ranges Pivot (“what if” faceting) Hierarchical (via domain modeling) Dynamic (via Carrot^2) Single and multi-select faceting supported Facet by Function In Development https://issues.apache.org/jira/browse/SOLR-1581 http://wiki.apache.org/solr/SimpleFacetParameters 10
  • 12. More Features Extensible Language Analysis Multilingual Support Synonyms Overrides on a per-word basis Pluggable Framework Frequent/Incremental Updates How often do you update your index? Near Real Time (IndexReader.open() ) Column Stride Fields (4.0) 11
  • 13. Relevance Controls Function Queries Ratings/Reviews Margin/Inventory/Price/Location Can Sort by Functions …/solr/browse?q=ipod&bf=price Editorial Controls (QueryElevationComponent) Fine grained controls …/solr/elevate?q=YYYY&enableElevation=true Landing Pages (if done in search…) Implement: Docs with field that is filtered on or a separate index/core Editorial Controls Click Scoring (LWE only) Popularity based ranking 12
  • 14. Beyond the Search Box Many eCom sites actually power all navigation by the search engine Many other tools in the Stack to help users discover content Auto Suggest Spell Checking More Like This Spatial 13
  • 15. Complementary Tools Apache Mahout Recommendation Systems Crude Solr/Mahout Rec Integration at https://github.com/gsingers/ApacheCon2010 Classifiers/Clustering User Analysis, Content Analysis, etc. Social BazaarVoice, etc. Business Rules Engine Drools or others 14
  • 16. What’s Missing? UI Controls for non-devs: Synonyms (LWE has UI/REST support) Facets (Field support in LWE) Relevance Control (LWE REST API Support) Business Rules Integration Deeper Taxonomy Support More performance reports (LWE has some) Facet Management tools Labels Sort order other than Count or Alphabetical Editorial facet control 15
  • 17. What’s Next? Some sample code and more discussion at http://www.lucidimagination.com/blog/2011/01/25/implementing-the-ecommerce-checklist-with-apache-solr-and-lucidworks/ 16
  • 18. Resources Principles for Effective Search in E-Commerce Design http://lucene.li/2T http://www.lucidimagination.com/search/?q=ecommerce grant@lucidimagination.com @gsingers 17 http://www.lucidimagination.com

Notas del editor

  1. Case 1: Don’t think relevance matters? This single result was costing lots of money every single dayCase 2: Think about how long it takes to add auto-suggest… How long to add NLP to search?Case 3: take a long term view, test hypotheses
  2. Many things can go wrong between search and conversion that aren’t related to searchEstimate MRR or P@10 based on click stream analysis
  3. Is a top product underperforming as it relates to search? In other words, is a user less likely to buy when searching for a top product versus other navigation options?Also, the usual performance metricsOthers?
  4. http://localhost:8983/solr/browse?q=ipod&bf=price
  5. All of these things are fairly easily built