SlideShare una empresa de Scribd logo
1 de 70
Descargar para leer sin conexión
Elasticsearch Meetup
Alaa Elhadba
alaa.elhadba@gmail.com
A
C P
REST
Distributed
Scalable
Queryable
Search Engine
Red basketball tshirt...
Search
Engine
Red basketball tshirt...
Search
Engine
Red basketball tshirt...
Search
Engine
Red basketball tshirt...
Search
Engine
Red basketball tshirt...
Search
Engine
Red basketball tshirt...
Search
Engine
Red basketball tshirt...
Search
Engine
Search
Engine
Search
Engine
Search
Engine
Search
Engine
Search
Engine
Search
Engine
Red basketball tshirt...
Search
Engine
Red basketball tshirt...
Feature Extraction
Extracting features
It’s all about…….. TOKENS
This parka is crafted from sturdy cotton in classic army green and comes with a
removable wool gilet that we've printed in leopard and can be worn inside or as
an outer. The parka features all the essentials: a quilted hood, a drawstring waist,
a fishtail, and utilitarian pockets. Detailed with silky padded sleeves for extra
warmth and superb comfort.
?
Char
Filters
Tokenizer
Token
Filters
Analyzer
Char
Filters
Tokenizer
Token
Filters
Analyzer
& => and, ph => f
Mapping char filter
Char
Filters
Tokenizer
Token
Filters
Analyzer
<b> Elasticsearch </b> -> Elasticsearch
HTML strip filter
Char
Filters
Tokenizer
Token
Filters
Analyzer
Elasticsearch is an awesome technology
White space tokenizer
Char
Filters
Tokenizer
Token
Filters
Analyzer
“Foo”, “bar”, “baz”
Pattern Tokenizer
[^w]+
foo,bar baz
Char
Filters
Tokenizer
Token
Filters
Analyzer
Stemmer Token Filter
Playing, Played, Player => play
Char
Filters
Tokenizer
Token
Filters
Analyzer
Shingle Token Filter
"please divide", "divide this", "this sentence",
"sentence into", "into shingles"
Please divide this sentence into shingles
Char
Filters
Tokenizer
Token
Filters
Analyzer
Stop Token Filter
a, about, above, after, again, against, all,
am, an, and, any, are, aren't, as, at, be
Char
Filters
Tokenizer
Token
Filters
Analyzer
Synonyms Token Filter
- america, usa
- british, english
- blue, duke blue, jade blue
- cuisine, food
Char
Filters
Tokenizer
Token
Filters
Analyzer
<p> in the U.S.A. anyone can become president. that’s the problem </p>
Char
Filters
Tokenizer
Analyzer
HTML strip filter White space Stop
Stemmer
Synonyms
Token
Filters
Char
Filters
Tokenizer
Token
Filters
Analyzer
{ “america” “anyone” “become” “president” “problem” }
<p> in the U.S.A. anyone can become president. that’s the problem </p>
Extracting features
It’s all about…….. TOKENS
fishtail, utilitarian pockets
parka, military, army green,
army, green, wool, hoodie,
silky sleeves, 100% cotton,
winter, leopard, jacket,
coat, winter, coat, tiger,
warm, casual, hiking, …
This parka is crafted from sturdy cotton in classic army green and comes with a
removable wool gilet that we've printed in leopard and can be worn inside or as
an outer. The parka features all the essentials: a quilted hood, a drawstring waist,
a fishtail, and utilitarian pockets. Detailed with silky padded sleeves for extra
warmth and superb comfort.
Design for user expectations
Acronyms: “I.B.M” , “Wi-Fi”, “U.S.A” , “IT” , “AFAIK” , “LOL”
Telephone Numbers: (+49) 152-02434977, (0049)15202434977, 015202434977
Names: “John Smith”, “John A. Smith”, “John Adam Smith”, “John S.”
Tailored analysis per field
The Art of Ranking
Ranking
● Filtering
● Boosting
● Scoring
Ranking
User Query
white sneakers
Color Category
Ranking
User Query
Color Category Recency Availability Location
Business
Value
Ranking
User Query
Color Category Recency Availability Location
Business
Value
Ranking
User Query
Color Category Recency Availability Location
Business
Value
Ranking
Boosting Boosting Score Func. Filtering Score Func.Filtering
User Query
Boosting Boosting Score Func. Filtering Score Func.Filtering
Color Category Recency Availability Location
Business
Value
Ranking
Color Category Recency Availability Location
Business
Value
Boosting Boosting Score Func. Filtering Score Func.Filtering
User Query
Boosting
Base
score
Base
Score
Total score = Base score + Additive Score Total score = Base score X Multiplicative Score
Adding Scores Multiplying Scores
Scoring in Elasticsearch
Function Score Query
● weight
● field_value_factor
● random_score
● Decay functions
● script_score
Search
Engine
Data ingestion & enrichment
Data retrieval & ranking
Elasticsearch in
Zalando
Shop The Look
Shop The Look
Product Service
● Fetch articles by sku
● Fetch articles by urlkey
● Fetch articles by family_sku
Key-Value Store ?
Catalog use-case
example:
100 Articles X
Catalog use-case
example:
100 Articles X 5 Colors
Catalog use-case
example:
100 Articles X 5 Colors X 1000 RPS
Catalog use-case
example:
100 Articles X 5 Colors X 1000 RPS = 500,000 RPS
Catalog use-case
Key-Value Store
example:
100 Articles X 5 Colors X 1000 RPS = 500,000 RPS
Product Service
Auto Scaling
shards_per_node: 3
Auto Scaling
shards_per_node: 1
The New PDP
Reviews Shop The LookProducts
Elasticsearch Express
● Easy deployment across multiple AZs
● Start serving data in less than 10 minutes
● Full data availability guarantee on each AZ
● Role separation of nodes
● Stable master election
● No manual configuration on AWS
● Automatic data backups in S3 bucket
● ES Monitoring dashboard template
www.search-relevancy-workshop.com
A hands-on workshop for building killer
search applications with Elasticsearch.
?

Más contenido relacionado

Destacado

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by HubspotMarius Sescu
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 

Destacado (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Elasticsearch in Zalando