Search: the right tool, but what is the job. At nosqlmatters amsterdam 2013

•

1 recomendación•834 vistas

This presentation is a non-technical overview of what kind of tool a search solution is. Elasticsearch is used to explain the concepts as well as provide a number of jobs that can be performed with a search solution. This presentation is given at the nosqlmatters road show conference in Amsterdam in oktober 2013

Tecnología Empresariales

Search: the right tool ...
... but what is the job?

Jettro Coenradie

jco@trifork.nl

@gridshore

Search Solution

=

Services for ﬁnding stuff

SELECT * FROM jobs

WHERE title like ‘%elasticsearch%’

OR description like ‘%elasticsearch%’

OR ...

Inverted index
For this job you need

thorough knowledge

of elasticsearch.

We are looking for

Elasticsearch

trainees

Terms
job

1

knowledge

1

elasticsearch

1,2

trainees

2

Analysis
• Tokenizing

• Filters

• Analyzers

Searching/Querying
• Stemming

• Synonyms

• Sounds like

Open source
Search solutions

elasticsearch

Design overview
Application
Java
Groovy
Php
Perl
Python

+

uses

Driver
calls

Design overview
Application
calls

REST/HTTP

There is no security
• Do not expose your search solution to the
public

• Use a proxy (guides are available)

Becoming successful
A lot of vacancies
A lot of job seekers

Being successful

Scalability

Availability

Log analysis
Ralph Meijer

using elasticsearch and logstash to

serve billions of searchable events
http://www.elasticsearch.org/blog/using-elasticsearch-and-logstash-to-serve-billions-of-searchableevents-for-customers/

Percolator

https://github.com/abronner/elasticsearch-monitoring

NoSQL

Beeld en Geluid

Store the meta-data of all image, audio and video material

The right tool

The job

Jettro Coenradie jco@trifork.nl

Más contenido relacionado

Similar a Search: the right tool, but what is the job. At nosqlmatters amsterdam 2013

RA Slideshare Presentation- Taryn Pahl

Taryn Pahl

Slideshare pres

Taryn Pahl

Diversity Sourcing Part II

Kay Kelison

Filar seymour oreilly_bot_story_

EndgameInc

To optimally interpret most natural language queries, its important to understand a highly-nuanced, contextual interpretation of the domain-specific phrases, entities, commands, and relationships represented or implied within the search and within your domain. In this talk, we'll walk through such a search system powered by Solr's Text Tagger and Semantic Knowledge graph. We'll have fun with some of the more search-centric use cases of knowledge graphs, such as entity extraction, query expansion, disambiguation, and pattern identification within our queries: for example, transforming the query "best bbq near activate" into: {!func}mul(min(popularity,1),100) bbq^0.91032 ribs^0.65674 brisket^0.63386 doc_type:"restaurant" {!geofilt d=50 sfield="coordinates_pt" pt="38.916120,-77.045220"} We'll see a live demo with real world data demonstrating how you can build and apply your own knowledge graphs to power much more relevant query understanding like this within your search engine.

Natural Language Search with Knowledge Graphs (Chicago Meetup)

Trey Grainger

A quick Description about presentation: • What is ElasticSearch and how it works. • How ElasticSearch works to analyze data splitting a document into meaningful portions and indexing each of those portions separately. So whenever a new search request comes in, it knows what to find. • Features and advantages of ElasticSearch like built in sharding defaults, maintaining fail-safe node clusters, automatically adding a new node without having to reboot and so on. • Out of the box features for today’s applications like faceted search, reverse search using Percolators and pre-built Analyzers. The tutorial includes big data search, contenders, intro to elasticsearch, more than just search, unchartered territory. Beginning is a brief detail about big data search which includes big data search in terms of rapid consumption and the challenges faced by big data search. Following is a section about contenders. It includes contenders like lucene, apache soir, sphinx and ElasticSearch itself. Moreover, there is also an introduction section to ElasticSearch. It includes an introduction to ElasticSearch as a search server and it's features like push replication, node auto discovery, fail-safe. It also includes data analyzing and ways of indexing it right. Afterwards, there is a section on more than search which includes factors more than just search functions like facets, range facet, histogram facet, geo facet, percolator and ElasticSearch percolating. The last section of this tutorial includes unchartered territory. It includes territories like ElasticSearch and NoSQL database, situations in cases of WHAT IF and references.

BigData Search Simplified with ElasticSearch

TO THE NEW | Technology

AI, Search, and the Disruption of Knowledge Management

Trey Grainger

How To Optimize Your Tech Recruiting Stack Patrick Christell, Senior Sourcer at Hire4ce, meets all the qualifications of “MASTER.” We’re talking a Full-Lifecycle Recruiter, Project Manager and Agile sourcing pod-builder with seven-plus years of progressive experience recruiting for technology companies across the boards. He also has a rather impressive tech stack, which is what this is all about. Patrick is here to give you 60-minutes of training and live Q&A that will help you learn to recruit top talent. In this webinar we will cover: - How to search. Tools like Hiretual, Seekout, AmazingHiring (and their plusses and minuses). The difference between searching for senior-level engineers, how to know if you are on a purple squirrel hunt, and what to with a BONUS live demo that iterates a single string. - How to run a sourcing pod. Learn how Patrick creates his own CRM that can do outreach and reporting - How to understand tech without being a techie. What a software stack even is, understanding how it fits together, learning what each part of the stack technologies are associated with. - How to engage talent. Why a mixture of broad spectrum outreach and personalized outreach is best. What cadence works best in 2019. Why only using inmails screws you, and how to leverage the phone even if you hate using it (TextNow). Nobody’s got time for a floppy stack. Let Patrick show you how to build in functionality and results.

Master Technical Recruiting Workshop: How to Recruit Top Tech Talent

RecruitingDaily.com LLC

NLP Applications in Search

Eoin Hurrell, PhD

Building a semantic search system - one that can correctly parse and interpret end-user intent and return the ideal results for users’ queries - is not an easy task. It requires semantically parsing the terms, phrases, and structure within queries, disambiguating polysemous terms, correcting misspellings, expanding to conceptually synonymous or related concepts, and rewriting queries in a way that maps the correct interpretation of each end user’s query into the ideal representation of features and weights that will return the best results for that user. Not only that, but the above must often be done within the confines of a very specific domain - ripe with its own jargon and linguistic and conceptual nuances. This talk will walk through the anatomy of a semantic search system and how each of the pieces described above fit together to deliver a final solution. We'll leverage several recently-released capabilities in Apache Solr (the Semantic Knowledge Graph, Solr Text Tagger, Statistical Phrase Identifier) and Lucidworks Fusion (query log mining, misspelling job, word2vec job, query pipelines, relevancy experiment backtesting) to show you an end-to-end working Semantic Search system that can automatically learn the nuances of any domain and deliver a substantially more relevant search experience.

How to Build a Semantic Search System

Trey Grainger

Natural Language Search with Knowledge Graphs (Activate 2019)

Trey Grainger

User Centered Design of an Android app

Satheesh Kumar Chandran

From keyword-based search to language-agnostic semantic search

CareerBuilder.com

Summit slide loop ny

Stuart Shulman

Reflected Intelligence - Lucene/Solr as a self-learning data system: Presente...

Lucidworks

4-200626030058kpnu9avdbvionipnmvdadzvdavavd

mmpnair0

Introduction to enterprise search

Usama Nada

Sourceconaifullv6forslideshare 120108133422-phpapp02

Rose Nolen

Leveraging Data: LinkedIn Recruiter, Jobs, & Talent Pool Analysis

LinkedIn Europe

Sais svcc

Pradeep Pujari

Similar a Search: the right tool, but what is the job. At nosqlmatters amsterdam 2013 (20)

RA Slideshare Presentation- Taryn Pahl

Slideshare pres

Diversity Sourcing Part II

Filar seymour oreilly_bot_story_

Natural Language Search with Knowledge Graphs (Chicago Meetup)

BigData Search Simplified with ElasticSearch

AI, Search, and the Disruption of Knowledge Management

Master Technical Recruiting Workshop: How to Recruit Top Tech Talent

NLP Applications in Search

How to Build a Semantic Search System

Natural Language Search with Knowledge Graphs (Activate 2019)

User Centered Design of an Android app

From keyword-based search to language-agnostic semantic search

Summit slide loop ny

Reflected Intelligence - Lucene/Solr as a self-learning data system: Presente...

4-200626030058kpnu9avdbvionipnmvdadzvdavavd

Introduction to enterprise search

Sourceconaifullv6forslideshare 120108133422-phpapp02

Leveraging Data: LinkedIn Recruiter, Jobs, & Talent Pool Analysis

Sais svcc

Último

Axa Assurance Maroc - Insurer Innovation Award 2024

The Digital Insurer

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...

Neo4j

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

apidays

This presentation explores the impact of HTML injection attacks on web applications, detailing how attackers exploit vulnerabilities to inject malicious code into web pages. Learn about the potential consequences of such attacks and discover effective mitigation strategies to protect your web applications from HTML injection vulnerabilities. for more information visit https://bostoninstituteofanalytics.org/category/cyber-security-ethical-hacking/

HTML Injection Attacks: Impact and Mitigation Strategies

Boston Institute of Analytics

Tata AIG General Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Increase engagement and revenue with Muvi Live Paywall! In this presentation, we will explore the five key benefits of using Muvi Live Paywall to monetize your live streams. You'll learn how Muvi Live Paywall can help you: Monetize your live content easily: Set up pay-per-view access to your live streams and start generating revenue from your content. Increase audience engagement: Provide exclusive, premium content behind the paywall to keep your viewers engaged. Gain valuable viewer insights: Track viewer data and analytics to better understand your audience and tailor your content accordingly. Reduce content piracy: Muvi Live Paywall's security features help protect your content from unauthorized distribution. Streamline your workflow: The all-in-one platform simplifies the process of managing and monetizing your live streams. With Muvi Live Paywall, you can take control of your live stream monetization and create a sustainable business model for your content. Learn more about Muvi Live Paywall and start generating revenue from your live streams today!

Top 5 Benefits OF Using Muvi Live Paywall For Live Streams

Roshan Dwivedi

Created by Mozilla Research in 2012 and now part of Linux Foundation Europe, the Servo project is an experimental rendering engine written in Rust. It combines memory safety and concurrency to create an independent, modular, and embeddable rendering engine that adheres to web standards. Stewardship of Servo moved from Mozilla Research to the Linux Foundation in 2020, where its mission remains unchanged. After some slow years, in 2023 there has been renewed activity on the project, with a roadmap now focused on improving the engine’s CSS 2 conformance, exploring Android support, and making Servo a practical embeddable rendering engine. In this presentation, Rakhi Sharma reviews the status of the project, our recent developments in 2023, our collaboration with Tauri to make Servo an easy-to-use embeddable rendering engine, and our plans for the future to make Servo an alternative web rendering engine for the embedded devices industry. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://ossna2024.sched.com/event/1aBNF/a-year-of-servo-reboot-where-are-we-now-rakhi-sharma-igalia

A Year of the Servo Reboot: Where Are We Now?

Igalia

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

Discord is a free app offering voice, video, and text chat functionalities, primarily catering to the gaming community. It serves as a hub for users to create and join servers tailored to their interests. Discord’s ecosystem comprises servers, each functioning as a distinct online community with its own channels dedicated to specific topics or activities. Users can engage in text-based discussions, voice calls, or video chats within these channels. Understanding Discord Servers Discord servers are virtual spaces where users congregate to interact, share content, and build communities. Servers may revolve around gaming, hobbies, interests, or fandoms, providing a platform for like-minded individuals to connect. Communication Features Discord offers a range of communication tools, including text channels for messaging, voice channels for real-time audio conversations, and video channels for face-to-face interactions. These features facilitate seamless communication and collaboration. What Does NSFW Mean? The acronym NSFW stands for “Not Safe For Work,” indicating content that may be inappropriate for professional or public settings. NSFW Content NSFW content encompasses material that is sexually explicit, violent, or otherwise graphic in nature. It often includes nudity, profanity, or depictions of sensitive topics.

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

UK Journal

MINDCTI Revenue Release Quarter One 2024

MIND CTI

Search: the right tool, but what is the job. At nosqlmatters amsterdam 2013

1. Search: the right tool ... ... but what is the job? Jettro Coenradie jco@trifork.nl @gridshore

2. The right tool ...

3. ... but what is the job?

4. The right tool Search and the job is

5. Two people to help me

6. Meet the customer ! Marc

7. Meet our software developer ! John

8. What is a Search Solution?

9. Search = ﬁnding stuff

10. Search Solution = Services for ﬁnding stuff

11. SELECT * FROM jobs WHERE title like ‘%elasticsearch%’ OR description like ‘%elasticsearch%’ OR ...

12. Not optimized for free text search

13. Inverted index For this job you need thorough knowledge of elasticsearch. We are looking for Elasticsearch trainees Terms job 1 knowledge 1 elasticsearch 1,2 trainees 2

14. Analysis • Tokenizing • Filters • Analyzers

15. Searching/Querying • Stemming • Synonyms • Sounds like

16. Open source Search solutions elasticsearch

17. Design overview Application Java Groovy Php Perl Python + uses Driver calls

18. Design overview Application calls REST/HTTP

19. What can you tell about Security?

20. There is no security • Do not expose your search solution to the public • Use a proxy (guides are available)

21. Becoming successful A lot of vacancies A lot of job seekers

22. Being successful Scalability Availability

23. Storing more content

24. Storing more content

25. Prevent data loss

26. Keep copies

27. The right tool ...

28. Github

29. Facets

30. Highlighting

31. Recommendation

32. Geospatial search

33. Log analysis

34. Data analysis http://www.kibana.org

35. Log analysis Ralph Meijer using elasticsearch and logstash to serve billions of searchable events http://www.elasticsearch.org/blog/using-elasticsearch-and-logstash-to-serve-billions-of-searchableevents-for-customers/

36. Percolator

37. Percolator https://github.com/abronner/elasticsearch-monitoring

38. Percolator

39. NoSQL Beeld en Geluid Store the meta-data of all image, audio and video material

40. The right tool The job Jettro Coenradie jco@trifork.nl

41. Questions?

Search: the right tool, but what is the job. At nosqlmatters amsterdam 2013

Recomendados

Recomendados

Más contenido relacionado

Similar a Search: the right tool, but what is the job. At nosqlmatters amsterdam 2013

Similar a Search: the right tool, but what is the job. At nosqlmatters amsterdam 2013 (20)

Último

Último (20)

Search: the right tool, but what is the job. At nosqlmatters amsterdam 2013