Apache Solr is a highly scalable and fault-tolerant search platform based on Lucene. It provides distributed search and index replication. Solr indexes content into its internal representation format and provides a REST-like API to query the index. During indexing, documents are processed by analyzers which break text into tokens, then the tokens are stored in the index. During search, queries are processed by analyzers and the results are compared to the tokens in the index.

1. Apache Solr
Rafael Valério
Gustavo Vinícius
Monday, February 4, 13

2. Servidor de busca ultra-rápido
baseado em Lucene*
* Biblioteca de motor de busca de alta performance, escrita em Java.
Monday, February 4, 13

3. Como funciona?
Monday, February 4, 13

4. Como funciona?
Monday, February 4, 13

5. Dois Processos
#1 Indexação #2 Busca
Monday, February 4, 13

6. #1 Indexação #2 Busca
Monday, February 4, 13

7. FIELD ANALYZERS
#1 Indexação #2 Busca
Monday, February 4, 13

8. FIELD ANALYZERS
Monday, February 4, 13

9. FIELD ANALYZERS
Monday, February 4, 13

10. Texto
FIELD ANALYZERS
Monday, February 4, 13

11. Texto
FIELD ANALYZERS
Tokens
Monday, February 4, 13

12. FIELD ANALYZERS
Monday, February 4, 13

13. FIELD ANALYZERS
Monday, February 4, 13

14. FIELD ANALYZERS
Monday, February 4, 13

15. FIELD ANALYZERS
TOKENIZERS FILTERS
Monday, February 4, 13

16. TOKENIZERS
Quebram os dados do campo em unidades
léxicas, ou tokens.
Monday, February 4, 13

17. FILTERS
Analisam um fluxo de tokens
+
mantém | transforma | descarta | cria
Monday, February 4, 13

18. TOKENIZER
FILTER
FILTER
FILTER
FILTER
Monday, February 4, 13

19. TOKENIZER
FILTER
FILTER
FILTER
FILTER
Monday, February 4, 13

20. TOKENIZER
FILTER
FILTER
FILTER
FILTER
Monday, February 4, 13

21. TOKENIZER
FILTER
FILTER
= ANALYZER
FILTER
FILTER
Monday, February 4, 13

22. schema.xml
Simples
<fieldType name="nametext" class="solr.TextField">
<analyzer class="org.apache.lucene.analysis.WhitespaceAnalyzer"/>
</fieldType>
Composto
<fieldType name="nametext" class="solr.TextField">
<analyzer>
<tokenizer class="solr.StandardTokenizerFactory"/>
<filter class="solr.StandardFilterFactory"/>
<filter class="solr.LowerCaseFilterFactory"/>
<filter class="solr.StopFilterFactory"/>
<filter class="solr.EnglishPorterFilterFactory"/>
</analyzer>
</fieldType>
Monday, February 4, 13

23. Fases de Análise
Monday, February 4, 13

24. Na indexação, um campo é criado
e os tokens são armazenados.
Monday, February 4, 13

25. Na busca, o termo pesquisado é
analisado e comparado com os
campos do índice.
Monday, February 4, 13

26. schema.xml
Duas Fases
<fieldType name="nametext" class="solr.TextField">
<analyzer *type="index"{*}>
<tokenizer class="solr.StandardTokenizerFactory"/>
<filter class="solr.LowerCaseFilterFactory"/>
<filter class="solr.KeepWordFilterFactory" words="keepwords.txt"/>
<filter class="solr.SynonymFilterFactory" synonyms="syns.txt"/>
</analyzer>
<analyzer *type="query"{*}>
<tokenizer class="solr.StandardTokenizerFactory"/>
<filter class="solr.LowerCaseFilterFactory"/>
</analyzer>
</fieldType>
Monday, February 4, 13

27. Exemplos de Tokenizers
Monday, February 4, 13

28. Standard Tokenizer
<analyzer>
<tokenizer class="solr.StandardTokenizerFactory"/>
</analyzer>
IN: Please, email john.doe@foo.com by 03-09, re: m37-xq.
OUT: "Please", "email", "john.doe@foo.com", "by", "03-09", "re", "m37-xq"
Monday, February 4, 13

29. Keyword Tokenizer
<analyzer>
<tokenizer class="solr.KeywordTokenizerFactory"/>
</analyzer>
IN: Please, email john.doe@foo.com by 03-09, re: m37-xq.
OUT: “Please, email john.doe@foo.com by 03-09, re: m37-xq.”
Monday, February 4, 13

30. Obrigado!
rafael@webgoal.com.br
@rafaelvalerio
gustavo@webgoal.com.br
@gustavovncius
Monday, February 4, 13