Real World Challenges in Scaling Enterprise Search
•
3 recomendaciones•716 vistas
Enterprise Search is complex, even in theory. But when you implement your search solution and everything turns to reality, you’ll find some new, never-seen challenges. In this session, I’ll collect the best, biggest and most exciting challenges from my experience, including real world customer scenarios and solutions. Regardless of the SharePoint version you use (SharePoint 2010, FAST Search for SharePoint, SharePoint 2013), this session is for you if you want to prepare for these “unexpected” scenarios.
Recomendados
Recomendados
Más contenido relacionado
La actualidad más candente
La actualidad más candente (20)
Similar a Real World Challenges in Scaling Enterprise Search
Similar a Real World Challenges in Scaling Enterprise Search (20)
Más de Agnes Molnar
Más de Agnes Molnar (20)
Último
Último (20)
Real World Challenges in Scaling Enterprise Search
- 1. Real World Challenges in Enterprise Search COM 704 Agnes Molnar
- 2. Introduction – Agnes Molnar Independent Consultant • 10+ Years SharePoint Experience • Enterprise Content Management • Search SharePoint Server MVP • 6 Years SharePoint Server MVP • 5+ Years Speaking at Conferences Around the World • Books, White Papers Contact • E-mail: aghy@aghy.hu • Blog: http://aghy.hu • Twitter: @molnaragnes
- 3. Agenda
- 4. Enterprise Search Search Technology that your organization owns and controls
- 5. Search is more than Technology Source: http://searchpatterns.org
- 7. Requirements Gathering Find Collect Analyze Take Action Search
- 8. Requirements Gathering Information-Seeking Patterns „I know what I’m searching for and know how to do that” „I know what I’m searching for but I don’t know how to do that” „I don’t know what I’m searching for” „Am I Searching?...”
- 9. Requirements Gathering Content Sources Types of Content Actions to Take Metadata Amount of Content Users’ Behavior Current Pain Points MBWA
- 11. Assessing your needs: Expectations Users IT Business Interactive Flexible ‘Psychic’ Customized Ergonomic Secure Scalable Standards-based Flexible Accurate Tunable Flexible Activity Reports
- 12. Traditional System Integration 12 Custom Integration Cost: Time Frame: $ $$ $ Challenge: Brittle code Middleware Cost: Time Frame: $ $$ $ Challenge: $1,000,000 + costs with limited content sources $ SOA Cost: Time Frame: $ $$ $ Challenge: Massive re-engineer $ Sales & Marketing I need all information we have about my customer? Where can I see all my suppliers data in one place? Where do I have to look for research projects? Do we know our liability on this matter? Engineering/R&D Legal/ComplianceSupply Chain Data Silos Email & Messaging ERPCRM ECM, Search, Collaboration Structured Data (databases) Unstructured Data (file shares) Public Web Sites Cloud/ Office 365
- 14. Security
- 15. The Search Security Paradox As Search is deployed further and further into the Enterprise, the likelihood of having a security problem increases.
- 18. Federate vs. Build Index Federate CANNOT or don’t want to crawl remote site’s robots.txt blocks SharePoint’s crawler you need results only with specific keywords and/or keyword patterns in the query content changes very often, immediately crawling needed queries under different security context infrequently queried contents >500 content sources Build Index you CAN crawl and index you don’t have enough bandwith to federate content changes very often, but immediately crawling NOT needed content that is not indexed by the remote server remote server does not return with RSS or Atom
- 19. Sizing and Capacity Planning
- 21. Scale-Out Principals To improve this… Take these actions… Index freshness / crawl times Add more Indexer machines and/or Crawl components. Add additional Crawl DB on the same SQL server. Add additional SQL server(s) with additional Crawl DBs. Query Latency / Throughput Partition the index to smaller index partitions. Add Query components with mirror index partitions. Add additional Crawl DB on the same SQL server. Add additional SQL server(s) with additional Crawl DBs. Query Availability Deploy redundant Query servers, redundant Index partitions and components. Use clustered or mirrored DB servers to host Property DBs Crawl / Index Availability Use multiple Crawler components or redundant Index servers. Add Crawl DBs.
- 22. Components – Scaling cheat sheet Component CPU Network Disk Memory Search administration Crawling Content processing (CPC) Analytics processing (APC) Index Query processing (QPC)
- 23. Conclusion
- 24. Thank you for attending! Contact E-mail: aghy@aghy.hu Blog: http://aghy.hu Twitter: @molnaragnes
Notas del editor
- No longer within the firewallRelevance is criticalSearch within the organization„Transparent” SearchSearch Driven Applications
- Management by Walking Around
- New Search Solution vs. Upgrading/Changing the existing one
- Plan!!Research on SOURCE SYSTEM, involve the admins there!!TestOn Source systemOn SearchInvolve:Source system key usersSource system adminsTest users (<7)More test users
- Jeff