This document discusses performance testing and optimization for Drupal websites. It includes information on stakeholders and why they care about load testing. There are examples of existing customer website configurations that discuss traffic volumes, page caching percentages, and server specifications. The document also outlines a load testing plan framework and shares optimizations identified from load testing an Acquia customer site, such as increasing load balancer and server sizes. Finally, it shares the experience of one company that performed load testing through Acquia and Soasta prior to a major website launch.
Injustice - Developers Among Us (SciFiDevCon 2024)
Tuning for Success: Performance Intelligence for Enterprise Drupal
1. Tuning for Success: Performance Intelligence for Enterprise Drupal Steve Strong and David Orr – APCO Worldwide, Kieran Lal – Acquia, Dan Bartow – Soasta, 1
2. Do you love working with Drupal? If so, Acquia is hiring: Engineering & design Client advisors and consulting Inside sales Check out openings at http://acquia.com/careers
3. Who cares about load testing? Stake holders and why they care. Acquia Company Confidential 3
4. State of Drupal load testing report Acquia Company Confidential 4
8. Existing Customer Configuration #1 Acquia Company Confidential 8 Caching Load Balancer Web Servers User-contributed publishing site 20M PVs/month <2% page caching 100,000+ unique pages per day 70% hit caching Moderate complexity 8 blocks/page with 3 views High-memory PHP footprint 200+MB m1.large m1.large c1.xlarge c1.xlarge MySQL DB Cluster m1.large m1.large
9. Existing Customer Configuration #2 Acquia Company Confidential 9 Shared Load Balancer Web Servers Online Magazine 13M PVs/month 30% page caching 95%+ anonymous traffic 75% hit caching Moderate-High complexity 8 to 11 views/page m1.large m1.large MySQL DB Cluster m1.large m1.large
10. Existing Customer Configuration #3 Acquia Company Confidential 10 Shared Load Balancer File Server Cluster Web Servers Movie trailer and ticketing site 7M PVs/month 60% authenticated traffic No page caching Moderate complexity 3-8 views/page Very high DB load 250K registered users Drupal 5 Note: Backup DB server also serves as file server m1.large m1.large m1.large MySQL DB Cluster c1.xlarge c1.xlarge m1.large
11. Existing Customer Configuration #4 Acquia Company Confidential 11 Caching Load Balancer Web Servers User-contributed publishing site 400M+ PVs/month >97% page caching All anonymous traffic Round-robin DNS to include both load balancers Low complexity Brochure-ware site c1.xlarge c1.xlarge c1.xlarge c1.xlarge MySQL DB Cluster m1.large m1.large
13. Acquia Optimizations from Soasta testing Increase load balancer sizes to X-Large Configure firewalls to allow for all clients Increase Varnish TTL from 2-5 minutes, adjusted grace time Increase PHP CGI lifetime Used DNS round robin, 2 A records, to split the load Allowed for more per server configurations Varnish PURGE everything AWS to AWS network issues Acquia Company Confidential 13
15. SOASTA CloudTest Ne FIRST Cloud Testing Company (since 2007) Performed The FIRST Test Simulating over a Million Users Provisioned Over 350,000 Cloud Servers For Testing AWARD Winning Technology: Top Ten New Cloud Services (IW) Best Cloud Application (IT Mgmt) Visionary Leader MQ (Gartner) Named One of the Hottest Companies in America (WSJ) Top 100 On-Demand Cloud Service (On-Demand Magazine)
27. The big project, 8 days notice Launching a site with 8 days notice First cluster didn’t make it Coming to Acquia Pre-tuned Drupal cloud Levels of Service Built before you bought Learning about pressflow Three rounds of Soasta load testing Confident it would scale Acquia Company Confidential 27
28. Questions For more information, visit: http://acquia.com http://acquia.com/facebook Contactus: sales@acquia.com 888.9.ACQUIA Recording of today’s event and slides will be posted at: http://acquia.com/resources/recorded_webinars
Editor's Notes
What are the total monthly page views across your sites? (actual or estimate): What are the total HTTP requests per month across your sites? (actual or estimate):What is the total bandwidth utilization per month across your sites? (actual or estimate):What is the average number page views per second for your sites? (actual or estimate): How many authenticated user logins does your site currently have? How many in 30 days, 90 days?: What percentage of your page views are from logged in (authenticated) users?:
Dan Bartow is Vice President and CloudTest Evangelist at SOASTA, the leader in performance testing from the cloud. Prior to joining SOASTA he was Senior Manager of Engineering at Intuit, where his team was responsible for the speed and stability of TurboTax Online, the #1 rated, best-selling online tax software. Over the past decade he has been responsible for the speed and scalability of websites for such well-known brands as American Eagle Outfitters, AT&T, Best Buy, Finish Line, J.Crew, Neiman Marcus and Sony Online Entertainment, among others. Dan has set multiple industry precedents including launching the worlds largest statefulJBoss cluster and using over 2000 cloud computing cores to generate load against a live web site. Dan is a frequent industry presenter and has spoken at leading testing and cloud computing conferences such as Software Test & Performance (STP), O'Reilly's Web2.0 Expo, Amazon's Web Services Road Show, and SYS-CON’s Cloud Computing Expo.
Finger PointingComplex interdependencies due to frameworksToo many sockets usedFull heap due to memory leakInefficient algorithmsInefficient or redundant callsFile handle leaksPoor choice of object representationHigh serialization (data marshalling) cost (SOAP, XML)High latency and heavy payload for specific callsHigh CPU usageToo many SQL callsFull connection pool
JVM Tuning
JVM Tuning
High ConfidenceBetter Customer ExperienceOperational Readiness
High ConfidenceBetter Customer ExperienceOperational Readiness
High ConfidenceBetter Customer ExperienceOperational Readiness
High ConfidenceBetter Customer ExperienceOperational Readiness