To survive in today’s competitive market, it’s imperative that you drive high-velocity experimentation and maximize site performance. In this talk, Optimizely will be joined by performance experts, Cloudflare to share latest updates to the Optimizely platform to make client-side experimentation blazing fast.
In this session you’ll learn:
- How to take advantage of the latest performance enhancements to the Optimizely platform
- Best practices for implementing Optimizely for maximum performance including how to take advantage of your CDN
- How to have an informed conversation with your performance engineering team when it comes to Optimizely
Supercharging Optimizely Performance by Moving Decisions to the Edge
1.
2. 2
▪ Welcome to Opticon!
▪ Sessions today will be recorded and will be available after
Opticon
▪ Join the conversation on Twitter at #Opticon19
▪ We want to hear from you! Give feedback and rate sessions
on the mobile app
3. Whelan Boyd
Senior Product Manager, Optimizely
Rita Kozlov
Product Manager, Cloudflare
Performance Edge
Supercharge Performance by
Moving Decisions to the Edge
4. Agenda 1. Speed matters
2. Product announcement
3. How fast is it?
4. Technology deep dive with Rita Kozlov
5. Getting Started
6. Q&A
6. “For every additional
second of page load,
10% of users leave.”
13% increase in sales
when page load time
was cut by half
The Business Impact of Speed
7. “For every additional
second of page load,
10% of users leave.”
13% increase in sales
when page load time
was cut by half
Found that 53% of mobile
visits were abandoned if
page took > 3 seconds to load
The Business Impact of Speed
14. 15
Most common number
of experiments conducted
per month
Revenue
Increase
1-20 Experiments 1-4%
20+ Experiments 14+%
15
Survey of 800+ digital professionals at
companies greater than 500 employees
40. Performance Edge by the Numbers
Edge
Time to Experiment Render: Less than 50ms to
render experiments at the 50th percentile on
customer sites and internal tests.
Faster Download: 2-20x faster Time to First
Contentful Paint than traditional client-side
Smaller snippet: Order of magnitude reduction in
file size (e.g. 80kb → 8kb)
The fastest client-side A/B experimentation
platform on the market.
Materials presented are for demonstration purposes only and may not be developed and / or delivered. Optimizely provides no guarantees and has no liability for information contained herein.
CTA: Get Started
Experiment
Delivery
Network
script
site.com/home
Standard
CDN
script
Experiment A
variation 1: CTA: Get Started
variation 2: CTA: Try it out
Experiment B
variation 1: Promo Code
variation 2: No promo code
site.com/home
< 50ms
2-20x
1/10th
42. 45
Traditional
Standard
CDN
script
Experiment A
variation 1: CTA: Get Started
variation 2: CTA: Try it out
Experiment B
variation 1: Promo Code
variation 2: No promo code
site.com/home
URL Targeting
Audience Targeting
Traffic Splitting
Apply Variations
Event Tracking
Standard
CDN
Experiment A
variation 1: CTA: Get Started
variation 2: CTA: Try it out
Experiment B
variation 1: Promo Code
variation 2: No promo code
site.com/home
URL Targeting
Audience Targeting
Traffic Splitting
Apply Variations
Event Tracking
Task load:
script
Experiment
Delivery
Network
site.com/home
43. 46
Traditional
Standard
CDN
Experiment A
variation 1: CTA: Get Started
variation 2: CTA: Try it out
Experiment B
variation 1: Promo Code
variation 2: No promo code
site.com/home
URL Targeting
Audience Targeting
Traffic Splitting
Apply Variations
Event Tracking
Task load:
script
Experiment
Delivery
Network
CTA: Try it out
URL Targeting
Audience Targeting
Traffic Splitting
Apply Variations
Event Tracking
Performance Edge
site.com/home
script
44. Less data Less code Faster machines
Why is it so fast?
▪ Far smaller file loading
over the wire
▪ Reduce download time
▪ Only code necessary for
active variations
▪ Fraction of the execution
time in browser
▪ Powerful Cloudflare
Workers execute
expensive tasks
▪ Located extremely close
to end visitor
50. Cloudflare Workers Differentiation
High Performance
Unlike serverless platforms built on containers
to run in regions, Workers’ V8 isolate
architecture experiences negligible cold
starts due to far less overhead.
Traditional Container
Serverless Overhead
Workers Isolate
Serverless Overhead
Deliver a High Quality
User Experience
53
51. Cloudflare Workers Differentiation
Instant Global Scale
With Workers, developers avoid complex load
balancing setups — they can deploy to 165+
locations as easily as they can deploy to one
cloud availability zone with other providers.
Traditional Cloud Provider Cloudflare Workers
Easily Expand to Serve a
Global User Base
54
52. Cloudflare Workers Differentiation
Developer Productivity
Built in HTTP handling removes the need to
integrate with an API gateway, and the use of
the standardized Service Worker specification
makes getting started and troubleshooting
easier.
Stay Ahead of The
Competition
55
56. 59
One-time Configuration
Performance Edge Implementation
Customer
CDN
Experiment
Delivery
Network
2. Configure route handler to call Edge Decider API
1. Install the <script> tag
Edge Decider API
“microsnippet”
57. 60
One-time Configuration
Performance Edge Implementation
Customer
CDN
Experiment
Delivery
Network
2. Configure route handler to call Edge
Decider API
1. Install the <script> tag
Technical Details
▪ Works with all major CDNs
▪ Edge Decider API returns
JavaScript for active variations
▪ 1st-party request makes it easier
to supply required arguments
59. Use CasesTechnical Fit
Who should participate?
▪ Use CDN or Workers
▪ Prioritize performance
▪ Web users who focus on
experimentation
▪ Full Stack customers
who’ve avoided client-side
60. When? How? On what terms?
Early Access
▪ Early Access starts
today!
▪ Fill out registration form
on iPads at Opticon19
▪ Reach out to your
Optimizely contact
▪ Free during Early Access
▪ Customers and
Prospects welcome
▪ Premium Add-On to Web
Platform at General
Availability
63. ▪ Head to the Expo Hall for a quick break and say hello to
our sponsors
▪ Up next…learn how to build better products with
FullStory Head of Product Justin Dilley
Notas del editor
The next 2B users aren’t going to be coming from NA or Europe. They are going to be coming from places like India, Nigeria, Cambodia. They are going to be coming on mobile and likely on lower-end devices with not the greatest connectivity.
Already over half of the world’s internet traffic is on a mobile device, and that trend is only going to continue.
Here’s a visualization of how the same webpage loads with more and more experiments
On the left, you see the baseline. In the middle, a handful of experiments.
And on the right, a site with lots of experiments running.
[CLICK] Now, some performance cost is often worth it for the value you get from all those experiments
But if you’re an engineer charged with maintaining performance, you know that every millisecond is critical
Each test you run increases the size of the code
[CLICK] Which is fine with a few experiments
[CLICK] But as you start to run dozens, you start to pay a performance cost
If you’re an engineer, you know your team is getting great value from all these experiments
But as the steward of performance, you want to keep the latency impact as small as possible
And that creates a tradeoff: between growing testing velocityand keeping performance impact to a minimum.
Incredible shrinking snippet
Here’s that same page we saw earlier, with the same scale of experimentation
But this time, running Optimizely Performance Edge
Let’s see it load
[CLICK] Raise your hand if you could see the difference there
Let’s try it one more time
This time on mobile, where latency is even more critical
Here’s those same pages loading on an Android device with a 3G connection
[CLICK] How about now? Can you tell the difference?
Even when scaling to hundreds or thousands of experiments, it’s hard to spot any performance delay.
At the heart of Cloudflare is our network.
Our Global Anycast network consists of 194+ data centers, across 70+ countries.
Cloudflare has over 12 million websites, applications, and APIs on its network with 2.8 billion monthly active users accessing those assets, generating over 1.3 trillion page views.
We serve 10% of the world’s internet requests everyday — amounting to over 8 million requests per second — our network speeds up these requests by 2x or more!
Decentralization
Workers communicate with services, APIs or databases from multiple cloud providers without cost or latency penalties. Use the tools and services best for the task at hand.No need for API gateway HTTP handling
Standard API