SlideShare una empresa de Scribd logo
1 de 23
Descargar para leer sin conexión
Under the Hood
- Daum UCC
Reach For More Secure
And Responsive Architecture
1. The Path of Daum
2. Problems on Mass Network Traffic
Environment and Their Solutions
3. Things can Never be forsaken for
your own UCC Service
4. Conclusion
The Path of Daum
2001 2002 2003 20052001 2002 2003 2005 20072007
1. The Path of Daum
•Approx. 1,000 Proprietary Unix Servers
•Poor R.O.I, Low Scalability
2001 2002 2003 20052001 2002 2003 2005 20072007
1. The Path of Daum
•Decision made
•Migrate to Linux based x86 servers.
•Adopt Open Source Software
2001 2002 2003 20052001 2002 2003 2005 20072007
1. The Path of Daum
•Radical Growth
•The Portion Linux based, cheap x86
servers kept Increasing.
•The Opening of Scaling out ERA
2001 2002 2003 20052001 2002 2003 2005 20072007
1. The Path of Daum
•The quality of x86 servers and open
source software were getting better
day by day.
•Open Source and Linux Boom up
•Keep Scaling Out.
2001 2002 2003 20052001 2002 2003 2005 20072007
1. The Path of Daum
•Approx. 10,000 Servers, 4 PB of Storages
•The Largest of IT Infrastructure in Korea.
•DAUM Pioneered UCC World.
1. The Path of Daum
UCC service is Growing Fast
2006.4
6360 %
2007.9
Problems on Mass
Network Traffic
Environment And
Their Solutions
2. Problems & Solutions
Optimizing Cost
•What was in our hand
The Largest Portion is Network Traffic
Network Traffic Cost
Cut down Cost by Optimizing Contents Delivery Procedure
2. Problems & Solutions
Optimizing Cost
•Grasp the characteristic of UCC Service
"Let users have their contents as fast as Possible!“
Not always Good.
Not all users are play video files till the end
If we could restrict download bandwidth to minimum...?
2. Problems & Solutions
Optimizing Cost
•What we did
What we need was a little more than 1Mbps per session.
Set max download bandwidth
Infinite 5 Mbps
Try to use just as much as we need.
2. Problems & Solutions
Optimizing Cost
•The Result
Immediate Response: Network Traffic Reduced 15%
We also can cut the cost about 10% a month
Before After Decrement Ratio
Day 1 24 Gbps 19 Gbps - 15.4 %
Day 2 22 Gbps 19 Gbps - 26.1 %
Day 3 19 Gbps 16 Gbps - 16.9 %
2. Problems & Solutions
Performance Boost on Image Caching
•What was in our hand
Single request Dozens of images
As burden on image servers
gets bigger, QoS gets poorer.
2. Problems & Solutions
Performance Boost on Image Caching
•What we did
Enforce Cache Servers more Optimally,
That is Hierarchical architecture that scales well
Origin Server
Primary Cache
Secondary Cache
2. Problems & Solutions
Performance Boost on Image Caching
•The Result
Origin Server Workload dropped
2. Problems & Solutions
Performance Boost on Image Caching
•The Result
Response Time improved dramatically
Worst: more than 5 seconds
Current : Less than 500ms
Things can never be
forsaken for your own
UCC Video Service
3. Things can never be forsaken
Origin Data Protection
•NO WONDER
Whether you do it or let others do it
No matter what,
You Have to prepare appropriate Protection
3. Things can never be forsaken
Architecture represents essence of service
•The Long Tail
Contents must be transferred through Hot Zone
and Cool Zone freely.
Decent Architecture is required.
Traffic
Hot Zone
Cool Zone
“The Challenge
For Reliable and Efficient Service”
Makes Daum UCC More Vaulable.
5.Conclusion
Thank you.
SungKyu Park, Daum Communicaions
lointain@daumcorp.com

Más contenido relacionado

Similar a Under the hood daum ucc.20071105

The challenges of live events scalability
The challenges of live events scalabilityThe challenges of live events scalability
The challenges of live events scalability
Guy Tomer
 
2 b brychan watkins
2 b brychan watkins2 b brychan watkins
2 b brychan watkins
CFG
 
Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...
Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...
Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...
Jay Hung
 
High performance Infrastructure Oct 2013
High performance Infrastructure Oct 2013High performance Infrastructure Oct 2013
High performance Infrastructure Oct 2013
Server Density
 

Similar a Under the hood daum ucc.20071105 (20)

Get Connected Minehead 05.04
Get Connected Minehead 05.04Get Connected Minehead 05.04
Get Connected Minehead 05.04
 
Flood modelling on the Cloud
Flood modelling on the CloudFlood modelling on the Cloud
Flood modelling on the Cloud
 
Rendering Takes Flight
Rendering Takes FlightRendering Takes Flight
Rendering Takes Flight
 
Rendering Takes Flight
Rendering Takes FlightRendering Takes Flight
Rendering Takes Flight
 
E2 evc 3-2-1-rule - mikeresseler
E2 evc   3-2-1-rule - mikeresselerE2 evc   3-2-1-rule - mikeresseler
E2 evc 3-2-1-rule - mikeresseler
 
Mage uk-2013-1345-chris-wells-131030120920-phpapp01
Mage uk-2013-1345-chris-wells-131030120920-phpapp01Mage uk-2013-1345-chris-wells-131030120920-phpapp01
Mage uk-2013-1345-chris-wells-131030120920-phpapp01
 
The Importance of Site Performance and Simple Steps to Achieve It
The Importance of Site Performance and Simple Steps to Achieve ItThe Importance of Site Performance and Simple Steps to Achieve It
The Importance of Site Performance and Simple Steps to Achieve It
 
The challenges of live events scalability
The challenges of live events scalabilityThe challenges of live events scalability
The challenges of live events scalability
 
2 b brychan watkins
2 b brychan watkins2 b brychan watkins
2 b brychan watkins
 
Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...
Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...
Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...
 
Scalable Media Processing in the Cloud (MED302) | AWS re:Invent 2013
Scalable Media Processing in the Cloud (MED302) | AWS re:Invent 2013Scalable Media Processing in the Cloud (MED302) | AWS re:Invent 2013
Scalable Media Processing in the Cloud (MED302) | AWS re:Invent 2013
 
Praxistaugliche notes strategien 4 cloud
Praxistaugliche notes strategien 4 cloudPraxistaugliche notes strategien 4 cloud
Praxistaugliche notes strategien 4 cloud
 
PostgreSQL at 20TB and Beyond
PostgreSQL at 20TB and BeyondPostgreSQL at 20TB and Beyond
PostgreSQL at 20TB and Beyond
 
AWS re:Invent 2013 Scalable Media Processing in the Cloud
AWS re:Invent 2013 Scalable Media Processing in the CloudAWS re:Invent 2013 Scalable Media Processing in the Cloud
AWS re:Invent 2013 Scalable Media Processing in the Cloud
 
Cloud Backup Solutions for Your Church
Cloud Backup Solutions for Your ChurchCloud Backup Solutions for Your Church
Cloud Backup Solutions for Your Church
 
Using commercial Clouds to process IceCube jobs
Using commercial Clouds to process IceCube jobsUsing commercial Clouds to process IceCube jobs
Using commercial Clouds to process IceCube jobs
 
Architectural Tactics for Large Scale Systems
Architectural Tactics for Large Scale SystemsArchitectural Tactics for Large Scale Systems
Architectural Tactics for Large Scale Systems
 
Lugano Tech Talks - Why Docker
Lugano Tech Talks - Why DockerLugano Tech Talks - Why Docker
Lugano Tech Talks - Why Docker
 
High performance Infrastructure Oct 2013
High performance Infrastructure Oct 2013High performance Infrastructure Oct 2013
High performance Infrastructure Oct 2013
 
Addressing Uncertainty How to Model and Solve Energy Optimization Problems
Addressing Uncertainty How to Model and Solve Energy Optimization ProblemsAddressing Uncertainty How to Model and Solve Energy Optimization Problems
Addressing Uncertainty How to Model and Solve Energy Optimization Problems
 

Último

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 

Under the hood daum ucc.20071105

  • 1. Under the Hood - Daum UCC Reach For More Secure And Responsive Architecture
  • 2. 1. The Path of Daum 2. Problems on Mass Network Traffic Environment and Their Solutions 3. Things can Never be forsaken for your own UCC Service 4. Conclusion
  • 3. The Path of Daum
  • 4. 2001 2002 2003 20052001 2002 2003 2005 20072007 1. The Path of Daum •Approx. 1,000 Proprietary Unix Servers •Poor R.O.I, Low Scalability
  • 5. 2001 2002 2003 20052001 2002 2003 2005 20072007 1. The Path of Daum •Decision made •Migrate to Linux based x86 servers. •Adopt Open Source Software
  • 6. 2001 2002 2003 20052001 2002 2003 2005 20072007 1. The Path of Daum •Radical Growth •The Portion Linux based, cheap x86 servers kept Increasing. •The Opening of Scaling out ERA
  • 7. 2001 2002 2003 20052001 2002 2003 2005 20072007 1. The Path of Daum •The quality of x86 servers and open source software were getting better day by day. •Open Source and Linux Boom up •Keep Scaling Out.
  • 8. 2001 2002 2003 20052001 2002 2003 2005 20072007 1. The Path of Daum •Approx. 10,000 Servers, 4 PB of Storages •The Largest of IT Infrastructure in Korea. •DAUM Pioneered UCC World.
  • 9. 1. The Path of Daum UCC service is Growing Fast 2006.4 6360 % 2007.9
  • 10. Problems on Mass Network Traffic Environment And Their Solutions
  • 11. 2. Problems & Solutions Optimizing Cost •What was in our hand The Largest Portion is Network Traffic Network Traffic Cost Cut down Cost by Optimizing Contents Delivery Procedure
  • 12. 2. Problems & Solutions Optimizing Cost •Grasp the characteristic of UCC Service "Let users have their contents as fast as Possible!“ Not always Good. Not all users are play video files till the end If we could restrict download bandwidth to minimum...?
  • 13. 2. Problems & Solutions Optimizing Cost •What we did What we need was a little more than 1Mbps per session. Set max download bandwidth Infinite 5 Mbps Try to use just as much as we need.
  • 14. 2. Problems & Solutions Optimizing Cost •The Result Immediate Response: Network Traffic Reduced 15% We also can cut the cost about 10% a month Before After Decrement Ratio Day 1 24 Gbps 19 Gbps - 15.4 % Day 2 22 Gbps 19 Gbps - 26.1 % Day 3 19 Gbps 16 Gbps - 16.9 %
  • 15. 2. Problems & Solutions Performance Boost on Image Caching •What was in our hand Single request Dozens of images As burden on image servers gets bigger, QoS gets poorer.
  • 16. 2. Problems & Solutions Performance Boost on Image Caching •What we did Enforce Cache Servers more Optimally, That is Hierarchical architecture that scales well Origin Server Primary Cache Secondary Cache
  • 17. 2. Problems & Solutions Performance Boost on Image Caching •The Result Origin Server Workload dropped
  • 18. 2. Problems & Solutions Performance Boost on Image Caching •The Result Response Time improved dramatically Worst: more than 5 seconds Current : Less than 500ms
  • 19. Things can never be forsaken for your own UCC Video Service
  • 20. 3. Things can never be forsaken Origin Data Protection •NO WONDER Whether you do it or let others do it No matter what, You Have to prepare appropriate Protection
  • 21. 3. Things can never be forsaken Architecture represents essence of service •The Long Tail Contents must be transferred through Hot Zone and Cool Zone freely. Decent Architecture is required. Traffic Hot Zone Cool Zone
  • 22. “The Challenge For Reliable and Efficient Service” Makes Daum UCC More Vaulable. 5.Conclusion
  • 23. Thank you. SungKyu Park, Daum Communicaions lointain@daumcorp.com