SlideShare una empresa de Scribd logo
1 de 26
The Future For Scale-Out
                                   Computing



                                                                                     Dennis Ang
                                                                                     Hewlett-Packard
                                                                                     Asia-Pacific Region

                                                                                     Dec 11, 2008



                                                                                      Technology for better business outcomes
© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
Key Topics

•   Drivers of Scale-Out
    Computing
    − HPC Trends
    − Advent Of Cloud Computing

•   The Challenges Of Scale-
    Out Computing
•   HP In Scale-Out Computing




2    15 December 2008
Drivers of Scale-Out Computing




3   15 December 2008
Top Trends in HPC
    HPC hit an all-time high of $11.5 billion in 2007
       19% CAGR in server factory revenue over last 4 years
    X86 and Linux still dominate
          Clusters continue to gain shares across all segments
    Mid- to low-end of the market continue to fuel the growth
    Blades are making in-road to all segments
        Oil/Gas, CAE, DCC and EDA are high growth areas
    New challenges for datacenters:
        Power, cooling, real estate, system management, system
        consolidation
    Storage and data management continue to grow in importance


                       IDC data; market remains hot; growing in strategic importance.


4   15 December 2008
TOP500 Performance Projections

     1 Eflop/s
100 Pflop/s                                             1 Pflop/s
 10 Pflop/s

     1 Pflop/s
100 Tflop/s
  10 Tflop/s           SUM
   1 Tflop/s
                                   6-8 years
100 Gflop/s
                       N=1
 10 Gflop/s
     1 Gflop/s
                           N=500
100 Mflop/s
                 1993 1995 1997    1999 2001 2003 2005 2007 2009 2011 2013 2015




 5      15 December 2008
Some interesting data
    Eight years ago: ASCI White                   Today: one rack full of Bl2x220c
    •#1 on the Top500 in June 2001




    Peak performance: 12,288 Gflop/s       Peak performance: 12,288 Gflop/s
    Weight: 106 Tons (w/ 160 TB storage)   Weight: ~2000 lbs (~1 ton) – 100x lighter
    Power: 3MW                             Power: ~30KW – 100x less power
    Cost: US$110 million                   Cost: ~ US$1M -- more than 100x lower
                                           cost
6      15 December 2008
From rack-mount to blade

                                                    Example
                                                    configuration:
                                                    256-node cluster
                                                    w/ InfiniBand



BladeSystem Advantage
Power:                    up to 30% saving
Floor space:              from 8 racks to 5 racks
Network cables:           up to 78% less


     And excellent manageability!
 7     15 December 2008
HP in the Top500 (Nov’07)

HP BladeSystem                                                  www.top500.org



 @ 28% share
                                  1                                          20
                                  21                                         40
                                  41                                         60
                                  61                                         80

•       From launch in            81
                                  101
                                  121
                                                                            100
                                                                            120
                                                                            140

        June 2006                 141
                                  161
                                  181
                                                                            160
                                                                            180
                                                                            200
                                  201                                       220

•       Most popular              221
                                  241
                                                                            240
                                                                            260
                                  261                                       280
        single platform,          281
                                  301
                                                                            300
                                                                            320

        with 151 entries          321
                                  341
                                  361
                                                                            340
                                                                            360
                                                                            380
                                  381                                       400
                                  401                                       420
                                  421                                       440
FootNote : TOP500 (Nov’ 08)       441                                       460
                                  461                                       480
-209 entries for HP overall       481                                       500

-201 c-Class Blades @ 40% Share
                                        HP c-Class   HP other


    8    15 December 2008
‘EKA’, the world’s 13th fastest supercomputer and #2 in Asia,
delivering 175 Tflops peak performance, used for:
   Advanced modeling and simulation in computational
   sciences
   Cutting edge R&D in HPC, Petascale design
  Cloud computing research
Based on highly scalable, high efficiency HP core technologies
    HP Cluster Platform 3000BL
       1822 HP ProLiant BL460c server blades with 28 terabytes
       memory
       InfiniBand 4X DDR
       HP XC cluster management, HP MPI message passing libraries          EKA in CRL’s Rajiv Gandhi InfoTech
       140 terabytes storage, HP SFS parallel file system                   Park HPC Facility, Hinjewadi, Pune

    HP Smart Cooling data center services
“Computational Research Laboratories (CRL), a wholly-owned company of the Tata Group, India’s largest
conglomerate, used HP blades, cluster OS and technical assistance to design and implement the high
performance, high efficiency system EKA, the 8th fastest supercomputer in the world. HP’s highly scalable
core technologies, such as BladeSystem c-Class server blades and data center cooling services, have
helped CRL design and deploy EKA’s supercomputing infrastructure for cloud computing research with
Yahoo. This is the world's largest system used for research in cloud computing.”
S. Ramadorai, 2008
9
                 Chairman of CRL
     15 15 December 2008
        December
Cloud Computing is Changing the Game
reach
                                                          The
                                                         Cloud

                                        The                        virtualized
                                                                    services
                                        Web

                                                information &
                                                 e-commerce
             The
           Internet
                         connectivity

                                                                             time
                  1970   1980   1990     2000     2005      2010     2020

10   15 December 2008
What do we mean by cloud?
          Service providers                                    Service users

                     The cloud is a means by which certain types of
                      highly scalable and flexible services can be
                       delivered and consumed over the internet
                      through a as-needed, pay-per-use business
                                        model




                                    What’s new?
                 New access:
                                    New capabilities:        New connections:
                everything is a
                                   multi-tenant software   information in context
                   service


 11
11        15-Dec-08
      15 December 2008
Adaptive Infrastructure is the foundation
to all technology-enabled services…
                                                    Business outcomes
                                                    Business outcome

                                               Technology-enabled services




                             Traditional applications              Cloud-based applications



                                                Infrastructure as a service
         Internally hosted
       Externally hosted




                             Infrastructure Utility                   Infrastructure Utility
              Adaptive Infrastructure
                    standardized – optimized –                   Adaptive Infrastructure
                                                                    standardized – optimized –
                                      automated                            automated
                                                                                automated
                    Pooled resources -- shared infrastructure      Pooled resources -- shared infrastructure



 12
12     15-Dec-08
      15 December 2008
Targeting the Convergence of
Massive Scale-Out
                                                                       Emerging business
                                                                       models:
                                                                       Best performance =
           Enterprise/HPC
     •   Engineering &
                                             Massive                   faster time to revenue
                                                                       New metrics:
     •
         Geo-Sciences
         Life & Materials Sciences          Scale-Out                  Best performance
                                                                       per $/watt/sq. ft.
     •   Defense/Security
                                        •   Financial Analytics
     •   Scientific Research
                                        •   Digital Content Creation
                                        •   Streaming Media            Extreme pain points:
                                                                       Data center constraints
          Photo/Video                                                  of power, cooling, space,
            Sharing         Web 2.0
                                                                       manageability & automation
                    •   Internet Commerce                              of dynamic workloads
                    •   Interactive Media
                    •   On-Line Gaming
                                                                       Market Requirements :
                                                                       Optimized supply chain &
                                                                       unique products and services



13       15 December 2008
The Challenges Of Scale-Out Computing




14   15 December 2008
Scale-Out Changes Everything
              Traditional IT                           Scale-Out
                           Single core        Multi-core
                           Single site         Multi-site
                          100s of nodes     1,000s of nodes

                           Proprietary        Commodity

                          HW resiliency      SW resiliency

                         Max performance     Max efficiency

                           Data Marts      Data Super Centers

                            Systems           Grids/Cloud

                              Static            Dynamic
     Cost-Center                                                Revenue-Center
                         Shared storage    Replicated storage

                          Facility costs      Power costs
15    15 December 2008
Scale-Out challenges
 •   Grow the business
      – Scale performance
      – Rapidly integrate new capacity
      – Deploy globally


 •   Physical data center constraints
      – Power
      – Cooling
      – Density


 •   Control IT spend
      – Reduce TCO
      – Reduce software costs
      – Ease of management and automation
      – Vendor reach & reliability



                        Bridge the gap between scale and performance

16   15 December 2008
Data Center Challenges
                                                        •   Datacenters constraining growth
                                                            − Density, power, and cooling demands outpacing
                                                              capacity in many data centers
                                                        •   More energy efficiency needed
                                                            − Increasing energy costs driving focus on
                                                              improving power efficiency
                                                        •   Faster capacity expansion required
                                                            − Companies outgrowing data center capabilities
                                                              and need immediate expansion space
                                                        •   Increased focus on capital expense
 Belady, C., “In the Data Center, Power and
 Cooling Costs More than IT Equipment it
 Supports”, Electronics Cooling Magazine (Feb
                                                            − Pay as you grow enables capex postponement,
 2007)
                                                              and more efficient procurement




17     4/1/2008
       15 December 2008               HP Confidential
HP In Scale-Out Computing




18   15 December 2008
HP Adaptive Infrastructure for Scale-
Out
       Designed for
     massive scale-out
                                                              Automate the
                                                             environment for
                         Dense
                                              Software      dynamic workloads
                         Servers           Infrastructure
                        & Storage

                                Next-Generation
                                 Data Center

                         Data Center       Data Center
     New baselines      Infrastructure      Services
                                                       Provide new business
      for energy,
                                                        models for delivering
      floor space
                                                          technology as a
       & cooling
                                                              service
19   15 December 2008
Recent additions to HP’s Scale-Out
portfolio                                                              Announced
           Announced                                                  July 16, 2008
          May 28, 2008
                                                              Performance Optimized
Proliant BL2x220c                                               Datacenter (POD)
•    Double compute density                                   •   Industry-standard Flexibility
•    Infrastructure costs in half                             •   Best-in-class Density
•    Maximum power & cooling                                  •   Fast & easy deployment
     efficiency
                                                              •   Energy Effectiveness




                                    StorageWorks ExDS9100
                                      Extreme scalability
                                      Unified manageability
                                      Extreme affordability


                                        Announced
                                        May 6, 2008


20    15 December 2008
Double the Compute Power in the
same 20MW Data Center
                                             Expects the 2-in-1 blade
                                             to save ½ a data center

                                  Deliver movies to market faster, faster rendering,
                                  increase creative productivity, take on more
                                  projects at once
                        •   Installed the first order for over 100 TeraFlops of
                            BL2x220c
                        •   Recently deployed 200TF more of BL2x220c due
                            to success of first implementation
                        •   2x the performance - Same amount of power
                            in half the space
                        •   Designed, tested, integrated, shipped and rapidly
                            deployed internationally
21   15 December 2008
HP innovating across the Scale-Out
value chain
                                   Successful Scale-Out
                                      Deployments

     HP process innovation                                             HP technology innovation

     ISV partnerships & joint   applications & development tools
                                                                      HP-MPI, multi-core initiative
          development
                                provisioning, monitoring, resource   proprietary & open source s/w,
     streamline for scale-out           scheduling & mgmt                integrated OS stacks
                                        OS & networking                   integrated OS stacks,
 direct R&D with customers                                                     IB in c-class
                                   rapid & flexible deployment         flexible compute services,
     customized supply chain                                                 cluster platform
                                        energy efficiency            chip to chiller energy portfolio,
         design for TCO                                                       c-class blades
                                data center consulting & services        performance optimized
            EYP MCF                                                            datacenter

                                compute & storage infrastructure     c-class infrastructure, scale-out
 custom engineered nodes                                              optimized compute & storage


22     15 December 2008
The HP-Intel-Yahoo Open Cloud
Computing Research Test Bed
What is it?


     An open, scalable, secure, large scale global test
     bed for cloud computing research and education
        Collaborative research focused on software, data center
        management, hardware issues at a larger scale than
        ever before; as well as support research on cloud
        applications and services
        Scalable, multi-continent, multi-datacenter, cloud
        computing system
        A broad base research community including HP, Intel,
        Yahoo and other partners and academic researchers
23    15 December 2008
Open Cloud Computing Research
Testbed
     Initial 6 “Centers of Excellence” around
     the globe
        Singapore IDA, UIUC, KIT, Intel Lab, Yahoo
        and HP Labs
        Specific research agenda to each region
        external + internal nodes; fluid boundary

     Each center: 1000-4000 cores and few
     PB storage
        base service: PRS (physical resource set)
        required services: EC2, S3, and Hadoop-on-
        demand
        plus additional local
        extensions/variants/service types

24    15 December 2008
HP - The Leader for Scale-Out
Environments
•    Expertise in scale-out
     computing
•    Superior economics
•    Innovative products and
     services to address
     emerging PetaScale &
     Cloud Computing
•    Global research initiative
     and technology
     partnership

25    15 December 2008
26   15 December 2008

Más contenido relacionado

La actualidad más candente

Daily agri-report by epic research 15 feb 2013
Daily agri-report by epic research 15 feb 2013Daily agri-report by epic research 15 feb 2013
Daily agri-report by epic research 15 feb 2013Epic Daily Report
 
Daily agri-report19-march-2013 (1)
Daily agri-report19-march-2013 (1)Daily agri-report19-march-2013 (1)
Daily agri-report19-march-2013 (1)Epic Daily Report
 
Daily agri-report by epic research 13.02.13
Daily agri-report by epic research 13.02.13Daily agri-report by epic research 13.02.13
Daily agri-report by epic research 13.02.13Epic Daily Report
 
Daily agri-report by epic research 31 jan 2013
Daily agri-report by epic research 31 jan 2013Daily agri-report by epic research 31 jan 2013
Daily agri-report by epic research 31 jan 2013Epic Daily Report
 
Daily agri-report by epic research 7 march 2013
Daily agri-report by epic research 7 march 2013Daily agri-report by epic research 7 march 2013
Daily agri-report by epic research 7 march 2013Epic Daily Report
 
DAILY AGRI REPORT BY EPIC RESEARCH- 14 DECEMBER 2012
DAILY AGRI REPORT BY EPIC RESEARCH- 14 DECEMBER 2012DAILY AGRI REPORT BY EPIC RESEARCH- 14 DECEMBER 2012
DAILY AGRI REPORT BY EPIC RESEARCH- 14 DECEMBER 2012Epic Research
 
Daily agri-report by epic research 14 dec 2012
Daily agri-report by epic research 14 dec 2012Daily agri-report by epic research 14 dec 2012
Daily agri-report by epic research 14 dec 2012Epic Daily Report
 
Daily agri-report (5)
Daily agri-report (5)Daily agri-report (5)
Daily agri-report (5)Epic Research
 
DAILY AGRI REPORT BY EPIC RESEARCH- 6 OCTOBER 2012
DAILY AGRI REPORT BY EPIC RESEARCH- 6 OCTOBER 2012DAILY AGRI REPORT BY EPIC RESEARCH- 6 OCTOBER 2012
DAILY AGRI REPORT BY EPIC RESEARCH- 6 OCTOBER 2012Epic Research
 
DAILY AGRI REPORT BY EPIC RESEARCH-19 NOVEMBER 2012
DAILY AGRI REPORT BY EPIC RESEARCH-19 NOVEMBER 2012DAILY AGRI REPORT BY EPIC RESEARCH-19 NOVEMBER 2012
DAILY AGRI REPORT BY EPIC RESEARCH-19 NOVEMBER 2012Epic Research Limited
 

La actualidad más candente (12)

Daily agri-report by epic research 15 feb 2013
Daily agri-report by epic research 15 feb 2013Daily agri-report by epic research 15 feb 2013
Daily agri-report by epic research 15 feb 2013
 
Daily agri-report19-march-2013 (1)
Daily agri-report19-march-2013 (1)Daily agri-report19-march-2013 (1)
Daily agri-report19-march-2013 (1)
 
Daily agri-report by epic research 13.02.13
Daily agri-report by epic research 13.02.13Daily agri-report by epic research 13.02.13
Daily agri-report by epic research 13.02.13
 
Daily agri-report by epic research 31 jan 2013
Daily agri-report by epic research 31 jan 2013Daily agri-report by epic research 31 jan 2013
Daily agri-report by epic research 31 jan 2013
 
Daily agri-report by epic research 7 march 2013
Daily agri-report by epic research 7 march 2013Daily agri-report by epic research 7 march 2013
Daily agri-report by epic research 7 march 2013
 
DAILY AGRI REPORT BY EPIC RESEARCH- 14 DECEMBER 2012
DAILY AGRI REPORT BY EPIC RESEARCH- 14 DECEMBER 2012DAILY AGRI REPORT BY EPIC RESEARCH- 14 DECEMBER 2012
DAILY AGRI REPORT BY EPIC RESEARCH- 14 DECEMBER 2012
 
Daily agri-report by epic research 14 dec 2012
Daily agri-report by epic research 14 dec 2012Daily agri-report by epic research 14 dec 2012
Daily agri-report by epic research 14 dec 2012
 
Hotel Tower Project . Emre Ergin
Hotel Tower Project . Emre ErginHotel Tower Project . Emre Ergin
Hotel Tower Project . Emre Ergin
 
Daily agri-report (5)
Daily agri-report (5)Daily agri-report (5)
Daily agri-report (5)
 
Daily agri-report
Daily agri-reportDaily agri-report
Daily agri-report
 
DAILY AGRI REPORT BY EPIC RESEARCH- 6 OCTOBER 2012
DAILY AGRI REPORT BY EPIC RESEARCH- 6 OCTOBER 2012DAILY AGRI REPORT BY EPIC RESEARCH- 6 OCTOBER 2012
DAILY AGRI REPORT BY EPIC RESEARCH- 6 OCTOBER 2012
 
DAILY AGRI REPORT BY EPIC RESEARCH-19 NOVEMBER 2012
DAILY AGRI REPORT BY EPIC RESEARCH-19 NOVEMBER 2012DAILY AGRI REPORT BY EPIC RESEARCH-19 NOVEMBER 2012
DAILY AGRI REPORT BY EPIC RESEARCH-19 NOVEMBER 2012
 

Destacado

Sharding
ShardingSharding
ShardingMongoDB
 
Ultra-scale e-Commerce Transaction Services with Lean Middleware
Ultra-scale e-Commerce Transaction Services with Lean Middleware Ultra-scale e-Commerce Transaction Services with Lean Middleware
Ultra-scale e-Commerce Transaction Services with Lean Middleware WSO2
 
Cloud Computing Design Best Practices
Cloud Computing Design Best PracticesCloud Computing Design Best Practices
Cloud Computing Design Best PracticesMoshe Kaplan
 
Openstack architure part 1
Openstack architure part 1Openstack architure part 1
Openstack architure part 1Nhan Cao Thanh
 
Middleware as a Service - How the cloud is shaping next generation middleware
Middleware as a Service - How the cloud is shaping next generation middlewareMiddleware as a Service - How the cloud is shaping next generation middleware
Middleware as a Service - How the cloud is shaping next generation middlewareSkills Matter
 
Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...
Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...
Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...Odinot Stanislas
 
Database Sharding At Netlog
Database Sharding At NetlogDatabase Sharding At Netlog
Database Sharding At NetlogJurriaan Persyn
 
How to scale relational (OLTP) databases. Think: Sharding @C16LV
How to scale relational (OLTP) databases. Think: Sharding @C16LVHow to scale relational (OLTP) databases. Think: Sharding @C16LV
How to scale relational (OLTP) databases. Think: Sharding @C16LVMaxym Kharchenko
 
Architecturesfor massive parallel data base clustersproviding linear scale ou...
Architecturesfor massive parallel data base clustersproviding linear scale ou...Architecturesfor massive parallel data base clustersproviding linear scale ou...
Architecturesfor massive parallel data base clustersproviding linear scale ou...Romeo Kienzler
 
Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...
Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...
Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...VoltDB
 
Caching, sharding, distributing - Scaling best practices
Caching, sharding, distributing - Scaling best practicesCaching, sharding, distributing - Scaling best practices
Caching, sharding, distributing - Scaling best practicesLars Jankowfsky
 
Scaling Out Tier Based Applications
Scaling Out Tier Based ApplicationsScaling Out Tier Based Applications
Scaling Out Tier Based ApplicationsYury Kaliaha
 
Red Hat Forum Tokyo - OpenStack Architecture Design
Red Hat Forum Tokyo - OpenStack Architecture DesignRed Hat Forum Tokyo - OpenStack Architecture Design
Red Hat Forum Tokyo - OpenStack Architecture DesignDan Radez
 
Research and technology explosion in scale-out storage
Research and technology explosion in scale-out storageResearch and technology explosion in scale-out storage
Research and technology explosion in scale-out storageJeff Spencer
 
Distributed RDBMS: Data Distribution Policy: Part 1 - What is a Data Distribu...
Distributed RDBMS: Data Distribution Policy: Part 1 - What is a Data Distribu...Distributed RDBMS: Data Distribution Policy: Part 1 - What is a Data Distribu...
Distributed RDBMS: Data Distribution Policy: Part 1 - What is a Data Distribu...ScaleBase
 
HAProxy scale out using open source
HAProxy scale out using open sourceHAProxy scale out using open source
HAProxy scale out using open sourceIngo Walz
 
Beyond Aurora. Scale-out SQL databases for AWS
Beyond Aurora. Scale-out SQL databases for AWS Beyond Aurora. Scale-out SQL databases for AWS
Beyond Aurora. Scale-out SQL databases for AWS Clustrix
 
OpenStack Scale-out Networking Architecture
OpenStack Scale-out Networking ArchitectureOpenStack Scale-out Networking Architecture
OpenStack Scale-out Networking ArchitectureRandy Bias
 

Destacado (20)

Sharding
ShardingSharding
Sharding
 
Distributed Middleware Factory
Distributed Middleware FactoryDistributed Middleware Factory
Distributed Middleware Factory
 
Top 10 Ways to Mess Up Your Distributed System
Top 10 Ways to Mess Up Your Distributed SystemTop 10 Ways to Mess Up Your Distributed System
Top 10 Ways to Mess Up Your Distributed System
 
Ultra-scale e-Commerce Transaction Services with Lean Middleware
Ultra-scale e-Commerce Transaction Services with Lean Middleware Ultra-scale e-Commerce Transaction Services with Lean Middleware
Ultra-scale e-Commerce Transaction Services with Lean Middleware
 
Cloud Computing Design Best Practices
Cloud Computing Design Best PracticesCloud Computing Design Best Practices
Cloud Computing Design Best Practices
 
Openstack architure part 1
Openstack architure part 1Openstack architure part 1
Openstack architure part 1
 
Middleware as a Service - How the cloud is shaping next generation middleware
Middleware as a Service - How the cloud is shaping next generation middlewareMiddleware as a Service - How the cloud is shaping next generation middleware
Middleware as a Service - How the cloud is shaping next generation middleware
 
Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...
Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...
Scale-out Storage on Intel® Architecture Based Platforms: Characterizing and ...
 
Database Sharding At Netlog
Database Sharding At NetlogDatabase Sharding At Netlog
Database Sharding At Netlog
 
How to scale relational (OLTP) databases. Think: Sharding @C16LV
How to scale relational (OLTP) databases. Think: Sharding @C16LVHow to scale relational (OLTP) databases. Think: Sharding @C16LV
How to scale relational (OLTP) databases. Think: Sharding @C16LV
 
Architecturesfor massive parallel data base clustersproviding linear scale ou...
Architecturesfor massive parallel data base clustersproviding linear scale ou...Architecturesfor massive parallel data base clustersproviding linear scale ou...
Architecturesfor massive parallel data base clustersproviding linear scale ou...
 
Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...
Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...
Kyle Kingsbury Talks about the Jepsen Test: What VoltDB Learned About Data Ac...
 
Caching, sharding, distributing - Scaling best practices
Caching, sharding, distributing - Scaling best practicesCaching, sharding, distributing - Scaling best practices
Caching, sharding, distributing - Scaling best practices
 
Scaling Out Tier Based Applications
Scaling Out Tier Based ApplicationsScaling Out Tier Based Applications
Scaling Out Tier Based Applications
 
Red Hat Forum Tokyo - OpenStack Architecture Design
Red Hat Forum Tokyo - OpenStack Architecture DesignRed Hat Forum Tokyo - OpenStack Architecture Design
Red Hat Forum Tokyo - OpenStack Architecture Design
 
Research and technology explosion in scale-out storage
Research and technology explosion in scale-out storageResearch and technology explosion in scale-out storage
Research and technology explosion in scale-out storage
 
Distributed RDBMS: Data Distribution Policy: Part 1 - What is a Data Distribu...
Distributed RDBMS: Data Distribution Policy: Part 1 - What is a Data Distribu...Distributed RDBMS: Data Distribution Policy: Part 1 - What is a Data Distribu...
Distributed RDBMS: Data Distribution Policy: Part 1 - What is a Data Distribu...
 
HAProxy scale out using open source
HAProxy scale out using open sourceHAProxy scale out using open source
HAProxy scale out using open source
 
Beyond Aurora. Scale-out SQL databases for AWS
Beyond Aurora. Scale-out SQL databases for AWS Beyond Aurora. Scale-out SQL databases for AWS
Beyond Aurora. Scale-out SQL databases for AWS
 
OpenStack Scale-out Networking Architecture
OpenStack Scale-out Networking ArchitectureOpenStack Scale-out Networking Architecture
OpenStack Scale-out Networking Architecture
 

Último

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 

Último (20)

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 

Hp - The Future For Scale Out Computing

  • 1. The Future For Scale-Out Computing Dennis Ang Hewlett-Packard Asia-Pacific Region Dec 11, 2008 Technology for better business outcomes © 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
  • 2. Key Topics • Drivers of Scale-Out Computing − HPC Trends − Advent Of Cloud Computing • The Challenges Of Scale- Out Computing • HP In Scale-Out Computing 2 15 December 2008
  • 3. Drivers of Scale-Out Computing 3 15 December 2008
  • 4. Top Trends in HPC HPC hit an all-time high of $11.5 billion in 2007 19% CAGR in server factory revenue over last 4 years X86 and Linux still dominate Clusters continue to gain shares across all segments Mid- to low-end of the market continue to fuel the growth Blades are making in-road to all segments Oil/Gas, CAE, DCC and EDA are high growth areas New challenges for datacenters: Power, cooling, real estate, system management, system consolidation Storage and data management continue to grow in importance IDC data; market remains hot; growing in strategic importance. 4 15 December 2008
  • 5. TOP500 Performance Projections 1 Eflop/s 100 Pflop/s 1 Pflop/s 10 Pflop/s 1 Pflop/s 100 Tflop/s 10 Tflop/s SUM 1 Tflop/s 6-8 years 100 Gflop/s N=1 10 Gflop/s 1 Gflop/s N=500 100 Mflop/s 1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 2013 2015 5 15 December 2008
  • 6. Some interesting data Eight years ago: ASCI White Today: one rack full of Bl2x220c •#1 on the Top500 in June 2001 Peak performance: 12,288 Gflop/s Peak performance: 12,288 Gflop/s Weight: 106 Tons (w/ 160 TB storage) Weight: ~2000 lbs (~1 ton) – 100x lighter Power: 3MW Power: ~30KW – 100x less power Cost: US$110 million Cost: ~ US$1M -- more than 100x lower cost 6 15 December 2008
  • 7. From rack-mount to blade Example configuration: 256-node cluster w/ InfiniBand BladeSystem Advantage Power: up to 30% saving Floor space: from 8 racks to 5 racks Network cables: up to 78% less And excellent manageability! 7 15 December 2008
  • 8. HP in the Top500 (Nov’07) HP BladeSystem www.top500.org @ 28% share 1 20 21 40 41 60 61 80 • From launch in 81 101 121 100 120 140 June 2006 141 161 181 160 180 200 201 220 • Most popular 221 241 240 260 261 280 single platform, 281 301 300 320 with 151 entries 321 341 361 340 360 380 381 400 401 420 421 440 FootNote : TOP500 (Nov’ 08) 441 460 461 480 -209 entries for HP overall 481 500 -201 c-Class Blades @ 40% Share HP c-Class HP other 8 15 December 2008
  • 9. ‘EKA’, the world’s 13th fastest supercomputer and #2 in Asia, delivering 175 Tflops peak performance, used for: Advanced modeling and simulation in computational sciences Cutting edge R&D in HPC, Petascale design Cloud computing research Based on highly scalable, high efficiency HP core technologies HP Cluster Platform 3000BL 1822 HP ProLiant BL460c server blades with 28 terabytes memory InfiniBand 4X DDR HP XC cluster management, HP MPI message passing libraries EKA in CRL’s Rajiv Gandhi InfoTech 140 terabytes storage, HP SFS parallel file system Park HPC Facility, Hinjewadi, Pune HP Smart Cooling data center services “Computational Research Laboratories (CRL), a wholly-owned company of the Tata Group, India’s largest conglomerate, used HP blades, cluster OS and technical assistance to design and implement the high performance, high efficiency system EKA, the 8th fastest supercomputer in the world. HP’s highly scalable core technologies, such as BladeSystem c-Class server blades and data center cooling services, have helped CRL design and deploy EKA’s supercomputing infrastructure for cloud computing research with Yahoo. This is the world's largest system used for research in cloud computing.” S. Ramadorai, 2008 9 Chairman of CRL 15 15 December 2008 December
  • 10. Cloud Computing is Changing the Game reach The Cloud The virtualized services Web information & e-commerce The Internet connectivity time 1970 1980 1990 2000 2005 2010 2020 10 15 December 2008
  • 11. What do we mean by cloud? Service providers Service users The cloud is a means by which certain types of highly scalable and flexible services can be delivered and consumed over the internet through a as-needed, pay-per-use business model What’s new? New access: New capabilities: New connections: everything is a multi-tenant software information in context service 11 11 15-Dec-08 15 December 2008
  • 12. Adaptive Infrastructure is the foundation to all technology-enabled services… Business outcomes Business outcome Technology-enabled services Traditional applications Cloud-based applications Infrastructure as a service Internally hosted Externally hosted Infrastructure Utility Infrastructure Utility Adaptive Infrastructure standardized – optimized – Adaptive Infrastructure standardized – optimized – automated automated automated Pooled resources -- shared infrastructure Pooled resources -- shared infrastructure 12 12 15-Dec-08 15 December 2008
  • 13. Targeting the Convergence of Massive Scale-Out Emerging business models: Best performance = Enterprise/HPC • Engineering & Massive faster time to revenue New metrics: • Geo-Sciences Life & Materials Sciences Scale-Out Best performance per $/watt/sq. ft. • Defense/Security • Financial Analytics • Scientific Research • Digital Content Creation • Streaming Media Extreme pain points: Data center constraints Photo/Video of power, cooling, space, Sharing Web 2.0 manageability & automation • Internet Commerce of dynamic workloads • Interactive Media • On-Line Gaming Market Requirements : Optimized supply chain & unique products and services 13 15 December 2008
  • 14. The Challenges Of Scale-Out Computing 14 15 December 2008
  • 15. Scale-Out Changes Everything Traditional IT Scale-Out Single core Multi-core Single site Multi-site 100s of nodes 1,000s of nodes Proprietary Commodity HW resiliency SW resiliency Max performance Max efficiency Data Marts Data Super Centers Systems Grids/Cloud Static Dynamic Cost-Center Revenue-Center Shared storage Replicated storage Facility costs Power costs 15 15 December 2008
  • 16. Scale-Out challenges • Grow the business – Scale performance – Rapidly integrate new capacity – Deploy globally • Physical data center constraints – Power – Cooling – Density • Control IT spend – Reduce TCO – Reduce software costs – Ease of management and automation – Vendor reach & reliability Bridge the gap between scale and performance 16 15 December 2008
  • 17. Data Center Challenges • Datacenters constraining growth − Density, power, and cooling demands outpacing capacity in many data centers • More energy efficiency needed − Increasing energy costs driving focus on improving power efficiency • Faster capacity expansion required − Companies outgrowing data center capabilities and need immediate expansion space • Increased focus on capital expense Belady, C., “In the Data Center, Power and Cooling Costs More than IT Equipment it Supports”, Electronics Cooling Magazine (Feb − Pay as you grow enables capex postponement, 2007) and more efficient procurement 17 4/1/2008 15 December 2008 HP Confidential
  • 18. HP In Scale-Out Computing 18 15 December 2008
  • 19. HP Adaptive Infrastructure for Scale- Out Designed for massive scale-out Automate the environment for Dense Software dynamic workloads Servers Infrastructure & Storage Next-Generation Data Center Data Center Data Center New baselines Infrastructure Services Provide new business for energy, models for delivering floor space technology as a & cooling service 19 15 December 2008
  • 20. Recent additions to HP’s Scale-Out portfolio Announced Announced July 16, 2008 May 28, 2008 Performance Optimized Proliant BL2x220c Datacenter (POD) • Double compute density • Industry-standard Flexibility • Infrastructure costs in half • Best-in-class Density • Maximum power & cooling • Fast & easy deployment efficiency • Energy Effectiveness StorageWorks ExDS9100 Extreme scalability Unified manageability Extreme affordability Announced May 6, 2008 20 15 December 2008
  • 21. Double the Compute Power in the same 20MW Data Center Expects the 2-in-1 blade to save ½ a data center Deliver movies to market faster, faster rendering, increase creative productivity, take on more projects at once • Installed the first order for over 100 TeraFlops of BL2x220c • Recently deployed 200TF more of BL2x220c due to success of first implementation • 2x the performance - Same amount of power in half the space • Designed, tested, integrated, shipped and rapidly deployed internationally 21 15 December 2008
  • 22. HP innovating across the Scale-Out value chain Successful Scale-Out Deployments HP process innovation HP technology innovation ISV partnerships & joint applications & development tools HP-MPI, multi-core initiative development provisioning, monitoring, resource proprietary & open source s/w, streamline for scale-out scheduling & mgmt integrated OS stacks OS & networking integrated OS stacks, direct R&D with customers IB in c-class rapid & flexible deployment flexible compute services, customized supply chain cluster platform energy efficiency chip to chiller energy portfolio, design for TCO c-class blades data center consulting & services performance optimized EYP MCF datacenter compute & storage infrastructure c-class infrastructure, scale-out custom engineered nodes optimized compute & storage 22 15 December 2008
  • 23. The HP-Intel-Yahoo Open Cloud Computing Research Test Bed What is it? An open, scalable, secure, large scale global test bed for cloud computing research and education Collaborative research focused on software, data center management, hardware issues at a larger scale than ever before; as well as support research on cloud applications and services Scalable, multi-continent, multi-datacenter, cloud computing system A broad base research community including HP, Intel, Yahoo and other partners and academic researchers 23 15 December 2008
  • 24. Open Cloud Computing Research Testbed Initial 6 “Centers of Excellence” around the globe Singapore IDA, UIUC, KIT, Intel Lab, Yahoo and HP Labs Specific research agenda to each region external + internal nodes; fluid boundary Each center: 1000-4000 cores and few PB storage base service: PRS (physical resource set) required services: EC2, S3, and Hadoop-on- demand plus additional local extensions/variants/service types 24 15 December 2008
  • 25. HP - The Leader for Scale-Out Environments • Expertise in scale-out computing • Superior economics • Innovative products and services to address emerging PetaScale & Cloud Computing • Global research initiative and technology partnership 25 15 December 2008
  • 26. 26 15 December 2008