Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Scalability and Availability - Without Compromise
1. SCALABILITY AND
AVAILABILITY
- WITHOUT COMPROMISE
BJORN ANDERSSON, HITACHI DATA SYSTEMS
SUPERCOMPUTING 2012, SALT LAKE CITY
1
2. SCALABILITY AND AVAILABILITY
- THE CHALLENGES
SCALABILITY AND AVAILABILITY – OPPOSING FORCES?
Scale-up and Scale-out
‒ Different applications require different approaches
Going beyond physics of single system or small cluster…
‒ More complexity (hundreds to many thousands of parts)
‒ More vulnerability (things break, bad things happen)
You need to architect for it from the start
‒ Higher quality sub systems for higher reliability
‒ Design for resiliency and high availability
‒ Use the right technology in the right place
‒ How does a technology refresh impact availability?
Copyright Hitachi Data Systems, 2012
3. HOW DO YOU MANAGE THIS?
Common Subsystems
‒ Easy as long as each subsystem behave the same
‒ But, locks you in with a set of technologies or vendors
Virtualization
‒ Removes dependencies and enable high availability
‒ Trade-off based on value of availability
Applications Applications … Applications
…
Virtualization layer
OS & SW Services OS & SW Services OS & SW Services
…
Virtualization and Aggregation layer
Network Network Network
…
Virtualization and Aggregation layer
Storage Storage Storage
…
Virtualization and Aggregation layer
CPU CPU CPU
SCALE and TECHNOLOGY SHIFTS
SCALE
Copyright Hitachi Data Systems, 2012
4. BIG DATA IS ESCALATING THE NEED FOR
CONCURRENT SCALABILITY AND AVAILABILITY
ALL DATA TYPES MACHINE DRIVEN
HUMAN DRIVEN
SATELLITE
IMAGES
EMAIL
BUSINESS DRIVEN SENSORS
DATA
BIG DATA BIG DATA
DOCUMENTS LANDSCAPE
TODAY TOMORROW BIO-
EVOLUTION
INFORMATICS
OLTP
WEB LOGS
M2M LOG
FILES
SOCIAL
VIDEO
AUDIO
1X 10X 100X
COMPANIES MUST MANAGE, GOVERN AND ANALYZE MORE DATA
WITH MORE COMPLEX RELATIONSHIPS…IN REAL TIME…AT SCALE
Copyright Hitachi Data Systems, 2012
5. WHO IS HITACHI?
HITACHI, LTD. – ORGANIZATION
ELEVEN INDUSTRY SEGMENTS
GROUP REVENUE BY INDUSTRY SEGMENT
Others Information and
Telecommunication
Systems
Financial
Services
7%
4%
9%
17%
Digital Media and 8% Power
Consumer 8%
7%
$112B 11%
Systems
Products
13% 9%
7% Social Infrastructure
Component and Industrial
and Devices Systems
Automotive Electronic Systems
Systems and Equipment
High-Functional Construction
Materials and Machinery
Components
Copyright Hitachi Data Systems, 2012
6. HITACHI ENTERPRISE CLASS HERITAGE
A 50+ YEAR HERITAGE
OF LEADERSHIP IN THE
ENTERPRISE CLASS
COMPUTE MARKET.
R&D innovation and
leadership
‒ A big user of HPC
‒ Key HPC player in Japan,
expanding globally
Quality and Reliability
Service and Support
(*1957: HIPAC-MK1 – Hitachi’s first digital computer)
Copyright Hitachi Data Systems, 2012
7. OUR PORTFOLIO IS YOUR FOUNDATION
DELIVERY
DATA CENTER | CLOUD
MANAGEMENT SOFTWARE
INTELLIGENT File and content storage
ACCESS Indexing and search
FILE | CONTENT | SEARCH Intelligent object management
FOUNDATION
Integrated components
CONVERGED include Hitachi servers
INFRASTRUCTURE Fast time to value
STORAGE | COMPUTE | NETWORK
Predictable, reliable results
STORAGE Reliability and performance
INFRASTRUCTURE Sustainability
ENTERPRISE | MIDRANGE Superior economics
Copyright Hitachi Data Systems, 2012
9. INTEGRATED SCALABLE PORTFOLIO
UNIFIED MANAGEMENT ACROSS ALL STORAGE SYSTEMS
Hitachi Unified
Hitachi Unified Hitachi Virtual
Storage 100 Storage VM Storage Platform
Midrange Entry-Level Enterprise Enterprise
Copyright Hitachi Data Systems, 2012
10. THE NEXT GENERATION OF UNIFIED STORAGE
HITACHI UNIFIED STORAGE VM
No more compromises HIGHEST
PERFORMANCE
High performance for wide range
of demanding applications
LOWEST
High, dynamic scalability with OPERATING COST
multiple storage technologies
Enterprise class high availability c HIGHEST
SCALABILITY
Tiering and virtualization for both
block and file based storage
MOST
EFFICIENT
Simplified operation and easy
migration
EASIEST
Best functionality for the best MIGRATION
value
Copyright Hitachi Data Systems, 2012
11. HARDWARE-ACCELERATED FILE SERVER
DELIVERS THE HIGHEST IOPS AND MOST SCALABILITY
Hardware File
Line Rate Speed System
IOPS Performance
Advantage
Software File
System
Number of Clients or Features
Linear IOPS performance increases with hardware- accelerated file
system per node
Highest-capacity scalability, with up to 16PB in a single NFS namespace
Benefits: Fewer file server nodes, more users, simpler management
Copyright Hitachi Data Systems, 2012
12. HITACHI COMPUTE PORTFOLIO
High availability, performance and
HIGH-END scalability for the enterprise
BLADE Optimized for virtualization, maximizing
utilization in the data center
CB 2000
CB 500 Highly dense chassis design optimized
MIDRANGE for virtualization and consolidation
BLADES Compact and flexible with a variety of
CB 320
blade and connectivity options
Compact and flexible application
RACK-OPTIMI server platform
ZED Available in Hitachi file and content
CR 220 solutions
Copyright Hitachi Data Systems, 2012
13. HITACHI COMPUTE: HIGH END BLADES
Innovative blade design offers
HITACHI COMPUTE BLADE 2000
performance & scalability
“Hybrid” I/O design supports a
diverse range of application
workloads
Hardware based LPAR logical
partitioning maximizes utilization
and efficiency without
compromising security or
performance
Multi-blade SMP feature allows a
system image to scale beyond a
single blade (up to four blades) for
application headroom and
investment protection
Copyright Hitachi Data Systems, 2012
14. HITACHI COMPUTE: MIDRANGE BLADES
New Midrange Blade Chassis
HITACHI COMPUTE BLADE 500
6 RU Height
8 Standard Blades, or 4
Double-wide Blades
‒ Blade types may be mixed
Compute density between
CB 2000 and CB 320
Introduces new technologies:
‒ New Intel Processor
Architecture
‒ 10GigE native ports, CNA
cards
Virtualization and RAS
features
Customer Replaceable Units
(CRUs)
Copyright Hitachi Data Systems, 2012
15. UNIFIED COMPUTE PLATFORM FAMILY PORTFOLIO
Hitachi Hitachi
UCP Pro UCP Select
Hypervisor
Server
Network
Storage
Copyright Hitachi Data Systems, 2012
16. HITACHI DATA SYSTEMS HIGH-THROUGHPUT
STORAGE SOLUTION WITH LUSTRE
SINGLE-RACK CONFIGURATION SOLUTION FRAMEWORK
1RU x86 Rack Server
(Running Intel Chroma and
Hitachi Command Suite)
Second High-Availability Object Network Switch
Storage Server (OSS) Pair
MDS BUILDING BLOCK
1RU x86 1RU x86
Rack Server Rack Server
Management and Network
HUS 110
High-Availability Metadata (Internal Disk)
Server (MDS) Cluster
OSS BUILDING BLOCK
First High-Availability Object 2RU x86 2RU x86
Rack Server Rack Server
Storage Server (OSS) Pair
HUS 150
5RU 5RU
84-Disk Tray 84-Disk Tray
12GB/sec target performance, 720TB usable capacity (1PB raw)
Copyright Hitachi Data Systems, 2012
17. HDS HIGH-THROUGHPUT SOLUTION WITH LUSTRE
COMPLEMENTS HNAS FOR THE MOST CAPABLE FILE STORAGE OFFERING
Combines HDS high availability with Lustre scalability
Easy design and deployment with pre-architected building blocks
Simplified management with included management tools
Streamlined vendor management with single infrastructure vendor
Global presence and support
Hitachi NAS Platform, powered by HDS High-Throughput
BlueArc® (HNAS) High-Performance NAS Solution with Lustre
Scalability
Functionality
Copyright Hitachi Data Systems, 2012
18. THANK YOU!
bjorn.andersson@hds.com
See us also in booth #1331
Copyright Hitachi Data Systems, 2012
Notas del editor
Hello, I’m Bjorn Andersson with Hitachi Data SystemsThank you Intel for inviting me, we have a great partnerships where we use Intel technology in many of our products and solutions, storage and serversMy talk today will primarily focus on Production HPC environmentsWe typically sell to customers who care about uptime and availability as well as scalability. They are often commercial enterprises or a larger user community depends on their services being availableI only have limited time today so I can only give you a glimpse into what we’re doing, I invite you to discuss with me afterwards or visit our booth for a deeper discussion
The title of my talk is about Scalability and Availability – which if you think about it may seem like a challenge/contradictionTwo options for scaling, bigger more capable building blocks or many of lesser building blocksWe have hardware accelerated NAS systems and large memory blade systems with 1.5TB, so we can do scale-up alsoAt some point you have to go beyond the capabilities of a single system or small cluster though and then you’re definitely into scale-outScale-out can potentially mean more complexity and with that more vulnerabilityArchitect for scalability with availability (and manageability) from the startLook at your applications and use the right technologyPlan forward for technology refreshesWe have a broad portfolio, including systems we sell to banks and other environments where high availability is a must
Life ismore complexNeed to virtualizeData or services unavailable = zero performanceProduction environments how much do you value availability?This is the kind of thinking that is driving us to provide highly available solutions that also scales very well
Another are that is putting even more emphasis on the issue of scalability and availability is big data.Again, we’re looking at production environmentsWe see it evolving in phases where we move from data generated, stored and processed in business systems to data generated by humans and more and more by machines or sensors and this is where the real data volumes are coming in and need to be analyzed.Hitachi is a very broad organization and we’re both a user, a generator and solution provider in this space
Hitachi’s fiscal year runs from April to March.Total FY10 revenue: $112B (17% Y/Y growth)20% of overall R&D investment is in Information Systems and Telecommunications segmentsFY09: $96BFY08: $102BFY07: $112.2B FY06: $87BAny investment made in information technology, whether it’s networking, telecommunications, enterprise servers, super computers, storage systems, other storage solutions, etc., Hitachi Data Systems utilizes cross-pollination to reap the benefits of that investment and leverages it for the development of other products.Taking a look now at the composition of Hitachi, Ltd’s business and the vertical markets it competes in. Hitachi, Ltd. has 11 distinct business segments, which comprise the over 20,000-strong product portfolio. Comprising about 17% of total sales for last fiscal year is the Information Systems and Telecommunications Group. This is the most strategic business segment for Hitachi, and many times, the most profitable as well. This comprises storage systems, storage consulting services, super computers, telecommunications equipment, gigabit Ethernet routers, SONET switches, enterprise blade servers, which are now being sold in North America, Korea, as well as Japan and other geographies. Basically, all information systems in telecommunications, IT and networking all unified in one group spanning servers, networking and storage. Powerful unification amongst these three facilitates great cross-pollination efforts. NOTE: HGST is included in Component & Devices segment, not Information & Telecommunication Systems.Power Industrial Systems and Social Infrastructure & Industrial Systems are very profitable business segment for Hitachi, Ltd. This comprises everything ranging from Shinkansen Bullet Trains (the trains in Tokyo and other regions of the world that can go in excess of 150 to 160 miles-per-hour), thermonuclear fusion reactors; heavy earth-moving equipment; various turbines that are being made in conjunction with General Electric; and so forth. If your customer is interested in earth moving equipment, Hitachi produces bulldozers and cranes and other earth-moving equipments. (Note Caterpillar competes with Hitachi).There is also the financial services business segment comprised of various capital and leasing corporations, within Hitachi Ltd., which constitutes about 4% of overall total sales. The Electronic Systems and Equipment segment covers primarily semiconductor manufacturing equipment contributed to 9% of overall revenues. Hitachi, Ltd. has its own semiconductor fabrication operation which provides a distinct advantage over competitors. While many competitors rely upon third-parties for semiconductor chip manufacturing, we have our own fabrication plants, which gives us a powerful story from a vertical integration perspective.High Functional Materials & Components and Automotive Systems are a rather interesting group with tremendous industry expertise not many people are aware of. For one, Hitachi, Ltd. is a key supplier to automotive companies such as Honda, Toyota, Mazda, and General Motors. Case in point, Toyota recently turned to Hitachi, Ltd. for hybrid motors for its Lexus RX 400H hybrid.The turbo chargers in the Mazda Miata; the hoses and rubber materials in many of the Nissan cars leverage manufacturing innovations from Hitachi, Ltd. Another example, Hitachi, Ltd. owns a subsidiary called the Xanavi (Spelled x-a-n-a-v-i) which is a leading provider of navigation systems for automobiles. In fact, if you go to your local Infinity or Nissan dealer, all the navigation systems in those vehicles are from Xanavi, owned by Hitachi.
In 1957 Hitachi developed it’s first digital computer HIPAC-MK-1In 1964 – The same year IBM announced the S/360 - Hitachi introduced the HITAC 5020 – The first large general purpose computer in JapanHITAC 8000 followed in 1965, with HITAC 8100 for small business.1967 HITAC 8210 – First medium scale general purpose compute using integrated circuits1979 – M200 – World’s fastest large general purpose computerSource: IPSJ Computer Museum: http://museum.ipsj.or.jp/en/computer/main/index.html
We have a broad portfolio addressing both traditional data center environments and functionality that we put under the Cloud umbrella, Infrastructure cloud, content cloud, information cloudA layer above the infrastructure, sits a family of offerings aimed to provide intelligent access to business content and information. These software-based products provide management, protection, archiving and searching of your files, objects and information across the complete lifecycle.
As well look at the HDS portfolio, The new HUS products will be establishing a new category of unified storage. We will continue to sell our AMS2000 and VSP as our midrange and enterprise block storage offerings. Over time, the block only configurations of HUS will replace the AMS2000. The HNAS product line will continue to be our file only line. Dedicated content storage can be delivered by HCP. This is a very good solution for cloud infrastructure and/or archiving. HDI is our data ingestor that is capable of moving data from the edge to the core where it can be better protected.By the 2nd half of 2012, all of these platforms will be managed by Command Suite. 7 years ago Hitachi announced a vision of a common management platform that will enable one platform for all data. The administrative efficiencies of this approach provides a lot of cost savings to our customers.
Within our integrated, scalable storage portfolio, this new platform fills the gap between enterprise and midrangeIt will be positioned as a new, entry level enterprise storage platformIt is a unified extension to our new family of HUS products and bridges the gap to our VSP enterprise systemIt is complemented by the rest of the portfolio of NAS, HCP, HDIAnd unified management across the line creating a comprehensive architecture for all data
To summarize what HUS VM gives our customersThe bottom line is that with HUS VM they don't need to compromise between functionality and performance. They get higher performance than the HUS 100 family and competitors. They get entry level enterprise class features for their technical apps, which is what they want. They get the flexibility of virtualizing and tiering on both the file and block level. They get high scalability to support the data growth and in addition they get the unified management across that will save them on operational costs.
Hardware accelerated file system functionsNo performance drop off during peak load timesBoth IOPS and throughput with standard file systems like NFSHighly efficient
Overview, from rackmount to high end blades, using Intel arhcitecture