Data Warehousing: What's Available on System z Today

Total Solution Event for System z: Brussels 2010

Session IM03:
Data Warehousing:
What's Available on System z Today

Willie Favero – Data Warehouse on System z Swat Team (DB2 SME)
09 September 2010
© 2010 IBM Corporation

Notices
This information was developed for products and services offered in the U.S.A.

Note to U.S. Government Users Restricted Rights — Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products
and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product,
program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used
instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service.
IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to
these patents. You can send license inquiries, in writing, to: IBM Director of Licensing, IBM Corporation, North Castle Drive Armonk, NY 10504-1785 U.S.A.
The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS
MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT
NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do
not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.
This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated
in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time
without notice.

Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The
materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk.

IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.

Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has
not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the
capabilities of non-IBM products should be addressed to the suppliers of those products.

This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of
individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is
entirely coincidental.

COPYRIGHT LICENSE:

This information contains sample application programs in source language, which illustrates programming techniques on various operating platforms. You may copy,
modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application
programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been
thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs. You may copy, modify, and
distribute these sample programs in any form without payment to IBM for the purposes of developing, using, marketing, or distributing application programs
conforming to IBM's application programming interfaces.

Copyright © 2010 IBM Corporation
IM03 - Data Warehousing: What's available on System z today Slide 2 of 63
All rights reserved

Trademarks

This presentation contains trade-marked IBM products and technologies.
Refer to the following Web site:

http://www.ibm.com/legal/copytrade.shtml

All rights reserved

Agenda

Why Data Warehouse and Business Intelligence on System z?
– Industry Trends
– Changing Business Requirements
– System z Features
An Introduction to Data Warehousing on System z
IBM Smart Analytics System 9600
IBM Smart Analytics Optimizer

All rights reserved

Why System z
and
zEnterprise 196
for
Data Warehousing and BI?

zEnterprise 196
processor chip

All rights reserved

Applications are Moving to Optimized Business Processes
Creating a New Set of Requirements
Customer
Service/
Care
Online Sales
Customer Self
Service

Marketing/Sales
Interactions The focus is on having the right
information at the right time
To enable the right business Financial
decision Trading

Fraud
Financial Avoidance
Planning

Supply Chain
Optimization
Regulatory
Compliance

All rights reserved

Providing the Right Information .....
To the right person, at the right time –

... Changes the Way We Do Business
Delivering Information When it Has the Most Impact
Traditional
Operational Business Intelligence
Warehousing
Identifying seats for rerouted passengers due to flight delays
Caring for high value before the flight arrives
customers
--------------- Travel and Transportation
Identifying related incidents and potential suspects prior to
Crime statistics arriving at the crime scene
and reporting
--------------- Transforms law enforcement
Understanding relevant customer info to identify cross sell and up
Customer sell opportunities and improve value of sale at the point of sale
Analysis
--------------- Transforms sales effectiveness
Identifying potentially fraudulent claims prior to approval and
Insurance fraud payment rather than after the fact
analysis & reporting --------------- Transforms insurance fraud

All rights reserved

Industry Trends that Favor the System z Platform

Cost efficiencies of a consolidated, virtual environment
– Reduced: labor costs, energy consumption, data center footprint
– Improved: ability to manage operations, upgrades, performance

Mixed workload environments and operational business intelligence
– When warehouse and analytics become more operational, System z platform
qualities of service become more critical:
• Availability, Reliability, Security

Compliance pressures
– Centralized data can dramatically improve ease of data governance by
reducing the number of servers and copies of data to be managed
– Single version of the truth

All rights reserved

The Changing Data Warehouse Market

The data warehouse is a mission-critical system, with data warehouses
serving in an increasingly mixed workload capacity, including as a data
source for online applications. "Deep mining“ analysts and business
analysts are running less-structured but equally complex queries and fast
running tactical queries, each with differing service-level expectations.
These differing workloads are all competing for CPU, memory and disk
access. At the same time, data latency continues to progress from batch
to continuous loading demands.

Publication Date: 23 December 2008/ID Number: G00163473; © 2008 Gartner, Inc. and/or its Affiliates. All Rights Reserved.

All rights reserved

Data Warehouse/BI Basics
- 4 stages between Data and Information
Present

Transform/
Optimize
Excel
Store Cubing

Warehouse

Acquire
Operational
ETL Applications
Data Quality ELT
Replication
EAI*
EII**
Where does your System z fit?
Operational Source Systems
Structured/ Unstructured Data
* Enterprise Application Integration
** Enterprise Information Integration
All rights reserved

Cost effective alternative to masses of commodity servers

– Management/Administration costs are already exceeding new server spending
– Power and energy costs growing dramatically

Spending Installed Base
(US$B) W orldw ide IT Spending Trend (M Units) 2000 –
$300
Power and cooling costs 50 Raw processing
Server m gm t and adm in costs 45 “horsepower” is the primary
$250
New server spending 40 goal, while the infrastructure
35 to support it is assumed
$200
30
ready
$150 25
2010 –
20
$100
Raw processing
15
“horsepower” is a given,
10
$50 but the infrastructure to
5
support deployment can
$0 0 be a limiting factor
00

03
98

04

08

10
97

01

05

07

09
96

99

02

06
20

20
19

20

20

20
19

20

20

20

20
19

19

20

20

Source: IDC, Virtualization 2.0: The Next Phase in Customer Adoption, Doc #204904, Dec 2006

All rights reserved

Processor Performance and Scalability

System z is no longer your father’s mainframe system!!!

Additional Capacity using hybrid Technologies

zEnterprise
z10
Customer Engines

z9

+
Compute Intensive
z990 Decimal FP
z900

IFL + + Capacity +
Crypto zAAP zIIP Accelerators

All rights reserved

IBM zEnterprise System – Best in Class Systems & Software Technologies
A system of systems that unifies IT for predictable service delivery
Unified management for a smarter system:
Unified management for a smarter system:
zEnterprise Unified Resource Manager
zEnterprise Unified Resource Manager
Part of the IBM System Director family,
provides platform, hardware and workload Scale out to a trillion
Scale out to a trillion
The world’s fastest and
The world’s fastest and instructions per second:
instructions per second:
management
most scalable system:
most scalable system: Unifies management of resources, IBM zEnterprise
IBM zEnterprise
IBM zEnterprise™ 196
IBM zEnterprise™ 196 extending IBM System z® qualities of BladeCenter® Extension
BladeCenter® Extension
(z196)
(z196) service across the infrastructure (zBX)
(zBX)
Ideal for large scale Selected IBM POWER7™
data and transaction blades and IBM x86
serving and mission Blades1 for tens of
critical applications thousands of AIX® and
Most efficient platform Linux applications
for Large-scale Linux®
consolidation High performance
Leveraging a large optimizers and
portfolio of z/OS® and appliances to accelerate
Linux on System z time to insight and
applications reduce cost
Capable of massive Dedicated high
scale up, over 50 Billion HMC
performance private
Instructions per Second
network
(BIPS)
1 All statements regarding IBM future direction and intent are subject to change or withdrawal without notice,
and represents goals and objectives only.

All rights reserved

Proven Ability to Handle Mixed Workloads
The z/OS Workload Manager (WLM) is the most mature and
sophisticated workload manager available today

Granular WLM policies provide improved performance for mixed workloads

Throughput Effects Response Time Effects
900 180
Queries Completed / minute

800 160
700
3x 140 88% +

Avg Response Times
600
500
120 faster
100
400
80
300
60
200
100 40

0 20

Triv. Mod Med Large 0 Triv small mod l Large
Triv.Mod/ Med Large Moderate/ Med /Large

Policy: WLM Policy in Policy: WLM Policy in effect
Equal Priority effect Equal Priority

All rights reserved

50TB System z Data Warehouse Benchmark
Poughkeepsie Lab / Silicon Valley Lab joint effort

Deliver proof points of System z scalability in Business
Intelligence environment

Establish capability of System z to scale to larger volumes

Develop best practices of managing large data warehouses

Drive unique value of System z
– Workload Manager: capabilities to manage mixed workloads
– Operational BI: large volumes of users, smaller queries
– zIIP: lower cost BI solution
– Data compression: minimal overhead with hardware compression

SG24-7674

All rights reserved

Cost Benefits of System z
Reduce Operational Costs Reduce overall Risk Exposure
Save on storage using DB2 for z/OS System z Highly sensitive personal or financial data is
hardware based data compression without secure and auditable
compromising performance DB2 for z/OS data sharing and GDPS provide
– Typical savings in the 50-60% range unparalleled availability
Index compression, DB2 9, software based Mixed workloads benefit from the capability of the
Save on labor, energy, and floor space through world class System z workload manager
consolidation to System z Reduced latency and duplication provide a sound
– Save up to 85% on floor space** basis for timely and consistent business analysis

– Save up to 80% on energy costs**
Position for Growth
– Save up to 50% on labor resource** Application growth on System z scales well, while
cost savings increase
Parallel Sysplex and DB2 for z/OS data sharing
enable incremental growth
System z provides a non-disruptive upgrade path;
System z tech dividends make that upgrade path
more cost effective

** Based on calculations of savings realized in internal IBM System z consolidation projects
All rights reserved

An Introduction to Data Warehouse
and BI on System z & zEnterprise

MDM Server

Industry
Cognos 8 BI Models
DB2 for z/OS

InfoSphere Information
Warehouse Server

All rights reserved

The Data Warehouse and BI Solution on System z

OLTP
data

‘09 ‘09
w InfoSphere New
Data Ne InfoSphere
Warehouse Warehouse
Warehouse Cubing
SQW
Services
DB2 for z/OS

InfoSphere
InfoSphere Replication Server Cognos 8 BI
Information for Linux on
Server for System z
System z
Source Systems :
DB2 Serving Up
IMS Complete ETL The Enterprise Data Consolidated
VSAM Solution Warehouse Enterprise BI

Combining the Reliability and Availability of DB2 for z/OS with Cost Effective
Applications running on Linux for System z
All rights reserved

Warehouse/BI Highlights of DB2 for z/OS V8

Materialized Query Tables
–Improved performance for query
Multi-row insert and fetch
–Improved speed of warehouse ETL and query
Online Schema evolution
–Improves availability and efficiency
Longer Table and Column names
–Increased compatibility with ETL and BI tools
Increased SQL vocabulary
–Increased compatibility with ETL and BI tools
64 bit support
–Expanded size capability

All rights reserved

Warehouse/BI Highlights of DB2 9 for z/OS

Index over Expression
–Improved performance on ETL and BI tools
Index Compression
–Improved use of space (up to 50%)
Not Logged Tablespace
–More efficient for temporary tables such as Staging tables
Universal Table Space – partition by growth
–Easier to manage growth
–Best of segmented tables and partitioning
Utility Improvements
–More online utility operations, reduced CPU
Overall DB2 9 for z/OS– reduced CPU

All rights reserved

2
1

Top 10 in DB2 10 for z/OS
1. CPU reductions for transactions, queries, & batch
2. Ten times more users by avoiding memory constraints
3. More concurrency for catalog, utilities, and SQL
4. More online changes for data definition, utilities and subsystems
5. Improved security with more granularity
6. Temporal or versioned data
7. SQL enhancements improve portability
8. pureXML performance and usability enhancements
9. Hash, index include columns, access path stability, skip migration, …
Pick your favorite!
10.Productivity improved for database & systems administrators, and
application programmers

All rights reserved

InfoSphere Information Server on System z

Information Services Director
Publish SOA services for information
integration and access

Business Glossary QualityStage DataStage Federation Server
Enterprise Data Data Quality: Standardize, Virtualize access to
Dictionary Correct & Match Data disparate information

Information Analyzer Global Name Recognition Extract, Transform, and CDC & Replication
Data Source Profiling & Recognize & Classify Load in Batch or Real- Deliver and replicate
Problem Diagnosis Multi-cultural names time changed data

Metadata Workbench / FastTrack
Manage and track consistent metadata across information integration
tasks and automate generation of data flow logic
Parallel Processing
Rich Connectivity to Applications, Data, and Content

All rights reserved

Maintaining a Low Latency Warehouse or ODS

Replication, InfoSphere CDC, Event Publisher, Classic Event Publisher

Provides incremental near real time feed to InfoSphere DataStage from IMS,
VSAM, IDMS, Adabas, DB2 all platforms, Oracle, MS SQL Server, Sybase
All rights reserved

The core Cognos 8 BI components for Linux on System z
Reporting
• Provides full breadth of report types
• Ensures consistent information to all users
• Engages business users with simplified role-based
interface
• Delivers personalized content via email, portal, MS-
Office, search and mobile devices etc
• Enables collaboration across users, communities and
with IT
Analysis

• Provides guided exploration across multiple dimensions
of information
• Performs complex analysis and scenario modeling
easily and quickly
• Exposes the “why” behind trends to reveal symptoms
and causes
• Moves from summary level to detail levels of
information effortlessly
All rights reserved

Right time Information

Dashboards

• Provides at-a-glance, high impact views
of complex information
• Helps quick focus on issues that need
attention and action
• Are highly visual and intuitive
• Combines information across disparate sources

All rights reserved

Cognos 8 BI for Linux on System z

PRESENTATION TIER Broad Range of
Capabilities

Common Set of
SERVICES
APPLICATION TIER Services

Right time Information

Open Data Access
DATA TIER (Transactional, Warehouses or Modern data
sources)

All rights reserved

OLAP – Online Analytical Processing
BI analyses most often involve aggregates and
calculations such as …

“I want to see all departments where the total
salary is greater than $xx and if they exceed the
previous year by 15% then …”

Let’s start with a simple SELECT DEPT,(SUM) SALARY AS SUMSAL
example … just the sum of FROM BIG_PERSONNEL_TABLE
the salaries … GROUP BY DEPT

DB2 will do a vast scan of the table
… form the aggregate values
… and present the result set to the end user
or application
…and frequently many business users are DB2
looking at the same data over and over

All rights reserved

Multidimensional Analytics

Multidimensional Analytics (aka OLAP)
– Multidimensional view of the business: customers, products, time and
measures
– Analysis of business metrics/measures over time, previous to “current”
– Maps well to Star Schema concepts (Dimensions, Facts, Aggregates)

Key Aspects
– Dimensions, Hierarchies, Measures, Summarizations
– Cross dimensional calculations
– Time Series, Parallel Period analysis
– Dimensional navigation – slice, dice, drill, pivot

All rights reserved

OLAP Portfolio from IBM
Different methods for different uses
MODELING

Specialized OLAP Modeling Tools

Transformer Turbo Integrator Data Architect

IBM Cognos IBM Cognos TM1 IBM IW Cubing
PowerCube Services
Optimized for write back and high
Optimized for broad, general Optimized for very large datasets
volatility applications
purpose BI usage with very large dimensions

Large read only user communities Read/write user communities Large user communities
Moderate ‘focused area’ data sets 64 bit in-memory fast performance Large data sets
Pre-aggregated static fast results Larger highly dynamic data sets Planned performance/optimization facilities
-------------------------------------------- -------------------------------------------- --------------------------------------------
OLAP

Off-line portable/ partitioned storage Dynamic changing dimensions and hierarchy, Optimized ROLAP
Rapid startup for advanced business what-if scenarios, data contribution Zero Latency
user self service modeling Common dimensions shared across multi-cube High volume concurrency
Automatic time series analysis & trending models
Largest Data Volumes
Point in time data Budgeting and planning
Centralized IT management of information
Personal and corporate data sources Personal and corporate data sources

All rights reserved

InfoSphere Warehouse on System z

Adds core data warehouse and analytics capability to DB2 for z/OS:
– Advanced physical database modeling and design
– In-database data movement and manipulation capabilities of SQL Warehouse
Tool (SQW)
– Optimize multidimensional reporting and analysis of data with Cubing Services

z/OS Linux on System z
MS Excel
SQW

MDX Queries
Cubing Services Cognos
IW Design Studio

OLTP DB2 DWH DB2

30
IM03 - Data Warehousing: What's available on System z today
All rights reserved
Slide 30 of 63

InfoSphere Warehouse on System z - Architecture
MQT
MQT Eclipse
Advisor
Advisor Design Studio
Design Studio Client Layer
• Design and admin client
IE/Firefox
Admin Console • BI / Reporting tools and
Admin Console Cognos 8 BI for
Excel apps
Windows / Linux System z

MDX

Cubing Services
Cubing Services
Engine
Engine
WebSphere
WebSphere SQL
Application Server
Application Server
Application Server
SQW Runtime
SQW Runtime

Linux on System z Partition / IFL
JDBC/DB2 Connect/Hipersockets

Data Warehouse
MQT Cube Metadata DB2 for z/OS
DB2 for z/OS Control DB Server

DB2 for z/OS
DB2 for z/OS IMS
IMS VSAM
VSAM RDBMS
RDBMS Source Systems
All rights reserved

Cubing Services Supports Microsoft Excel 2007

IBM OLE DB
Provider for
OLAP

Uses Excel Pivot
Table Services

All rights reserved

Cubing Services Supports Cognos

All Cognos Studios
can access Cubing
Services
Query Studio
Report Studio
Analysis Studio

Integrate cube data
into Cognos
Dashboards and
Reports

Cognos 8 BI uses
metadata directly
from Cubing
Services – no
duplicate metadata
development

All rights reserved

Modernize an Existing Reporting Server
Transform it into a DB2 for z/OS Warehouse
1. Model your data for OLAP access using the InfoSphere Warehouse
Design Studio
2. Populate your star schema using InfoSphere Warehouse SQW Scripts
3. Build one or more Cube structures using the InfoSphere Warehouse
Design Studio
4. Access data through Excel or Cognos MDX queries

z/OS Linux on System z
SQW Excel

2

MDX Queries 4
InfoSphere Warehouse Cubing Services
Design Studio 1 3 Cognos
OLTP DB2 DWH DB2

System z Environment Improved with InfoSphere Warehouse

34
All rights reserved
Slide 34 of 63

Modernize an Existing Reporting Server
Add Cubing Services to enhance business user experience

Data can remain in one single
repository – DB2 for z/OS C S
ube erver Performance
Increasing ease of data
compliance, security and 12000

responds time in sec
governance 10000
8000
6000 Series1
Analysis can be performed with
4000
high speed through in-memory
2000
caching 0
1.runnocache 1.runcache 2.runcache
CPU on System z can be reduced cu eserv cach
b er e
when more queries can be
answered through the in-memory
workload contains 30 MDX queries
caching

All rights reserved

Scalable Architecture for Financial Reporting (SAFR)

Problem SAFR Solution
Wasted I/O or resource contention Generate multiple extracts or reports
because of multiple programs simultaneously with a single pass of
reading the same transaction data the transaction data

Sales Sales
Trans Trans

SAFR
Program Program Program
Views
A B C
A/B/C

“Scan sharing”
All rights reserved

IBM Smart Analytics
System 9600

All rights reserved

Solution Edition for Data Warehousing –
Legendary System z quality, priced aggressively to fit within a shrinking budget

Complete Offering:
– Solution – based offering
– Customized hardware to meet your business requirements Solution
– Pre-determined software stack tuned for Data Warehousing Editions
workloads
– Maintenance for the hardware

For a highly available, energy efficient
Data Warehousing infrastructure
designed for growth

Created to simplify your IT decision!

All rights reserved

New! IBM® Smart Analytics System 9600

Delivers - unprecedented value in deploying new business analytics

What’s new:
– Delivers a complete end-to-end software, hardware, and services solution for a rapid deployment of business analytics on System z at a
compelling price point.
Features / Business Value:
– Provides unprecedented value for an end-to-end analytics solution on System z
– Inherits the unique System z quality of service, for new business analytic workloads
– Delivers continuous availability to a centralized single view of the business to support enterprise wide business analytics
– Leverages customers existing disaster recovery and backup processes to simplify deployment without requiring additional backup and
recovery processes.

Client Benefits: Powerful Data Warehouse Software
–To deliver enterprise-wide business InfoSphere Warehouse on System z
analytics to operational users Cognos 8 BI for Linux on System z
–Deliver business insights to the right DB2 for z/OS Value Unit Edition (MLC
person, at the right time, in the right context Option)
DB2 Utilities Suite
z/OS Operating System Stack

All rights reserved

IBM Smart Analytics System Offerings Deliver Analytics
Value Across Platforms
Faster Time to Value, Faster Business Results

5600
Meeting clients where Based System x
their information is…

Consistent value,
Right fitted to your needs

7600 9600
Based Power System Based on System z

40 Copyright © 2010 IBM Corporation
All rights reserved


What is it? How is it different?
The IBM Smart Analytics System 9600 is an Secure, Available Business Analytics
integrated solution of hardware, software and – Rapidly delivers analytic information to decision makers at
services that enables customers to rapidly deploy the time of decision.
cost effective game changing analytics across their
– New environment for the availability, reliability and
business. scalability necessary to stay aligned with the operational
systems
Simplified administration
– Appliance-like delivery
– Faster deployment at lower cost.
– Leverages customers existing disaster recovery, and
backup processes
Proven Operational Characteristics
– Extends the qualities of service of System z.
– Reduces risk through extending System z manageability
and security across the entire system.
High Value Operational BI
– Cost effective way to drive daily operational decisions

Delivering business results in days, not months
All rights reserved

High Value Dynamic Warehousing
Cognos 8 BI
System z
InfoSphere
Warehouse
Cubing
Services
Data
Warehouse
Powercube
Services

DB2 for z/OS VUE Implementation
ELT
(option for MLC) Services

DB2 Utilities Suite
Operational Source Systems Image Copy, LOAD, UNLOAD,
Structured/ Unstructured Data REORG, etc

All rights reserved

IBM Smart Analytics System 9600 Software
Deeply Optimized by IBM Experts… Flexible Growth…
Powerful Data Warehouse and BI Software
DB2 for z/OS Value Unit Edition (primary) V9 - Option for MLC
DB2 Utilities Suite V9
DB2 Connect
InfoSphere Warehouse on System z V9.5.2
IBM Cognos 8.4 BI for Linux on System z
IBM Cognos® 8 BI reporting, IBM Cognos® 8 BI analysis, IBM Cognos® 8 BI
dashboard, Cognos 8 Go! Mobile, Cognos 8 Go! Search, Cognos 8 Go! Office
z/OS Operating System Stack V1.11
z/VM 6.1
Optional Value Priced Add-ons
Tivoli OMEGAMON for DB2 Performance Expert
Tivoli Directory Server
InfoSphere Master Data Management Server
InfoSphere Information Server
InfoSphere Replication Server
Q-Rep, CDC and Event Publisher eligible
InfoSphere Federation Server plus Classic Federation on System z
SPSS
Tivoli ITCAM, ITUAM
Cognos Now! For Linux on System z
Cognos Blueprints for Healthcare, Banking and others…
BI User on-boarding application (as proposed for Smart Analytics Cloud)

All rights reserved
Slide 43 of 63 43

IBM Smart Analytics System
Pre-Set Configurations Sized to Meet Business Requirements

Data Capacity Sizing
Database Size

Amt
Amt Usable Disk*
User Data*

244TB 100TB

122TB 50TB

61TB 25TB

27TB 12TB

10TB 4TB

*Usable = Disk for compressed table data, indexes, work files, MQTs etc.
*User Data = Raw, uncompressed, user data

All rights reserved

IBM Smart Analytics System
Pre-Set Configurations Sized to Meet Business Requirements

BI Capacity Sizing
Cognos Workload

Max Concurrent
Named Users
Users

5000 - 10,000 100

50

5-2500 25

All rights reserved

Choosing A Deployment Style

Standalone Delivery
Server delivered in
“appliance-like” fashion

Virtual Upgrade
Delivery

Capacity delivered as a
“bolt-on” to existing
server(s) or as new
server(s) depending on
customer needs in a
“virtual appliance-like”
fashion

All rights reserved

Scales for Your Unique Needs
Deployed in scalable increments to match each type of need

Rapidly & easily add Rapidly & easily add
new capacity as new users as business
information & new needs expand
analytic capabilities grow

Building blocks for each growth increment
All rights reserved

Faster Time to Value
Results in Days Versus Months
Build from Scratch Pre-Built
June
Jan.

Testing & Validation
5

Faster Results
Installation &
Less Risk
4
Configuration

Acquire
3
Components

Pre-implementation
2
System Sizing

Jan.

Months Days
All rights reserved

Capitalizing on the best of relational and the best of columnar databases

What is it? How is it different
The IBM Smart Analytics Optimizer is a workload Performance: Unprecedented
optimized, appliance-like, add-on, that enables the response times to enable 'train of
integration of business insights into operational thought' analyses frequently blocked by
processes to drive winning strategies. It accelerates
poor query performance.
select queries, with unprecedented response times.
Integration: Connects to DB2 through
deep integration providing transparency
to all applications.
Self-managed workloads: queries are
executed in the most efficient way
Transparency: applications connected
to DB2, are entirely unaware of the
accelerator
Simplified administration: appliance-
like hands-free operations, eliminating
many database tuning tasks

Breakthrough Technology Enabling New Opportunities
All rights reserved

Smart Analytics Optimizer
– Deep DB2 Integration

Applications DBA Tools, z/OS Console, ...

Application Interfaces Operation Interfaces
(standard SQL dialects) (e.g. DB2 Commands)

Smart
Data Buffer Log
Manager Manager
IRLM
Manager
... Analytics
Optimizer

DB2

All rights reserved

Smart Analytics Optimizer
- Platform View

Applications DBA Tools, z/OS Console, ...

Application Interfaces Operation Interfaces
(standard SQL dialects) (e.g. DB2 Commands)

Price/Performance

Hardware
optimized
z/OS Smart
Data Buffer Log
Manager Manager
IRLM
Manager
... Analytics
Optimizer

DB2

All rights reserved

Extreme performance for complex queries

Game Changing
Performance
Rapidly delivers information to decision
makers through breakthrough
technologies providing dramatic
performance improvement.
The best of row and columnar store
technologies
Highly compressed data
Compressed data operations
In-memory processing
Massively parallel architecture
Enables decision makers to submit
queries they never dared in the past, that
analyze trends, predict outcomes, and
produce better business results.

All rights reserved

Target Market: Business Intelligence (BI)

Characterized by:
– “Star” or “snowflake” schema:
Dimensions
Region
Fact Table Brand
City
Store Product

Month SALES
Time Category

Quarter

– Complex, ad hoc queries that typically
• Look for trends, exceptions to make actionable business decisions
• Touch large subset of the database (unlike OLTP)
• Involve aggregation functions (e.g., COUNT, SUM, AVG,…)
• The “Sweet Spot” for IBM Smart Analytics Optimizer!

All rights reserved

Database Performance Appliance

Significantly reduces costs and
enables quick time to value

Appliance-like, add-on device

Application transparent, install and
begin reaping the benefits of higher
performance

Rapidly add new applications and user
requirements driving immediate value to
the bottom line

No need for indices, materialized query
tables (MQTs), query plans or query
hints

All rights reserved

Orders of Magnitude Faster for Queries
Beta Customer Results

For customers who have struggled with
gaining the required performance out their
complex queries of full table scans, multiple
compares, and complex logic – the results
are astounding!

... and its acceleration factor : :

Runtime of queries w/o ISAOpt Factor with ISAOpt
163 s 48 3s
2311 s 511 5s
25 s 12 2s
1593 s 206 8s
35 s 4 8s
5435 s 1424 4s

IM03 - Data Warehousing: What's available on System z today Slide 56 of 63 56
All rights reserved

Combining the Smart Analytics offerings in System z:
IBM Smart Analytics System 9600 IBM Smart Analytics Optimizer

Must Connect to D W

GA June 2010 GA 4Q 2010

Complete, end-to-end environment for BI workload Workload optimized, appliance-like, add-on to a
Processes ALL queries submitted by end-users Data Warehouse on System z

Software: MUST connect TO a DB2 for z/OS environment that
is running a BI workload
Includes z/OS, DB2 for z/OS, Linux, InfoSphere Will enhance a Smart Analytics System 9600
Warehouse, Cognos, DB2 Connect
Software:
Supports:
Includes ISAO software running on blades and
Data movement / ETL connects to DB2 for z/OS to enable query routing
End user tools (Cognos) / BI queries/reports to ISAO
Data Storage (Data warehouse)
Supports:
Runs in z/OS-DB2 LPAR, Linux for System z LPAR for (Subset of) complex and long-running BI queries
Tooling with access to data in a star or snowflake schema
Is an all purpose environment to deploy any BI Order of magnitude acceleration of a SUBSET of
workload queries that are selected/routed to ISAO by DB2
for z/OS

For acceleration of multidimensional star schema queries, use IBM Smart Analytics Optimizer as add on option

All rights reserved

Co-locating Transactional and Data Warehouse Workloads

Poughkeepsie Lab / Silicon Valley Lab joint effort

Managing analytic and traditional workload best practices

Using workload manager (WLM) to manage mixed workloads

OLAP vs data warehouse workloads

Data sharing vs non data sharing considerations

Single vs multiple LPAR configurations

Implementation considerations

Benchmark results

SG24-7726

All rights reserved

Other Significant System z Data Warehouse Redbooks

SG24-7637 SG24-7813 REDP-4606
Enterprise Data InfoSphere Warehouse: A Using IBM System z As the
Warehousing with DB2 9 Robust Infrastructure for Foundation for Your
for z/OS Business Intelligence Information Management
Architecture

All rights reserved

More Significant System z Data Warehouse Redbooks

REDP-3927 SG24-6489 REDP-4668
Workload Management Best Practices for SAP BI IBM zEnterprise
for DB2 Data using DB2 9 for z/OS BladeCenter Extension

All rights reserved

Reference Materials

Relevant System z DW/BI Redbooks:
– 3 more currently in progress: Cognos on System z, Data Collocation,
InfoSphere Warehouse

Cognos 8 BI Performance Whitepaper:
– http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP101437

WLM Magazine Article:
– http://www.ibmsystemsmag.com/mainframe/novemberdecember09/tipstechniq
ues/26908p1.aspx

More info:
– http://www-01.ibm.com/software/data/businessintelligence/systemz/

All rights reserved

More information on zEnterprise

IBM zEnterprise Announcement Landing Page:
ibm.com/systems/zenterprise196
IBM zEnterprise HW Landing Page: ibm.com/systems/zenterprise196
IBM zEnterprise Events Landing Page: ibm.com/systems/breakthrough
IBM Software: ibm.com/software/os/systemz/announcements
IBM System Storage: ibm.com/systems/storage/product/z.html
IBM Global Financing: ibm.com/financing/us/lifecycle/acquire/zenterprise/
Global Technology Services:
– vanity: ibm.com/services/zenterprise

All rights reserved

Data Warehousing: What's Available on System z Today

Data Warehousing: What's Available on System z Today

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (19)

Similar a Data Warehousing: What's Available on System z Today

Similar a Data Warehousing: What's Available on System z Today (20)

Más de Willie Favero

Más de Willie Favero (14)

Último

Último (20)

Data Warehousing: What's Available on System z Today