The Briefing Room with Krish Krishnan and Teradata
Live Webcast on Dec. 4, 2012
The current Holy Grail of analytical systems is the Unified Data Architecture: a management layer that connects people and systems to all the appropriate information sources, both structured and unstructured, across the entire enterprise. The idea is to provide a strategic view of information assets, ideally with an intelligent metadata layer that helps users align salient data sets, thus enabling a big-picture perspective that fosters insight, collaboration and improvement.
Check out this episode of The Briefing Room to hear veteran Analyst Krish Krishnan explain why we're closer than ever to achieving this holistic perspective for data assets. He'll be briefed by Imad Birouty of Teradata, who will tout his company's Unity offering, a management environment for connecting Teradata systems of all shapes and sizes. He'll explain how Unity allows users to navigate through complex information architectures, route queries to specific data sources, even access Big Data in Hadoop via AsterSQL. Birouty will also offer a sneak peek at Shark, a new project spun out of the Kickfire acquisition, which promises super-high performance queries on specific workloads.
Visit: http://www.insideanalysis.com
2. Welcome
Host:
Eric Kavanagh
eric.kavanagh@bloorgroup.com
Twitter Tag: #briefr The Briefing Room
3. Mission
! Reveal the essential characteristics of enterprise software,
good and bad
! Provide a forum for detailed analysis of today s innovative
technologies
! Give vendors a chance to explain their product to savvy
analysts
! Allow audience members to pose serious questions... and get
answers!
Twitter Tag: #briefr The Briefing Room
4. December: Innovators
January: Big Data
February: Analytics
March: Data in Motion
Twitter Tag: #briefr The Briefing Room
5. Innovators
! Necessity is the mother
of invention, and the
need for unified access
is driving innovation
! Big Data, Cloud and
Photo by George P. Landow (www.victorianweb.org)
Social Media are the
horses in front of the
carriage
! Users want easier,
faster and better
system management This image may be used without prior permission for any scholarly or educational purpose
Twitter Tag: #briefr The Briefing Room
6. Analyst: Krish Krishnan
Mr. Krishnan is a recognized expert in the
strategy, architecture and implementation of
high performance data warehousing solutions
and unstructured data. He co-authored
“Building the Unstructured Data Warehouse”
along with Bill Inmon. He also has written
eBooks, over 150 articles, viewpoints and
case studies in Big Data, Business
Intelligence, Data Warehousing, Data
Warehouse Appliances and High Performance
Architectures. Mr. Krishnan currently is
promoting the next generation of data
warehousing, focusing on Big Data, Semantic
Technologies, Crowdsourcing, Analytics, and
Platform Engineering. He leads the Data
Warehouse Appliance and Architectures
Expert Channel at BEyeNetwork.com and
publishes with
www.beyenetwork.comkkrishnan.
Twitter Tag: #briefr The Briefing Room
7. Teradata
! Teradata is known for its analytic data solutions with a
focus on integrated data warehousing, big data analytics
and business applications.
! It offers a broad suite of technology platforms and
solutions, and a wide range of data management
applications and data mining capabilities.
! Teradata is now offering an integrated portfolio that turns a
multi-system environment into an Analytical Ecosystem.
Twitter Tag: #briefr The Briefing Room
8. Imad Birouty
Imad Birouty is the Program Marketing
Manager for the Teradata Analytical
Ecosystem, which includes features such
as Teradata Unity and Teradata’s Dual
Active Solution. Imad is also responsible
for Teradata’s Data Mart Consolidation
program, the Value of Integrated Data,
and Total Cost of Ownership. Prior to
this, Imad led the Product Management
team responsible for the NCR Platform
including the processing nodes, BYNET
Interconnect, Server Management, and
Operating Systems. He set product
strategy and direction and was
responsible for seven major platform
releases spanning 8 years.
Twitter Tag: #briefr The Briefing Room
9. TERADATA UNITY AND THE
UNIFIED DATA ARCHITECTURE
Imad Birouty
Program Marketing Manager
11. Teradata Unified Data Architecture
Teradata
Analytical
Ecosystem
INTEGRATED
DATA WAREHOUSE
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
11 12/4/12
12. Teradata Unified Data Architecture
Teradata
Analytical
Ecosystem
INTEGRATED
DATA WAREHOUSE
DATA
LAB
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
12 12/4/12
13. Teradata Unified Data Architecture
Teradata
Analytical
Ecosystem
INTEGRATED
DATA WAREHOUSE
DATA DATA
LAB
MARTS
ANALYTICAL
TEST/
ARCHIVE
DEV
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
13 12/4/12
14. Teradata Unified Data Architecture
Teradata
Analytical
Ecosystem
INTEGRATED
DATA WAREHOUSE
DATA DATA
LAB
MARTS
INDEPENDENT ANALYTICAL
DATA MART TEST/
ARCHIVE
DEV
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
14 12/4/12
15. Teradata Unified Data Architecture
Teradata
Analytical
Ecosystem
DUAL INTEGRATED
SYSTEMS DATA WAREHOUSE
DATA DATA
LAB
MARTS
INDEPENDENT ANALYTICAL
DATA MART TEST/
ARCHIVE
DEV
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
15 12/4/12
16. Teradata Unified Data Architecture
VIEWPOINT UNITY SUPPORT
Teradata
Analytical
Ecosystem
DUAL INTEGRATED
SYSTEMS DATA WAREHOUSE
DATA DATA
LAB
MARTS
INDEPENDENT ANALYTICAL
DATA MART TEST/
ARCHIVE
DEV
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
16 12/4/12
17. Teradata Unified Data Architecture
Business Analysts Marketing Front-Line Workers
Customers / Partners Executives Operational Systems
VIEWPOINT DATA MINING BUSINESS INTELLIGENCE APPLICATIONS SUPPORT
Teradata
Analytical
Ecosystem
DUAL INTEGRATED
SYSTEMS DATA WAREHOUSE
DATA DATA
LAB
MARTS
INDEPENDENT ANALYTICAL
DATA MART TEST/
ARCHIVE
DEV
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
17 12/4/12
18. Teradata’s Analytical Ecosystem Benefits
• Meet service level goals
> The right data, in the right place, at the right time, for the
right users
> Track application readiness
• Resource optimization
> Match application profiles to the right Teradata platform
> Availability, performance, cost
• Investment protection
> Seamless application portability between
Teradata platforms
> Platform repurposing
• One source support for Teradata products
and services
18 12/4/12
19. Teradata Unity
Integrated portfolio that turns a
multi-system environment into an
orchestrated Analytical Ecosystem
Teradata Unity
Unity Director Unity Loader Unity Data Unity Ecosystem
Mover Manager
Query routing and High volume, Data End-to-end monitoring
database intelligent data movement across data warehouse
synchronization loading to between components
between Teradata multiple Teradata Teradata
Systems systems systems
19 12/4/12
20. Unity Director Provides Query Management
Reads
• Two methods for Read queries
> User session routing
> Individual query routing
20 12/4/12
21. Unity Director Provides Query Management
Reads
• Two methods for Read queries
> User session routing
> Individual query routing
Controlled Routing
(Named, Preferred)
Great for session and workload
control across systems, especially
when high availability failover is
required
21 12/4/12
22. Unity Director Provides Query Management
Reads
• Two methods for Read queries
> User session routing
> Individual query routing
Controlled Routing Automatic Routing
(Named, Preferred) (Automatic)
Great for session and workload Great when systems contain
control across systems, especially different data and/or for fast setup
when high availability failover is where session control isn’t required
required
22 12/4/12
23. Unity Director Provides Query Management
Writes
• Three methods for Write operations
> Default, Create Preferred, Create Balanced
> Can be used in combination
Default
(writes)
• Writes to all systems
where objects reside
• Great for keeping
systems in sync
23 12/4/12
24. Unity Director Provides Query Management
Writes
• Three methods for Write operations
> Default, Create Preferred, Create Balanced
> Can be used in combination
Default Create Preferred
(writes) (writes)
• Writes to all systems • Creates to only one system
where objects reside • Subsequent writes to created
• Great for keeping objects on just one system,
systems in sync such as temporary tables
• Prevents wasted resources on
other systems
24 12/4/12
25. Unity Director Provides Query Management
Writes
• Three methods for Write operations
> Default, Create Preferred, Create Balanced
> Can be used in combination
Default Create Preferred Create Balanced
(writes) (writes) (writes)
• Writes to all systems • Creates to only one system • Creates to only one system
where objects reside • Subsequent writes to created • Designated system for
• Great for keeping objects on just one system, creates alternates among
systems in sync such as temporary tables systems for different
• Prevents wasted resources on sessions based on a round-
other systems robin algorithm
25 12/4/12
26. Unity Loader
• Bulk loads sent to all participating systems; updates are asynchronous
• More than two sites are supported with additional Unity Loader and
Director servers
Site 1
Unity Loader
26 12/4/12
27. Unity Loader
• Bulk loads sent to all participating systems; updates are asynchronous
• More than two sites are supported with additional Unity Loader and
Director servers
Site 1
Unity Loader
Unity Loader
Unity Loader
27 12/4/12
28. Unity Loader
• Bulk loads sent to all participating systems; updates are asynchronous
• More than two sites are supported with additional Unity Loader and
Director servers
Site 1 ü
ü
Unity Loader
Unity Loader
Unity Loader
ü
28 12/4/12
29. Unity Loader
• Bulk loads sent to all participating systems; updates are asynchronous
• More than two sites are supported with additional Unity Loader and
Director servers
Site 1 ü
ü
Unity Loader
Unity Loader
Unity Loader
ü
Site 2
Unity Loader
29 12/4/12
30. Unity Loader
• Bulk loads sent to all participating systems; updates are asynchronous
• More than two sites are supported with additional Unity Loader and
Director servers
Site 1 ü
ü
Unity Loader
Unity Loader
Unity Loader
ü
Site 2
Unity Loader
Unity Loader
Unity Loader
30 12/4/12
31. Unity Loader
• Bulk loads sent to all participating systems; updates are asynchronous
• More than two sites are supported with additional Unity Loader and
Director servers
Site 1 ü
ü
Unity Loader
Unity Loader
Unity Loader
ü
Site 2
Unity Loader
Unity Loader
Unity Loader
31 12/4/12
36. Teradata Unified Data Architecture
Data Scientists Business Analysts Marketing Front-Line Workers
Engineers Customers / Partners Executives Operational Systems
LANGUAGES MATH & STATS DATA MINING BUSINESS INTELLIGENCE APPLICATIONS
DISCOVERY INTEGRATED
PLATFORM DATA WAREHOUSE
CAPTURE | STORE | REFINE
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
36 12/4/12
37. Teradata Unified Data Architecture
Data Scientists Business Analysts Marketing Front-Line Workers
Engineers Customers / Partners Executives Operational Systems
LANGUAGES MATH & STATS DATA MINING BUSINESS INTELLIGENCE APPLICATIONS
DISCOVERY INTEGRATED
PLATFORM DATA WAREHOUSE
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
37 12/4/12
38. Teradata Unified Data Architecture
Data Scientists Business Analysts Marketing Front-Line Workers
Engineers Customers / Partners Executives Operational Systems
LANGUAGES MATH & STATS DATA MINING BUSINESS INTELLIGENCE APPLICATIONS
DISCOVERY INTEGRATED
PLATFORM DATA WAREHOUSE
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
38 12/4/12
39. INTRODUCING
TERADATA ASTER BIG
ANALYTICS APPLIANCE
3H
Industry’s First Big Analytics Appliance
with Aster and Hadoop in the same cabinet
Unified System Management and Analytics
Unified Solution for Big Data Storage,
Management, and Analytics
Available NOW
39 12/4/12
41. Teradata Unified Data Architecture
Data Scientists Business Analysts Marketing Front-Line Workers
Engineers Customers / Partners Executives Operational Systems
VIEWPOINT LANGUAGES MATH & STATS DATA MINING BUSINESS INTELLIGENCE APPLICATIONS SUPPORT
DISCOVERY INTEGRATED
PLATFORM DATA WAREHOUSE
CAPTURE | STORE | REFINE
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
41 12/4/12
42. Teradata Viewpoint Integration
Easier, Faster, and Better System Management
Common Management Console
for Aster, Teradata and Apache
Hadoop
Aster Specific Query Portlets
Portlets • Query Monitor
• Aster Node
Monitoring Admin Portlets
• Aster Completed • Teradata System
Processes • Roles Manager
Trend/ Other Portlets
• System Health
Visualization • Canary queries
Portlets • Aster Data
• Capacity Alerting
Heat Map
• Metrics Graph
• Metrics Analysis
Available now with Teradata and Aster. Hadoop availability early 2013
42 12/4/12
43. Improve Supportability with
Teradata Vital Infrastructure
• Customers that want to
improve supportability Regularly Collects Asset Data
ensure that Teradata
Constantly Monitors Events
Vital Infrastructure is
activated in their Identifies Risk Data Patterns/Trends
production environment
Detects Fault Alerts
• Teradata Vital
Infrastructure is Records Fault Events
embedded proactive
support software Automatic Incident Reports Are Created
available on each
Teradata platform Alert Notifications Are Sent and Tracked
62–70% of Incidents Discovered
Through TVI
43 12/4/12
44. Teradata Unified Data Architecture
Business Analysts Marketing Front-Line Workers
Customers / Partners Executives Operational Systems
VIEWPOINT DATA MINING BUSINESS INTELLIGENCE APPLICATIONS SUPPORT
Teradata
Analytical
Ecosystem
DUAL INTEGRATED
SYSTEMS DATA WAREHOUSE
DATA DATA
LAB
MARTS
INDEPENDENT ANALYTICAL
DATA MART TEST/
ARCHIVE
DEV
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
44 12/4/12
45. Teradata Unified Data Architecture
Data Scientists Business Analysts Marketing Front-Line Workers
Engineers Customers / Partners Executives Operational Systems
VIEWPOINT LANGUAGES MATH & STATS DATA MINING BUSINESS INTELLIGENCE APPLICATIONS SUPPORT
DISCOVERY DUAL INTEGRATED
PLATFORM SYSTEMS DATA WAREHOUSE
DATA DATA
LAB
MARTS
INDEPENDENT ANALYTICAL
DATA MART TEST/
ARCHIVE
DEV
CAPTURE | STORE | REFINE
AUDIO & VIDEO IMAGES TEXT WEB & SOCIAL MACHINE LOGS CRM SCM ERP
45 12/4/12
52. Data
Workloads
&
Processing
Datamarts
&
Transac1onal
Reports
ODS
Analy1cal
Systems
Databases
Dashboards
Enterprise
Transac1onal
Datamarts
&
ODS
Datawarehouse
Systems
Analy1cal
Databases
Analy1c
Models
Other
Transac1onal
Datamarts
&
Applica1ons
ODS
Systems
Analy1cal
Databases
Data
Transforma1on
@2012
Copyright
Sixth
Sense
Advisors
53. Workload
Challenge
S Issues
S Requirements
S Long
running
jobs
S Assigning
the
appropriate
systems
S Missed
SLA’s
and
processes
to
manage
workloads
S Creates
an
interchangeable
S Performance
&
Response
Issues
infrastructure
S Scalability
S Support
Homogenous
/
S Fault
Tolerance
Heterogeneous
plaIorms
S Need
to
process
data
in
a
S Unknowns
reasonable
1me
S Do
not
know
what
data
we
are
S Need
a
fault
tolerant
architecture
as
geCng
large
chunks
of
data
cannot
be
reprocessed
if
and
when
a
failure
S Do
not
know
formats
or
occurs
volumes
of
data
S Need
automa1c
resource
management
@2012
Copyright
Sixth
Sense
Advisors
54. Workload
Isolation
Semi-‐
Structured
Data
@2012
Copyright
Sixth
Sense
Advisors
55. BeneGits
S Requirements
S Assigning
the
appropriate
systems
and
processes
to
manage
workloads
S Creates
an
interchangeable
infrastructure
S Support
Homogenous
/
Heterogeneous
plaIorms
S Need
to
process
data
in
a
reasonable
1me
S Need
a
fault
tolerant
architecture
as
large
chunks
of
data
cannot
be
reprocessed
if
and
when
a
failure
occurs
S Need
automa1c
resource
management
@2012
Copyright
Sixth
Sense
Advisors
56. Questions
S What
are
the
key
drivers
behind
the
“unity”
architecture?
S What
is
the
biggest
benefit
of
this
applica1on?
S Will
Teradata
evolve
this
fabric
in
the
next
genera1ons?
S What
releases
of
the
ecosystem
are
supported?
S Will
this
include
integra1on
of
other
Teradata
management
tools
in
the
future?
S How
can
Systems
Administrators
learn
this
architecture?
What
addi1onal
skills
are
needed?
@2012
Copyright
Sixth
Sense
Advisors
57. Thank
You
Krish
Krishnan
rkrish1124@yahoo.com
Twi]er
Handle:
@datagenius
@2012
Copyright
Sixth
Sense
Advisors