Hp dba v.6.2 technical slides

H P D a t a b a s e Ar c h iv in g
- t e c h n ic a l d e t a il s

T h e s e a r e t e c h n ic a l s l id e s t o
u n d e r s t a n d ‘h o w t h in g s w o r k ’ u n d e r
t h e c o v e r s . T h is is n o t a c o m p l e t e
p r e s e n t a t io n b y it s e l f . In c o r p o r a t e
in t o y o u r c u s t o m e r f a c in g s l id e
d ecks & d emos.

T e c h n ic a l T o p ic s
• D e p l o y m e n t S c e n a r io s
• D a t a S e l e c t io n & R e p o r t in g
• D a t a Mo v e m e n t
• Ar c h iv e Ac c e s s
• N o t e : t h e a b o v e t o p ic s a s s u m e a w o r k in g
k n o w l e d g e o f D e s ig n e r t o m o d e l t a b l e s
an d rules .

2 C o n f id e n t ia l & P r o p r ie t a r y

Deplo ymen t
S c e n a r io s

©2 0 0 8 H e w l e t t -P a c k a r d D e v e l o p m e n t C o m p a n y , L .P .
T h e in f o r m a t io n c o n t a in e d h e r e in is s u b j e c t t o c h a n g e w it h o u t n o t ic e

Re l o a d b y
T y p ic a l D e p l o y m e n t S c e n a r io s Ar c h iv e R u n
or
b y T r a n s a c t io n
(D B t o D B o n l y )
P e r f o r m a n c e O p t im iz a t io n , S u b s e t t in g DB DB

M a in t a in
C o m p l ia n c e , Ap p l ic a t io n R e t ir e m e n t ,
DB XML O n l in e /O f f l in e
L o n g -t e r m s t o r a g e
Sto rage

u l t i-t ie r e d Ar c h iv in g (f u l l l if e c y c l e ) DB DB XML

Lo a d

C o m p l ia n c e Ar c h iv in g w it h e v e n t -b a s e d D B XDM L
B DB
o a d (t o a t e m p o r a r y D B )

a in t a in c o p y f o r l o n g -t e r m c o m p l ia n c e D B DB
e l e t e f r o m a r c h iv e D B a s r e q u ir e d ) Co p y
XML

D a t a S e l e c t io n


D a t a S e l e c t io n
• S t a n d a r d iz e d a c r o s s a l l d a t a m o v e m e n t m e t h o d s

• C r e a t e s d r iv in g r o w s f o r n e x t s t e p in t h e p r o c e s s
(d a t a m o v e m e n t )

• C a n b e r u n s t a n d a l o n e if d e s ir e d (w it h o u t
a u t o m a t ic a l l y g o in g t o t h e d a t a m o v e m e n t s t e p )

• E l ig ib il it y An a l y t ic s ™ e p o r t s p r o v id e d f o r t h e
r
b u s in e s s t o in v e s t ig a t e a n d c l e a n -u p
t r a n s a c t io n s t h a t a r e ‘s t u c k ’ (i.e in e l ig ib l e )

• Al l o w s r e p o r t in g o n e l ig ib l e a n d in e l ig ib l e
record s

• S u p p o r t s c o m p l e x c h a in e d r e l a t io n s h ip s b e t w e e n
6
t r a n s a c t io n s w it h C opn fr ee t -b&u r ilp rt t ar yl g o r it h m s
id n ia l P o ie a

S t a n d a r d S e l e c t io n
• S e l e c t io n d e t e r m in e s a r c h iv e c a n d id a t e s f o r
t h e d a t a m o v e m e n t s t e p a n d E l ig ib il it y
An a l y t ic s ™ p t io n a l )
(o
• T h e S e l e c t io n s t e p is r u n f o r e a c h c a r t r id g e
a n d a l w a y s r u n s t w o p r o c e s s e s – S e l source t io n _S E L
< e c tabl ename>

a n d E l ig ib il it y <PK1 Column> Id e n t if ic a t io n b y
R E P O S IT O R <PK2FColumn> R O W ID (O r a c l e
lags -
Y <…> o n ly)
E l ig ib il it y An a l y t ic s o n e
OBT_ROW_SEQ
Ke e p Re s u l t s
OBT_ROW_EXCLUDED
OBT_WF_RUN_ID
<source tablename>_EXC
OBT_GROUP_ID
OBT_SAVED_ROWID (*)

ELIGIBILITY _ RULE
OBT _ROW _SEQ
Selection OBT _WF _RUN _ ID
TABLE _ CATALOG
• Ta b l e s c r e a t e d a t Tables TABLE _OWNER
d e p l o y m e n t t im e in t h e TABLE _NAME
‘in t e r f a c e ’ s c h e m a
• On e t ab le f o r e ac h
t r a n s a c t io n t a b l e
• S e l e c t io n r o w s p o p u l a t e d Exclusion
d u r in g s e l e c t io n & e l ig ib il it y Tables
steps
• E x c l u s io n t a b l e p o p u l a t e d
d u r in g e l ig ib il it y s t e p
(o p t io n a l ) In t e r f a c e S c h e m a


S t a n d a r d S e l e c t io n
• S e l e c t io n P r o c e s s p o p u l a t e s t h e s e l e c t io n t a b l e s
b y c h o o s in g t h e r o w s t h a t m a t c h t h e g iv e n p o l ic y
a n d ‘u n r e c o r d e d ’ r u l e s (a s d e s ig n a t e d in D e s ig n e r )
• E l ig ib il it y p r o c e s s u s e s ‘r e c o r d e d ’ e l ig ib il it y r u l e s t o
d e t e r m in e e x c l u s io n s a n d r e c o r d s r e a s o n s (r o w s
t h a t c a n n o t b e a r c h iv e d ) T r a n s a c t io n
R E P O S IT O R
Y
T r a n s a c t io n T a b l e s Ta b l e s
P o l ic y Re c o r d e d
Un r e c o r d e d Ru l e s Ru l e s
Ru n
E l ig ib il it y
An a l y t ic s ™
Selection reports
S e l e c t io n Tables E l ig ib il it y a n d /o r
Pr o c e s s Pr o c e s s c o n t in u e
to d ata
D e t e r m in e s D is q u a l if ie d b y R u l e * movement
Exclusion s tep
‘s c o p e ’ o f r o w s
Tables
t o a c t u p o n (e .g
o ld er th an
Ja n -0 1 -2 0 0 5
ib il it y An a l ya n s ™ u l o b eetd r n e d
t ic d m s t s
‘c u ’) o n in t h e C o n s o l e t o p o p u l a t e e x c l u s io n t a b l e s

D a t a Mo v e m e n t


T r a n s a c t io n a l D a t a M o v e m e n t
• N o s p e c ia l c o d in g r e q u ir e d (s t a n d a r d
platfo rm feature)
• E n s u r e s c o m p l e t e t r a n s a c t io n s (a l l
r e l a t e d r o w s a c r o s s D e s ig n e r m o d e l )
a r e c o m m it t e d t o g e t h e r
• M a in t a in s c o n s is t e n c y o f t h e
p r o d u c t io n d a t a b a s e a n d a r c h iv e a t a l l
t im e s (e v e n in t h e e v e n t o f a f a il u r e )
• P r o v id e s h ig h d e g r e e o f s c a l a b il it y u s in g
j o b e n g in e a n d d a t a b a s e p a r a l l e l is m
• S u p p o r t s ‘o n l in e ’ a r c h iv in g (e n d -u s e r s
c a n r e m a in o n t h e s y s t e m )
• Al l o w s r e l o a d o f in d iv id u a l
t r a n s a c t io n s o r e n t ir e a r c h iv e r u n s

D a t a M o v e m e n t O p t io n s
• Databas e to Databas e
− T r a n s a c t io n a l (s t a n d a r d o p t io n )
− Ad v a n c e d O p t io n s f o r O r a c l e (w it h a d d it io n a l
l ic e n s in g )
B u l k
 P a r t it io n -b a s e d
• D a t a b a s e t o XML
− T r a n s a c t io n a l o n l y
• P l a t f o r m p r o v id e s b o t h D B t o D B a n d D B
t o X M L c a p a b il it ie s (s in g l e p l a t f o r m
l ic e n s e )
• S e l e c t io n p r o c e s s is s h a r e d a c r o s s a l l
d a t a m o v e m e n t t e c h n iq u e s

T r a n s a c t io n a l D a t a M o v e m e n t
1 -S t e p D a t a C o m m it s iz e
M o v e m e n t -Ar c h iv e s e t in
C o n s o l e (#
d a t a in s e r t e d o f d r iv in g
d ir e c t l y in t o table ro ws )
a r c h iv e t a b l e s . 3

D ELET E 2
So urce H is t o r y
Sch ema 1 COPY Sch ema

Next n rows
First n rows
E l ig ib l e R o w s
Ar c h iv e t a r g e t -
S E L E C T IO N V IE W In s o u r c e o r a r c h iv e d a t a b a s e
Selection Exclusion
Tables Tables

In t e r f a c e
Sch ema


D a t a M o v e m e n t P a r a l l e l is m
D a t a m o v e m e n t t h r o u g h p u t c a n b e s im p l y
a d j u s t e d b y t h e n u m b e r o f t h r e a d s , b a t c h s iz e
a n d /o r d a t a b a s e p a r a m e t e r s b a s e d o n t h e
a v a il a b l e # o f C P U s .

D ELET E
So urce H is t o r y
Sch ema COPY Sch ema

Jo b P a r a l l e l is m M e t h o d D a t a b a s e P a r a l l e l is m M e t h o d
Java Start Row- End Row- S E L E C T IO N V IE W
Threads Sequence Sequence Java Start Row- End Row-
Selection Exclusion
Tables Tables Threads Sequence Sequence
Thread#1 1 100
Thread#1 1 MAX
Thread#2 101 200
Database Threads Spawned and
Thread#3 201 300 In t e r f a c e Managed by Database
… … … Sch ema
H P Jo b E n g in e u s e s w o r k e r s
to s pawn th read s &
o p t im iz e t h r o u g h p u t


C h a in in g - Ad d it io n a l b u s in e s s
C h a in in g C o n c e p t r e l a t io n s h ip s e x is t s in a d d it io n
t o t a b l e r e l a t io n s h ip s t h a t
in t e r -r e l a t e t r a n s a c t io n s .
An y s in g l e t r a n s a c t io n in a
c h a in t h a t is in e l ig ib l e m a k e s
t h e e n t ir e c h a in in e l ig ib l e .


O r a c l e E B S /AR C h a in in g E x a m p l e

HP D at ab as e
Ar c h iv in g
p r o v id e s b u il t -in
a l g o r it h m s t o
a n a l y z e c h a in s
bas ed o n th e
D e s ig n e r m o d e l
(n o c o d in g
r e q u ir e d )


Ad v a n c e d D a t a M o v e m e n t O p t io n s
• Bu l k

• P a r t it io n -b a s e d (P D M )

• T h e s e o p t io n s a r e a v a il a b l e f o r O r a c l e
d a t a b a s e im p l e m e n t a t io n s o n l y

N o t e : if B u l k D a t a M o v e m e n t is u s e d o n e -t im e a s p a r t o f t h e s e r v ic e s
e n g a g e m e n t t h e n t h e c u s t o m e r d o e s n o t h a v e t o l ic e n s e t h is
o p t io n


Bu l k d a t a m o v e m e n t Dro p s o urce & ren ame
o r trun c ate & c o py
d a t a b a c k t o o r ig in a l
source
S o u r c e Ta b l e
Ar c h iv e E l ig ib l e R o w s R e t a in
Ta b l e
Ac t iv e R o w s Co p y
Ta b l e t o Ac t iv e Ex c l u d
ed
Ar c h iv eDEa ig ib l e R o w s
l ta Ro w s
a r c h iv e
h a s h ig h Ac t iv e D a t a Selection Exclusion Stan d ard
Tables Tables
percenta S e l e c t io n

ge of R e l o c a t e t o a r c h iv e d a t a b a s e
Ar c h iv e E l ig ib l e R o w s
e l ig ib l e C o p y E l ig ib l e
Ro w s
rows
(~5 0 % o r Ac t iv e D a t a Ar c h iv e
h ig h e r ) Ta b l e
Ar c h iv e E l ig ib l e R o w s

Tr a n s p o r t a b l e Ta b l e s p a c e

G o a l s : 1 . Ar c h iv e d a t a q u ic k l y b y
e l im in a t in g d e l e t e s
2 . Au t o m a t ic a l l y r e -o r g a n iz e s o u r c e
17 tables C o n f id e n t ia l & P r o p r ie t a r y

Ad d in g v a l u e t o O r a c l e
P a ratl y z ios n a r t it io n s f o r e l ig ib il it y (p a r t ia l o r
• An
it e p in g
co mplete)
• Id e n t if ie s c o m p l e t e s e t s o f d a t a a c r o s s
p a r t it io n e d a n d n o n -p a r t it io n e d t a b l e s (b a s e d
o n D e s ig n e r m o d e l )
• Al l o w s f u l l l if e c y c l e it ioanne a g a bml e n t n o t j u s t
Pa r t m d t e e
s t o r a g e t ie r in g (u n t il d e s t r u c t io n )

 AR C H IV E
D AT A
S TO RE

R e l a t e d n o n -p a r t it io n e d d a t a


P a r t it io n e d d a t a m o v e m e n t
Tr u n c a t e Ta b l e s
P a r t it io n in g S a l e s Or d e r Ta b l e R e t a in T a b l e
k e y = Cr e at e
Swap
Date
P a r t it io n s
N e x t Ye a r P1 4
P
P0 … P1 0 P1 1
P 0 P 1
Co p y
C u r r e n t Ye a o d a y
Tr Ex c l u d
P1 3 ed
Ro w s

C Y -1 P1 2 Selection Exclusion PD M
Tables Tables
S e l e c t io n

C Y -2 P 1 11
P Ar c h iv e T a b l e
C o p y E l ig ib l e Co p y t o
Ro w s a r c h iv e
CY -3 P1 0 d ataba
P0 … P1 0 P1 1 se
P o l ic y : … (u s in g
S h ip D a t e < S h ip D a t e Data
to d ay – 2 P0 Pu m p )
years Status

G o a l s : 1 . L e v e r a g e e x is t in g p a r t it io n in g
s c h e m e (k e y r a n g e )
2 . C o n s is t e n t e n f o r c e m e n t a r c h iv in g
19 p o l ic ie s & r u l e s C o n f id e n t ia l & P r o p r ie t a r y

Ar c h iv e Ac c e s s


Ar c h iv e Ac c e s s O p t io n s
• X M L S e a r c h /R e t r ie v e
− L o n g -t e r m p r e s e r v a t io n o f d a t a
− S e a r c h a n d v ie w a r c h iv e r e c o r d s (AS C II t e x t
v ie w )
− L o a d t o d a t a b a s e f o r m o r e in t e n s e
r e s e a r c h /in q u ir ie s
• B I/R e p o r t in g t o o l s a c c e s s
− R u n c u s t o m q u e r ie s a g a in s t X M L o r
D a t a b a s e Ar c h iv e
− ‘H is t o r y O n l y ’ a c c e s s t o d a t a

• Tr a n s p a r e n c y
− N a t iv e a p p l ic a t io n a c c e s s & s e c u r it y (in
a d d it io n t o B I/R e p o r t in g t o o l s a c c e s s )
− C o m b in e d R e p o r t in g ™ a p a b il it ie s (c u r r e n t +
c

X M L S e a r c h /R e t r ie v e

R E P O S IT O R
Y

IN D E X E S
Search & Retrieve

S O URCE Ar c h iv e D a t a S t o r e
.XSD .XSD .XSD

.XML .XML .XML
.XSD .XSD .XSD

.XML
Database to File .XML
Database to File .XML
Database to File

Reload
.XSD .XSD .XSD

.XML .XML .XML
.XSD .XSD
.XSD

.XML .XML
.XML

TEMP D B


R e p o r t in g /B I Ac c e s s

Ar c h iv e Ac c e s s
‘H is t o r y O n l y Q u e r ie s ’
SQL SQL

ARCHIVE QUERY SERVER

C O L L E C T IO N S D y n a m ic
Sales
POs In v o ic e s In d e x e s
Us e r s Or d er s

Archive V ie w s Ta b l e s
D atabase XS D
Ar c h iv e D a t a S t o r e

.XSD .XSD .XSD

.XML .XML .XML
.XSD .XSD .XSD

.XML Database to File .XML Database to File .XML Database to File
.XSD .XSD .XSD

.XML .XML .XML
.XSD .XSD .XSD

.XML .XML .XML

Re load
D atabase

O n l in e /O f f l in e S t o r a g e


M o r e t h a n u n io n v ie w s !
T r a n s p a r e n c y D e f in e d
• Ap p l ic a t io n l e v e l a c c e s s
− L e v e r a g e s a p p l ic a t io n s e c u r it y m o d e l
− P r o v id e s u s e r s w it h s a m e n a v ig a t io n a s p r o d u c t io n
sys tem
− Al l o w s a c c e s s t o s t a n d a r d s c r e e n s a n d r e p o r t s in
r e a d -o n l y m o d e
− P r e s e r v e s u s e o f e x is t in g q u e r ie s /r e p o r t s (in c l u d in g
t h ir d -p a r t y r e p o r t in g t o o l s )

• C o m b in e d R e p o r t in g ™
− Al l o w s c u r r e n t + a r c h iv e d a t a t o b e q u e r ie d in a
s in g l e s c r e e n /r e p o r t
− H ig h l y o p t im iz e d a c r o s s d is t r ib u t e d d a t a b a s e s
− ‘H is t o r y o n l y ’ o p t io n a v a il a b l e (a r c h iv e o n l y
t r a n s a c t io n s )

• Au t o m a t e d g e n e r a t io n &
24 s y n c h r o n iz a t io n C o n f id e n t ia l & P r o p r ie t a r y

T r a n s p a r e n c y Ar c h it e c t u r e
Ar c h iv e Ac c e s s s c h e m a s a r e c r e a t e d u s in g t h e
T r a n s p a r e n c y G e n e r a t o r a n d a r e d is t in c t f r o m t h e a r c h iv e
d a t a . E a c h p r o d u c t io n o b j e c t is c l o n e d a n d g e n e r a t e d .
Ke y Fe a t u r e s -
•D r o p a n d g e n e r a t e AA s c h e m a s a t a n y t im e
•T w o m o d e s – F u l l o r N e t C h a n g e (j u s t n e w o b j e c t s )
•Ar c h iv e s c h e m aAp pa ic a b e c r e a t e d in S O U R C E o r H IS T O R Y
Ap p l ic a t i
c ln
d a nt a b a sProductionn f ig tu r a b l e )
o e (c o
S chema
io n Archive Access Schema
Me t a d a t S e c u r it Tr a n s p a
a y rency
Syn o n y
Pac k a g e s V ie w s Ge n e r a t
ms
or
Tr a n s a c t Ma s t e r Re f e r e n
io n D a t a Data c e Data

S C H E M A1 S C H E M A2 S C H E M A…

Indexes Indexes Indexes S C H E M A1 S C H E M A2 S C H E M A…

Non-managed Non-managed Non-managed In d e x e s In d e x e s In d e x e s
tables tables tables Relocation
Managed tables Managed tables Managed tables Archive tables tablespace
Archive tables Archive tables


T r a n s p a r e n c y Ar c h it e Al l t aun a g ed t a b l e s
c m re
M o d e l s /t a b l e l is t a r e a u t o m a t ic a l l y
g e n e r a t e d a s v ie w s –
j o in e d v ie w s if C o m b in e d
R E P O S IT O R Y
R e p o r t in g ™ s e l e c t e d .
is

Ap p l ic a t i Ap p l ic a
on Production t io n Archive Access Schema
Me t a d a t S chema S e c u r it Tr a n s p a
a y rency
Syn o n y
ms
or B AS E
io n D a t a Data c e Data V IE W S

Sub Sub
Indexes Indexes Indexes Query Query S C H E M A1 S C H E M A2 S C H E M A3

Managed tables Managed tables Managed tables Managed tables tablespace
Managed tables Managed tables


M o d e l s /t a b l e l is t
D e p e n d e n t o b je c t s
R E P O S IT O R Y a r e a u t o m a t ic a l l y
gen erated fro m th e
d atabas e c atalo gs .

on Production t io n Archive Access Schema
a y rency
Syn o n y V IE W S S Y N O N Y M S P AC K AG E S
ms
or B AS E

Sub Sub



R e m a in in g o b j e c t s a r e
M o d e l s /t a b l e l is t g e n e r a t e d a s s y n o n y m s t o
p r o d u c t io n o b j e c t s
(t a b l e s /v ie w s /s y n o n y m s
R E P O S IT O R Y e t c .)

Production
on t io n S y n o nArchiveN o n -m a n a g e d o b j e c t s
yms Access Schema
a y rency
ms
or B AS E
S
M
Y
N
O
N
Y
S

Sub Sub



Ar c h iv e C o n n e c t io n
P r o d u c t io n C o n n e c t io n
AP P L IC AT IO N (a p p s s e r v e r /d b s e r v e r )
(a p p s s e r v e r /d b s e r v e r )

1 0 ,0 0 0 o b j e c t s = 1 0 ,0 0 0 o b j e c t s
Production
on t io n S y n o nArchiveN o n -m a n a g e d o b j e c t s
yms Access Schema
a y rency
ms
or B AS E
S
M
Y
R e a d /w r it e a c c e s s N R e a d -o n l y a c c e s s
O
N
Y
S

Sub Sub



Ke y Tr a n s p a r e n c y Fe a t u r e s
• F u l l s u p p o r t f o r n a t iv e a p p l ic a t io n a c c e s s a n d
s e c u r it y f o r a r c h iv e in q u ir ie s /r e p o r t s
• C u r r e n t + a r c h iv e d a t a in a s in g l e r e p o r t /in q u ir y
u s in g C o m b in e d R e p o r t in g ™ a p a b il it ie s
c
• S e s s io n a n d q u e r y o p t im iz a t io n
• R e a d -o n l y a c c e s s (in c l u d in g p r e v e n t io n o f
u p d a t e s t o p r o d u c t io n )
• S u p p o r t f o r s c h e m a e v o l u t io n (d u e t o p a t c h in g
e t c .)
• R u n T r a n s p a r e n c y G e n e r a t o r in F u l l o r N e t
Ch an g e m o d e
• M u l t i-s c h e m a s u p p o r t


Hp dba v.6.2 technical slides

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (19)

Destacado

Destacado (6)

Similar a Hp dba v.6.2 technical slides

Similar a Hp dba v.6.2 technical slides (20)

Último

Último (20)

Hp dba v.6.2 technical slides

Notas del editor