Hi Speed Datawarehousing

Hi-Speed DataWarehousing Jos van Dongen, Tholis Consulting

Agenda ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING

Hi-Speed Why? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING

Hi-Speed Where? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING

Hi-Speed How? Database Systems 2008 THOLIS CONSULTING Upgrade 2-5* Extend 5-100* Migrate 10-400* ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Upgrade Hardware: Cost ‘no issue’ Database Systems 2008 THOLIS CONSULTING <2000: Solve performance problems in software (tuning, optimization) 2008: hardware is cheaper than time!

Upgrade Hardware: Memory Database Systems 2008 THOLIS CONSULTING Feb 2008: 2 GB €41,- (PC) 4 GB €160,- (Server) Entry level server: 32 GB à €1.280,-

Upgrade Hardware: CPU Database Systems 2008 THOLIS CONSULTING 2004 2008

Upgrade Hardware: disk Database Systems 2008 THOLIS CONSULTING 2008: SSD disks + Access time 0,1 ms (vs. 4-5 ms SAS disk) + I/O *2-3 + Power consumption 10-20% of HDD + Noise level 0 db - Still very expensive: €2.300,- for 128 GB EMC Symmetrix: SSD as ‘ultra high performance’ option

Upgrade Software ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING

Extend: Add datamart(s) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING

Extend: ‘Buddy’ system ,[object Object],Database Systems 2008 THOLIS CONSULTING ,[object Object],[object Object],[object Object]

Extend: Datastore replacement ,[object Object],Database Systems 2008 THOLIS CONSULTING

Migrate: Appliances ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING

Migrate: ‘Roll your own’ ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING *Also available as DWH Appliance #Mostly special purpose solutions, e.g. BigTable

Part 2: New Hi-Speed Solutions ,[object Object],[object Object],[object Object],[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING * Netezza founders

What’s different? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING

SMP vs MPP Database Systems 2008 THOLIS CONSULTING ,[object Object],[object Object],[object Object],[object Object]

Rows vs Columns ,[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING Rows Columns

Products: Vertica (1) Database Systems 2008 THOLIS CONSULTING Architecture: WOS & ROS Architecture: Columns & projections ,[object Object],[object Object],[object Object],[object Object],[object Object]

Products: Vertica (2) Database Systems 2008 THOLIS CONSULTING

Products: ParAccel (1) Database Systems 2008 THOLIS CONSULTING ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],*SQL Server only; Oracle version in Beta

Products: ParAccel (2) Database Systems 2008 THOLIS CONSULTING ,[object Object],[object Object],[object Object],[object Object],[object Object]

Products: ExaSol Database Systems 2008 THOLIS CONSULTING ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Products: BrightHouse (1) ,[object Object],[object Object],[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING

Products: BrightHouse (2) Database Systems 2008 THOLIS CONSULTING

Products: DatAupia Database Systems 2008 THOLIS CONSULTING ,[object Object],[object Object],[object Object],[object Object],[object Object]

How Fast: TPC/H Benchmark Database Systems 2008 THOLIS CONSULTING ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Query Example: TPC-H Q9 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING

Remember last year? Database Systems 2008 THOLIS CONSULTING ,[object Object],[object Object]

How Fast: TPC-H 100 & 300GB Database Systems 2008 THOLIS CONSULTING

How Fast: TPC-H 1 TB Database Systems 2008 THOLIS CONSULTING But: So: Always verify your own workload against your own data!

Hi-Speed, what now? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Database Systems 2008 THOLIS CONSULTING

Database Systems 2008 THOLIS CONSULTING ?

Hi Speed Datawarehousing

Recomendados

Recomendados

Más contenido relacionado

La actualidad más candente

La actualidad más candente (18)

Destacado

Destacado (20)

Similar a Hi Speed Datawarehousing

Similar a Hi Speed Datawarehousing (20)

Último

Último (20)

Hi Speed Datawarehousing