Open Source Software on OpenPOWER systems. With 100% open source system software (including the firmware), OpenPOWER is the most open server architecture in the market. Based on the IBM POWER8 chip, this new family of servers featuring the latest Nvidia NVLink technology runs all the software solutions presented at OPEN'16 with significant cost advantages. This session explains how Docker, EnterpriseDB and many others benefit from this advanced design, and how 200+ technology companies including Google and RackSpace are collaborating in an open development alliance to build the datacenter of the future.

1. Open source on IBM POWER System
Franz Bourlet
POWER Linux Technical sales
September 29, 2016

2. Open standards offer choice
Applications
Operating Systems
Hypervisors
HW Architecture
Software Stack ComponentsCommonality
Difference = $$
Visibility
####
###
##
#
Evolution of SW Stack
“Platform”
“Platform”
“Platform”
“Platform”
Open source – driving commonality & reducing expense

3. Example : new platform for EnterpriseDB project
EDB
Linux LE
KVM
Dell, HP, Lenovo,…
x86

4. EDB
Linux BE
PowerVM
IBM
POWER7
EDB
Linux LE
KVM
Dell, HP, Lenovo,…
x86
Example : new platform for EnterpriseDB project

5. EDB
Linux LE
KVM
IBM, Tyan, Supermicro,…
POWER8
EDB
Linux LE
KVM
Lenovo, Dell, HP,…
x86
Same application
Example : new platform for EnterpriseDB project
Same operating system
Same hypervisor
Manufacturer choice

6. EDB
Linux LE
KVM
IBM, Tyan, Supermicro,…
POWER8
EDB
Linux LE
KVM
Lenovo, Dell, HP,…
x86
PLUS :
Better performance per €
Fewer SW licenses
100% open ecosystem
Better RAS
Unparalleled acceleration
Example : new platform for EnterpriseDB project
Same application
Same operating system
Same hypervisor
Manufacturer choice

7. Manufacturer choice

8. NVIDIA:
Tesla P100 GPU with NVLink Interface
Ubuntu : NVLink compatible OS
Wistron: Platform co-design
Mellanox: InfiniBand/Ethernet
Connectivity in and out of server
Samsung: 2.5” SSDs
HGST: Optional NVMe Adapters
Hynix, Samsung, Micron: DDR4
IBM: POWER8 CPU
POWER S822LC for high performance computing
8

9.  Open source virtualisation from IBM
(PowerKVM) or distributor
 Provides simplicity and familiarity for
VMware and KVM x86 Linux admins
 Integrates with OpenStack
environments, including vRealize
 GUI console
 Exploits KVM live migration,
POWER8 SMT and micro-threading
functionalities
Same hypervisor

10. Built from the same source as x86
Delivered on the same schedule as x86
Supported at the same time as x86
Same operating system

11. Estimated >95% x86/Linux
applications written in C/C++
will require no source code
change, only a recompile
Moving Linux apps to Power has never been easier
Well-written Java applications
written in scripting or interpretive
languages will run as is
>95%
Require no source code change
+
Same application

12. EDB
Linux LE
KVM
IBM, Tyan, Supermicro,…
POWER8
EDB
Linux LE
KVM
Lenovo, Dell, HP,…
x86
PLUS :
Better performance per €
Fewer SW licenses
100% open ecosystem
Better RAS
Unparalleled acceleration
First review
Same application
Same operating system
Same hypervisor
Manufacturer choice

13. Latest Intel (2016) vs latest POWER (2014)

14. 2S=2 Socket, 4S=4 Socket, 8S=8 Socket, DCM=Dual Chip Module, SCM=Single Chip Module, Low Power Models Not Included, Updated 6/1/2015
Chip Family
Core
Frequency
(GHz)
L1 plus L2
Cache per
Core (KB)
Approximate
Cache per Core
(MB)
Intel 26xx-V4 (2S, 8+ Cores) 1.7 – 3.6 320 2.81 – 3.44
Intel 46xx-V4 (4S, 8+ Cores) 1.8 – 2.6 320 2.81 – 4.06
Intel 48xx-V4 (4S, 8+ Cores) 2.0 – 2.1 320 2.81
Intel 88xx-V4 (8S, 8+ Cores) 2.1 – 2.8 320 2.81 – 6.31
POWER8 (DCM, 8+ Cores) 3.02 – 4.15 608 19.27
POWER8 (SCM, 8+ Cores) 4.02 – 4.35 608 19.27
IBM z13 5.0 4,320 32.22
Note: Only 3 of the 42 Intel chips included on this chart have greater than 2.81 MB of
cache per core. Only 3 of the chips included have clock frequencies >= 3 GHz
Cache per core

15. Superior price / performance : EDB
© 2016 IBM Corporation
1.72X
Better
Price-performance
IBM Power S822LC
(16-core, 128GB)
HP
DL380 Gen9
(36-core, 128GB)
Server web price*
-3-year warranty
$15,105 $29,871
System Cost
-Server + RHEL OS + EDB Annual
Subscription @ $1,750 per core
$44,404
($15,105 + $1,299 + $28,000)
$94,170
($29,871 + $1,299 + $63,000)
EDB pgbench
Total Transactions per Second
406.6k tps 500.2k tps
$ / k TPS 109 $ / k tps 188 $ / k tps
1.72X
better
•Results are based on IBM internal testing of single system and OS image running with pgbench work load at scale factor of 1000 and are current as of March 16, 2016. Individual results will
vary depending on individual workloads, configurations and conditions. OS and EDB support price is for 1 year duration and Hardware is 3 yr standard support.
•IBM Power System S822LC; 16 cores / 64 threads, POWER8; 3.3 GHz, 128 GB memory, EDB 9.4, RHEL 7.1 compared to Competitive stack: HP Proliant DL380 Gen9; 36 cores / 72 threads;
Intel E5-2699 v3; 2.3 GHz; 128 GB memory, EDB 9.4, RHEL 7.1 Both tested configurations represent the highest processor frequency for that specific processor and incuded 2 x 1TB SATA
7.2K rpm HDD, 1 Gb 2-port, 2 x 16gbps FCA
•Pricing is based on web pricing for S822LC http://www-03.ibm.com/systems/power/hardware/s822lc-commercial/buy.html EDB 9.4 http://www.enterprisedb.com/products-services-
training/subscriptions-power and HP DL380 Gen9 https://h22174.www2.hp.com/SimplifiedConfig/Index
1.8X
Better per
core

16. Superior price / performance : Docker

17.  ALL data is PUBLISHED
SAP results are based on the two-tier SAP SD standard application benchmark running SAP enhancement package 5 for the SAP ERP 6.0 application. Results valid as of September 8, 2014. Source:
http://www.sap.com/benchmark
SPECcpu2006 results are submitted as of 9/8/2014. For more information go to http://www.specbench.org/cpu2006/results/
SPECjbb2013 results are submitted as of 9/8/2014. For more information go to http://www.specbench.org/jbb2013/results
SPECjEnterprise2010 results are valid as of 9/8/2014. For more information go to http://www.specbench.org/jEnterprise2010/results/
Oracle eBS 12.1.3 Payroll Batch Extra Large Kit and are current as of 3/24/2014. For more information go to http://www.oracle.com/us/solutions/benchmark/apps-benchmark/results-166922.html
Siebel 8.1.1.4 PSPP Kit and are current as of 3/24/2014. For more information go to http://www.oracle.com/us/solutions/benchmark/white-papers/siebel-167484.html
Superior price / performance : other workloads

18. Example : mix of IBM SWG workloads requiring 50 cores (20€/PVU) on x86 :
Fewer software licenses : IBM SW
- Scale out approach (2-socket) :
70 PVU X 50 X 20 = 70K
- Optimized scale out (4-socket) :
100 PVU X 50 X 20 = 100K
- Scale up approach (> 4-socket) :
120 PVU X 50 X 20 = 120K
- Scale out approach (2-socket) :
70 PVU X 25 X 20 = 35K
- Optimized scale out (4-socket) :
70 PVU X 25 = 35K
- Scale up approach (> 4-socket) :
70 PVU X 25 = 35K

19. 100% open ecosystem

20. OpenPOWER Foundation : from 0 to 200+ members in 20 months
Complete list on http://openpowerfoundation.org/membership/current-members/

21. Processors
Semiconductor Technology
System stack innovations are required to drive Cost/Performance
Workload Acceleration
Services Delivery Model
Advanced Memory Tech
Network & I/O Accel
Use Cases
Microprocessors alone no longer drive sufficient Cost/Performance improvements
Processors
Semiconductor Technology
POWER8 Linux
OpenPOWER
NEW
Unparalleled acceleration

22. Current CPU to GPU PCIe Attachment
System
Bottleneck
Graphics
Memory
CPUDDR4
GPUGPU NVLink
115GB/s
80 GB/s
POWER8 with NVLink Technology
CPUDDR4
GPU
PCIex163.0
32GB/s
Graphics
Memory
Graphics
Memory
POWER8 with NVLink
delivers >2.5X the
bandwidth
PCIe Data Pipe
POWER8 with NVLink
Data Pipe
THE platform for applications utilizing CPU-GPU
bandwidth!
<77GB/s
25
Unparalleled acceleration : NVLink

23. 2.1X
Better
Price-performance
Unparalleled Acceleration with NVLink –
2.4X Better Performance at 52% Lower Cost per Query/Hour
26
IBM Power
S822LC for HPC
(20-core, 256GB,
4xPascal)
Dell
C4130
(20-core, 256GB, 4xK80)
Server price*
-3-year warranty
$66,612 $57,615
GPUDB
Total Queries per Hour
444 qph 185 qph
$ / k TPS 150 $ / qph 311 $ / qph
2.1X
better
52%
Lower HW costs and
maintenance per qph
2.4X
More Performance
per Server
@
• All results are based on running GPUDB query (filter by geographic area query)
• IBM Power System S822LC; 10 cores (2 x 10c chips) / 160 threads, POWER8; 2.9 GHz, 256 GB memory, 4xP100 GPU; RHEL 7.2.
• Competitive stack: Dell C4130 E5-2640 v4; 20 cores (2 x 10 chips) / 40 threads; Intel E5-2640 v4; 2.4 GHz; 256 GB memory, RHEL 7.2 . Both server priced with 2 x 1TB
SATA 7.2K rpm HDD, 10 Gb 2-port.
• Pricing is based on list prices expected for S822LC for HPC and Dell prices form Gartner list price
Accelerated application example : Kinetica

24. 2015 ITIC Global Server Reliability Report
Sources: http://www.bitpipe.com/detail/RES/1446127681_768.html
Category Best Non z Systems Result
Best Tier 1 Unplanned Downtime
(Under 1 hour)
IBM Power
Best Tier 2 Unplanned Downtime
(1 to 4 hours)
IBM Power
Best Tier 3 Unplanned Downtime
(Greater than 4 Hours)
IBM Power (a)
Best Virtualization Reliability IBM PowerVM
(a) Lenovo x86 was the only x86 platform that achieved a tie with IBM Power for unplanned down time > 4 Hours
Superior RAS

25. EDB
Linux LE
KVM
IBM, Tyan, Supermicro,…
POWER8
EDB
Linux LE
KVM
Lenovo, Dell, HP,…
x86
PLUS :
Better performance per €
Fewer SW licenses
100% open ecosystem
Better RAS
Unparalleled acceleration
Final review
Same application
Same operating system
Same hypervisor
Manufacturer choice

26. First OpenPOWER Summit Europe – 26-28 october

27. TCO calculator : https://extbasicdsgtool.podc.sl.edst.ibm.com/power8tco/power8_tool.html
POWER portal : http://www-03.ibm.com/systems/power/software/linux/index.html
Videos and demos : https://www.youtube.com/results?search_query=power8+linux
POWER Linux Community :
https://www.ibm.com/developerworks/community/groups/service/html/communityview?communit
yUuid=fe313521-2e95-46f2-817d-44a4f27eba32
OpenPOWER Foundation : http://openpowerfoundation.org/
Google / Rackspace Zaius project :
http://www.nextplatform.com/2016/04/06/inside-future-google-rackspace-power9-system/
Test zone : POWER in the cloud : http://www.siteox.com/ - http://www.softlayer.com/
POWER open lab : http://ptopenlab.com/cloudlabconsole/#/
Great links

28. Recent Redbooks
Link
Link
Link to search for “Linux” on the Power Systems Redbooks site
Link