POWER8 Hardware Dan Hurlimann System p Hardware Architect

June 2014
POWER8 Hardware
Dan Hurlimann
System p Hardware Architect
[email protected]
© 2014 IBM Corporation
Agenda
POWER8 chips
Power Road map
Scale-out Servers
New HMC & virtualization management
OS support
SAS I/O .... adapters, Easy Tier
© 2014 IBM Corporation
POWER8
Processor
© 2014 IBM Corporation
Power Processor Technology Roadmap
POWER9
POWER8
POWER5/5+
130/90 nm
Dual Core
Enhanced Scaling
SMT
Distributed Switch +
Core Parallelism +
FP Performance +
Memory Bandwidth +
Virtualization
2004
© 2014 IBM Corporation
POWER6/6+
65/65 nm
POWER7/7+
45/32 nm
Eight Cores
On-Chip eDRAM
Power-Optimized Cores
Memory Subsystem ++
SMT++
Dual Core
Reliability +
High Frequencies
VSM & VSX
Virtualization +
Memory Subsystem + Protection Keys+
Altivec
Instruction Retry
Dynamic Energy Mgmt
SMT +
Protection Keys
2007
2010
More Cores
SMT+++
Reliability ++
FPGA Support
Transactional Memory
PCIe Acceleration
2014
Extreme Analytics
Optimization
Extreme Big Data
Optimization
On-chip accelerators
POWER8 Highlights
Announced 2013 at Hot Chips Conference
12 Cores per Socket/Chip
Significantly Strengthened Cores
8 threads per core (SMT8)
Wider fetch / dispatch/issue of instructions (8 fetch / dispatch, 10 issue)
Doubled highly utilized execution units
Larger Caches:
64K D Cache, 32K I Cache, 512K private L2, 8M L3 / Core (96M)
2 Integrated Memory Controllers w/ Improved Latency & BW
~ 25% memory latency improvement via on-chip fastpath interconnect
16MB mem cache / buffer chip
Integrated SMP Interconnect w/ improved “Flatness”
2-Hop fabric topology
Integrated IO Subsystem
On Chip PCIe Controller
Fine Grained Power Management
On Chip Power Management Controller & Power gating
© 2014 IBM Corporation
Scale Out Systems - DCMs and POWER8 Chips
1S & 2S servers use DCM (Dual Chip Module)
 1 DCM fills 1 socket …. Similar to POWER7+ 750 / 760
 1 DCM has two Scale Out POWER8 chips
 1 DCM can provide 6-core, 8-core, 10-core or 12-core sockets
Remote SMP Links
PCI Gen 3 Links
© 2014 IBM Corporation
Local SMP Links
Accelerators
6-core Processor Chip
 362 mm2
 22nm SOI w/ eDRAM
Strengthen Cores
 8 Threads per Core
Caches
 D Cache: 64KB
 L2: 512KB
 L3: 8 MB per Region
Total: 48MB
Fine Grained Power Management
 On Chip power management
Excellent I/O bandwidth per socket
Core
Core
Core
L2
8M L3
Region
L2
L2
L3 Cache & Chip Intercon MemCtrl
L2
L2
L2
Core
Core
Core
POWER8 Memory Buffer Chip
DRAM
Chips
Memory
Buffer
DDR Interfaces
Intelligence Moved into Memory
• Scheduling logic, caching structures
• Energy Mgmt, RAS decision point
– Formerly on Processor
– Moved to Memory Buffer
Processor Interface
• 9.6 GB/s high speed interface
• More robust RAS
•“ On-the-fly” lane isolation/repair
Performance Value
• End-to-end fastpath and data retry (latency)
• Cache  latency/bandwidth, partial updates
• Cache  write scheduling, prefetch, energy
© 2014 IBM Corporation
16MB
Scheduler &
POWER8
Memory
Management Cache Link
POWER8 Memory Organization
DRAM
Chips
Memory
Buffer
128
GB
16MB
(Max Config shown)
16MB
128
GB
POWER8 DCM
128
GB
16MB
16MB
128
GB
128
GB
16MB
16MB
128
GB
128
GB
16MB
16MB
128
GB
 Up to 1 TB / Socket
 First P8 Systems:
 512 GB /Socket
© 2014 IBM Corporation
POWER8 Integrated PCI Gen 3
POWER8
Native PCIe Gen 3 Support
POWER7
•
•
•
•
Direct processor integration
Replaces proprietary GX/Bridge
Low latency
Gen3 x16 bandwidth (32 GB/s)
Transport Layer for CAPI Protocol
GX
Bus
•
•
Coherently Attach Devices connect to
processor via PCIe
Protocol encapsulated in PCIe
PCIe G3
I/O
Bridge
PCIe G2
PCI
Devices
© 2014 IBM Corporation
PCI
Device
CAPI - Coherent Accelerator Processor Interface
10
© 2014 IBM Corporation
CAPI - Coherent Accelerator Processor Interface
Virtual Addressing
• Accelerator can work with same memory addresses that the
processors use
• Pointers de-referenced same as the host application
• Removes OS & device driver overhead
POWER8
POWER8
Coherence Bus
Hardware Managed Cache Coherence
• Enables the accelerator to participate in “Locks” as a normal
thread Lowers Latency over IO communication model
Custom
Hardware
Application
PSL
FPGA or ASIC
PCIe Gen 3
Transport for encapsulated messages
Processor Service Layer (PSL)
• Present robust, durable interfaces to applications
• Offload complexity / content from CAPP
Customizable Hardware
Application Accelerator
• Specific system SW, middleware, or user application
• Written to durable interface provided by PSL
11
© 2014 IBM Corporation
CAPP
CAPI Optimization Example (Flash Device)
Application
Read/Write
Syscall
FileSystem
strategy()
iodone()
LVM
strategy()
iodone()
Disk & Adapter DD
Pin buffers,
Translate,
Map DMA,
Start I/O
20K
Instructions
Interrupt,
unmap,
unpin,Iodone
scheduling
Application
Posix Async
I/O Style API
aio_read()
aio_write()
User Library
< 500
Instructions
Shared
Memory
Work Queue
Attach TMS Flash to POWER8 via CAPI coherent Attach
Issues Read/Write Commands from applications to eliminate 97% of code path length
Saves 10 Cores per 1M IOPs
12
© 2014 IBM Corporation
POWER8 Multi-threading Options
4
SMT1: Largest unit of execution work
SMT2: Smaller unit of work, but provides
greater amount of execution work per
cycle
SMT4: Smaller unit of work, but provides
greater amount of execution work per
cycle
SMT8: Smallest unit of work, but provides
the maximum amount of execution work
per cycle
Can dynamical shift between modes as
required: SMT1 / SMT2 / SMT4 / SMT8
Mixed SMT modes supported within
same LPAR
 Requires use of “Resource Groups”
3.5
3
2.5
2
1.5
1
0.5
0
P7
P8
P8
P8
P8
SMT1 SMT1 SMT2 SMT4 SMT8
© 2014 IBM Corporation
POWER8 SMT Scaling (Briefing Center System)
1000’s of Transactions
2.5
2
1.5
1
0.5
0
SMT1
© 2014 IBM Corporation
SMT2
SMT4
SMT8
POWER8
Bandwidths
© 2014 IBM Corporation
POWER8 IO Bandwidth
POWER8
POWER7+
POWER7
POWER6
0
50
100
GB/Sec
© 2014 IBM Corporation
150
200
POWER8 Memory Bandwidth per Socket
POWER8
POWER7
POWER6
POWER5
0
50
100
GB/Sec
© 2014 IBM Corporation
150
200
POWER8
Roll Out
© 2014 IBM Corporation
Power System Roadmap
2013
2014
Enhanced HMC
Management
KVM
PowerVC
PowerVP
4U Systems: S814 & S824
Power
Linux Engines
Enterprise
Pools
2U System: S822
2U Linux: S812L & S822L
© 2014 IBM Corporation
POWER8
Power April Announcements
New Scale-Out Servers with POWER8 technology
 2U servers: 2 socket
 4U servers: 1 socket and 2 socket
Linux-only server models
 2U servers: 1 socket and 2 socket
New Virtualization Management
 IBM PowerKVM – Kernel Virtual Machine
 PowerKVM for Linux-only servers
New HMC Functionality
 LPAR Creation
 LPAR Management
 Performance Monitoring
© 2014 IBM Corporation
Power April Announcements
New IBM i Releases
 IBM i 7.2 --- New Release
 IBM i 7.1 --- New Technology Refresh, TR8
POWER8 Hardware support
 IBM BLU Acceleration Solution - Power Systems Edition
 IBM PowerVP – Virtualization Performance
 IBM PowerSC – Security and Compliance
 IBM PowerVM
 IBM PowerVC
© 2014 IBM Corporation
1&2 Socket Servers
New Scale-Out Servers with POWER8 technology
 1 socket :
 2 socket:
4U
2U and 4U
S814
S822 and S824
Linux-only Power Systems
 1 socket:
 2 socket:
2U
2U
S812L
S822L
1 Socket
1 Socket
2 Socket
Opt 1S
2 Socket
Opt 1S
2 Socket
S814
S812L
S824
S822
S822L
8286-41A
8247-21L
8286-42A
8284-22A
8247-22L
4U
2U
4U
2U
2U
© 2014 IBM Corporation
POWER8
Systems
© 2014 IBM Corporation
2U Server
© 2014 IBM Corporation
POWER8 2S2U Layout
PCIe G3 x8
2X SAS
Ports
PCIe G3 x16
Memory
POWER8
PCIe G3 x16
Memory
PCIe G3 x8
POWER8
12 SFF Bays
USB-3
6 SSD Slots
Slim DVD
© 2014 IBM Corporation
USB-3
Memory
2xHMC
Serial
USB-2
HMC
POWER8 2S2U Scale-Out System
Power S822
 Single Socket populated
 Cores:
6 or 10
 Memory:
Up to 512 GB
 PCIe Slots: 6 PCIe Gen3 LP (Hotplug)
 Both Sockets populated
 Cores:
12 or 20
 Memory:
Up to 1 TB
 PCIe Slots: 9 PCIe Gen3 LP (Hotplug)
 Ethernet: Quad 1 Gbt / (x8 slot)
3 Yr Warranty
 Integrated ports: USB (4), Serial (2), HMC (2)
 Internal Storage
 DVD
 12 SFF Bays -- Split Backplane: 6 + 6
 or 8 SFF Bays & 6 1.8” SSD Bays with Easy Tier with 7GB write cache
 Hypervisor: PowerVM
 OS: AIX, Linux
(not IBM i)
© 2014 IBM Corporation
POWER8 Linux 2S2U Scale-Out System
Power S822L
 Dual Sockets
 Cores:
20 or 24
 Memory:
Up to 1 TB
 Slots:
9 PCIe Gen3 LP (Hotplug)
 Ethernet: Quad 1 Gbt / (x8 slot)
 Integrated ports: USB (4), Serial (2), HMC (2)
 Internal Storage
 DVD
 12 SFF Bays -- Split Backplane: 6 + 6
 or 8 SFF Bays & 6 1.8” SSD Bays with Easy Tier with 7GB write cache
 Hypervisor: PowerVM or PowerKVM
 OS: Linux
3 Yr Warranty
© 2014 IBM Corporation
POWER8 2S2U Scale-Out Comparison - S822
Power 730
Power System S822
Processor
Sockets
Cores
Maximum Memory
Memory Cache
Memory Bandwidth
Memory DRAM Spare
System unit PCIe slots
CAPI (Capable slots)
PCIe Hot Plug Support
PCIe Expansion Drawers
IO bandwidth
Ethernet ports
POWER7+
2
8 / 12 / 16
512 MB @ 1066 MHz
No
136 GB/sec
No
6 PCIe Gen2 LP
N/A
No
Optional PCIe Gen1
40 GB/sec
Quad 1 Gbt in x4 slot
SAS bays in system unit
3 or 6 SFF-1
Integrated write cache
Easy Tier Support
Integrated split backplane
NIC SRIOV Support
Service Processor
Optional 175MB
No
Yes ( 3 + 3 )
No
Generation 1
POWER8
1 (Upgradeable) / 2
6 / 10 or 12 / 20
256 / 512 GB @ 1600 MHz
Yes
192 / 384 GB/sec
Yes
6 / 9 PCIe Gen3 LP
Yes (one per socket)
Yes
SoD Gen3
192 GB/sec
Quad 1 Gbt in x8 slot
12 SFF-3
Or 8 SFF-3 + 6 SSD
Optional effectively 7GB
Yes
Yes ( 6 + 6 )
SoD
Generation 2
© 2014 IBM Corporation
POWER8 2S2U Scale-Out Comparison - S822L
Power 730
Power System S822L
Processor
Sockets
Cores
Maximum Memory
Memory Cache
Memory Bandwidth
Memory DRAM Spare
POWER7+
2
16
512 MB @ 1066 MHz
No
136 GB/sec
No
POWER8
2
24
512 GB @ 1600 MHz
Yes
384 GB/sec
Yes
System unit PCIe slots
6 PCIe Gen2 LP
9 PCIe Gen3 LP
CAPI (Capable slots)
PCIe Hot Plug Support
PCIe Expansion Drawers
IO bandwidth
Ethernet ports
N/A
No
Optional PCIe Gen1
40 GB/sec
Quad 1 Gbt in x4 slot
Yes (one per socket)
Yes
SoD Gen3
192 GB/sec
Quad 1 Gbt in x8 slot
SAS bays in system unit
3 or 6 SFF-1
12 SFF-3
Or 8 SFF-3 + 6 SSD
Integrated write cache
Easy Tier Support
Integrated split backplane
NIC SRIOV Support
Service Processor
Opt 175MB
No
Yes ( 3 + 3 )
No
Generation 1
Opt effectively 7GB
Yes
Yes ( 6 + 6 )
SoD
Generation 2
© 2014 IBM Corporation
4U Servers
© 2014 IBM Corporation
System 1S4U Layout
PCIe G3 x8
4x 1Gbt Enet
2x SAS Ports
PCIe G3 x16
2xUSB-3
Memory
POWER8
SSD Bays
18 SFF Bays
2xUSB-3
Slim DVD
© 2014 IBM Corporation
Memory
2xHMC
2xSerial
2xUSB-2
System 2S4U Layout
PCIe G3 x8
4x 1Gbt Enet
2x SAS Ports
PCIe G3 x16
PCIe G3 x16
Memory
2xUSB-3
Memory
PCIe G3 x8
POWER8
Memory
POWER8
SSD Bays
18 SFF Bays
2xUSB-3
Slim DVD
© 2014 IBM Corporation
2xHMC
2xSerial
2xUSB-2
POWER8 1S4U Scale-Out System
Power S814
 Form Factor: 4U or Tower
 Single Socket
 Cores:
6 or 8
 Memory:
Up to 512 GB
 Slots:
7 PCIe Gen3 Full-high (Hotplug)
 Ethernet: Quad 1 Gbt / (x8 slot)
 Integrated ports: USB (4/5), Serial (2), HMC (2)
 Internal Storage
 DVD
 12 SFF Bays -- Split Backplane: 6 + 6
 or 18 SFF Bays with Easy Tier with 7GB write cache
 Hypervisor: PowerVM
 OS: AIX, IBM i, Linux
3 Yr Warranty
© 2014 IBM Corporation
POWER8 2S4U Scale-Out System
Power S824
 Single Socket populated
 Cores:
6 or 8
 Memory:
Up to 512 GB
 Slots:
7 PCIe Gen3 full-high (Hotplug)

Both Sockets populated
 Cores:
12, 16, or 24
 Memory:
Up to 1 TB
 Slots:
11 PCIe Gen3 full-high (Hotplug)
 Ethernet: Quad 1 Gbt / (x8 slot)
3
 Integrated ports: USB (4/5), Serial (2), HMC (2)
 Internal Storage
 DVD
 12 SFF Bays -- Split Backplane: 6 + 6
 or 18 SFF bays & 8 SSD bays with Easy Tier with 7GB write cache
 Hypervisor: PowerVM
 OS: AIX, IBM i, Linux
© 2014 IBM Corporation
Yr Warranty
POWER8 4U Scale-Out Comparison – S814
Power 720
Power System S814
Processor
Sockets
Cores
Maximum Memory
Memory Cache
Memory Bandwidth
POWER7+
1
4/6/8
512 @ 1066 MHz
No
136 GB/sec
POWER8
1
6/8
512 GB @ 1600 MHz
Yes
192 GB/sec
Memory DRAM Spare
No
Yes
CAPI (Capable slots)
PCIe Hot Plug Support
IO bandwidth
6 PCIe Gen2 FH
Opt 4 PCIe Gen2 LP
N/A
No
40 GB/sec
Ethernet ports
Quad 1 Gbt (x4 slot)
SAS bays in system unit
6 or 8 SFF-1 bays
Integrated write cache
Easy Tier Support
Integrated split backplane
NIC SRIOV Support
Service Processor
Optional 175 MB
No
Yes ( 3 + 3 )
No
Generation 1
System unit PCIe slots
© 2014 IBM Corporation
7 PCIe Gen3 FH
One
Yes
96 GB/sec
Quad 1 Gbt (x8 Slot)
12 SFF-3 bays
Or 18 SFF-3 bays
Optional effectively 7GB
Yes
Yes ( 6 + 6 )
SOD
Generation 2
POWER8 4U Scale-Out Comparison – S824
Power 740
Power System S824
POWER8
1 (upgradeable) / 2
8 / 24
512GB / 1TB @ 1600 MHz
Yes
384 GB/sec
Yes
CAPI (Capable slots)
PCIe Hot Plug Support
IO bandwidth
Ethernet ports
POWER7+
1 (upgradeable) / 2
8 / 16
512GB / 1TB @ 1066 MHz
No
136 GB/sec
No
6 PCIe Gen2 FH
Opt 4 PCIe Gen2 LP
N/A
No
60 GB/sec
Quad 1 Gbt (x4 slot)
SAS bays in system unit
6 or 8 SFF-1
Integrated write cache
Easy Tier Support
Integrated split backplane
SRIOV Support
Service Processor
Optional 175 MB
No
Yes ( 3 + 3 )
No
Generation 1
Processor
Sockets
Max Cores
Maximum Memory
Memory Cache
Memory Bandwidth
Memory DRAM Spare
System unit PCIe slots
© 2014 IBM Corporation
7 / 11 PCIe Gen3 FH
Two
Yes
192 GB/sec
Quad 1 Gbt (x8 Slot)
12 SFF-3 bays
Or 18 SFF-3 + 8 SSD bays
Optional effectively 7GB
Yes
Yes ( 6 + 6 )
SOD
Generation 2
Performance
© 2014 IBM Corporation
Power 740+ / POWER8 S824
Performance
per Core
rPerf Comparisons
Performance
per Socket
Performance
per KW
18
27%
Better
200
150
9
100
50
0
0
P740
P740+ P8 4U2S
© 2014 IBM Corporation
P740
P740+ P8 4U2S
P 740+
P8 4U2S
Power 740 / POWER8 S824 CPW Comparisons
Performance
Dual Socket
Performance
per Core
24
Core
16
Core
16
Core
P740
P740+
© 2014 IBM Corporation
P8 4U2S
P740
16
Core
P740+
P8
4U2S
P8
4U2S
Power750+ vs POWER8 4U2S
(750+ = 4 sockets server)
Performance
Total # Cores
1.2
Performance
per $
TCA
3
3
2.5
2.5
2
2
1.5
1.5
1
1
0.5
0.5
0
0
32
1
0.8
24
0.6
16
0.4
8
0.2
0
0
P 750+ P8 4U2S
POWER8 ≥
Performance
© 2014 IBM Corporation
P 750+ P8 4U2S
Fewer cores means
Lower Software Costs
Does not reflect lower
PVU savings
P 750+ P8 4U2S
P 750+ P8 4U2S
Lower investment
costs
Better performance
per dollar spent
POWER8 System Performance
P8 S824
P5+ 595
P4 690
© 2014 IBM Corporation
PCIe Slots
© 2014 IBM Corporation
PCIe Slots
4U
1S
4U
2U
2S
4U
1S
2U
2S
2U
7 11 6
9
Total PCIe slots
All hot swap
All Gen3
• Use 1 of the above slots for a LAN adapter
• Use 1 of the above for expanded function backplane
© 2014 IBM Corporation
PCIe Gen3
Gen1 x8
Gen2 x8
Gen3 x8
2.5 GHz
Though these cards physically look the same … and fit in the same slots
Gen3 cards/slots have up to 2X more bandwidth than Gen2 cards/slots
Gen3 cards/slots have up to 4X more bandwidth than Gen1 cards/slots
 More virtualization
 More consolidation
saving PCI slots and I/O drawers
 More ports per adapter
18
16
14
12
Peak
A Gen1 x8 PCIe adapter has a theoretical max (peak)
bandwidth of 4 GB/sec.
A Gen2 x8 adapter has a peak bandwidth of 8 GB/sec.
A Gen3 x8 adapter has a peak bandwidth of 16 GB/sec.
Sustained
10
8
6
4
2
0
Gen1
Gen2
© 2014 IBM Corporation
Gen3
PCIe x8 and x16
POWER8 servers have x8
AND x16 PCIe slots
Compared to POWER7+ PCIe Gen2 x8 slot, a POWER8
PCIe Gen3 x16 slot has a peak bandwidth of 4X (2X
going Gen2 to Gen3 plus 2X going x8 to x16)
x8
x1
x4
x8
x16
x16
x16 slot/card has more connections than a x8 slot/card
“x16” or “x8” refers to the number of lanes. More lanes = more physical
connections = more bandwidth
A x8 card can be placed in a x16 slot, but only uses half the connections
© 2014 IBM Corporation
Storage
Backplanes
© 2014 IBM Corporation
Storage Backplanes
2U server example
12 SAS bays base & split
Backplanes provide
 High performance integrated SAS controller(s) built on IBM industry
leading PCIe Gen3 SAS adapter technology
 All include RAID 0, 1, 5, 6, 10. Plus hot spare capability
 Split backplane option with zero-write cache controllers
 Easy Tier® function*
 8-18** SAS bays for 2.5-inch (SFF) HDD or SSD
 6-8 SAS bays for 1.8-inch SSD*
 One DVD bay
Op-panel
 Option for attaching one EXP24S drawer of HDD or SSD*
DVD
* With dual IOA, expanded function backplane with write cache
** number varies based on 2U/4U and backplane option selected
© 2014 IBM Corporation
2U Storage Backplane Options
Must select one 
2U server
Base
Split
12 SFF SAS bays
1 SAS controller
No write cache
RAID-0,1,5,6,10
DVD bay
6+6 SFF SAS bays
2 SAS controllers
No write cache
RAID-0,1,5,6,10
DVD bay
Availability plan:
- eConfig 15 July
- GA Sept
Expanded
Function *
8 SFF SAS bays
Dual SAS controllers
7.2**GB cache
RAID-0,1,5,6,10
DVD bay
6-bay SSD cage
External SAS ports
Easy Tier function
* Uses one x8 PCIe slot
** 1.8GB physical write cache provides up to 7.2GB effectively with compression
© 2014 IBM Corporation
4U Storage Backplane Options
Must select one 
4U server
Base
Split
Expanded
Function *
12 SFF SAS bays
1 SAS controller
No write cache
6+6 SFF SAS bays
2 SAS controllers
No write cache
18 SFF SAS bays
Dual SAS controllers
7.2**GB cache
RAID-0,1,5,6,10
RAID-0,1,5,6,10
RAID-0,1,5,6,10
DVD bay
DVD bay
DVD bay
8-bay SSD cage***
External SAS ports
Easy Tier function
Availability plan:
- eConfig 15 July
- GA Sept
* Uses one x8 PCIe slot
** 1.8GB physical write cache provides up to 7.2GB effectively with compression
***SSD cage not available on mdl 41A, Required on mdl 42A with expanded function
© 2014 IBM Corporation
Easy Tier Function Advantage
Optional function with
expanded-function, highperformance storage
backplane
HDD
SSD
Low cost per IOP
Low cost per GB
Easy
Tier
 Automatically moves high activity (hot) data to SSD and low
activity (cold) data to HDD
 Function handled totally by POWER8 integrated SAS controllers.
No application coding. No SAN, just internal SAS drives.
 For AIX/Linux/VIOS. Just configure as a new type RAID array
 IBM i essentially already has same kind of hot/cold function in OS for all SAS adapters, but could
this function via VIOS
© 2014 IBM Corporation
SAS Bays for POWER8 Servers
New SSF-3
SFF-3 used in 2U and 4U POWER8 servers
3rd generation carrier/tray on which 2.5-inch (SFF) is mounted
Different tray/carrier than existing SFF-1 and SFF-2
 SFF-1 in POWER6/POWER7 system unit or #5802 I/O drawer
 SFF-2 in EXP24S Storage drawer (#5887 or #EL1S)
 Can not put wrong tray/carrier in the wrong SAS bay
For migrations to POWER8, conversions for SFF-1 to SFF-2 on POWER7/7+
servers. Protects client investment in HDD and SSD. Not a conversion to SFF-3,
requires space in an EXP24S drawer to place converted SFF drives. “Re-trays”
existing SFF-1 drives.
© 2014 IBM Corporation
POWER8
Memory
© 2014 IBM Corporation
POWER8 Memory Card
POWER8 Memory Cards
 Capacity: 16 GB / 32 GB / 64 GB
 1600 MHz
 Memory Sparing - RAS improvement
 8 Cards per socket (Scale-Out Systems)
© 2014 IBM Corporation
POWER8
OS
Support
© 2014 IBM Corporation
Compatible Mode Architecture
POWER6 MODE
(and POWER6+ Mode)*
POWER7 MODE
(No POWER7+ Mode)
POWER8 MODE
2-Thread SMT
4-Thread SMT, IntelliThreads
8-Thread SMT
8 Protection Keys *(16 in
P6+ Mode)
VMX (Vector Multimedia
Extension / AltiVec)
32 Protection Keys
User Writeable AMR
32 Protection Keys
User Writeable AMR
VSX2,
In-Core Encryption Acceleration
VSX (Vector Scalar Extension)
CPU/Memory Affinity
Enhancements
ON by Default, HomeNode,
3-tier Memory,
MicroPartition Affinity
HW Memory Affinity Tracking
Assists,
MicroPartition Prefetch,
Concurrent LPARs per Core
64-core/128-thread Scaling
64-core / 256-thread Scaling
256-core / 1024-thread Scaling
> 1024-thread Scaling
Hybrid Threads
Transactional Memory
Active System Optimization HW
Assists
N/A
Active Memory Expansion
HW Accelerated/Assisted Active
Memory Expansion
N/A
P7+ : AME compression
acceleration and
Encryption acceleration
Coherent Accelerator /
FPGA Attach
Affinity OFF by Default
© 2014 IBM Corporation
Linux Plans
RHEL6
RHEL 7
SLES 11
1H / 2014
2H / 2014
RHEL 6.5
P7 Mode in P8
RHEL 6.6
P7 mode in P8
RHEL 7.0
POWER8 Support
SLES 11 + SP3
P7 Mode in P8
SLES 12 (LE)
POWER8 Support
SLES 12
Ubuntu (LE)
Debian
PowerVM
© 2014 IBM Corporation
14.04.00/01
P8 Support
LE Introduction
POWER8 Support
2.2.3.3
14.04.00/02
LE Update
2.2.3.X
AIX Levels
11 / 2012
AIX 6
TL7
SP6
AIX 6
TL8
SP1
2 / 2012
3 / 2013
5 / 2013
8 / 2013
SP7
SP2
AIX 6
TL9
9 / 2013
10 / 2013 12 / 2013 2Q / 2014 3Q / 2014
SP8
SP9
SP10
SP3
SP4
SP5
SP1
AIX 7
TL1
SP6
AIX 7
TL2
SP1
AIX 7
TL3
SP7
SP2
SP3
SP8
SP9
SP10
SP3
SP4
SP5
SP1
P7 or P6 Modes with Virtual I/O
P7 or P6 Modes with Full I/O Support
P8, P7 or P6 Modes with Full I/O Support
© 2014 IBM Corporation
SP3
IBM i Levels
IBM i 7.1 TR8
POWER7
Max Scale = 32 cores (SMT4)
Max Partition = 64 cores (SMT4)
Threads = ST, SMT2, SMT4 up to 256 threads in single partition
Max Scale = 32 cores (SMT8)
POWER8
Max Partition = 64 cores (SMT4)
Threads = ST, SMT2, SMT4, SMT8 up to 256 threads / single partition
IBM i 7.2
POWER7
Max Scale = 32 cores (SMT4)
Max Partition = 96 cores (SMT4)
Threads = ST, SMT2, SMT4 up to 384 threads in single partition
POWER8
Max Scale = 48 cores (SMT8)
Max Partition = 96 cores (SMT8)
Threads = ST, SMT2, SMT4, SMT8 up to 768 threads / single partition
© 2014 IBM Corporation
PowerKVM
© 2014 IBM Corporation
Power Virtualization Options
PowerKVM
Initial Offering: Q2 2014
PowerVM
 PowerKVM: Open Source option for
virtualization on Power Systems for Linux
workloads.
 For clients that have Linux centric admins.
(RHEL 6.5 & SLES 11.3)
Initial Offering: 2004
PowerVM: Provides virtualization of
Processors, Memory, Storage, &
Networking for AIX, IBM i, and Linux
environments on Power Systems.
© 2014 IBM Corporation
PowerVM vs PowerKVM Comparison
PowerVM
PowerKVM
2004
Q2 2014
Supported Hardware
All P6, P7, P7+, P8
Systems
PowerLinux P8 Systems
Supported OS
AIX, IBM i & Linux
Linux
Supports AIX, IBM i &
Linux
Linux
IVM / HMC / FSM
Virtman/libvirt
PowerVC/VMControl
PowerVC, Vanilla
OpenStack
Power Centric
Linux/x86 Centric
Yes
No
No
Yes
GA Availability
Workload Mobility
Basic Virtualization
Management
Advanced Virtualization
Management
Admin Type
Established Security
Track Record on Power
Open Source
Hypervisor
© 2014 IBM Corporation
S120L & S220L
PowerKVM Positioning
•
•
•
•
•
•
•
•
•
•
First release available in 2014
Focus: New Linux workloads for Power Systems
Seamless transition for existing Linux admins to adopt Power Linux
Virtualization without any training
No HMC or other traditional IBM consoles
• Normal Linux management and OpenStack options
PowerKVM only supports Linux guest VMs
Cloud potential: Have many more small VMs than traditional Power
Virtualization
POWER8 PowerLinux hardware only
Live Workload mobility support between PowerKVM servers
Open Source Hypervisor: Hardware is abstracted by firmware
Managed by OpenStack(PowerVC) or by off the shelf OpenStack or
local Linux Tools
© 2014 IBM Corporation
Mobility
© 2014 IBM Corporation
POWER6 / POWER7 / POWER8 Partition Mobility
AIX 7.1
AIX 7.1
AIX 6.1
AIX 6.1
AIX 7.1
AIX 7.1
AIX 7.1
AIX 7.1
AIX 6.1
AIX 6.1
AIX 6.1
AIX 6.1
AIX 5.3
AIX 5.3
AIX 5.3
IBM i 7.2
Linux
Linux
Linux
POWER6/6+
POWER7
IBM i 7.2
Linux
Linux
POWER8
Leverage POWER6 / POWER7 Compatibility Modes
LPAR Migrate between POWER6 / POWER7 / POWER8 Servers
Can not move POWER8 Mode partitions to POWER6 or POWER7 systems.
© 2014 IBM Corporation
HMC
© 2014 IBM Corporation
HMC Model 7042-CR8
7042-CR8 is System x model 7914 Ref3
 Based on 7042-CR7
 2GHz Ivy Bridge Intel Proc*
 8GB DDR3 Mem (1x8GB DIMM)
 Dual 500GB HDD (RAID1)
 Quad GigE (First eth port can be shared IMM)
 Dedicated IMM port
UEFI, IMM, DSA is similar to CR7 (same for all 7914)
Planned GA with HMC: 2Q 2014
FW Level: 8R810
© 2014 IBM Corporation
Enhanced HMC Management Capabilities
Virtual Environment Deployment
Create System Template that meets specific configuration requirements
 Edit System Template & Capture Configuration as Template
Deploy Virtualization Configuration via “Deploy System from Template”
Create Partition Template that meets specific workload requirements
Deploy Partition
 Create Partition from Template and Install Operating System
Virtual Environment Management
1.
2.
3.
4.
Configure Virtual Network via “Manage PowerVM”
View Virtual Storage Adapter Mappings via “Manage PowerVM”
Add storage to a partition via “Manage Partition: Virtual Storage
Connect partition to a virtual network via “Manage Partition: Virtual Network”
Performance Monitoring
1. View System Performance Dashboard
2. View Resource Utilization Trends (Processor, Memory, Network, Storage)
© 2014 IBM Corporation
New I/O
© 2014 IBM Corporation
New I/O Announced with Scale-Out Servers
PCIe Adapters
LAN
2-port 40GbE
NIC & RoCE
2-port 10GbE
RJ45 (10GBaseT)
4-port 10GbE+1GbE Copper twinax & RJ45
4-port 10GbE+1GbE SR optical & RJ45
SOD for NIC SR-IOV two specific 10GbE adapters
USB-3 4-port
SAS PCIe3
4-port Tape/DVD
Reprice 4-port zero cache HDD/SSD
Graphics adapter for future RHEL 7
Disk/HDD
New capacity - 600GB 15k rpm
New 4k block drives
SSD new 1.8-inch 387GB for
© 2014 IBM Corporation
Questions?
© 2014 IBM Corporation