Advanced Technical Skills (ATS) North America © 2012 IBM Corporation

Advanced Technical Skills (ATS) North America
Accelerate with ATS: DS8870 Release 7.0
Technical Announcement Webinar
October 30th 2012
Brian Sherman, Paul Spagnolo, Hank Sautter,
Joanne Brown, Mark Kremkus, David
Whitworth, Yan Xu
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Agenda
Announcement overview
Hardware update
Energy, RAS, power, availability
VMware update
Ordering information details
Performance update
2
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 Release 7.0
Announcement Highlights
Brian Sherman
[email protected]
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8000 Storage Efficiency Provides Value to our Clients
OLTP/DB Performance, Batch Throughput
– Fastest, state-of-the-art disk system hardware
– DS8000 architecture virtually eliminates manual tuning
– DS8870 provides ideal platform for consolidation
Availability
– Highest levels of availability and data access protection
– Designed to provide over 6-9's availability with HyperSwap on System z and POWER
Storage Synergy
– Available years ahead of competitors
– Optimal design due to engineering collaboration
Replication and Automation
– Metro and Global Mirror: designed for efficient replication
– GDPS / TPC-R: scalable, proven D/R automation, many references
Management Advances
– Easy DS8800 GUI, consistent across the IBM Storage portfolio to provide ease of
configuration changes and streamlined provisioning of storage
Enterprise Disk for the World’s Most Demanding Clients
4
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Introducing the 5th Generation DS8000 Disk System – DS8870
Building on a market-proven, reliable code base!
94% of the same proven microcode
2004
2006
2009
2010
2012
POWER5
POWER5+
POWER6
POWER6+
POWER7
DS8300
DS8300
DS8300
DS8300
Turbo
Turbo
DS8700
DS8700
DS8800
DS8800
DS8870
DS8870
Designed for Enterprise environments with over 5-9’s availability natively
Designed for Enterprise environments with over 6-9’s availability when DS8000
with Metro Mirror is combined with GDPS/PPRC HyperSwap
5
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Key DS8000 dates from Oct 3 Announcement
DS8870 R7.0 (242x 961 / 96E)
– Announcement date - October 3, 2012
– General Availability date - October 19, 2012
Statement of Direction (SOD)
– Field model conversion from DS8800 to DS8870
– To be available in the first half of 2013
Announcing withdrawal for DS8800 Base Frame (242x 951)
– Due to new RoHS 2013 compliancy
– Effective date: 1st February 2013
– Latest CRAD date: 29th March 2013
– MES capabilities will continue for existing DS8800s in the field
6
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
IBM DS8870 - The Next Generation
Smarter Storage for enterprise critical information environments
Built on the DS8800 base
– Screaming fast with up to 3x performance increase
– Proven architecture and code base for optimal reliability
– Inherited all functionality of DS8800
– RoHS 2013 compliance reduces hazardous materials
New dual IBM POWER7 controllers
– Scalable processor options of 2, 4, 8 and 16 cores per controller
– Scalable cache from 16GB – 1TB
– Everything scales non-disruptively
New energy-efficiency power supply
– Improved efficiency, power dissipation, reliability
– ~20% reduction in energy usage
– Designed to meet upcoming Energy Star standard
Full Disk Encryption drives now standard
– Client decides when to encrypt *
* Requires deployment of Tivoli Key Lifecycle Manager or IBM Security Key Lifecycle Manager
7
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
•Provides improved
resiliency and
communication paths
Replaced Primary Power
Supplies (PPS) and
Batteries with DC-UPS
•Provides full wave
rectified power for
improved power
efficiency
June 4 SOD:
•Room for Ultra SSD drawers by
rotating 90deg and connecting
directly into available PCIe slots
RPC
Redesigned Rack Power
Control (RPC)
RPC
Base Frame Hardware Changes - DS8800 to DS8870
•Will provide substantial additional
performance improvement
DCUPS
p7
p7
Replace P6+ servers
with P7 servers that
provide
•Dual 2, 4, 8, 16 core
configuration options
DCUPS
•16GB – 1TB cache
DS8800
8
•Provides significant IOP
and sequential
performance
improvements
DS8870
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Hardware Consistency – DS8800 to DS8870
DA to DDM mapping / RAID / Intermix / Sparing
– Unchanged from DS8800
Front to back airflow
– Unchanged from DS8800
Rack dimensions
– Footprint same as DS8800
– Same number of drives (1536)
HA / DA Adapter
– Cards unchanged from DS8800
Provide equivalent performance per port and per adapter as DS8800
–
–
Port naming unchanged
Plug order unchanged
3000
250
2500
200
MB/s
100
1500
1000
0
0
9
t
gl
Si
n
Si
n
gl
e
e
HA
HA
W
Re
r it
e
ad
e
rit
tW
Po
r
le
Si
ng
DS8800
Hi
Hi
t
Hi
Hi
d
ea
Po
rt
R
gl
e
DS8870
t
500
t
50
Si
n
KIO/s
2000
150
S
DS8700
DS8300
e
gl
in
rt
Po
q
Se
DS8870
ad
Re
S
e
gl
in
rt
Po
q
Se
e
rit
W
DS8800
le
ng
Si
HA
q
Se
ad
Re
le
ng
Si
DS8700
HA
q
Se
e
rit
W
FRONT
DS8300
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 ― Features inherited from the DS8800
Easy to use GUI
Storage Pool Striping
Quick Initialization
Storage Pool Striping
is an algorithm choice
for volume creation
which allows for better
backend disk
utilization
Volumes are created
by allocating one
Extent from available
Ranks in an Extent
Pool, in a round-robin
fashion
Thin
AlignProvisioning
Risk and Performance
I/O Priority Queuing
Quick Initialization provides
volume initialization that is up to 2.6
times faster and therefore allows
the creation of devices and making
them available as soon as the
command completes.
Easy Tier
Easy Tier 1 (DS8700 R5.1)
•
•
•
–
TIER 8 - Application/workload level
Dynamic
HA; Automatic monitoring;
Automatic
growth
workload routing/recovery;
Uses
async replication between sites
Easy Tier 2 ( R6.1)
–
TIER 7: RPO=near zero, RTO <1min,
Automatic Continuous Availability
Space Efficient volumes and the Extent
Space
volumes
over
• TIEREfficient
6: RPO=Near
Zero,enable
RTO <1Hr.
to 4
provisioning
capabilities
thatData
provide
hours, Manual
Disk or Tape
theMirroring
customers with benefits in terms of
more efficient usage of the storage
• TIER 4:. RPO > 15 min. RTO= 4+ hours,
capacity
Manual PiT or SW Data Replication.
10
Automated cross-tier performance
management for SSD/HDD hybrid pools
I/O Priority Manager attempts to make
sure the most import I/O operations
get serviced when a given rank is
overloaded by the workload on the
storage system
Automated cross-tier performance or
storage economics management for hybrid
pools with any 2 tiers (SSD/ENT, SSD/NL or
ENT/NL)
Easy Tier 3 (R6.2)
–
Automated cross-tier performance and
storage economics management for hybrid
pools with 3 tiers (SSD/ENT/NL)
Easy Tier 4 (R6.3)
–
Support for encryption capable
environments
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Extraordinary performance for enterprise applications
DS8300
(R4.3)
P5+ 4-core
DS8700
(R5)
P6 4-core
DS8800
(R6)
P6+ 4-core
DS8870
(R7)
P7 16-core
Increase
vs.
DS8300
Increase
vs.
DS8700
Increase
vs.
DS8800
Seq. Read (GB/s)
3.9
9.7
11.8
21.0
5.4x
2.2x
1.8x
Seq. Write (GB/s)
2.2
4.7
6.7
11.0
5.0x
2.3x
1.6x
DB z/OS (K IOPS)
165
201
204
640
3.9x
3.2x
3.1x
DB Open (K IOPS)
165
191
198
550
3.3x
2.9x
2.8x
DS8300
DS8300
Turbo
Turbo
11
DS8870
DS8870
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Official Storage Performance Council (SPC) results
SPC-1 throughput of 451,082 IOPS
– #1 result for single, enterprise-class all-HDD system
– 67% faster than HDS VSP
SPC-2 throughput of 15,424 MB/s
– #1 result overall
– 6% faster than prior #1 result
– 17% faster than HDS VSP
– 59% faster than DS8800
SPC Benchmark 1 (SPC-1) results page SPC Benchmark 2 (SPC-2) results page 12
http://www.storageperformance.org/results/benchmark_results_spc1
http://www.storageperformance.org/results/benchmark_results_spc2
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8000 Energy Consumption Comparison
DS8700 with 1024 drives
DS8800 with 1536 drives
DS8870 with 1536 drives
– Base frame: 6.8kW
– Base frame: 7.5kW
– Base frame: 6.0kW
– Exp frame: 7.1kW
– Exp frame: 6.2kW
– Exp frame: 5.6kW
– Exp frame: 6.1kW
– Exp frame: 6.1kW
– Exp frame: 6.3k W
– Exp frame: 6.3kW
– Exp frame: 3.1kW
TOTAL:
29.2kW
– Exp frame
5.8kW
– Exp frame: 5.8kW
TOTAL:
TOTAL:
26.3kW
23.2 kW
DS8870 base frame is 20% more energy efficient!
Higher efficiency rating positioned to meet upcoming ENERGY STAR requirements
Note: Measurements taken on 100% read miss workload
13
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8000 Functional Summary by Release
Note: not all enhancements are included
2004
10-2006
•255 LCUs Supported
•HyperPAV
10-2008
•RAID5/RAID10
•HMC CIM Agent
•zHPF
4-2010
5-2011
4-2012
•Easy Tier
•Easy Tier2
•Thin Provisioning
•IO Priority
Manager (open)
•Encryption for
SSD and NL-SAS
•Quick Init
•400GB SSD
•Resource
Groups
•600GB 15K
7-2009
•Easy Tier4
•zMGM Incremental
•Enterprise Choice
Resync
2-2008
(extended) warranty
•Thin Provisioning •2TB nearline SATA
•New GUI
•64K Logical Volumes
•Multiple
GM
sessions
•DS8000 M/T intermix
•Quick init
•16TB LUN
•2GB FCP/FICON
•Extended Distance
•zHPF Multi-track
•New Business
•73/146/300GB DDs
FICON
support
Class option
•Thin
Provisioning for
all copy services
•RMC/zGM/PTC/PAV
1.0
2.0
2006
•Turbo Models with
Power5+
2.4
3.0
2007
3.1
4.0
5-2008
4.1
4.2
4.3
5.0
10-2009
5.1
6.0
10-2010
2-2009
•DS8700 with
•DS8800
•SSPC Support (new) •Extended Address
Volumes
Power6 controller
•Solid
State
Drives
•Power6+
•500GB FATA nearline •Storage Pool Striping
•Variable LPAR
•PCI-E internal
•1
TB
SATA
•All
2.5” SAS-2
•Space Efficient
•4GB FCP/FICON
fabric
•IPv6
drives
FlashCopy
•Intelligent Write
•Flexible Warranties
•Increased
Cache
•Dynamic Volume
(242x)
Cache/NVS •8GB HA and DA
Expansion
•Full Disk Encryption
•zOS Synergy Items
(FDE)
•3rd & 4th expansion
frames
•Remote pair
FlashCopy
6.1
6.2
6.3
7.0
11-2011
11-2012
•3TB nearline SAS
•DS8870 with
Power 7
controller
•Add’l expansion
frame and 1,536
drives
•Easy Tier3
•Increased
Cache / NVS
•I/O Priority Manager •All FDE drives
(CKD)
•RoHS 2013
•zHPF QSAM BSAM •Energy savings
BPAM
•1 TB EAV
•DB2 list pre-fetch
optimizer
14
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Optimized Server / Storage Data Placement
IBM Server
IBM Server
Host
Host
June 4, 2012 SOD
Client
Client
Driver
Driver
Host client and Easy Tier ensure hottest data copied
to Host SSD cache
–
Cooperative caching based on performance statistics
collected in the host and storage system
–
Asynchronous population of Host SSD cache from storage
–
Both server and storage resources optimized for real-time
Read and Write performance
–
Storage Tier Advisor Tool (STAT) extended to include Host
SSD Cache
Data coherency is ensured
–
Host client has the most up-to-date data access information
while DS8000 maintains data ownership
–
Storage advanced replication functions such as FlashCopy
and Remote Mirroring are transparently enabled
SSD
Cache
SSD
Cache
SAN
Storage
Coherency
Caching
Statistics
DS8000
Server
Global Heat
& Statistics
Data
EasyTier
SSD
HDD
IBM June Storage SOD announcement link
Easy Tier SOD Video (YouTube)
IBM Storage
*Statements of IBM’s future plans and direction are provided for informational purposes only. Plans and directions are subject to change without notice
15
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Application Performance Integrated with Easy Tier
June 4, 2012 SOD
Databases and ISV solutions will be able to provide
performance tips to Easy Tier
– Will guide what, when, where and how data is placed across
the server and storage systems dynamically
– Provide pin / unpin capability
Advanced self-tuning reduces administration costs
further and allows IT staff to focus on strategic
initiatives
Integration with existing QoS features enables better
multi-tenancy and cloud environments
IBM June Storage SOD announcement link
*Statements of IBM’s future plans and direction are provided for informational purposes only. Plans and directions are subject to change without notice
16
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8000 integration of EXP30 UltraSSD storage
June 4, 2012 SOD
1U drawer
– Up to 30 encryption capable eMLC SSD drives
•
With 387 GB drives = up to 11.6 TB (raw)
– Each drawer is independently installable; up to 4 per rack
Two 6 Gb SAS adapters especially designed for SSD
– Directly connected to DS8000 internal PCIe fabric via currently open slots
Great performance
– Up to 400,000 IOPS (100% read), up to 340,000 IOPS (60% read/40% write) and up to
270,000 IOPS (100% write)
– Up to 4.5 GB/s bandwidth
Enterprise class RAS
– RAID protected with spares
– Dual power supplies, sensors, adapters and fans
•
Concurrently replaceable components
Easy Tier enabled
IBM June Storage SOD announcement link . UltraSSD Announcement link
*Statements of IBM’s future plans and direction are provided for informational purposes only. Plans and directions are subject to change without notice
17
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Power HyperSwap Technology
HA/DR
HyperSwap non-disruptively substitutes
secondary for primary devices for planned and
unplanned events
Application
– Transparent to applications - continue to use same the
same device
Cluster
Hyperswap
Customer Benefits
– Unplanned HyperSwap
•
Continuous availability against storage failures
– Planned HyperSwap
•
Storage migrations without downtime
Customer
Benefits
•
Storage maintenance without downtime
Synchronous
Mirroring
Requirements
– AIX 6.1 TL8 with SP1 or AIX 7.1 TL2 with SP1
– PowerHA 7.1.2 SP1 with APAR IV2758
•
Available November 9, 2012
– DS8700/DS8800 R6.3 SP2 (DS8870 in 2013)
Primary DS8000
Site 1
Oct 3 PowerHA HyperSwap Announcement
18
Secondary DS8000
Site 2
Legend:
Brings together AIX, PowerHA and DS8000 to provide a
Active Path
comprehensive application and data availability solution
Passive Path
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 Release 7.0
Hardware Details
Hank Sautter
[email protected]
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8000 Enterprise Disk – Hardware Evolution
81/8300
8700
8800
8870
Disk
FC
FC
SAS
SAS
Power
Bulk
Bulk
Bulk
DC-UPS
CEC
p5/p5
p6
p6+
p7
IO Bay
RIOG
PCIE
PCIE
PCIE
Incremental changes between versions maximizes quality
20
07/10/2012
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 Processor Configurations (Power 7)
System Class
Active Processor
Configuration per
CEC
Processor Cards
per CEC
Feature Code
Business Class
2 cores
1 x 4 core
#4401
Total Active
Cores per
DS8870
Total System
Memory /
Persistent
Expansion
Frames
Supported
16 GB/1 GB
4 cores
None
32 GB/1 GB
4 cores
1 x 4 core
#4402
8 cores
8 cores
2 x 4 core
#4403
16 cores
Enterprise Class
16 cores
21
2 x 8 core
#4404
64 GB/2 GB
None
128 GB/4 GB
0–2
256 GB/8 GB
0–3
512 GB/16 GB
0–3
1024 GB /32 GB
0–3
32 cores
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 Enterprise Class enclosure layout
(no change from DS8800)
240 drives
2a2
2b2
1a1
1b1
3a1
3b1
0a1
0b1
2a1
2b1
480 drives
480 drives
7a2
3a3
5a4
7b2
4a2
3b3
0a3
5b4
1a4
4b2
6a2
0b3
2a3
1b4
3a4
2b3
7a3
3b4
0a4
7b3
4a3
0b4
2a4
4b3
6a3
2b4
7a4
6b3
5a2
7b4
4a4
5b2
1a2
4b4
6a4
1b2
3a2
6b4
5a3
3b2
0a2
5b3
1a3
0b2
1b3
336 drives
6b2
5a1
5b1
7a1
7b1
4a1
4b1
6a1
6b1
22
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 Business Class maximum configuration
(reduced drive support from DS8800, upgrades to Enterprise Class)
144 drives
2a2
2b2
•
•
–
–
3a1
3b1
2a1
2b1
23
2 active processor cores per CEC
16GB processor memory
No copy services support
No I/O priority manager support
•
32GB processor memory
– support copy services and IOPM
• Concurrent upgrade to Enterprise Class
• SSDs supported on all models
• Easy Tier is supported on all models
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 Configuration Specifications
Model
Processor
Physical
Capacity
Disk Drives
Memory
Adapters
9xE Attach
Enterprise Class Offering
961
4-core
216 TB
240
64 GB
8
0
961
8-core
1.38 PB
1536
256 GB
16
1-3
961
16-core
1.38 PB
1536
1024 GB
16
1-3
129 TB
144
32 GB
4
0
302 TB
336
N/A
8
N/A
480
N/A
N/A
N/A
Business Class Offering
961
2-core
Standard First Expansion Frame
96E
N/A
Standard Second/Third Expansion Frame
96E
N/A
24
432 TB
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Disk Drive Options
DS8870
DS8800
– All SAS-2
– All SAS-2
– 400 GB SSD FDE
– 300 GB SSD
– 146 GB/15,000 RPM FDE
– 400 GB SSD + FDE option
– 300 GB/15,000 RPM FDE
– 146 GB/15,000 RPM + FDE option
– 600 GB/10,000 RPM FDE
– 300 GB/15,000 RPM + FDE option
– 900 GB/10,000 RPM FDE
– 450 GB/10,000 RPM + FDE option
– 3 TB/7,200 RPM FDE
– 600 GB/10,000 RPM + FDE option
– 900 GB/10,000 RPM + FDE option
– 3 TB/7,200 RPM + FDE option
Maximum of 1,536 drives
Maximum of 1,536 drives
Drives install in groups of 16
– SSD drives available in groups of 8 or 16
Drives install in groups of 16
– SSD drives available in groups of 8 or 16
– Nearline drives available in groups of 8
– Nearline drives available in groups of 8
25
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 characteristics
DA to DDM mapping / RAID / Intermix / Sparing
– Unchanged from DS8800
Front to back airflow
– Environmental specs unchanged from DS8800
HA / DA Adapter Unchanged from DS8800
– Port naming unchanged
– Plug order unchanged.
Rack dimensions
– Footprint same as DS8800
– Weight is nearly the same as DS8800 ( within 100lb. Use IPG for specifics)
Power usage monitoring implemented for future Energy Star requirement
– Power measured in lab on 16 core system for reference
26
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 RAS Updates/Enhancements
JoAnne Brown
[email protected]
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
RAS Updates/Enhancements
New DC-UPS vs Old PPS
– Cabling Topology Different for Load Balancing
• DC-UPS to PDUs
• PDUs to IO-OS and CEC-PS
• PDU to GP-PS
– Multi-Element, Heavy Battery
• Battery Service Module (BSM)
• BSM set = 4 BSMs
• All replaced at once
Extended Powerline disturbance
– Protects storage unit up to 50 seconds
28
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
RAS Updates/Enhancements
New laptop phased in for next year
– New Laptop (T530)
– Will not be available for GA
– Phased in R7.0.5
Thinking about FDE, Order now
– All DDMs will be encryption capable
– Encryption Enablement still requires LIC Feature/TKLM/etc
RPQ to allow RAID-10 on Nearline and Solid State
– Long rebuild time
– PFE Control Switch to allow via RPQ
29
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
RAS Updates/Enhancements
New HMC Write-able Media
– DVD-RAM Media is going End-Of-Life
– Switch to SDHC Media
– Used for
• Data Offload when no remote connection
• Saving Physical Configuration on Discontinue
– Not Boot-able
– Read-only Media & Drive still included
CEC Service/Orientation
– HMC moves out of way
– Cards/Adapters comes out Top
30
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 R7.0 VMware VAAI Integration
Mark Kremkus
[email protected]
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
vStorage APIs for Array Integration (VAAI) Overview
Enables certain key storage tasks to be offloaded from the server hardware to
the storage array:
– Consumes less bandwidth on the SAN and on the host(s), as well as less CPU and memory
on the host(s)
Supported vSphere and ESX/ESXi versions:
– VAAI introduced in vSphere 4.1 for block access protocols
• Storage vendor supplies drivers that must be installed on your ESX/ESXi hosts
– VAAI is “native” to vSphere 5
• VMware supplies driver
• More primitives have been added to NFS that are not currently native to vSphere 5 VMFS
To implement hardware acceleration, VAAI relies on the storage to facilitate
certain SCSI-based operations known as “primitives.”
– In vSphere 5, these fundamental operations are initiated via standard T10 SCSI
specifications.
– All primitives are capable of operating independently and in isolation, though some can
operate synergistically to provide additional benefit
– VMware vSphere and ESX/ESXi versions that support VAAI are configured to automatically
use these primitives if they are supported by the storage; no intervention should be required
by the user to obtain the benefit of these features.
32
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 and VMware - Supported VAAI Primitives Overview
DS8870 vStorage API for Array Integration (VAAI) supports:
Integration with vStorage API’s to improve performance and enhance VM
multi-tenancy:
– Full copy (aka XCOPY) primitive offloads work from production virtual servers to storage
which improves application performance and reduces host and SAN resource utilization.
– Hardware-assisted locking (aka Atomic Test & Set) primitive enables a finer grained level of
locking (block-level instead of LUN-level) on VMFS metadata, which is more efficient and also
scales better, and vastly improves performance along with the consolidation potential for VMs
and VMware clusters sharing datastores.
Common tasks that can benefit from improved performance:
– VM creation/cloning/snapshots/deletion
– vMotion and storage vMotion
VMware Storage Stack
– Extending a VMFS Volume
– Extending the size of a VMDK file
VMFS
NFS
VMware LVM
NFS
Client
Provisioning / Cloning
Data Mover
vStorage APIs
NFS
vStorage API
for MultiPathing
HBA Drivers
33
Network
Stack
NIC
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 and VMware - VAAI Requirements
• For R7.0, any and all VAAI support requires these steps at minimum:
– Order the VMware VAAI Indicator on the DS8870 configuration – Feature Code 0965
– After installation, you need to open a PMR to have PFE enable VAAI functionality.
• For R7.0, Clone Blocks / Full Copy / XCOPY enablement also has these
restrictions:
– You need a FlashCopy license.
– LUNs used by the ESX/ESXi servers must not be larger than 2 TB.
– Track Space Efficient volumes and Extent Space Efficient volumes can not be used.
34
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
ESX/ESXi VAAI Limitations
The following restrictions are imposed by VMware:
– VAAI hardware offload cannot be used when:
• The source and destination VMFS volumes have different block sizes
• The source file type is Raw Device Mapping (RDM) and the destination file type is nonRDM (regular VMDK file)
• The source VMDK type is EagerZeroedThick and the destination VMDK type is Thin
• The source or destination VMDK is any sort of sparse or hosted format
• Cloning a Virtual Machine that has snapshots (or doing a View replica or recompose),
since this process involves consolidating the snapshots into the virtual disks of the
target Virtual Machine.
• The logical address and/or transfer length in the requested operation are not aligned to
the minimum alignment required by the storage device (all datastores created with the
vSphere Client are aligned automatically)
• The VMFS datastore has multiple LUNs/extents spread across different storage
systems
35
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 and VMware APIs for Array Integration Summary
VMware 2.1.1 is the minimum level for the DS8000 family.
• VMware 4.1 running VMFS 3 with DS8870 are the minimum requirements for VAAI
enablement
In summary, the DS8870 R7 announcement includes support for the following VMware
VAAI primitives:
• Atomic Test and Set (ATS) for VMware hardware-assisted locking
• Full Copy (aka XCOPY)
Releases prior to R7 will NOT support these VAAI primitives.
For more information on minimum server requirements and interoperability, please refer
to:
• http://www.vmware.com/products/server/esx_specs.html
• http://www-03.ibm.com/systems/support/storage/ssic/interoperability.wss
36
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Backup
37
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
VAAI Primitives – Atomic Test & Set
• Atomic Test & Set (ATS) / Hardware Accelerated Locking
– Function
•
Offload disk locking from ESX/ESXi host to disk array during VMFS metadata updates
– Scope
•
Locks are made at the granularity of data blocks within a single LUN, which improves concurrency of access to
the shared LUN
– Without this primitive, SCSI reservations necessitate that the minimum scope of serialized access is the
entire LUN that is backing the datastore
– Impact
•
•
•
Reduction or Elimination of SCSI-2 Reservation conflicts
Greatly improves time for creation, modification, and access of individual files and file metadata, as well as
datastore-level activities
Improves performance, particularly with larger concentrations of VMs
– SCSI Command
•
•
•
Exploits SCSI Compare-Write Command
Open issue of this command, the DS8870 microcode does the following:
– Receives one block (512 bytes) of data from the host.
– Compares that block of data to the data already present on the addressed device at a specified LBA. If the
block data is not byte-for-byte identical, then reject the command with sense indicating that the data is
different.
– Otherwise, receives a second block of data from the host and writes that to the specified LBA, replacing the
original data.
The above steps are executed atomically, meaning no other host can alter the data while the operation is in
progress
38
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Atomic Test and Set (ATS) - Functional Illustration
• With API
Without API
Access to the whole LUN (VIA SCSI-2
reservation) is serialized while on-disk
lock is granted to a host.
All transactions from adjacent hosts wait
DS8870
39
– Test/Set the on-disk lock required
for the update with block granularity
– Other metadata blocks remain
accessible to adjacent hosts
DS8870
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Common Events that can Exploit Atomic Test and Set (ATS)
V
M
D
K
V
M
D
K
V
M
D
K
V
M
D
K
V
M
D
K
V
M
D
K
Hardware Assisted Locking
Sample Lock Events
More granular locking
VM migrate, SVM
Improved performance for
VMDKs sharing LUNs
VM Power on/off
Better cluster scalability
New VM or VMDK
Acquiring a lock on a file
Etc.
40
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
VAAI Primitives – Clone Blocks
• Clone Blocks / Full Copy / XCOPY
– Function
•
Offload operation of cloning disk blocks from ESX/ESXi host to disk subsystem:
– The host itself is bypassed in the execution of reading the data blocks and subsequently writing to the target
blocks
– Scope
•
Range of logical blocks is copied either within a single LUN or between two LUNs on the same disk subsystem
– Impact
•
•
Operation stays within the storage array so there is a reduction/elimination in ESX/ESXi host resource usage,
as well as the time-to-data.
Facilitates the migration or cloning of VMDKs for other higher-level VMware functions, for example as part of
Storage vMotion for VMs utilizing datastores on a shared subsystem
– SCSI Command and Implementation
•
•
Exploits SCSI XCOPY Command
The DS8870 microcode interprets and translates the SCSI XCOPY command in order to leverage existing copy
services functionality via an extent-level (sub-LUN) FlashCopy.
– While the mechanics are very similar to a standard fixed block full-volume FlashCopy, the granularity is the
individual tracks (64 kilobytes) instead of the full volume
– The host receives a completion status as soon as the FlashCopy relationship is created; background copy is
initiated asynchronously, with reads redirected to the source for tracks not yet copied.
41
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Clone Blocks (XCOPY) Primitive - Functional Illustration
• Without API
–
–
SCSI Read (Data moved from array to host)
SCSI Write (Data moved from host to array)
• With API
–
–
SCSI READ
SCSI
SCSI READ
EXTENDED
SCSI
READ
COPY
..MANY times…
SCSI WRITE
SCSI WRITE
SCSI WRITE
..MANY times…
SCSI XCOPY Command sent by host
Allows copy within or between LUNs
• Use Cases
–
–
–
Storage vMotion
• Initiated by Administrator OR Storage
Distributed Resource Scheduler
Storage Clone
VM Creation from Template
42
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Additional VMware Support and Integration Links
VMware VAAI website:
http://kb.vmware.com/selfservice/microsites/search.do?languag
e=en_US&cmd=displayKC&externalId=1021976
VMware Compatibility Guide:
http://www.vmware.com/resources/compatibility/search.php
Performance Best Practices for VMware vSphere 4.1:
http://www.vmware.com/pdf/Perf_Best_Practices_vSphere4.1.p
df
Performance Best Practices for VMware vSphere 5.0:
http://www.vmware.com/pdf/Perf_Best_Practices_vSphere5.0.p
df
Performance Best Practices for VMware vSphere 5.1:
http://www.vmware.com/pdf/Perf_Best_Practices_vSphere5.1.p
df
43
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Ordering Detail Information
Paul Spagnolo
[email protected]
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Business Class Features
Business Class (BC) continues to be an option in addition to Enterprise Class
(EC)
– Identified by feature code #1250
– Can be concurrently upgraded to Enterprise Class
Offers lower cost entry level DS8870 option but a limited configuration
– No expansion frame
– Maximum of 144 DDMs
•
Including SSD, enterprise and nearline drive classes
– Maximum of 2-core processor
– Maximum of 4 host adapters in two I/O enclosures
– Choice of 16 GB or 32 GB of processor memory
•
•
No copy services on Business Class configuration with 16 GB of processor memory
No I/O Priority Manager on Business Class configuration with 16 GB of processor memory
Option for single phase power in addition to three phase power
45
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Processor Features
During physical configuration, identify the number of processor cores
desired in the configuration
– #4401
2 core processor (Business Class only)
– #4402
4 core processor (Enterprise Class only)
– #4403
8 core processor (Enterprise Class only)
– #4404
16 core processor (Enterprise Class only)
Number of core processors is tightly coupled to processor memory options
and expansion frame options
Cores are per storage controller. A DS8870 has two storage controllers
(POWER7 CECs)
2-core config
4-core config
Empty
Empty
Processor sockets
Processor sockets
8-core config
16-core config
Active cores
Processor sockets
Processor sockets
Inactive cores
46
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Processor Memory Features
Processor memory is used for operating system, control functions and
cache
Feature codes for processor memory include:
– #4311 – 16 GB processor memory (2-core BC only) – NVS 1 GB
– #4312 – 32 GB processor memory (2-core BC only) – NVS 1 GB
– #4313 – 64 GB processor memory (4-core EC only) – NVS 2 GB
– #4314 – 128 GB processor memory (8-core EC only) – NVS 4 GB
– #4315 – 256 GB processor memory (8-core EC only) – NVS 8 GB
– #4316 – 512 GB processor memory (16-core EC only) – NVS 16 GB
– #4317 – 1024 GB processor memory (16-core EC only) – NVS 32GB
47
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Configuration Option Summary
System Class
Processor
Indicator
Total System
Memory
NVS Size
Expansion
Frames (96E)
Allowed
Maximum
Device
Adapter Pairs
Maximum
Host Adapters
Maximum Host
Ports
Maximum
DDMs
Business Class
#4401 (2)
16 GB
1 GB
None
2
4
32
144
Business Class
#4401 (2)
32 GB
1 GB
None
2
4
32
144
Enterprise Class
#4402 (4)
64 GB
2 GB
None
4
8
64
240
Enterprise Class
#4403 (8)
128 GB
4 GB
0–2
8
16
128
1056
Enterprise Class
#4403 (8)
256 GB
8 GB
0–3
8
16
128
1536
Enterprise Class
#4404 (16)
512 GB
16 GB
0–3
8
16
128
1536
Enterprise Class
#4404 (16)
1024 GB
32 GB
0–3
8
16
128
1536
Notes:
1.The DS8870 supports both Single Phase Power and Three Phase Power
2.Business Class configurations do not have the option for an expansion frame. If you need additional capacity, Business Class configurations
may be nondisruptively upgraded to standard class cabling configuration.
3.The minimum number of host adapters in a storage unit configuration is two.
4.The DS8870 provides a nondisruptive upgrade from the smallest to the largest configuration including cache, processors, host adapters,
HDDs, SSD and 96E expansion frames.
48
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Encryption Features
All drives ordered for the DS8870 are Encryption Capable (Full Disk
Encryption or FDE) drives
Activate the encryption feature to enable FDE drives
– FC #1750 = Encrypted drive set activation indicator
– FC #1754 – Encrypted drive de-activation indicator
Enabling encryption requires key management servers (minimum of 2
maximum of 4 supported)
– Tivoli Key Lifecycle Manager (TKLM) or
– IBM Security Key Lifecycle Manager (ISKLM) for z/OS
– FC #1760 provides a System x server with TKLM preloaded
•
•
Can order multiple FC #1760s as desired
Need to separately license TKLM product but comes pre-installed
49
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Drive Summary
Drive Class
RAID
Support
Drive Set
(FDE capable)
Standby CoD Drive Set
(FDE capable)
400 GB SSD ½ drive set
Solid State
5
#6156
N/A
400 GB SSD
Solid State
5
#6158
N/A
146 GB/15K RPM
Enterprise
5, 6, 10
#5108
#5209
300 GB/15K RPM
Enterprise
5, 6, 10
#5308
#5309
600 GB/10K RPM
Enterprise
5, 6, 10
#5708
#5709
900 GB/10K RPM
Enterprise
5, 6, 10
#5808
#5809
Nearline
6
#5858
#5859
Drive Size
3 TB/7.2K RPM
If other RAID options are required, submit a RPQ
50
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 Extents
DS8870 provides slightly less usable capacity (extents) per rank as
compared to DS8800
– Each DS8000 rank has some metadata that reserves some extents on every
rank
– DS8870 now reserves more space for additional metadata then prior models
Need to claim this space now for future enhancements which will
require more metadata space on each DS8870 rank
– Failure to do this now would result in new function not being delivered
concurrently and would require customer to reformat of all disk ranks
(unacceptable option)
– New capabilities which require this additional metadata may include
•
•
•
Enhancements to FlashCopy and remote copy
Architectural scalability
Additional storage tiers
– Rank capacities are slightly smaller (34 GB) on DS8870 compared to DS8800
•
Plan for this when moving or migrating data to the DS8870
– See next three charts (or Capacity Magic) for details
51
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 RAID Capacities for RAID-5 Arrays
Refer to GC27-4209, DS8870 Introduction and Planning Guide for the latest information and restrictions
52
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 RAID Capacities for RAID-6 Arrays
Refer to GC27-4209, DS8870 Introduction and Planning Guide for the latest information and restrictions
53
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
DS8870 RAID Capacities for RAID-10 Arrays
Refer to GC27-4209, DS8870 Introduction and Planning Guide for the latest information and restrictions
54
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Power Features
Power features on the DS8870 have changed
– Do not attempt to reuse old, existing line cords with the DS8870 as doing so
may harm the DS8870
Single phase power is available on the Business Class and the
Enterprise Class DS8870
55
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Power Features - continued
Single phase power features
– #1061 – Single phase power 200-240V, 60A, 3-pin connector
– #1068 – Single phase power 200-240V, 63A, no connector
– #1072 – Top exit single phase power 200-240V, 60A, 3-pin connector
– #1073 – Top exit single phase power 200-240V, 63A no connector
Three phase power features
– #1081 – Three phase power cord, wye, 380V-415V, 32A, no connector
– #1082 – Three phase power cord, delta, 200-240V, 60A, 4-pin connector
– #1083 – Top exit three phase power cord, wye, 380V-415V, 32A, no connector
– #1084 – Top exit three phase power cord, delta, 200-240V, 60A, 4-pin connector
Top exit bracket for Fibre cables
– #1400 – bracket for fibre cabling for top exit
Special tool
– #1101 – Universal ladder
•
One required at location if using top exit power features (unless suitable ladder is otherwise available)
56
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Power Features – continued
Feature Code
Description
Connector
Receptacle
#1061
Single phase power
cord, 200-240V, 60A,
3-pin connector
Hubbell HBL360C6W
Pin and Sleeve
Connector, IEC 309,
2P3W
Hubbell
HBL360R6W, AC
Receptacle, IEC
60309, 2P3W
#1072
Top exit, single
phase power cord,
200-240V, 60A, 3-pin
connector
Hubbell HBL360C6W
Pin and Sleeve
Connector, IEC 309,
2P3W
Hubbell
HBL360R6W, AC
Receptacle, IEC
60309, 2P3W
#1082
Three phase power
cord, delta, 200240V, 60A, 4-pin
connector
Hubbell HBL460C9W
Pin and Sleeve
Connector, IEC 309,
3P4W
Hubbell
HBL460R9W, AC
Receptacle, IEC
60309, 3P4W
#1084
Top exit, three
phase power cord,
delta, 200-240V, 60A,
4-pin connector
Hubbell HBL460C9W
Pin and Sleeve
Connector, IEC 309,
3P4W
Hubbell
HBL460R9W, AC
Receptacle, IEC
60309, 3P4W
Note: The Russellstoll connector is not available on the DS8870
57
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Extended Power Line Disturbance Feature
Extended Power Line Disturbance feature (EPLD) allows a storage
system to be protected from power disturbances for 50 seconds
– Without EPLD, approximately 4 seconds of protection from power line
disturbance (which is longer than the prior models of the DS8000 which was 30
milliseconds)
– Specify FC #1055
– Usually not necessary in data centers where a UPS is providing conditioned
power and protection for power line disturbance
58
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
239x-LFA Function Authorization Table
59
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Statement of Direction1
Statement of Direction
It is IBM’s current plan and direction to release a field model
conversion from DS8800 to DS8870
– IBM intends this release to be available in the first half of 2013
1
IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s
sole discretion. Information regarding potential future products is intended to outline our general product direction and
it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products
is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. Information about potential
future products may not be incorporated Into any contract. The development, release, and timing of any future features
or functionality described for our products remains at our sole discretion.
60
© 2012 IBM Corporation
Advanced Technical Skills (ATS) North America
Trademarks
The following are trademarks of the International Business Machines Corporation in the United States, other countries, or both.
Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not
actively marketed or is not significant within its relevant market.
Those trademarks followed by ® are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States.
For a complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml:
*, AS/400®, e business(logo)®, DBE, ESCO, eServer, FICON, IBM®, IBM (logo)®, iSeries®, MVS, OS/390®, pSeries®, RS/6000®, S/30, VM/ESA®, VSE/ESA,
WebSphere®, xSeries®, z/OS®, zSeries®, z/VM®, System i, System i5, System p, System p5, System x, System z, System z9®, BladeCenter®
The following are trademarks or registered trademarks of other companies.
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.
Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel
Corporation or its subsidiaries in the United States and other countries.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.
IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce.
* All other products may be trademarks or registered trademarks of their respective companies.
Notes:
Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will
experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed.
Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual
environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.
This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without
notice. Consult your local IBM business contact for information on the product or services available in your area.
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance,
compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.
61
© 2012 IBM Corporation