IBM Tivoli Storage Productivity Center – Replication Management July 11 , 2013

IBM ATS, NA
IBM Tivoli Storage Productivity Center
– Replication Management
July 11th, 2013
Margaret Yu
ATS
[email protected]
© 2013 IBM Corporation
IBM ATS, NA
Topics
Introduction to TPC for Replication (TPC-R)
TPC-R Recent Improvements
Live Demo
– TPC-R look and feel
– Setting up DS Global Mirror with Practice session
– Manage DS Global Mirror with Practice session
2
© 2013 IBM Corporation
IBM ATS, NA
Introduction to TPC for Replication
3
© 2013 IBM Corporation
IBM ATS, NA
TPC Replication Management (TPC-R) Value
Common interface to manage heterogeneous IBM Storage System
based copy services
Easy and reliable user interface to setup large copy services
configuration
Simplify and automate complex replication tasks
– Planned outage recovery
– Unplanned outage recovery
– Outage recovery testing
4
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Supported Environment
IBM Storage System
– DS8000, DS6000, ESS 800
– SAN Volume Controller
– Storwize V7000 and Storwize V7000 Unified
– Storwize V3700* and Storwize V3500*
– XIV
Copy Services
– Snapshot* / FlashCopy
– Metro Mirror
– Global Mirror
– Metro Global Mirror*
* Note: Only FlashCopy available on V3700 v6.4.1 and V3500
FlashCopy, Metro Mirror, Global Mirror support for V3700 v7.1
Snapshot support for XIV
Metro Global Mirror support for DS8000
5
© 2013 IBM Corporation
IBM ATS, NA
Tivoli Storage Productivity Center (TPC) 5.1 Family
TPC (Distributed) and TPC Select Edition (Distributed)
–
Storage resources discovery, storage provisioning, capacity management, topology, monitoring and alerting
–
Performance management for storage systems and storage networks
–
Replication management (TPC for Replication)
–
–
Supports 2-site and 3-site replication and disaster recovery management including failback features
License based on capacity (TPC) or number of enclosure (TPC Select Edition)
IBM SmartCloud Virtual Storage Center
–
Offers the same features as TPC plus Storage Analytics features and Replication management
–
FlashCopy Manager software
–
SAN Volume Controller software
TPC for Replication for System z
–
–
Replication management
–
Supports 2-site and 3-site replication and disaster recovery management including failback features
–
Metro Mirror w/ HyperSwap and Metro Global Mirror w/ HyperSwap support in the System z
environment
License based on source capacity
TPC for Replication Basic Edition for System z
6
–
No charge product that provides z/OS Basic HyperSwap support and FlashCopy support only
–
No 2-site or 3-site data replication support
© 2013 IBM Corporation
IBM ATS, NA
TPC Replication Management vs TPC-R for System z
7
TPC and VSC imbedded
replication management
TPC for R for System z
Help simplify and automate complex replication tasks without scripts
Yes
Yes
Support DS8000, DS6000, ESS 800, SVC, Storwize V7000 , V7000 Unified, V3700,
V3500 and XIV
Manage both z/OS and distributed volumes
Yes
Yes
Yes
Yes
Help automate setting up volume pairs
Yes
Yes
Support FC, MM, GC, GM and MGM
Yes
Yes
Monitor Replication Progress
Yes
Yes
Provide Basic Reporting on Replication Progress
Yes
Yes
Provide SNMP Alerting
Yes
Yes
Support Practice Volumes
Yes
Yes
Support Consistency Groups
Yes
Yes
AIX High Availability - Metro Mirror w/ Open HyperSwap
Yes
Yes
Server Operating System
AIX, Linux and/or Windows
z/OS
Support z/OS HyperSwap Managment
No
Yes
Support in-band FICON commands
No
Yes
Orderable in PPA or AAS
Yes
No
Orderable via Shopz or Global Techline (CFSWeb Software Configurator)
No
Yes
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Server Redundancy
Standby TPC-R server for disaster recovery
Different Operating System platform support (Windows/AIX/Redhat/zOS)
– Active and Standby TPC-R Server may run on different OS platforms
100% consistent view across TPC-R servers of managed storage
Manually activate standby server and initiate recovery
Active
TPC-R Server
Consistent
TPC-R View
Standby
TPC-R Server
IP
IP
Linux
Windows
AIX
Primary Site
8
8
Primary Site
SAN
SAN
Secondary Site
Secondary Site
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Graphical User Interface (GUI)
Web Browser based
My Work hyperlinks on left
Display area for panels on
right
Wizards to provide guidance
on setting up replication on
configuration
Select session, select action
(from dropdown list) and GO
Tables with hyperlinks and
sortable columns
Dynamic Session Image
Health Overview on every
panel
Online help
Link to TPC Information Center
9
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Command Line Interface (CLI)
Installed with TPC-R – CSMCLI
May be used for additional automation
Similar to DS8000 CLI
– Command structure (mk, ch, rm, ls, show)
– Help structure
– Exit Codes
– Three types of invocation
• Single-shot (Single CSMCLI command)
csmcli mksess –cptype fc mySession
• Script (Sequence of CSMCLI commands)
csmcli –script scriptfile
Interactive (User CSMCLI session for multiple commands)
csmcli
10
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Terminology – Role
Role – 2-digit identifier indicating volume function and site
• Common
• Consistent
• Hardware
independent
Role Pair
Copy Set
Session
Example
DS Global Mirror session
H1
11
H2
J2
First digit -- volume function:
– H Host
Potentially accessed by application servers
– J Journal
Global Mirror FlashCopy target
Second digit -- site where volume is located:
– 1 Site 1
– 2 Site 2
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Terminology – Role Pair
Role – 2-digit identifier indicating volume function and site
• Common
• Consistent
• Hardware
independent
Role Pair - Pair of 2 volumes (2 roles) in a copy set
Copy Set
Session
Example
DS Global Mirror session
H1
H1-H2
H2-J2
H1-J2
12
H2
J2
Global Copy Role Pair
FlashCopy Role Pair
Global Mirror Role Pair
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Terminology – Copy Set
Role – 2-digit identifier indicating volume function and site
Role Pair - Pair of 2 volumes (2 roles) in a copy set
Copy Set – Set of volumes that represent copies of the same data
• Common
• Consistent
• Hardware
independent
Session
Example
DS Global Mirror session
H1
13
H2
J2
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Terminology – Session
Role – 2-digit identifier indicating volume function and site
• Common
• Consistent
• Hardware
independent
Role Pair - Pair of 2 volumes (2 roles) in a copy set
Copy Set – Set of volumes that represent copies of the same data
Session – Copy Sets making up a consistency group
Example
DS Global Mirror session
H1
H2
J2
H1
H2
J2
H1
H2
J2
Session managed via
simple commands
14
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Session with Practice Volumes
Manage Metro Mirror, Global Mirror and Metro Global Mirror with FlashCopy to
provide a point in time copy of data on a Practice volume
e.g. DS Global Mirror
Global Mirror Failover/Failback
w/ Practice
Global Mirror Failover/Failback
Built-in automation – Single command to put consistent data on practice volumes
Practice volumes can be used to
–
–
–
–
Test DR environment without interfering with DR operations
Testing or data mining without interfering with DR operations
An additional set of recoverable data to protect against a disaster during a resynchronization
Re-Flash consistent data if something went wrong during recovery
Practice volumes are also the recovery host volumes
– Practice how to recover and recover how it was practiced
– Use the recovery host volumes as source to resynchronize in reverse direction
15
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – DS8000 / DS6000 / ESS 800 Session Types
Metro Mirror
Failover/Failback
Flash Copy
• GC support,
• zOS HyperSwap &
Open HyperSwap
Capable
• FlashCopy
consistency
group
support
Global Mirror
Failover/Failback
w/ Practice
• GC support
• Pause with
secondary
consistency
option
16
Global Mirror
Either Direction w/
Two Site Practice
• GC support
• Pause with
secondary
consistency
option
Metro Mirror
Failover/Failback
w/ Practice
• GC support
Metro Global Mirror
• DS8000 only
• ESS in H1 only
• zOS HyperSwap
capable
• Pause with secondary
consistency option
(H2-H3)
Global Mirror
Failover/Failback
• GC support
• Pause with
secondary
consistency
option
Metro Global Mirror
w/ Practice
• DS8000 only
• ESS in H1 only
• zOS HyperSwap
capable
• Pause with secondary
consistency option
(H2-H3)
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – SVC / V7000 / V7000 Unified / V3700 /
V3500 Session Types
Flash Copy
Metro Mirror
Failover/Failback
Metro Mirror
Failover/Failback
w/ Practice
• Start H2->H1
initiates a full
volume copy of data
from H2 to H1
Global Mirror
Failover/Failback
Global Mirror
Failover/Failback
w/ Practice
• Start H2->H1
initiates a full
volume copy of data
from H2 to H1
Note:
17
Only FlashCopy available on V3700 v6.4.1 and V3500
FlashCopy, Metro Mirror and Global Mirror support for V3700 v7.1
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – XIV Session Types
Snapshot
18
Metro Mirror
Failover/Failback
Global Mirror
Failover/Failback
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Cascaded and 4 Site Solutions
While TPC-R does not have an explicit 4 site session type, it does allow
for setting up cascaded remote copy relationships
Using multiple TPC-R sessions it is possible to chain the replication by
making the targets of one session be the source of the other session
For example, a 4 site solution can be managed by using a DS Metro
Global Mirror session and a DS Metro Mirror Failover/Failback session
running in Global Copy mode, where the H3 volumes in the DS Metro
Global Mirror session are the H1 volumes in the DS Metro Mirror session
19
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Simple Setup
1. Define Storage Subsystems
2. Volume Protection (Optional)
3. Setup DS Logical Paths (Optional)
•
Mini Path Manager – portpairings.csv
4. Create Session
5. Add Copy Sets
6. Issue TPC-R Start command
20
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Session Commands
Common set of powerful TPC for Replication commands to perform necessary
steps for different replication session types on supported storage systems
–
–
–
–
–
–
–
–
Start, Start H1->H2, Start GC H1->H2, Start H2->H1, Start GC H2->H1, Start H1->H2->H3, Start
H2->H3, Start H1->H3, Start H3-H1, Start H2->H1->H3, Start H3->H1->H2
HyperSwap
Flash, Initiate Background Copy
Create Snapshot, Restore
Suspend, Stop
Recover
Terminate
Enable Copy to Site 1, Enable Copy to Site 2
Example
– Issue Start H1->H2 to start a Global Mirror Failover/Failback with Practice
session
21
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Practice Recovery
Session with Practice volumes
Issue TPC-R Flash command
1. Temporarily suspend Metro Mirror or Global Mirror if necessary
2. Ensure that all I2 volumes are consistent
3. Invoke Flash Copy to copy consistent data on I2 volumes to Practice volumes H2
4. Resume Metro Mirror or Global Mirror if suspended
5. Practice volumes H2 are ready for use
22
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Planned / Unplanned Outage Recovery
Planned Outage Recovery
– Quiesce or stop applications
1. Issue TPC-R Suspend command to replication session
• Pause replication
2. Issue TPC-R Recover command to replication session
• Perform the steps necessary to make the recovery host volumes consistent
• Enable recovery host volumes at remote site for host access
Unplanned Outage Recovery
– Session suspended due to unplanned outage
– Determine if recover to remote site is necessary
– Issue TPC-R Start command to replication session
• To resume replication in the original direction
OR
– Issue TPC-R Recover command to replication session
• Perform the steps necessary to make the recovery host volumes consistent
• Enable recovery host volumes at remote site for host access
23
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Session Configuration
Add Copy Sets
– Manually add via the GUI/CLI, volume matching for DS storage systems
– Import from CSV file
– During session setup and when replication is running
Remove Copy Sets
– Remove copy sets from a session and copying relationships on hardware
– Optionally to keep the copying relationships on hardware
• Relationships are removed from the consistency group structure
• Avoid full copy when only TPC-R configuration must be changed or cleanup
Export Copy sets
– Export all copy sets of a session to a CSV file
• Session name and session type
• Date that the copy sets were exported
• All copy sets in the session
– Manually save the CSV file
• Keep as a backup copy of the replication session configuration
• Import to restore the configuration
24
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Migration from Existing Replication
Migrate existing replication to TPC-R
– DS8000 Metro Mirror, Global Mirror, Metro Global Mirror
– SVC/V7000 Metro Mirror, Global Mirror
–
Complete the following steps
1.
2.
3.
4.
Determine which existing replication configuration and copy sets to migrate to TPC-R
Create session in TPC-R
Add the copy sets to be managed by TPC-R to the session created
Remove consistency group / global mirror structure on the hardware
–
DS Global Mirror, Metro Global Mirror
–
Terminate the Master Global Mirror session on the hardware
–
Remove the volumes from the session on each LSS
–
Close the session on each LSS
–
SVC/V7000 Metro Mirror, Global Mirror
–
Remove the remote copy relationships from the consistency group
–
Delete the consistency group on the hardware
5. Issue TPC-R Start command
Note: The Start command does not invoke a full copy of the data, instead, it detects the existing
replication relationships on the hardware and adopt them.
In general, migration of existing relationships should be done in the H1-H2 or H1-H2-H3 direction.
25
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Role Pair Status and Progress
Role Pair status message
–
E.g. Starting role_pair_name relationships on the hardware
Provide an estimated time to complete for the action
Progress reporting
26
–
Progress bar displays copy progress value in percentage
–
Progress details displays GiBs or tracks remaining to be copied
–
Reporting at Role Pair level and at individual pair level
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – DS / ESS RPO Warning/Severe Threshold
Allow user to define Warning and or Severe thresholds in seconds on a session
When RPO threshold is surpassed
– Warming and severe level threshold messages in console log and session messages log
– Throw an SNMP event
– Session status changes to Severe (severe threshold)
27
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – DS / ESS Global Mirror Information
Global Mirror Info tab on DS / ESS Global Mirror Session Details screen
Average
RPO
GM Master
Data Exposure Chart
CG Info
Export GM History
28
28
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Export DS / ESS Global Mirror Historical Data
Export historical data to a CSV file
– RPO
– LSS Out-of-Sync Tracks
Can be used to analyze RPO trends and whether a particular sets of
LSSs have high out-of-sync tracks value at certain date and time
29
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – DS8870 Easy Tier Heat Map Transfer
TPC-R 5.1.1.1 includes Easy Tier Heat Map Transfer Utility (HMTU)
Select Enable Transfer on the primary DS8870 and the secondary DS8870 from
TPC-R
Primary DS8870 and secondary DS8870 must be connected to TPC-R using a HMC
connection
Easy Tier heat map transfer function must be enabled on primary and secondary DS8870
Connection Status changes from Inactive to Connected after enabled on TPC-R
Transfer occurs every 12 hours (default)
View Easy Tier Heat Map Transfer result
Note: When you enable or disable the use of the Easy Tier heat map transfer function in TPC-R, the
function is not enabled or disabled on the storage systems that are connected to TPC-R. The
configuration options that you set for Easy Tier heat map transfer in TPC-R are used only by
TPC-R.
30
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – SNMP Notifications
SNMP Notifications
–
–
–
–
– Suspending-event notification
Session state change
– Communication failure
Path state change
– Management Server state change
Configuration change
DS8000 Global Mirror RPO thresholds (warning and severe)
TPC-R CLI command to add SNMP manager to which notifications are sent to
–
mksnmp –server server –port port
TPC-R SNMP notifications are displayed on TPC GUI as Replication Alerts
–
31
Triggered actions can be set on TPC
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Scalability
Unlimited number of sessions and thousands of copysets
– Sessions page displays information of all sessions managed by TPC-R
– Session Details page displays more information on individual session
32
© 2013 IBM Corporation
IBM ATS, NA
TPC-R - Built in Safety Features
Command or Action Warning Message
– Prompt for confirmation before a command or action is executed
User Role
– Three access levels: Monitor, Operator, Administrator
Volume Protection
– Exclude volumes from TPC for Replication sessions
Site Awareness
– Protection against incorrectly reversing hardware relationship at wrong location
33
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – HyperSwap for z/OS Support
Provide ability to run Basic HyperSwap, Metro Mirror w/ HyperSwap or Metro
Global Mirror w/ HyperSwap
– HyperSwap provides high availability by handling both a planned or an unplanned
automatic swap of the data from the primary to secondary site for Metro Mirror pairs, in the
case of I/O errors on the primary.
– No operator interaction required and non-disruptive to the application
– Basic HyperSwap is an entitled version of TPC-R on z/OS for HyperSwap high availability
support without D/R capabilities
– Metro Mirror w/ HyperSwap and Metro Global Mirror w/ HyperSwap support add in D/R
capabilities along with the high availability of HyperSwap in both a 2 site and 3 site solution
– Once TPC-R loads the configuration, swap by command or event can be managed directly
from z/OS. Same IOS component handles actual swap as with GDPS.
– HyperSwap coordinated across sysplex
Available when TPC-R is installed and running on z/OS
All primary and secondary devices must be defined to z/OS, with available paths
34
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – Open HyperSwap for AIX
Add business continuity HyperSwap
function to Metro Mirror session
TPC for Replication
Server (Open or z/OS)
– Allows I/O to the primary volumes to be swapped,
without human intervention, to the secondary
volumes.
– Minimal disruption to the applications that are using
the primary volumes
– Planned HyperSwap
– Unplanned HyperSwap
AIX Host
AIX Host
Application
AIX Host
Application
Arbitration
Application
Engine
Arbitration
SDD
Engine MPIO
Arbitration
SDD
Engine MPIO
Device
SDD Disk MPIO
Disk Driver
Device
Disk Driver
Device
Driver
Support DS8000 AIX volumes
Work in conjunction with IBM SDD
Available when TPC for Replication is
installed on any supported platform
Replication Path
Metro
Mirror
I/O Path
Command Path
Event Path
35
DS8000
DS8000
© 2013 IBM Corporation
IBM ATS, NA
TPC-R Recent Improvements
36
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – What’s new in version 5.1
Support failover operations by external products (e.g. VMware Site
Recovery Manager)
Support for DS8000 Extent Space Efficient volumes in all remote
copy relationships
– Available on DS8000 Release 6.3 or later
New features on DS / ESS Global Mirror Support
– Allow user to define Warning and Severe thresholds for RPO alerts
– Allow user to export Global Mirror history to a csv file for RPO analysis
– “FlashCopy with No Copy” option for DS8000 role pair I2->H2 and I3->H3
– “Refresh After Recover” option for DS8000 role pair I2->J2
– Provide ability to start/restart a Global Mirror session in Global Copy mode
37
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – What’s new in version 5.1.1
Support for Storwize V3700 and V3500 data replication
Support for SAN Volume Controller 6.4 option to move volumes
between I/O groups
– The I/O group was removed from the volume ID
HyperSwap options available for Metro Global Mirror with Practice
sessions
Support DS8000 FlashCopy consistency groups in FlashCopy
sessions
– Consistency groups created automatically during the creation of a
FlashCopy session
– No longer required to quiesce an application before issuing the Flash
command
38
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – What’s new in version 5.1.1.1
Support for DS8000 pause with secondary consistency for Global
Mirror and Metro Global Mirror sessions
– Available on DS8000 with the appropriate microcode level
– When the pause with secondary consistency option is enabled on DS8000
– Create a consistent data set on the secondary volumes
Support for DS8870 Easy Tier Heat Map Transfer
39
© 2013 IBM Corporation
IBM ATS, NA
TPC-R – What’s new in TPC-R for System z
WebSphere Currency
– Support WAS OEM 7, WAS 7 and WAS 8
– 64 bit support
Support Metro Mirror hardened Freeze capabilities on z/OS
– For environment with TPC-R on z/OS and Metro Mirror session containing
system volumes
– Allow IOS to manage the freeze
– Prevent TPC-R from being locked
– Maintain data consistency even if TPC-R is not active
40
© 2013 IBM Corporation
IBM ATS, NA
Live Demo
41
© 2013 IBM Corporation
IBM ATS, NA
Demo Environment
TPC for Replication
TPC for Replication
Active Server
Standby Server
IPIPNetwork
Network
192.168.21.91
192.168.21.92
SANVM-21-91.atssan01.dmz
SANVM-21-92.atssan01.dmz
Primary DS8000
Secondary DS8000
HMC: 192.168.21.32
HMC: 192.168.21.34
SAN
SAN
Serial# 20331
Serial# ALDR2
LSS B5
LSS C1
LSS D5
B500
F100
C100
D100
B501
F101
C101
D101
B502
F102
C102
D102
H1
42
LSS F1
H2
I2
J2
© 2013 IBM Corporation
IBM ATS, NA
Thank You!
43
© 2013 IBM Corporation