EMC ViPR and ECS: A Lap Around Software-Defined Services EMC Forum 2014

EMC Forum 2014
EMC ViPR and ECS: A Lap Around
Software-Defined Services
© Copyright 2014 EMC Corporation. All rights reserved.
1
Session Agenda
• Market Dynamics
• EMC ViPR Overview
• What’s New in ViPR Controller
• What’s New in ViPR Data Services
• Additional Resources
© Copyright 2014 EMC Corporation. All rights reserved.
2
The EMC Exabyte Journey
© Copyright 2014 EMC Corporation. All rights reserved.
3
HYPERSCALE AND BIG DATA APPLICATIONS
10X More Data, Accessible 24x7x365
© Copyright 2014 EMC Corporation. All rights reserved.
4
BILLIONS
OF USERS
MILLIONS
OF APPS
Mobile
Cloud
Big Data
Mobile Devices
Social
HUNDREDS OF MILLIONS
OF USERS
TENS OF THOUSANDS
OF APPS
LAN/Internet
Client/Server
PC
MILLIONS
OF USERS
THOUSANDS
OF APPS
Mainframe, Mini Computer
Source : IDC, 2013
© Copyright 2014 EMC Corporation. All rights reserved.
Terminals
5
ECS Appliance
ECS Appliance
BILLIONS
MILLIONS
OF USERS
OF APPS
Mobile
Cloud
Big Data
Social
MOBILE DEVICES
HUNDREDS OF MILLIONS
OF USERS
TENS OF THOUSANDS
OF APPS
LAN/Internet
Source : IDC, 2013
© Copyright 2014 EMC Corporation. All rights reserved.
Client/Server
PC
6
ViPR: SOFTWARE-DEFINED STORAGE
Performance & Mission-Critical Workloads
New & Basic Workloads
ViPR
Services
ViPR
Controller
EMC
Provisioning
Non-EMC
Protect Current Investments
© Copyright 2014 EMC Corporation. All rights reserved.
Self-Service
Automation
Reporting
A rray
Support via
OpenStack
Commodity Hardware
ECS Appliances
7
PROVIDES UNMATCHED FLEXIBILITY & CHOICE
Simple, Open and Extensible Architecture
Application
Admin
Automate Storage Best Practices:
SELF–SERVICE UI
Orchestrates repetitive and complex tasks
Create a Bock Volume
Mount a Volume to Host
Snapshot a Volume
Restore from Snapshot
HIGH
MEDIUM
LOW
Multi-tenant, Multi-Site Self-Service C atalog
ViPR
C ontroller
EMC
100% Open & Extensible
Using ViPR REST API & Java SDK
Works with EMC & Non-EMC Storage
Platforms: Isilon, VMAX, VNX, HDS, & IBM plus
many others
Works with Data Protection Technologies:
RecoverPoint, VPLEX, and SRDF
Works with Commodity Platforms: HP
Integrated with Cloud Stacks: VMware,
Openstack Swift and Microsoft Hyper-V
Non-EMC
© Copyright 2014 EMC Corporation. All rights reserved.
via
OpenStack
8
ViPR 2.0 – ENHANCEMENTS
Controller
© Copyright 2014 EMC Corporation. All rights reserved.
•
Commodity Platform Support
•
Geo-Distributed Data Center
Support
•
Enhanced Native Array Support
•
Expanded 3rd Party Array
Support via OpenStack
•
Data Protection Technology
Enhancements
•
Federal Compliance
9
EXPANDED ARRAY SUPPORT
CONTROLLER
Native Integration
EMC
VMAX
EMC
VNX
EMC
Isilon
EMC
ScaleIO
EMC
VBLOCK
NetApp
FAS
© Copyright 2014 EMC Corporation. All rights reserved.
Hitachi
HUS VM
Hitachi
VSP
(Block)
IBM
XIV
IBM
SVC
IBM
DS8000
Dell
Equal-Logic
HP 3PAR
HP
Left-Hand
Solidfire
ORACLE
ZFS
NetApp
E-Series
10
COMMODITY HARDWARE SUPPORT
• Runs on 3rd party commodity
hardware
• Uses a certification model
– Enhanced serviceability drives scale
– HP SL4540 certified at launch
– Additional certifications pending
© Copyright 2014 EMC Corporation. All rights reserved.
11
Enhanced Data Protection Functionality
San Francisco
San Jose
Active Failure Domain
Active Failure Domain
•
Operational Recovery of
VPLEX Virtual Volumes
•
SNAPs for VPLEX volumes
•
Automate high availability –
reduce to 5 clicks
VPLEX Metro
VMAX
VMAX
Las Vegas
Passive Failure Domain
VMAX
© Copyright 2014 EMC Corporation. All rights reserved.
12
COMPLIANCE FEATURES FOR SECURE
ENVIRONMENTS
• IPv6 and Dual Stack Support
– All communication to ViPR, ViPR
to underlying systems and within
ViPR
• Security Hardening Scans
• Compliance Certifications
– Common Criteria
– FIPS 140-2 Compliance
– Section 508 Compliant GUI
© Copyright 2014 EMC Corporation. All rights reserved.
13
GEO-DISTRIBUTED DATA CENTER
MANAGEMENT
Multiple ViPR Controller Deployment
• Single Sign-on across Geo
• Global tenants and projects
• Reporting across ViPR instances
• Scale
Tenant
Volumes
File systems
#operations/hr
© Copyright 2014 EMC Corporation. All rights reserved.
1000s
1,000,000 / ViPR
400,000 / ViPR
500
14
NEW DATA MANAGEMENT REQUIREMENTS
Host Based
Storage
Documents
(XLS, PPT, DOC)
Relational
Databases
Universal Protocol Support
© Copyright 2014 EMC Corporation. All rights reserved.
Content
Repositories
Rich Media
(PDF, JPG, Video,
Streaming)
Effortless Scale
Analytics
Sensor Data
(GPS, measurements)
Unstructured
Content
(Web Server Logs)
Highly Efficient Geo-Storage
15
ViPR 2.0 – ENHANCEMENTS
Services
• Geo-replication and geodistribution
• ViPR Block – enabled by ScaleIO
• Data services on commodity
hardware
• ViPR CAS Support for Centera
workloads
© Copyright 2014 EMC Corporation. All rights reserved.
16
Geo-Replicated Data Protection
Protection against local and global failures
•
Handles local hardware and full data
center failures
– Disk, Node, Rack, Data Center are failure
domains
•
Site 2
Site 1
•
Local hardware failure recovery
requires no WAN traffic
New Hybrid encoding approach
enables low storage overhead
Site 3
© Copyright 2014 EMC Corporation. All rights reserved.
17
Active-Active Read/Write Architecture
Anywhere access to content
https://accesspoint.yourcompany.com
•
•
•
© Copyright 2014 EMC Corporation. All rights reserved.
Single global namespace across data
centers
Strong consistency across data centers
Optimized for minimal WAN round trips by
sensing access patterns across data
centers on individual entities
18
Data Access
Compatibility with common industry APIs
•
Simultaneous access to underlying data
through multiple interfaces
– Object, HDFS , File (Future)
HDFS
•
HDFS compatible with Cloudera, Hortonworks,
Pivotal etc.
•
Support for S3, Swift, Atmos and Centera CAS
APIs object
•
Extensions to APIs
– Byte-Range updates, Atomic appends, Rich ACLs etc.
© Copyright 2014 EMC Corporation. All rights reserved.
19
Data Services on Commodity Hardware
…
VIRTUAL ARRAY
Commodity
Commodity
© Copyright 2014 EMC Corporation. All rights reserved.
•
Running on top commodity
white boxes
•
End to end commodity H/W
bootstrap, setup, rolling
upgrades, and configuration
management.
Commodity
20
Compliance
Compliance archiving and long-term retention
•
•
•
•
•
•
© Copyright 2014 EMC Corporation. All rights reserved.
Enabled at object or bucket level
Time-based retention enforcement
Immutability and checksum
Platform lockdown
Privileged delete
SEC 17a-4f & HIPAA
21
ViPR BLOCK (Enabled by SCALEIO)
Software-Defined Storage – ViPR Block
 ViPR Block delivered by Scale IO
 Managed by ViPR controller similar to
other ViPR data services
 Can create virtual pools of storage with
varying performance tiers
 Scales to 1000’s of nodes
© Copyright 2014 EMC Corporation. All rights reserved.
22
Flexible Form Factors
© Copyright 2014 EMC Corporation. All rights reserved.
23
THE WORLDS FIRST COMMERCIALLY AVAILABLE
COMPLETE WEB-SCALE STORAGE
INFRASTRUCTURE FOR YOUR DATA CENTER
Exabyte+
Service
Provider
Self-Service
Elastic
COMPLETE
© Copyright 2014 EMC Corporation. All rights reserved.
WEB-SCALE
Enterprise
ANY DATA CENTER
24
ECS Appliance Configurations

Commodity HW (Intel x86, Ethernet, SAS)

Object and HDFS Configurations @ GA
– Small = 360TB
– Medium = 1.4PB
– Large = 2.9PB

Mixed Configurations @ GA
– Small = 360TB (Object, HDFS) & 120TB
(Block)
– Medium = 1.4PB (Object, HDFS) and 240TB
(Block)

© Copyright 2014 EMC Corporation. All rights reserved.
Racks can be clustered to scale to 100’s of
PBs
25
Join the ViPR
Community…
Learn
|
Explore how-to
videos, helpful
guides, and
training
Try
Download ViPR
FREE with no
time limit – for
non-production
use
| Develop | Collaborate
Access SDKs,
FAQs, forums,
technical
documentation,
sample apps,
and more
Ask the
experts, talk to
peers, share
ideas and
experiences
www.emc.com/viprcommunity
© Copyright 2014 EMC Corporation. All rights reserved.
26
ADDITIONAL RESOURCES
Visit EMC.com
© Copyright 2014 EMC Corporation. All rights reserved.
Read Rethink
Storage Blog
Follow on
Twitter
Join the
LinkedIn
Group
27