1 EMC CONFIDENTIAL—INTERNAL USE ONLY

EMC
©
Copyright
CONFIDENTIAL—INTERNAL
2015 EMC Corporation.
USEAll
ONLY
rights reserved.
1
EMC ECS (ELASTIC
CLOUD STORAGE)
New Options for Cloud Scale
Object Storage
EMC CONFIDENTIAL—INTERNAL USE ONLY
2
DATA GROWTH IS BREAKING TRADITIONAL
STORAGE
SCALE-OUT FILE & OBJECT STORAGE CONTINUES TO GROW
• Overly complex
– Multiple data protection schemes,
protocols, management tools
• Can’t economically scale
– Inefficient, high overhead,
especially at geo-scale
• Not cloud-ready
– Not architecturally suited and no
self-service
Source: IDC EMC Digital Universe Study 2014
EMC CONFIDENTIAL—INTERNAL USE ONLY
3
MODERN APPS ARE BREAKING TRADITIONAL
STORAGE
NOT DESIGNED FOR CLOUD AND BIG DATA APPLICATIONS
• Architecture is too complex
– Locking, replication, High Availability, geodistribution is complex
• Not Web or firewall friendly
– Distributed (WAN) access is complex
• Storage silos impede development
– Different hardware for every data type and
access protocol
EMC CONFIDENTIAL—INTERNAL USE ONLY
4
WHAT’S A DIME WORTH?
$0.10/GB SAVINGS = $100,000,000 / EXABYTE
1 Terabyte
1 Petabyte
1 Exabyte
$1
$10
EMC CONFIDENTIAL—INTERNAL USE ONLY
$100
$1.000
$10.000
$100.000
$1.000.000 $10.000.000 $100.000.000
5
DELIVER STORAGE ON COMMODITY
PLATFORMS
ECS
Software
OBJECT
STORAGE
HDFS
STORAGE
Commodity
Platforms
EMC CONFIDENTIAL—INTERNAL USE ONLY
6
A HYPERSCALE STORAGE INFRASTRUCTURE
USING COMMODITY PLATFORMS
EMC CONFIDENTIAL—INTERNAL USE ONLY
7
ECS SOFTWARE ARCHITECTURE
CLOUD-SCALE STORAGE SERVICES ON COMMODITY
ECS
Software
OBJECT
STORAGE
HDFS
STORAGE
Geo-Replicated Data Protection
Active-Active read/write support with strong consistency
No single point of failure
Performance and efficiency for small and large objects
SITE 1
EMC CONFIDENTIAL—INTERNAL USE ONLY
SITE 2
SITE 3
8
WHAT’S GEO-DISTRIBUTION?
• The ability for an object storage
platform to replicate or stripe
files/objects according to policy or
algorithms across multiple locations
in an efficient manner
• Reduces latency/Delivers enterprise
grade data protection
EMC CONFIDENTIAL—INTERNAL USE ONLY
9
STORAGE OVERHEAD
OPTIMIZED DATA ACCESS, PROTECTION AND EFFICIENCY
3,00
2,67
2,50
2,00
2,00
Overhead
1,50
1,77
1,67
1,60
1,55
1,52
1,33
1,00
0,50
0,00
1
2
3
4
5
6
7
8
# of Data Centers
EMC CONFIDENTIAL—INTERNAL USE ONLY
10
ACTIVE-ACTIVE READ/WRITE ARCHITECTURE
ANYWHERE ACCESS TO CONTENT
https://accesspoint.yourcompany.com
• Single global namespace across
data centers
• Strong consistency across data
centers
Site 1
EMC CONFIDENTIAL—INTERNAL USE ONLY
Site 2
• Optimized for minimal WAN round
trips by sensing access patterns
across data centers on individual
entities
11
COMPREHENSIVE DATA ACCESS
COMPATIBILITY WITH COMMON INDUSTRY API’S
• Simultaneous access to underlying data
through multiple interfaces
– Object, HDFS, File (future)
ATMOS
• HDFS compatible with Cloudera,
Hortonworks, Pivotal etc.
• Support for S3, Swift, Atmos and Centera
CAS APIs object
EMC CONFIDENTIAL—INTERNAL USE ONLY
12
COMPREHENSIVE REPORTING
ECS DASHBOARD – SELF SERVICE PORTAL
• Storage capacity utilization
• Erasure coding status
• Recovery status
• Per node statistics
– Process health, traffic metrics, resource
utilization and hardware health
• Replication group statistics
– Replication rate (MB/s), replication progress,
cached chunks, failover/bootstrap progress
EMC CONFIDENTIAL—INTERNAL USE ONLY
13
TEMPORARY SITE FAILOVER
TWO SITE SCENARIO
 Read, update and
create objects in
Site-1 and Site-2
 List buckets
 Edit buckets
Site-1
Bucket A
Site-2
Bucket A
Failed operations: bucket, namespace, and user creation
EMC CONFIDENTIAL—INTERNAL USE ONLY
14
ELASTIC CLOUD STORAGE
ECS on COTS
COTS HW
Customer provided
HW & OS M/O
*NFS access to Object data
EMC CONFIDENTIAL—INTERNAL USE ONLY
15
ELASTIC CLOUD STORAGE
COTS HW
EMC provided
HW & OS M/O built in
*NFS access to Object data
EMC CONFIDENTIAL—INTERNAL USE ONLY
16
HARDWARE CONFIGURATIONS
 Unstructured configurations
– Object & HDFS
 Available in multiple capacities within
a rack
 Deployable in customer provided
racking
 Clustering across racks scales to 100s
of PBs
EMC CONFIDENTIAL—INTERNAL USE ONLY
17
HARDWARE COMPONENTS

Servers
–
–
–
–

Dual CPU Intel
4 server nodes in 2U
Host ECS software
Provide disk attachment points
Disks & Enclosures
– 1TB & 6TB SATA Drives
– Up to 60 Drives / 4U Enclosure
EMC CONFIDENTIAL—INTERNAL USE ONLY

Data Network 10 GBE

Management Network 1 GBE
18
ECS IOT Cloud Storage Platform
“Internet of Things” Sensor, Telemetry, Data Collection
PROBLEM
• Need cost effective solution to store huge amounts of
unstructured data generated by IOT and sensors
• “No Public Cloud” policy - Data needs to be on-premises
• Data collection via modern cloud applications requires
compatibility with APIS’s like S3 and OpenStack
• Analytics workflow is slow, expensive and complicated
using Hadoop direct attach or public cloud storage
SOLUTION
• EMC ECS Appliance (Object and HDFS)
VALUE
• ECS cost per GB is less than public clouds
• ECS provides high availability with on-premises security
• ECS is compatible with S3, OpenStack, and other popular
API’s
• ECS is HDFS compatible and enables a streamlined Hadoop
workflow for “data in place” analytics
EMC CONFIDENTIAL—INTERNAL USE ONLY
19
ECS COLD ARCHIVE
COST EFFECTIVE LONG TERM RETENTION
PROBLEM
• Unstructured data growth - Reclaim costly Tier 1 storage
Memphis
• Current solutions aren’t scalable or cost efficient
• Instant access to cold-stored data is required
L.A.
UK
• “No Public Cloud” policy - Data needs to be on-premises
SOLUTION
• EMC ECS Appliance (Object and HDFS)
LAN/WAN
VALUE
• 65% cheaper than public cloud
• On-premises security
• Quick retrieval of archived data
Video
EMC CONFIDENTIAL—INTERNAL USE ONLY
Images
Sensor Data
Unstructured Data
20
ECS GLOBAL CONTENT REPOSITORY
ON-PREMISE UNSTRUCTURED HYPERSCALE STORAGE
PROBLEM
Applications
• Can’t cost-effectively manage or scale storage to support
growth in unstructured content.
Tiering, Archiving,
Backup
• Traditional storage not suited for new Web, mobile and
cloud applications.
• Difficult and costly to manage data lifecycle and retention
policies across archive silos and sites
SOLUTION
• EMC ECS Appliance (Object and HDFS)
https://accesspoint.yourcompany.com
VALUE
• Reduce complexity and cost–one globally accessible, geoefficient archive that serves multiple applications and
content types
• 65% lower cost than public cloud
• All data globally accessible by Web, mobile and cloud apps
• Enterprise-grade data protection – Efficient geo-protection
and policy-based retention for basic compliance and
governance
EMC CONFIDENTIAL—INTERNAL USE ONLY
Memphis
L.A.
UK
21
ECS MODERN APPLICATIONS PLATFORM
EFFICIENT GEO-CAPABLE STORAGE & ANYWHERE ACCESS
PROBLEM
• Traditional storage not optimized for multi-site, cloud
access to content
• Writing to multiple file systems and proprietary APIs
complicates development
• Can’t access or process large data sets
SOLUTION
• EMC ECS Appliance (Object and HDFS)
VALUE
• Designed for Cloud Apps - Provides anywhere access to
geo-replicated content
• Simpler, faster development - Supports multiple protocols
including S3 and OpenStack with strong consistency
• Unmatched access and efficiency - Geo-protection, activeactive architecture optimizes performance and storage
efficiency for large and small objects
Memphis
L.A.
EMC CONFIDENTIAL—INTERNAL USE ONLY
UK
22
WHERE TO START
• Free Unlimited capacity
• Free Unlimited time
• Go from application prototype to
production faster
• ‘Container-ized’ download available
www.emc.com/getecs
EMC CONFIDENTIAL—INTERNAL USE ONLY
23