Elastic Cloud Storage (Ecs) Storage For The 3 Platform: What'S New in 2015

ELASTIC CLOUD STORAGE (ECS)
STORAGE FOR THE 3RD PLATFORM

WHAT'S NEW IN 2015
#EMCECS
Copyright 2015 EMC Corporation. All rights reserved. 1
ROADMAP INFORMATION DISCLAIMER
EMC makes no representation and undertakes no obligations with
regard to product planning information, anticipated product
characteristics, performance specifications, or anticipated release
dates (collectively, Roadmap Information).
Roadmap Information is provided by EMC as an accommodation to the
recipient solely for purposes of discussion and without intending to be
bound thereby.
Roadmap information is EMC Restricted Confidential and is provided
under the terms, conditions and restrictions defined in the EMC Non-
Disclosure Agreement in place with your organization.
#EMCECS
Copyright 2015 EMC Corporation. All rights reserved.
MODERN APPS ARE CHANGING
INDUSTRIES
#EMCECS
MODERN APPS ARE BREAKING
TRADITIONAL STORAGE
NOT DESIGNED FOR MODERN APPLICATIONS AND HYPERSCALE
Architecture is too complex

Locking, replication, High Availability, geo-
distribution is complex
Not Web or firewall friendly

Distributed (WAN) access is complex
Storage silos impede development

Different hardware for every data type and
access protocol
#EMCECS
NEW DEMANDS FOR HYPERSCALE
SOFTWARE-DEFINED STORAGE AND COMMODITY ARE FOUNDATIONAL
The Potential
Reduce storage costs with

7:1 Savings
commodity off-the-shelf (COTS)
components and standard, open
technologies
The Reality
Individual components provide

lower performance, lower
reliability, etc.
You need sufficient scale, the right
software, and operational expertise Storage Appliance Commodity Hardware
to provide a reliable, scalable

infrastructure #EMCECS
Copyright 2014
2015 EMC Corporation. All rights reserved. Source: IDC DSS Tracker Q4 2014 , Dec. 2014 5
WHAT DO CUSTOMERS NEED?
Customer need simple, API-

accessible, software-based
storage
that can be deployed on
commodity off-the-shelf
components
in a hyperscale architecture
#EMCECS
ECS IS COMMODITY INNOVATION
ECS BRINGS HYPERSCALE AND RAS TO COMMODITY
COTS components
X86 Servers, Ethernet networking, SATA disk drives
EMC Innovation in:

Market leading software-defined object storage
engine
How the software and hardware are integrated to
enable scalability and serviceability!
Enterprise grade support from EMC
Integrated appliance or software on 3rd-

party commodity
#EMCECS
COMPLETE CLOUD STORAGE
PLATFORM
Lower cost than public cloud
Hyperscale independently scale performance and
capacity for billions of files across sites
Anywhere read/write access with strong consistency
simplifies application development
Single global namespace and multi-tenancy
simplifies storage and data management
No single points of failure increases availability
and performance
Broad API support eliminates storage silos and
inefficient ETL processes
#EMCECS
ECS ARCHITECTURE
Custom apps Packaged apps Analytics
Object archiving Cloud Backup Next-gen File (web/mobile)
HTTP/S (REST), S3, Swift, Atmos, CAS, HDFS

https://accesspoint.yourcompany.com
SITE 1 SITE 2 SITE 3
Geo-Replicated Data Protection Global namespace

Active-Active read/write support Performance and efficiency for
with strong consistency small and large objects
#EMCECS
DESIGN PRINCIPLE: LAYERED ARCHITECTURE
Limitless Scale: Each layer is

HDFS HDFS
OBJECT
HDFS
OBJECT
independently scalable, highly
OBJECT
available, and has no single
Storage Engine point of failure.
Scale-Out Architecture: Scale
Persistence Layer
by adding more nodes, no
special nodes or roles
JBODs
Global Namespace: Any node
has full system view off data and
meta-data
#EMCECS
COMPREHENSIVE DATA ACCESS
COMPATIBILITY WITH COMMON INDUSTRY APIS
Simultaneous access to underlying data

through multiple interfaces
Object, HDFS, File (future)
HDFS compatible with Cloudera,
Hortonworks, Pivotal etc.
ATMOS
Support for S3, Swift, Atmos and Centera
CAS APIs object
Extensions to APIs
Byte-Range updates, Atomic appends, Rich ACLs
etc.
#EMCECS
GEO-REPLICATED DATA PROTECTION
EFFICIENT PROTECTION AGAINST LOCAL AND GLOBAL FAILURES
Handles local hardware and full

data center failures
Disk, Node, Rack, Data Center are
failure domains
Local hardware failure recovery

Site 2
requires no WAN traffic
Site 1
New Hybrid encoding approach

enables low storage overhead
Site 3
#EMCECS
OPTIMIZED STORAGE OVERHEAD
# of Data Overhead Low Storage Overhead:

Centers ~1.8x replication over
head across 4 sites
1 1.33 x
WAN Optimization: All
2 2.67 x
node and disk failures
3 2.00 x are repaired within the
4 1.77 x site, without any WAN
5 1.67 x
traffic.
6 1.60 x
Increasing the number of
data centers lowers
7 1.55 x storage overhead and
8 1.52 x increases protection
Business Value: Hyperscale economics to leverage key
assets and compete with public cloud IaaS #EMCECS
ACTIVE-ACTIVE, READ/WRITE
ARCHITECTURE
FASTER DEVELOPMENT AND ANYWHERE ACCESS TO CONTENT
https://accesspoint.yourcompany.com Single global namespace across

data centers
Strong consistency across data
centers
Optimized for minimal WAN round
trips by sensing access patterns
across data centers on individual
entities
#EMCECS
ECS Software ECS Appliance
Enterprise & SPs Enterprise & SPs
DIY with 3rd Party Commodity Hyperscale Cloud Storage Platform
Hardware EMC Service and Support
#EMCECS
ECS SOFTWARE vs. ECS APPLIANCE
ECS Software ECS Appliance
Package Software Only; BYO Appliance (HW+SW)
Hardware
Services Object and HDFS Object and HDFS
Network Customer Provided EMC Provided
Infrastructure
OS Deployment Customer Managed Managed by EMC
& Patching
Support Joint support between Fully supported by
customer and EMC EMC
EMC Phone Home Yes Yes
#EMCECS
ECS 1.2 WHAT'S NEW
#EMCECS
ECS 1.2 - SIMPLIFIED DEPLOYMENT
Simplified Configuration
Define your data center
topology
Single Command Install
Connect to any ECS Server
and start the install process
Rolling Upgrade Support
#EMCECS
STORAGE POOL, VIRTUAL DATA
CENTER
Virtual Data Center
Storage Pool
#EMCECS
VIRTUAL DATA CENTER VIEW
Virtual Data Center

Storage Pool 1 Storage Pool 2 Storage Pool 3
#EMCECS
REPLICATION GROUPS
Replication Groups define the replication policy

across one or more virtual data centers
Up to 8 vdcs per replication group
Multiple replication groups per virtual data center
Geo-Replication
Storage Pool/VDC1 Storage Pool/VDC2
Replication Group
#EMCECS
MULTI-TENANCY
#EMCECS
ECS 1.2 MULTI-TENANT ROLES
Assigns Object user to a Create Namespace
namespace
Add Namespace &
System Admins
Namespace Admin System Admin
Namespace 1 Namespace 2 Namespace 3
Authorization Provider
(AD/LDAP) Object Users Object Users Object Users
Object Buckets Object Buckets Object Buckets
#EMCECS
ECS 1.2 NEW MULTITENANT FEATURES
Meter Usage Namespace/Bucket Metering

Metering at bucket or namespace level
Objects Created, Deleted, Capacity, Bandwidth
Quota Management
Quota can be enabled at a particular GB value
Ability to block writes
Manage Quota Ability to set Quota at namespace or bucket level
Bucket and Namespace Auditing

Create, Delete, Update bucket
Audit
Set bucket ACL
Change bucket owner
#EMCECS
MONITORING &
DIAGNOSTICS
#EMCECS
ECS 1.2 CAPACITY MONITORING
Capacity Utilization
Usable, used and available capacity
Drill down from VDC, to Node to Disk.
Traffic Metrics
Read/write Avg Latency
Read/write Bandwidth
Read/write Transaction/sec
Disk Bandwidth
Read/Write traffic across various
background operations
#EMCECS
ECS 1.2 PHYSICAL ENVIRONMENT
Hardware Health
Node and Disk Health
Node Health
CPU, Memory and Network
Process Health
CPU, Memory and Network
#EMCECS
ECS 1.2 STORAGE EFFICIENCY
Erasure Coding
EC vs Non-EC Data
Rate of EC
Recovery Metrics
Recovery Rate
Total Data to be recovered
Geo-Replication
Replication Rate
Index vs Data replication
Data Reduction Operations
#EMCECS
RPO
GEO-
ENHANCEMENTS
#EMCECS
ECS 1.2 - MULTI SITE PERFORMANCE
Improved access to secondary site Geo caching at

the array level
Cache can be invalidated based on time
Dynamic cache resizing on node add/remove
Diagnostics have been added to provide insight on cache
utilization
Bottom line: Lower Latency
#EMCECS
ECS 1.2 GEO-FAILOVER ON
NETWORK OUTAGE
Automatic Failover in the event
of a network outage
Automatic failover initiated once
data replication lags behind RPO
Access to buckets and objects
available across all sites
Automatic site synchronization
occurs when all zones are
reconnected
Capability is set at the bucket level
#EMCECS
ECS @ EMC WORLD 2015
Booth # ?
ECS Related sessions (list day/Times and room)
ECS Architecture Deep Dive
ECS & Vmware vCloud Air Architecting and
Deploying and Exabyte+ Cloud
#EMCECS
ECS AT EMC WORLD
ECS is Everywhere at EMC World!
On The Show Floor
ECS at CTD/ETD Booth 813 and kiosks #8 and #9
Breakout Sessions
EMC ECS: ECS and Unstructured Content Strategies for Web
Scale IT
EMC ECS: ECS and VMware vCloud Air - Architecting and
Deploying an Exabyte+ Cloud
EMC ECS: ECS Architecture Deep Dive
EMC ECS: ECS Storage for 3rd Platform and What's New in
2015
HOLs (Hands-on Labs)

EMC ECS: Empowering Storage Admins for Cloud Storage
#EMCECS

Elastic Cloud Storage (Ecs) Storage For The 3 Platform: What'S New in 2015

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Elastic Cloud Storage (Ecs) Storage For The 3 Platform: What'S New in 2015

Uploaded by

Copyright:

Available Formats

ELASTIC CLOUD STORAGE (ECS)

STORAGE FOR THE 3RD PLATFORM

Architecture is too complex

Not Web or firewall friendly

Storage silos impede development

Reduce storage costs with

Individual components provide

to provide a reliable, scalable

Customer need simple, API-

EMC Innovation in:

Integrated appliance or software on 3rd-

HTTP/S (REST), S3, Swift, Atmos, CAS, HDFS

SITE 1 SITE 2 SITE 3

Geo-Replicated Data Protection Global namespace

Limitless Scale: Each layer is

Simultaneous access to underlying data

Handles local hardware and full

Local hardware failure recovery

New Hybrid encoding approach

# of Data Overhead Low Storage Overhead:

https://accesspoint.yourcompany.com Single global namespace across

Virtual Data Center

Virtual Data Center

Replication Groups define the replication policy

Namespace 1 Namespace 2 Namespace 3

Object Buckets Object Buckets Object Buckets

Meter Usage Namespace/Bucket Metering

Bucket and Namespace Auditing

Improved access to secondary site Geo caching at

HOLs (Hands-on Labs)

You might also like