You are on page 1of 25

Copyright 2016 EMC Corporation. All rights reserved.

1
DELIVERING OBJECT SERVICES TO CLOUD
FOUNDRY APPLICATIONS
TRAVIS RHODEN DEVELOPER ADVOCATE, EMC {code}
AARON SPIEGEL ADVISORY SYSTEMS ENGINEER
Copyright 2016 EMC Corporation. All rights reserved. 2
Elastic Cloud Storage for cloud


Copyright 2016 EMC Corporation. All rights reserved. 4
EMC ELASTIC CLOUD STORAGE
CLOUD FOUNDRY SERVICE BROKER (PART I)
SPRING CLOUD CONNECTOR INTEGRATION

Copyright 2016 EMC Corporation. All rights reserved. 5


SPRING CLOUD CONNECTORS

Connect Java applications to cloud services


Support Cloud Foundry, Heroku & more
Protect Developers from technology lock-in
Two libraries are available supporting AWS S3/IAM
SDKs directly, and jclouds blobstore SDK

Copyright 2016 EMC Corporation. All rights reserved. 6


Elastic Cloud Storage for


Copyright 2016 EMC Corporation. All rights reserved. 7
EMC ELASTIC CLOUD STORAGE
CLOUD FOUNDRY SERVICE BROKER (PART II)
DEPLOYMENT & REGISTRATION

Copyright 2016 EMC Corporation. All rights reserved. 8


Copyright 2016 EMC Corporation. All rights reserved. 9
THE ECS CLOUD FOUNDRY SERVICE BROKER
Create, Modify and Delete Object Storage
Buckets

Bind one or more CF apps to buckets, with


unique credentials for each app

Customize CF Marketplace bucket plans

Customize bucket ACLs for applications

Upgrade or downgrade bucket plans

Specify an ECS namespace and replication group

Customize services & plans via YAML


configuration

https://github.com/emccode/ecs-cf-service-broker
Copyright 2016 EMC Corporation. All rights reserved. 10
A COMPLETE PRIVATE OR HOSTED CLOUD
SOLUTION
Cloud Foundry Architecture Stack

CF App Blobstore

User Application
Object/Hadoop
Data

BOSH Blobstore

Copyright 2016 EMC Corporation. All rights reserved. 11


Declarative Formats
Clean Contract
Suitable for Cloud Platforms
Minimize divergence
Scalable
http://12factor.net/
Copyright 2016 EMC Corporation. All rights reserved. 12
IV. Backing services
Treat backing services as attached resources

http://12factor.net/backing-services
Copyright 2016 EMC Corporation. All rights reserved. 13
IV. Backing services
Treat backing services as attached resources

Object doesnt require host operating system configuration


Contrary to NAS mounts, which introduce snow-flakes
HTTP stateless sharable access with unique credentials
Simplified object storage semantics
No need to manipulate directory structures
Single boundless namespace
Less development overhead for capacity, permission and lock checks
HTTP accessible assets
Direct content access to clients: binary & static content
Removes application server from data flow

Copyright 2016 EMC Corporation. All rights reserved. 14


CLOUD FOUNDRY SERVICE BROKER API

Natural user-experience for


backing services
Catalog & marketplace for
both private & public clouds
Supports all kind of services:
Free/Paid
Database
Message queues
Caches
Binary stores

http://docs.cloudfoundry.org/services/api.html
Copyright 2016 EMC Corporation. All rights reserved. 15
ECS - CLOUD SCALE OBJECT STORAGE PLATFORM
OBJECT STORAGE SERVICES ON COMMODITY HARDWARE

ECS
Software FILE OBJECT HDFS
STORAGE STORAGE STORAGE

Commodity
Platforms

Copyright 2016 EMC Corporation. All rights reserved. 16


COMPREHENSIVE MULTI-PROTOCOL DATA ACCESS

Simultaneous access to underlying data


through multiple interfaces (Protocols)
Object, HDFS, File
HDFS compatible with Cloudera,
ATMOS
Hortonworks, Pivotal etc.
Support for S3, Swift, Atmos and Centera
CAS APIs object
NFS V3 FILE Support
Extensions to APIs
Byte-Range updates, Atomic appends, Rich ACLs,
MetaData Search, etc.

Copyright 2016 EMC Corporation. All rights reserved. 17


ECS ELASTIC SCALABILITY
Global Namespace
Limitless Scale: Each layer is
independently scalable, highly
HDFS HDFS
OBJECT
HDFS
OBJECT
available, and has no single point
OBJECT
of failure.
Storage Engine
Scale-Out Architecture: Scale
Persistence Layer
by adding more nodes, no
special nodes or roles
Global Namespace: Any node
JBODs has full system view of data and
meta-data

Copyright 2016 EMC Corporation. All rights reserved. 18


GEO-REPLICATED DATA PROTECTION
Handles local hardware and full
data center failures
Disk, Node, Rack, Data Center are
failure domains
Component failures are recovered using
fragments from local site without WAN
traffic

Local hardware failure recovery


Site 1 Site 2
requires no WAN traffic
New Hybrid encoding approach
Site 3
enables low storage overhead

Copyright 2016 EMC Corporation. All rights reserved. 19


EASY TO MANAGE MULTI-TENANT ARCHITECTURE

Bucket level metering


Reporting on capacity, object count,
bandwidth in/out, objects created and
deleted

Object capacity quota


management
Set quota limits on bucket or
namespace

Deep dive monitoring and auditing


Displayed in GUI and REST API

Copyright 2016 EMC Corporation. All rights reserved. 20


SUPPORT MODERN APPLICATIONS & ANALYTICS
SIMPLY & EASILY

Modern Application Data Lake


Platform Foundation
Multiple APIs Active archive analytics
(S3, Swift, Atmos, HDFS) with HDFS support
New application models Unstructured data
Mobile app platforms repository
Memphis Multi-protocol access
Active-active anywhere Faster time to value with
access to geo-replicated L.A. UK
data-in-place analytics
content
Global analytics on geo-
Simple App Dev with distributed data and
Strong Consistency archives

Copyright 2016 EMC Corporation. All rights reserved. 21


Copyright 2016 EMC Corporation. All rights reserved. 22
SUMMARY

Copyright 2016 EMC Corporation. All rights reserved. 23


Questions?

@EMCcode
@spiegela
@codenrhoden

Come visit us at
emccode.com Booth #1044
community.emccode.com or in the vLab
Copyright 2016 EMC Corporation. All rights reserved. 24
Copyright 2016 EMC Corporation. All rights reserved. 25

You might also like