PRACTICAL

CONSIDERATIONS
FOR MICRO SERVICES
Sam Newman
NDC London, December 2014
1

14 PRACTICAL TIPS
FOR MICROSERVICES
Sam Newman
NDC London, December 2014
2

YOU WONT BELIEVE

WHAT THEY DO WITH
MICROSERVICES IN
THIS TALK!
Sam Newman
NDC London, December 2014
3

SEE WHAT JENNIFER

LAWRENCE THINKS
ABOUT DISTRIBUTED
SYSTEMS!
Sam Newman
NDC London, December 2014
4

Shipping
Returns

Customer
Service

Invoicing
Accounts
Inventory

#ndclondon

@samnewman

Small

Shipping

Returns

Customer
Service

Invoicing
Accounts
Inventory

#ndclondon

@samnewman

Small

Shipping

Returns

Customer
Service

Modelled Around Business Domain

Invoicing
Accounts
Inventory

#ndclondon

@samnewman

Small

Shipping

Returns

Customer
Service

Modelled Around Business Domain

Invoicing
Accounts
Inventory

#ndclondon

Autonomous
@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

V1

#ndclondon

@samnewman

V2

#ndclondon

@samnewman

Go
Ruby

NodeJS
Java

#ndclondon

@samnewman

Go
Ruby

NodeJS
Clojure!

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

Where To Standardise?

#ndclondon

@samnewman

#ndclondon
2013 Electronic

Arts Inc.

@samnewman

#ndclondon

@samnewman

Interfaces

#ndclondon

@samnewman

Monitoring

Interfaces

#ndclondon

@samnewman

Monitoring

Interfaces

Deployment & Testing

#ndclondon

@samnewman

Architectural Safety
#ndclondon

@samnewman

#ndclondon

@samnewman

Free For All

#ndclondon

@samnewman

Standardisation

Free For All

#ndclondon

@samnewman

Standardisation
TIP 1 / 14: Standardise in the gaps between services be exible about what happens inside the boxes

Free For All

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

https://www.ickr.com/photos/garrymsmith/6108841070

Autonomy

Communication

#ndclondon

@samnewman

Team Ownership

#ndclondon

@samnewman

Team Ownership

???

#ndclondon

@samnewman

Trusted Committer /
Roving Custodian

#ndclondon

@samnewman

Trusted Committer /
Roving Custodian

???

#ndclondon

@samnewman

Trusted Committer /
Roving Custodian

???

#ndclondon

@samnewman

Trusted Committer /
Roving Custodian

???

#ndclondon

@samnewman

Trusted Committer /
Roving Custodian

???

#ndclondon

@samnewman

Trusted Committer /
Roving Custodian

???

#ndclondon

@samnewman

Trusted Committer /
Roving Custodian

TIP 2 / 14: Have a clear

???custodian model!

#ndclondon

@samnewman

Interfaces

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

Coupling Is Bad

#ndclondon

@samnewman

Integration Styles
An Evolutionary View

Data Oriented

#ndclondon

Procedure
Oriented

Document
Oriented

Resource
Oriented

@samnewman

Integration Styles
An Evolutionary View

Data Oriented

#ndclondon

Procedure
Oriented

Document
Oriented

Resource
Oriented

@samnewman

Integration Styles
An Evolutionary View
TIP 3 / 14: Be careful of RPC-mechanisms/shared
Procedure
Document
Resource
Data Oriented
serialisation protocols
to
avoid
coupling
Oriented
Oriented
Oriented

#ndclondon

@samnewman

Database

#ndclondon

@samnewman

Database

#ndclondon

@samnewman

Database

#ndclondon

@samnewman

Database

#ndclondon

@samnewman

Database

#ndclondon

@samnewman

Database

#ndclondon

@samnewman

Database

#ndclondon

@samnewman

Database

#ndclondon

Database

@samnewman

Database

#ndclondon

Database

@samnewman

TIP 4 / 14: Separate the databases before separating services

Database

#ndclondon

Database

@samnewman

The Customer Is Always Right

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

TIP 5 / 14: Adopt a consumer rst approach

#ndclondon

@samnewman

Monitoring

#ndclondon

@samnewman

#ndclondon

@samnewman

http://www.flickr.com/photos/kalexanderson/5421517469/

#ndclondon

@samnewman

http://www.flickr.com/photos/kalexanderson/5421517469/

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

???

#ndclondon

@samnewman

You have to get *much*

better at monitoring

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

You are not a badass if you

use an SSH Multiplexer

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

Response Time

Response Time

Response Time

#ndclondon

@samnewman

Response Time

Response Time

Response Time

#ndclondon

@samnewman

Response Time

Response Time

Response Time

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

TIP 6 / 14: Capture metrics, and logs, for each node,

and aggregate them to get a rolled up picture

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

TIP 7 / 14: Use synthetic transactions to test

production systems

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

ID: 123

#ndclondon

@samnewman

ID: 123

ID: 123

ID: 123

#ndclondon

@samnewman

ID: 123

TIP 8 / 14: Use correlation IDs to track down nasty bugs

ID: 123

ID: 123

#ndclondon

@samnewman

Deployment

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

!
!

#ndclondon

@samnewman

!
!

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

TIP 9 / 14: Abstract out underlying platform

dierences to provide a uniform deployment
mechanism

#ndclondon

@samnewman

Shipping
Returns

Customer
Service

Invoicing
Accounts
Inventory

#ndclondon

@samnewman

Shipping
Returns

Customer
Service

Invoicing
Accounts
Inventory

#ndclondon

@samnewman

Shipping
Returns

Customer
Service

Invoicing
Accounts
Inventory

#ndclondon

@samnewman

Inventory

Accounts

Mountebank
http://www.mbtest.org
#ndclondon

@samnewman

Inventory

Accounts
Stub

Mountebank
http://www.mbtest.org
#ndclondon

@samnewman

Shipping
Returns

Customer
Service

Invoicing
Accounts
Inventory

#ndclondon

@samnewman

Shipping
Returns

Customer
Service

Invoicing
Accounts
Inventory

#ndclondon

@samnewman

Shipping
Returns

Customer
Service

Invoicing
Accounts
Inventory

#ndclondon

@samnewman

Shipping
Returns

Customer
Service

Invoicing
Accounts
Inventory

#ndclondon

@samnewman

Shipping
Returns

Customer
Service

Invoicing
Accounts
Inventory

#ndclondon

@samnewman

#ndclondon

@samnewman

Browsers

#ndclondon

@samnewman

Timing
Browsers

#ndclondon

@samnewman

Provisioning of Environments
Timing
Browsers

#ndclondon

@samnewman

Networks
Provisioning of Environments
Timing
Browsers

#ndclondon

@samnewman

Deployment
Networks
Provisioning of Environments
Timing
Browsers

#ndclondon

@samnewman

Deployment
Networks
Provisioning of Environments
Timing
Browsers

#ndclondon

Diagnosis

@samnewman

CONSUMER-DRIVEN CONTRACTS

Shipping

#ndclondon

Inventory

@samnewman

CONSUMER-DRIVEN CONTRACTS

Shipping

Inventory

Expectations

#ndclondon

@samnewman

CONSUMER-DRIVEN CONTRACTS

Shipping

Inventory

Expectations

#ndclondon

@samnewman

CONSUMER-DRIVEN CONTRACTS

Shipping

Inventory

Expectations
Prod

#ndclondon

@samnewman

CONSUMER-DRIVEN CONTRACTS

Shipping

Inventory

Expectations
Prod

#ndclondon

@samnewman

#ndclondon

@samnewman

https://github.com/realestate-com-au/pact

#ndclondon

@samnewman

TIP 10 / 14: Consumer Driven Tests to catch breaking changes

https://github.com/realestate-com-au/pact

#ndclondon

@samnewman

Pending

Prod

Pending

Prod

Pending

Prod

Pending

Prod

Pending

Prod

Pending

Prod

TIP 11 / 14: Dont let changes build up - release as

soon as you can, and preferably one at a time!

Architectural Safety

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

http://www.flickr.com/photos/louish/5611657857/

#ndclondon

@samnewman

Connection Pool

#ndclondon

@samnewman

Connection Pool

#ndclondon

@samnewman

Connection Pool

#ndclondon

@samnewman

Connection Pool

#ndclondon

@samnewman

Connection
Pool

#ndclondon

Connection
Pool

@samnewman

Connection
Pool

#ndclondon

Connection
Pool

@samnewman

Connection
Pool

#ndclondon

Connection
Pool

@samnewman

Connection
Pool

#ndclondon

Connection
Pool

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

TIP 12 / 14: Use timeouts, circuit breakers and bulkheads to avoid cascading failure

#ndclondon

@samnewman

Special Service Behaviour

#ndclondon

@samnewman

Integration

Special Service Behaviour

#ndclondon

@samnewman

Integration

Special Service Behaviour

Downstream

#ndclondon

@samnewman

Integration

Special Service Behaviour

Metrics

Downstream

#ndclondon

@samnewman

Integration

Special Service Behaviour

Metrics

Downstream

#ndclondon

@samnewman

Integration

Special Service Behaviour

Metrics

Downstream

#ndclondon

@samnewman

Integration

Special Service Behaviour

Metrics

TIP 13 / 14: Consider Service Templates to make it

easy to do the right thing!
Downstream

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

#ndclondon

@samnewman

Choice
Opportunity

#ndclondon

@samnewman

Choice
Opportunity

Complexity

#ndclondon

@samnewman

Choice
Opportunity

Monitoring

Complexity

Deployment
#ndclondon

Safety

Integration
@samnewman

Choice
Opportunity

TIP 14 / 14: Find your own balance

Monitoring

Complexity

Deployment
#ndclondon

Safety

Integration
@samnewman

Building
Microservices
DESIGNING FINE-GRAINED SYSTEMS

Sam Newman
62

Designing For
Rapid Release

500 West Madison

500 West Madison

#ndclondon

@samnewman

Designing For
Rapid Release

500 West Madison

500 West Madison

From Macro To Micro

#ndclondon

@samnewman

Designing For
Rapid Release

500 West Madison

500 West Madison

From Macro To Micro

http://lanyrd.com/prole/samnewman/
#ndclondon

@samnewman

THANKS!
Any questions:
@samnewman
snewman@thoughtworks.com