Making Big Data Work

for Your Organization

Alan Simon
Zunesis Senior Fellow,
Analytics & Data Management
December 3, 2015
2015 Alan Simon. All Rights Reserved

Introductions

Select experience
Arizona Attorney Generals Office
Pennsylvania Department of Transportation (PennDOT)
Pennsylvania Department of Health
Wisconsin Department of Administration
Santa Clara County (CA)
Washington (State) Department of Early Learning
Arizona State University
USAF
Department of Defense

Check out this mission statement

Our investigators need instantaneous access

to a broad range of data at their fingertips

not only all direct person-to-person and
person-to-business relationships, but also
relationships several levels removed. The
same direct and indirect relationships to
assets also need to be immediately available
to our investigators
4

Nope!
Arizona Attorney Generals Office, 1979-1980

What do we want from analytics and big data?

Data-Driven
Insights
Insight-Driven
Better Decisions

Proposition:

However

Big data success isnt automatic!!!

9

7 KEYS TO
BIG DATA SUCCESS

10

1 The art of the now possible

Put deferred solutions back on the table

and also
Reengineer and rebuild old, overly

complicated solutions

11

2001-2002: The Anthrax Attacks

12

Bioterrorism fears go viral !

Anthrax
Smallpox
Plague
Viral hemorrhagic fever
?????

13

Worries about timeliness of response

Many bioterrorism agents show symptomsbut cannot be

confirmed for several more days

In meantime outbreaks could get much worse
The solution a concept known as

Syndromic Surveillance
Patterns

Analysis

Interdiction

Reports

Hypotheses

14

Circa 2001-2002 solution:

15

But if I could figure out time travel

16

2 Big data doesnt just mean Hadoop!

Hadoop is certainly important but also
HANA
MongoDB
Columnar and other specialized databases
Pretty much any post-relational data

management technology!

Also: big data is relative!

17

3 Hadoop is evolving at light speed!

https://blog.cloudera.com/blog/2015/09/kudu-new-apache-hadoop-storage-for-fast-analytics-on-fast-data/
http://www.infoworld.com/article/2986675/hadoop/cloudera-kudu-hdfs-hbase-in-one.html

18

Evolution often yields confusion

http://sdsblog.com/2015/10/12/kudu/

19

Traditional BI and DW not out of the

pictureat least for now

20

Hadoop as supersized data staging area

in front of EDW Hadoop
Sqoop

Flume

data staging
area AND
ANALYTICS
SANDBOX

Sqoop

Relational
EDW

Sqoop

Flume

Hadoop/data lake as next-generation EDW

Sqoop

Flume

Hadoop
EDW:
staging +
useraccessible
data

Sqoop

Flume

Prescriptive
analytics
are
critically
5
important!

23

The Analytics Continuum

Category

Purpose

Descriptive
analytics

Tell me what happened, and why

Tell me what is happening right now,
and why

Predictive
analytics

Tell me what is likely to happen, and

why

Discovery
analytics

Tell me something importanteven

without me asking specific questions!

Prescriptive
analytics

Tell me what my options are

Tell me what I should do

The prescriptive analytics framework

Detect Events
Categorize and
Process Events
Apply Analytical
Models
Form Hypotheses
Take Initial Actions
Update and
Correlate Data
Analytics

BPM

Prove or Disprove
Hypotheses
Take Prescribed
Actions
25

Why?

26

6 The hard work doesnt go away with big data

You still need:
Master data management
Data standardization
Data governance
Data quality management

27

Your big data strategy and architecture

must also include your social media
listening and engagement

28

This is the world we now live in

Your Citizens are Online
Everyone is Connected!

Constituents
Service Consumers
Residents
Voters
Veterans

Social Listening for State and Local

Government
Technology + Human Analysis = Actionable Insight
Government
Organizations

Focus:
Services, Security, Sentiment

Communications Manager
Public Info. Office
Public Services

iWeSocial Insights
(monthly readout)

Public Web:
iWeSocial IQ
Social Media Listening Platform

iWeSocial
Research Analyst

Social Listening Use Case:

McCarran International Airport
Business Return:

Discover whats
being said about the
services you
provide:
Sentiment
Problem areas
What's
working

Crisis Management
listen for spikes in
conversation in realtime

Increase
engagement by
better
understanding the
conversation

HOW DO YOU GET

STARTED?

32

Good news: the classic approach still works!

Assessment
Strategy
Business Architecture
Technology Architecture
Roadmap
33

During assessment, focus on:

Both opportunities and points of pain
What you cannot do today
What is challenging and cumbersome to do today
What has been put into mothballs
Blue skies and green fields

34

Big data and analytics assessment

Assessment

Analytics continuum
Todays technology
In-progress initiatives

Hypotheses vs. facts

Pain points
Known opportunities

Deferred initiatives
Analytics appetite
Competition

Typically 3 5 weeks
Grounded in your organizations reality

35

Followed by
Strategy

Commitment to analytics
Change management
Pace of change

Business
Architecture
DW/BI role
Tools
Support
Big data role Migration plans
Data flows
Platforms
Integration architecture Control flows
Phases
Risk mitigation
Stretch goals
Program leadership
Contingency plans Sponsorship

Typically 8-12 weeks

Migration strategy
Leadership (RACI)
Resourcing models

Day in the Life scenarios

Use cases and process flows
Roles and responsibilities

Technology
Architecture

Defining success
CSFs
User adoption

Roadmap

Complete blueprint
36

Wed love to hear from you!

Zunesis
Email: info@Zunesis.com
Website: www.zunesis.com
Headquarters
8375 S. Willow Street
5th Floor
Lone Tree, CO 80124
720-221-5200

Las Vegas Office

6280 S. Valley View Blvd.
Suite 604
Las Vegas, NV 89118
702-837-5300
37

For more information

My Wednesday analytics blog:

https://humpdayanalytics.wordpress.com/

Cross-posted on LinkedIn

Follow me on Twitter: @HumpDayAnalytic

My LinkedIn/Lynda.com courses:

http://www.lynda.com/Alan-Simon/3981678-1.html

38

39