Professional Documents
Culture Documents
Data-Driven Insights
An IDC InfoBrief
Brought to you by
Executive Summary
Organizations that treat data as a corporate asset and put analytics at the center of their data strategy make better decisions for the business.
The adoption of Hadoop and its ecosystem is growing, spurred by increased demands for data-driven insights and new data sources which
span customer transactions, security threats, mobile usage patterns, wireless sensor networks, and social media. Big data and analytics (BDA)
technologies will also play a critical role as it helps organizations analyze all the unstructured data generated as a result of the explosive growth in
connected devices.
This IDC InfoBrief summarizes the key findings from a recent Cloudera-sponsored survey conducted to better understand where Asia/Pacific
businesses are on their BDA journey. We also spotlight their challenges and outline the considerations for successful implementations.
Survey highlights:
40%
80%
TOP 3 TOP 3
reasons for deploying Hadoop
Retaining customers
Capturing new customers
Increase revenues from
existing products and
services
Study Methodology
IDC surveyed 636 IT decision makers and influencers for BDA from large organizations with more than 500 employees, across a broad range of industries.
Respondents were executives and senior managers across IT, finance, marketing and business analytics. The goal of the survey was to understand current
priorities and challenges related to justifying the value of and implementing BDA initiatives. We also wanted to understand organizations future plans as
well as their awareness and perception of Hadoop, a key emerging BDA technology.
rvi
ce
Se
11%
12%
12%
18%
ns
o
rati
pe
ing
ur
act
nuf
Con
and Rstruction
esou
rces
67
BI and Analytics
Sale
marks and
eting
ia
tral
Aus
China
nesia
Indo
12%
le Retail
7%
Ko
re
a
18%
Ma
ns,
icationsport
mun
Com and Tra
ia
Med
Wholesa
Singapore
12%
sia
lay
Ma
16%
hc
ar
e
cto
12%
36%
alt
Se
Japan
He
lic
14%
5%
ROLES
24
9%
b
Pu
7%
INDUSTRY VERTICALS
Financial Services
COUNTRIES
428
49
O
/ Risk
Financpeliance
Com
Inf
Tec orma
hno tion
log
y
68
LOB 208
43%
Indonesia
41%
Region
40%
40%
China
39%
Singapore
38%
Korea
Australia
50%
37%
32%
TODAY
IN 12 MONTHS
9%
have more
than
50 nodes
9%
8%
12%
23%
17%
31%
1-10
11-20
21-30
31-40
41-50
50 and above
61%
of respondents will
deploy at least 20
nodes in the next 1
year
Organizations top reasons for investing in BDA are to uncover insights that enable them to serve their customers better. With proliferation of data footprint, it
is no surprise that operational efficiency and security are key motivating factors too. Improving customer engagement while ensuring compliance and security
standards are met is an ongoing business priority.
38%
38%
37%
34%
31%
27%
37%
12%
5%
Wholesale / Retail
16%
22%
Financial Services
7%
1%
$5 - $9.9 millions
>$50 millions
Services
<$1 million
53%
32%
48%
46%
LOB managers
40%
Operational employees
Data scientists, data miners,
advanced analytics
15%
52%
Executives
Business analysts
32%
29%
19%
How important is it for your company to track and analyze these data
sources for decision making? Please rate on a scale of 1 -5, where 4 is
important and 5 is very important)
To the best of your knowledge, how are these types of data currently
analyzed?
% of respondents
-50%
85%
35%
57%
Telcos have a wealth of data, including where their customers are, who
they are with, what they search for on the Internet, who they call, and
who messages them. They have the data and the technical capabilities to
analyze customer behavior and buying intentions should they choose to
do so. Service providers are looking to gain insights to improve customer
experience and drive new revenue streams.
55%
76%
77%
-19%
34%
44%
64%
71%
-20%
-37%
-22%
Organizations that
cite importance of
data source
Organizations
that have begun
analysis
Rich
Media
n=636
Social
Media
Location
Data
Logs
Data
Mobile
Data
Country Highlights
Digital transformation is one of the most key topics in Australia, as the country transforms away from
a mining-led economy to a more diverse economy. BDA maturity ranks highest in Australia across
APEJ. Previously, larger organizations in data-intensive industries were most inclined to be the early
adopters of digital transformation. Having experienced the benefits of digital transformation, these
organizations are now extending their adoption to wider use cases beyond customer analytics to areas
such as workforce optimization, IT operations and supply chain management. In addition, high profile
data breaches and the new data retention regulation are adding complexity to big data management.
72%
2 in 3
Realized Benefits
72%
45%
Australia
Latest industry transformation
Banking
Resources
Government
With the ambition of building a Smart Nation, the Singapore government is developing infrastructure,
resources and policies to promote data-driven innovations. The slowing economy drives organizations
to look into data assets for competitive advantages. Singapore leads in BDA maturity in APEJ and
data-intensive industries are either early adopters or experimenters. With noticeable increase in
productivity, customer engagement is the top focus in the next year, but having talent possessing both
business and analytics skills is one of the key roadblocks in wider adoption of BDA in Singapore.
Singapore
Latest industry transformation
Banking
Engaging Customers
Almost half
Marketing Focus
2 in 3
Productivity Gain
Skills Shortage
75%
64%
Telecom Providers
Government
Malaysia is at an early stage in BDA maturity. The strong headwind impacting the economy is posing more
challenges in transformation spending. Nevertheless, the national budget 2016 signaled prioritization
of Malaysias digital drive. In a long term, the investments in broadband infrastructure and R&D will
accelerate broader BDA adoption. Malaysian organizations are looking to expand their market reach
using data analytics. In particular, they demonstrate strong interests in Hadoop deployments. Lack of
BDA skills, however, will remain a key challenge to deliver revenue benefits.
Expansion Priority
Half
1 in 2
Productivity Gain
Skills Shortage
67%
64%
Malaysia
Latest industry transformation
Telecom Providers
Banking
Retail
Despite of a slowing economy, BDA is one areas with continued growing interests in Korea. Korea has
progressed faster than average in the past 2 years, moving up as one of the leading APEJ countries in
terms of BDA maturity. According to South Korea's Ministry of Science, big data is one of the strategic
initiatives to drive employment, an essential part of Korean President Park Geun-hye's "creative economy
initiatives. Personalized customer experience is a focus across sectors, and early BDA adopters have
started to monetize their data and enjoying cost saving benefits. However, lack of skills will remain a key
challenge to broaden the adoption across enterprises.
Customer Experience
38%
35%
Costs Benefits
Skills Shortage
63%
59%
Korea
Latest industry transformation
Manufacturing
Retail
Healthcare
Indonesia is at an early stage in BDA maturity. The economic recession that started in early 2015
continues to impact spending. Moderate growth has been seen recently with the implementation of
stimulus packages, called Paket Kebijakan Ekonomi. The adoption of BDA in Indonesia is limited to
large, data-intensive organizations, as they are looking to expand their market reach with innovative
solutions and early adopters have started to experience costs benefits. Unstructured data that are
not analyzed, and performance of end-user tools and lack of analytics skills are the top roadblocks for
delivering value with BDA technologies.
Customer Experience
42%
Unexplored Data
Below Average
Costs Benefits
68%
62%
Indonesia
Latest industry transformation
Telecom Providers
Retail/E-Commerce
Banking
Despite of a slowing economy, IT spending remains stable in China with digital transformation. Chinas
13th five year plan, which have been effective early 2016, will drive innovation with investment in
infrastructure, Internet Plus and new technologies. The BDA maturity of China is close to average, but
has progressed fast in the past 2 years. In particular, BDA is moving up the CXO agenda with half of CEOs
as sponsors. Banks and Telcos are the early adopters of BDA to manage the massive consumer data, and
many have seen quantifiable benefits, in terms of revenue. However, the larger pool of enterprises will
look to not only big data management, but also to leverage better tools for business users or analysts as
the tools performance is the top challenge in delivering value to business.
Customer Retention
CEO Sponsorship
Revenue Gains
Tool Performance
43%
63%
53%
58%
China
Latest industry transformation
Financial Services
Retail/E-Commerce
Public Sector
Japanese economy is still moderately recovering, and this pushes organizations look to innovate with
emerging technologies. Strong interests in IoT, robotics and cognitive systems will drive investment in
big data management and data-driven insights. The BDA maturity of Japan is above the Asia Pacific
average. Operational efficiency is a top priority in Japanese organizations, and most early adopters have
gained quantifiable productivity benefits in their BDA initiatives. Data scientists are in high demand in
Japanese organizations, and many respondents look to improve performance of tools to data analysts
and data scientists, to better deliver value to businesses.
Operational Efficiency
Top priority
43%
of Japanese organizations is
to gain insights to improve
operational efficiency
Productivity Gains
Tool Performance
66%
59%
Japan
Latest industry transformation
Financial Services
Manufacturing
Retail/Restaurants
36%
FAST
46%
29%
68%
of organizations consider
enterprise-grade security
and support important.
In particular, Japanese
organizations and
service providers value
enterprise-grade
security even more
SECURE
Organizations see Hadoop as more than just a scalable database, citing benefits as gaining real-time analytics and consequently receiving real-time
predictions more quickly.
% of respondents
38%
37%
24%
24%
20%
48%
48% of LOB respondents
cited real-time analytics
as a preferred benefit
42%
42% of LOB respondents
indicated preference for
real-time predictions
50%
47%
45%
70%
56%
50%
Innovation
Group
Operation
15%
13%
7%
79%
of organizations consider
governance as important
in leveraging BDA including
information governance, security,
data privacy and master data
management.
14%
76%
Hadoop
Specialist
Korea
Australia
China
Japan
Data
Data Engineer/
Modeler
Architect
Data
Analyst
Planned 1 - 2 years
Data
Scientist
Existing
28%
47%
28%
48%
36%
66%
19%
32%
50%
27%
41%
46%
49%
68%
Average
56%
53%
53%
59%
59%
62%
64%
% of respondents
Administrator
Data
of BDA Mining
related IT
Specialist
Hardware
Role of Cloudera
Cloudera, a recognized player in the big data arena by 86% of survey
respondents, is the first to build its business on Hadoop. The company
has continuously contribute to the open source community and
expanded together with the evolution of Hadoop ecosystem.
The community-driven technology provider is on path to achieve its
aspiration of making Hadoop fast, easy, and secure. Cloudera has
partnered Intel to take advantage of the latest processor technology to
deliver real-time insights for its customers. Integration with Spark has
enabled Cloudera to drive faster in-memory analytics. Its latest Hadoop
storage solution, Kudo, has also been key in ensuring it is able to meet
organizations demand for faster analytics.
Cloudera is committed to groom talent in BDA. The company trained
more than 40,000 participants and certified more than 10,000 Hadoop
professionals. In April 2016, Cloudera launched the Big Data Analytics
Skills Enablement (BASE) initiative in Singapore and Malaysia, aiming
at filling the impending BDA skills gap. Wider industry partnership and
government support in the region can be expected in the coming years.
More than half or 67% of survey respondents associate Cloudera with
Hadoop, which is no surprise considering its heritage and it has Doug
Cutting, co-creator of Hadoop, as its Chief Architect since 2009. Cloudera
will continue to expand to cater to the increasing demands of Hadoop
solutions.
Essential Guidance
Deriving value from data assets is critical. What should you look for in your big
data solutions partner?
Copyright 2016 IDC. Reproduction without written permission is completely forbidden. This IDC InfoBrief was produced by IDC Asia/Pacific Custom
Solutions Services. Any IDC information or reference to IDC that is to be used in advertising, press releases, or promotional materials requires prior
written approval from IDC. For more information, visit: www.ap.idc.asia or email: gmsap@idc.com.