11/12/2014

Big data Analytics and Predictive Analytics - | Predictive Analytics Today

Predictive Analytics

Business Intelligence

Text Analytics

Bigdata

Interview

News

Events

Big data Analytics and Predictive Analytics

Home

Bigdata

Big data Analytics and Predictive Analytics

Follow Predictive Analy

Gartner added big data to its 2011 hype cycle

4.73/5 (94.55%) 33
ratings

and has called it one of the top 10 strategic

technologies for 2012, stating, The size,

Search Predictive Analy

complexity of formats and speed of delivery exceeds the

capabilities of traditional data management technologies; it
requires the use of new or exotic technologies simply to
manage the volume alone.

Big data Analytics and Predictive Analytics

Data is emerging as the worlds newest resource for competitive
advantage among nations, organizations and business. It is

Search

Subscribe to Predicti
Analytics Today New
Email address

GO !

estimated that every day we create 2.5 quintillion bytes of data from a variety of sources. These are from the
computer notes to posts on social media sites and from purchase transaction records to pictures.
These collection of data sets which are so large and complex and are difficult to process using the on hand

Recent From Software L

database management tools are known as Big data. The challenges in Big data includes capture, curation,
storage, search, sharing, transfer, analysis and visualization of the data.
Big data has few key characteristics such as volume, sources, velocity, variety and veracity. The first among these
is volume. Experts predict that by 2020, the volume of data in the world will grow to 40 Zettabytes. This affects
every business, governments and individual. Based on a recent study,2.8 Zettabytes of data were created in
2012 and only .5% of that data were used for analysis. Unstructured data, such as texts, notes, logs makes up a
large chunk of this data volume and these requires text mining to analyze the data.

Top 30 Predictive A
Software API

The business data is also growing at these same exponential rate too.Along with the volume, the number of
sources, from where the data is extracted are also growing. Data is increasingly accelerating the velocity at
which it is created, as the process are moved from batch to a real time business. The demands of the business
from these data also has increased, from an answer next week to an answer in a minute.

http://www.predictiveanalyticstoday.com/big-data-analytics-and-predictive-analytics/

Top 12
Qualitativ
Analysis
Software
1/9

11/12/2014

Big data Analytics and Predictive Analytics - | Predictive Analytics Today

Top 14 Fre
Qualitativ
Analysis
Software

43 Bigdat
Platforms
Bigdata
Analytics
Software

29 Top So
Media An
Software

Top 21 Pre
Analytics
Software

34 Top Fre
Mining So
Data in Big data and Predictive Analysis

Top 27 Fre
Analysis
Software

Bigdata Platforms and Bigdata Analytics Software

Big data Analytics

Business intelligence (BI) provides OLAP based, standard business reports, ad hoc reports on past data. These
ad hoc analysis looks at the static past of data. This has its purpose and business uses, but doesnot meet the
needs of a forward looking business. Forward looking big data analytics requires statistical analysis, statistical
forecasting, casual analysis, optimization, predictive modeling and text mining on the large chunk of data
available. There are performance issues, when these high volume past data are used in the relational data
model, for a forward looking big data analytics, for future in the current system landscape in many
organizations.
Data Mining

Big Data Analysis

Hadoop Analytics

Top 12 Pre
Analytics
Freeware
Software

Top 37 so
for Text
Analysis,
Mining, T
Analytics

Top 40 Fre
Statistica
software

CRM Analytics

Follow Predictive Analy

Cyberoam C

Username
Password

Login

Note : Do no

http://www.predictiveanalyticstoday.com/big-data-analytics-and-predictive-analytics/

2/9

11/12/2014

Big data Analytics and Predictive Analytics - | Predictive Analytics Today

Follow Predictive Analy

My Tweets

Follow Predictive Analy

Predictive Analytics
Follow

332 have us in circles

Follow Predictive Analy

Recent From Predictive

Predictive Analytics Value Chain

Big Data Analytics will help organizations in providing an overview of the drivers of their business by introducing
big data technology into the organization. This is the application of advanced analytic techniques to a very large
data sets. These can not be achieved by standard data warehousing applications. These technologies are
hadoop, mapreduce, massively parallel processing databases, in memory database, search based applications,

What is Predictive
Analytics ?

data-mining grids, distributed file systems, distributed databases, cloud etc.

Technology drivers for Big data Analytics

Multi core processors
Lower power consumption
Low cost storage
High speed local networking

DIGITAL
ANALYTICS
QUALITY
hub-scan.com

Big data Technology

Big data should not be bad data

Ensure 24/7 100% data quality

With the Big data analytics the relevant information from data
warehouse in terabytes, petabytes and exabytes can be extracted
and analyzed to transform the business decisions for the future.
The reason that big data is currently a hot topic is partly due to the fact that the technology -MapReduce,
Hadoop, In memory database, Massively parallel processing database, database grids, search based
functionality etc are now available to process these large data sets which are mostly a combination of structured
and unstructured data. With these technologies, it is now possible to bring insights from these data in to the day
to day decision making process.

http://www.predictiveanalyticstoday.com/big-data-analytics-and-predictive-analytics/

Big data
Analytics
Predictive
Analytics

Advanced
Analytics
interview
Ingo Mier

Predictive
Modeling

Predictive
Analytics
Insurance

Predictive
Analytics
and Gas

Predictive
Analytics
Banking

3/9

11/12/2014

Big data Analytics and Predictive Analytics - | Predictive Analytics Today

Deployme
Predictive
Models

Upcoming Events

Data Analytics We

November 10 @ 8:0

November 13 @ 5:0

Advancements in C
Marketing

November 10 @ 8:0

November 12 @ 5:0

Social Analytics &

Intelligence Forum
Big data Analytics Technology

December 3 @ 8:00

December 5 @ 5:00
1.MapReduce
MapReduce was created by Google in 2004. It is a model inspired by the map and reduce functions for
processing large data sets with a parallel, distributed algorithm on a cluster.

Data and Analytics

Exchange 2015

2.Hadoop

February 22, 2015 @

Hadoop is an open source Apache implementation project. It was created by Yahoo in 2004 as a way to
implement the MapReduce function. Hadoop enables applications to work with huge amounts of data stored on

am - February 24, 2
5:00 pm

various servers. Hadoop has a large scale file system which is known as Hadoop Distributed File System or HDFS
and this can write programs, manages the distribution of programs, accepts the results, and then generates a

View All Events

data result set.

3.In memory database
Data in main memory can be accessed faster than data stored in hard disk or other flash storage device. A

Recent From Random

database management system that primarily relies on main memory for computer data storage is called an In
memory database.
4.Massively parallel processing databases
GE T

Y O UR

CLO U D

TO GE THE R

A Single Integrated Platform to Do Anything! We Offer Tr

Top 14 Free Extrac

Transform, and Lo
Software

Massively parallel processing is a loosely coupled databases where each server or node have memory or
processors to process data locally and data is partitioned across multiple servers or nodes.
5.Search based applications
Search based applications are search engine platform is used to aggregate and classify data and use natural
language technologies for accessing the data.
6.Data mining grids
Data mining grids are environment which uses grid computing concepts, which allows to integrate data from
various online and remote data sources.
7.Distributed file systems
Distributed file system is a shared file system which is shared by being simultaneously mounted on multiple
servers.

Top 13 Su
Chain Ana
Software

Top 11 Op
Source Bi
Enterpris
Search So

Top 9 In M
Data Grid
Applicatio

Top 16 Gr
Database

8.Distributed databases
http://www.predictiveanalyticstoday.com/big-data-analytics-and-predictive-analytics/

4/9

11/12/2014

Big data Analytics and Predictive Analytics - | Predictive Analytics Today

Cloud computing is distributed computing over a network.

25 Open S
and Free
Business
Intelligen
Solutions

Business benefits of Big data Analytics

List of Tex
Analytics
Startups

Distributed databases is a database system which is controlled by a distributed database management system.
9.Cloud

March towards business goals faster by turning dormant data into new opportunities making use of big data

List of 18
Security E
Managem
and Log A
Software

analytics.
Intuitively design very complex predictive models using casual factors
Big Data integration capabilities with traditional databases and other systems.

Top Busin
Intelligen
Tools

Hadoop Distributed File System for faster reading from and loading to performance and scalability.

Top Busin
Intelligen
Companie

Wide range of Big data applications and analytics to analyse more history data.
Visualize, discover, and share hidden insights for forward looking plan.

Top Predi
Analytics
Programs

From adhoc report analysis to Real-time answers using Big data.

Linguistic analysis and extracts relevant content from files, Web logs and social media.
Data from Multiple sources analysed for one business solution.

Real time answers from unstructred data.

Big data Analytics and Predictive Analytics

Recent From Software R

Top 30 Predictive A
Software API

Neural De
for data m
using Neu
Networks

Provalis
Research
Analytics
Software
Big data and Predictive Analytics processing

http://www.predictiveanalyticstoday.com/big-data-analytics-and-predictive-analytics/

R Softwar
Environm
5/9

11/12/2014

Big data Analytics and Predictive Analytics - | Predictive Analytics Today

Predictive Analytics identifies meaningful patters of Big data to predict future events and assess the
attractiveness of various options. Predictive analytics can be applied to any type of unknown data, whether it be
in the past, present or future.Predictive Analytics provides the Business Intelligence about the future using the
insights of Big data.

Live Search

Predictive Analytics Examples

Search for:
Web Data

Hadoop Data Data Base

SAS

Some of the examples where Predictive Analytic can be used on Big data are :

Provide Alert when market share for my products are dropping in specific regions.
Where and what was the Rx trend and what predictions are there for future ?
Which products and product groups are our best and worst? Used By Which regions? and what is the
percentage cummulative decline ?
How much commission did the sales folks accumulate ?
What are a few planned scenarios moving forward ?
How do I leverage the past to segment regions to concentrate to reduce the drop moving forward?
31

Based on previous Rx, what clusters of regions should I market to?

Whats the word on the street? How will the digital media help me target new regions and what is going to be
my marketing effectiveness ?

Bigdata Platforms and Bigdata Analytics Software

Top Graph Databases

Top In Memory Data Grid Applications

Top Open Source Big data Enterprise Search Software

More Information on Predictive Analysis Process

Predictive Analytics Process Flow

http://www.predictiveanalyticstoday.com/big-data-analytics-and-predictive-analytics/

6/9

11/12/2014

Big data Analytics and Predictive Analytics - | Predictive Analytics Today

For more information of predictive analytics process, please review the overview of each components in the
predictive analytics process: data collection (data mining), data analysis, statistical analysis, predictive modeling
and predictive model deployment.
You may also like to read these !

Statistical Analysis
What is big data and why this coverage ?
Text Analytics
Predictive Modeling
What is Predictive Analytics ?

Related

Top 21 Predictive Analytics Software

What is Predictive Analytics ?

Angoss Predictive Analytics

In "List"

In "Predictive Analytics"

In "Software Review"

Text Analytics

Data Warehouse

Data Visualizer

Analysis Software

Author: PAT

Share This Post On

Subscribe to Predictive Analytics Today Newsletter

Email address

GO !

3 Comments

Bhaskar
DECEMBER 3, 2013

This was a very interesting read.

I would like to see more on this topic.

Post a Reply

Nicholas Merolla
DECEMBER 24, 2013

I too think this was interesting reading; it covered many of the salient points of Big Data Analytics.
There are a couple of items, I respectfully submit that the author did not address [although they
may be addressed in the links provided,] and which Id like to see addressed at some point. To wit:
http://www.predictiveanalyticstoday.com/big-data-analytics-and-predictive-analytics/

7/9

11/12/2014

Big data Analytics and Predictive Analytics - | Predictive Analytics Today

There is not any space allotted in the literature to address the management requirements of
hyper-large clusters, and from what Ive read; I dont see vendors offering any products that speak to
the point. Specifically; in a Hadoop cluster [for example] with perhaps 100s of nodes; what is the
impact on management of that clusters processing capacity and operations staff? Likewise, with a
large enough cluster, one can reasonably expect to have a downed node almost consistently. Thus
far, no vender that Ive researched, except perhaps one, offers a single system image and
automatically accounts for recovery from downed nodes at the OS layer. Moreover the expectation
is that fail-over processing in reaction to a failed node condition will undoubtedly burden the cluster
with the additional processing burden on the cluster if that processing is not done at the OS layer.
What then happens to expected performance expectations [or agreements.]
None of the vendors claiming to be in the Big Data space are taking on the problem of zero [or
very low] data latency. Gartner, I believe, published a report on Zero Latency Enterprises [ZLE] in a
paper a number of years ago, but no one today save for SAP, and they vaguely refer to ZLE, has
taken on the requirement of ZLE or very low latency [VLLE.] It does an enterprise little good to claim
predictive analysis and real-time monitoring capabilities via a DW unless the ZLE issue is tackled
head on. Id like to see the authors [Gartner, perhaps] reintroduce this requirement as it applies to
Big Data Predictive Analytics.
As regards to in-memory data bases, it does a DW owner little good to have an in-memory data
base if that owner is always looking at stale information. A few examples come to mind: capturing a
customer before theyve left the store in retail; real time fraud detection in credit card processing as
offered in a comForte paper by comparing card transactions with something seemingly as
insignificant as a Tweet.
I expect that ZLE will become part of the price of entry into the arena as data volumes continue to
grow. To perform an ETL activity off-line in a batch or parallel batch mode wont cut the mustard
until someone figures out how to get more than 24 hours into a day. DW/BI vendors have to start
offering or, at least, showing on their product road maps how they address the issue of ZLE or VLLE
in an interoperable, heterogeneous environment.

Post a Reply

Vrej
JANUARY 30, 2014

Fantastic

Post a Reply

Submit a Comment
Your email address will not be published. Required fields are marked *
Name *

Email *

Website

http://www.predictiveanalyticstoday.com/big-data-analytics-and-predictive-analytics/

8/9

11/12/2014

Big data Analytics and Predictive Analytics - | Predictive Analytics Today

Comment

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym
title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite="">
<strike> <strong>
Yes, add me to your mailing list.

Submit Comment

Notify me of follow-up comments by email.

Notify me of new posts by email.

Email: info at
predictiveanalyticstoday.com

About

Privacy Policy

Advertise

ToS

Events

2013 All rights reserved Predictive Analytics T

http://www.predictiveanalyticstoday.com/big-data-analytics-and-predictive-analytics/

9/9