Advance Big Data Science

using Python-R-Hadoop-
Spark
A comprehensive, job-oriented
training program crafted by experts

Disclaimer: This material is protected under copyright act AnalytixLabs , 2011-2016. Unauthorized use and/ or duplication of this material or any part of this material
including data, in any form without explicit and written permission from AnalytixLabs is strictly prohibited. Any violation of this copyright will attract legal actions
About AnalytixLabs
AnalytixLabs is a capability building and training solutions firm led by McKinsey, IIM, ISB and IIT alumni with deep industry experience
and a flair for coaching. We are focused at helping our clients develop skills in basic and advanced analytics to enable them to emerge as
Industry Ready professionals and enhance career opportunities. AnalytixLabs has been also featured as top institutes by prestigious
publications like Analytics India Magazine and Higher Education Review, since 2013.

Content
Approach
80-20 focus on practical & theory
Personal attention and Individual
counselling
Industry best practices
World class course structure
Surpasses industry requirements
Cater to Standard certifications
High quality course material and
real life case studies
Faculty
Seasoned analytics professionals
Together we have 30 + years of
experience with prestigious firms,
like McKinsey, KPMG, Deloitte
and AOL
Regular sessions by industry
experts
Bottom line
Job-oriented training
Lucrative job prospects in high
growth domain
Support for relevant
certifications and diplomas
Career counseling and planning
Value for money with high return
on investment
Global Data science and Big Data skill gap

McKinsey Global Institute estimates a shortage of nearly 1.7 million big data talents by 2018. This includes a
shortage of 140,000 to 190,000 workers with deep technical and analytical expertise, and a shortage of 1.5
million managers and analysts equipped to work with and use big data outputs
Candidates trained by us are working in leading companies across
industries
Program Objective

Advance Big Data Science using Python-R-Hadoop-Spark program aims to provide its students an international, wide-spectrum
qualification for job-readiness and seamless absorption in Big Data job roles.

The program will expose the students and professionals to the roles of Big Data Analysts who have:

Ability to translate business problem into analytics problem

Understanding of storage, retrieval and mining of data
Possess Outcome-Oriented and Global Industry-Specific expertise in Critical Data Analytics and Data Management Skills
Hands-on practical skills on exploratory analysis using Hadoop, and prescriptive and predictive analysis using R Spark-Python
Application of analytics in various domains, like ecommerce, Retail, Telecom, BFSI etc.
Skills to leverage analytics to drive smart business decisions

Crafted by team of experts and maintains a balance between theoretical concepts and practical applications
Advance Big Data Science is a comprehensive program with following
modules, weekly assignments and case studies
Python 30 hours + Practice exercises
Module 1
Basic data handling, data manipulation, descriptive analytics and visualization

Hadoop & its components 15 hours + Practice

Module 2 Introduction to the ecosystem and focus on core components Pig, Hive, MapReduce,
HDFS, Impala Hbase and other Apache projects

Spark 45 hours + Practice

Module 3 Working on Spark and connecting to Hive and Python for advance analytics and
Machine Learning

R (video based) 12 hours

Module 4 Data manipulation, descriptive analytics and visualization using R

Crafted by team of experts and maintains a balance between theoretical concepts and practical applications
Advance Big Data Science using Python-R-Hadoop-Spark (1/3)
Total Duration: 90 hours + Practice
Introduction to Data Science
What is Data Science?
Data Science Vs. Analytics vs. Data warehousing, OLAP, MIS
Reporting
Relevance in industry and need of the hour
Type of problems and objectives in various industries
How leading companies are harnessing the power of Data
Science?
Different phases of a typical Analytics/Data Science projects
Python: Introduction & Essentials
Overview of Python- Starting Python
Introduction to Python Editors & IDE's(Canopy, pycharm,
Jupyter, Rodeo, Ipython etc)
Custom Environment Settings
Concept of Packages/Libraries - Important packages(NumPy,
SciPy, scikit-learn, Pandas, Matplotlib, etc)
Installing & loading Packages & Name Spaces
Data Types & Data objects/structures (Tuples, Lists,
Dictionaries)
List and Dictionary Comprehensions
Variable & Value Labels Date & Time Values
Basic Operations - Mathematical - string - date
Reading and writing data
Simple plotting
Control flow
Debugging
Code profiling
Python: Accessing/Importing and Exporting Data
Importing Data from various sources (Csv, txt, excel, access
etc)
Database Input (Connecting to database)
Viewing Data objects - subsetting, methods
Exporting Data to various formats
Python: Data Manipulation cleansing
Cleansing Data with Python
Data Manipulation steps(Sorting, filtering, duplicates, merging,
appending, subsetting, derived variables, sampling, Data type
conversions, renaming, formatting etc)
Data manipulation tools(Operators, Functions, Packages,
control structures, Loops, arrays etc)
Python Built-in Functions (Text, numeric, date, utility
functions)
Python User Defined Functions
Stripping out extraneous information
Normalizing data
Formatting data
Important Python Packages for data manipulation (Pandas,
Numpy etc)
Python: Data Analysis Visualization
Introduction exploratory data analysis
Descriptive statistics, Frequency Tables and summarization
Univariate Analysis (Distribution of data & Graphical Analysis)
Bivariate Analysis(Cross Tabs, Distributions & Relationships,
Graphical Analysis)
Creating Graphs- Bar/pie/line
chart/histogram/boxplot/scatter/density etc)
Important Packages for Exploratory Analysis(NumPy Arrays,
Matplotlib, Pandas and scipy.stats etc)
Python: Basic statistics
Basic Statistics - Measures of Central Tendencies and Variance
Building blocks - Probability Distributions - Normal distribution -
Central Limit Theorem
Inferential Statistics -Sampling - Concept of Hypothesis Testing
Statistical Methods - Z/t-tests (One sample, independent, paired),
Anova, Correlation and Chi-square
Python: Polyglot Programming
Making Python talk to other languages and database systems
How do R and Python play with each other, why it's essential to
know both
Hadoop: Introduction to Hadoop & Ecosystem
Introduction to Hadoop
Hadoopable Problems - Uses of Big Data analytics in various
industries like Telecom, E- commerce, Finance and Insurance etc
Problems with Traditional Large-Scale Systems & Existing Data
analytics Architecture
Key technology foundations required for Big Data
Comparison of traditional data management systems with Big
Data management systems
Evaluate key framework requirements for Big Data analytics
Apache projects in the Hadoop Ecosystem
Hadoop Ecosystem & Hadoop 2.x core components
Explain the relevance of real-time data
Explain how to use Big Data and real-time data as a Business
planning tool
Advance Big Data Science using Python-R-Hadoop-Spark (2/3)
Total Duration: 90 hours + Practice
Hadoop core components- HDFS
HDFS Overview & Data storage in HDFS
Get the data into Hadoop from local machine(Data Loading
Techniques) - vice versa
Hadoop core components- MapReduce (YARN)
Map Reduce Overview (Traditional way Vs. MapReduce way)
Concept of Mapper & Reducer
Understanding Map reduce program skeleton
Running MapReduce job in Command line
Hadoop Data Analysis Tools: Hadoop-PIG
Introduction to PIG - MapReduce Vs Pig, Pig Use Cases
Pig Latin Program & Execution
Pig Latin : Relational Operators, File Loaders, Group
Operator, COGROUP Operator, Joins and COGROUP, Union,
Diagnostic Operators, Pig UDF
Use Pig to automate the design and implementation of
MapReduce applications
Data Analysis using PIG
Hadoop Data Analysis Tools: Hadoop-Hive
Introduction to Hive - Hive Vs. PIG - Hive Use Cases
Discuss the Hive data storage principle
Explain the File formats and Records formats supported by
the Hive environment
Perform operations with data in Hive
Hive QL: Joining Tables, Dynamic Partitioning, Custom
Map/Reduce Scripts
Hive Script, Hive UDF
Hadoop Data Analysis Tools: Impala Distributed Persistence
Introduction to Impala & Architecture Spark Streaming Overview(Example: Streaming Word Count)
How Impala executes Queries and its importance.
Hive vs. PIG vs. Impala Spark: Spark meets Hive
Extending Impala with User Defined functions Analyze Hive and Spark SQL Architecture
Improving Impala Performance Analyze Spark SQL
Context in Spark SQL
Hadoop Data Analysis Tools: Hbase (NOSQL Database) Implement a sample example for Spark SQL
Introduction to NoSQL Databases, types, and Hbase Integrating hive and Spark SQL
HBase v/s RDBMS, HBase Components, HBase Architecture Support for JSON and Parquet File Formats Implement Data
HBase Cluster Deployment Visualization in Spark
Loading of Data
Hadoop: Introduction to other Apache Projects Hive Queries through Spark
Introduction to Zookeeper/Oozie/Sqoop/Flume Performance Tuning Tips in Spark
Shared Variables: Broadcast Variables & Accumulators
SPARK: Introduction
Introduction to Apache Spark Data Science using SPARK Python
Streaming Data Vs. In Memory Data Hadoop - Python Integration
Map Reduce Vs. Spark Spark - Python Integration (PySpark)
Modes of Spark
Spark Installation Demo Spark -Python: Machine Learning -Predictive Modeling Basics
Overview of Spark on a cluster Introduction to Machine Learning & Predictive Modeling
Spark Standalone Cluster Types of Business problems - Mapping of Techniques
Major Classes of Learning Algorithms -Supervised vs
Spark: Spark in practice Unsupervised Learning,
Invoking Spark Shell Different Phases of Predictive Modeling (Data Pre-processing,
Creating the Spark Context Sampling, Model Building, Validation)
Loading a File in Shell Overfitting (Bias-Variance Trade off) & Performance Metrics
Performing Some Basic Operations on Files in Spark Shell Types of validation(Bootstrapping, K-Fold validation etc)
Building a Spark Project with sbt
Running Spark Project with sbt
Caching Overview
Advance Big Data Science using Python-R-Hadoop-Spark (3/3)
Total Duration: 90 hours + Practice
Spark -Python: Machine Learning in Practice
Linear Regression
Logistic Regression
Segmentation - Cluster Analysis (K-Means)
Decision Trees (CHAID/CART/CD 5.0)
Artificial Neural Networks(ANN)
Support Vector Machines(SVM)
Ensemble Learning (Random Forest, Bagging & boosting)
Other Techniques (KNN, Nave Bayes, LDA/QDA etc)
Important Packages for Machine Learning (Sci Kit Learn,
scipy.stats etc)
R: Introduction - Data Importing/Exporting - (Video Based)
Introduction R/R-Studio - GUI
Concept of Packages - Useful Packages (Base & other
packages) in R
Data Structure & Data Types (Vectors, Matrices, factors, Data
frames, and Lists)
Importing Data from various sources
Database Input (Connecting to database)
Exporting Data to various formats)
Viewing Data (Viewing partial data and full data)
Variable & Value Labels Date Values
R Built-in Functions (Text, Numeric, Date, utility)
R User Defined Functions
R Packages for data manipulation(base, dplyr, plyr, reshape,
car, sqldf, etc)
R: Data Analysis Visualization - (Video Based)
Introduction exploratory data analysis
Descriptive statistics, Frequency Tables and summarization
Univariate Analysis (Distribution of data & Graphical Analysis)
Bivariate Analysis(Cross Tabs, Distributions & Relationships,
Graphical Analysis)
Creating Graphs- Bar/pie/line
chart/histogram/boxplot/scatter/density etc)
R Packages for Exploratory Data Analysis(dplyr, plyr, gmodes,
car, vcd, Hmisc, psych, doby etc)
R Packages for Graphical Analysis (base, ggplot, lattice,etc)
Integration of Hadoop with R

R: Data Manipulation - (Video Based)

Data Manipulation steps (Sorting, filtering, duplicates,
merging, appending, subsetting, derived variables, sampling,
Data type conversions, renaming, formatting, etc)
Data manipulation tools(Operators, Functions, Packages,
control structures, Loops, arrays, etc)
Course completion and career assistance
Course completion & Certification criteria
You shall be awarded an AnalytixLabs certificate only
post the submission and evaluation of mandatory course
project work. These will be provided as a part of the
training.
There is no pass/fail for these assignments and projects .
Our objective is to ensure that trainees get strong hands-
on experience so that they are well-prepared for job
interviews along with performance at their jobs.
Incase the assignments and projects are not up-to-the-
mark, trainees are welcome to take help and support for
improvisation.
While weekly schedule is shared with trainees for regular
assignments, candidates get 3 months, post course
completion, to submit their final assignment and
projects.
What is included in career assistance?
Post successful course completion, candidates can seek
assistance from AnalytixLabs for profile building. A team
of seasoned professionals will help you based on your
overall education background and work experience. This
will be followed by interview preparation along with
mock interviews (if required)
Job referrals are based on the requirements we get from
various organizations, HR consultants and large pool of
AnalytixLabs ex-students working in various companies.
No one can truthfully provide job guarantee, particularly
for good quality job profiles in Analytics. However, most
of our students do get multiple interview calls and good
career options based on the skills they learn during
training. For this there will be continuous support from
our side for as long as required.
Time and investment
Full interactive online training: 90 hours live training + 12 hours video based training + Practice (~80 hours),
INR 40,000 + 15% ST / $1500 (foreign nationals) including taxes
Self-paced video training: 100 hours + Practice, INR 35,000 + 15% ST / $1200 (foreign nationals) including taxes

Timing: 6 hours per weekend live training (Saturday & Sunday 3 hours each) + Practice

Training mode: Fully interactive live online class

(In addition to the above, you will also get access to the recordings for future reference and self study)

Components: Learning Management System access for courseware like class recordings - study material, Industry-
relevant project work

Certification: Participants will be awarded a certificate on successful completion of the stipulated requirements
including an evaluation
 We provide trainings both in fully interactive live online and classroom*
mode
Fully interactive
live online class
with personal
attention
Access to quality
Saves training and 24x7
commuting time practice
and resources in sessions
todays chaotic available at the
world comfort of your
Ensures place
best use of
time and
Delivered resources
Studies prove
lectures are
that online
recorded and
education beats
can be replayed
the conventional
by individuals as
classroom
per their needs One of strongest
global trends in
education, both
in developing
and developed
countries

*Classroom only available at Gurgaon center

Contact Us

Visit us on: http://www.analytixlabs.in/

For course registration, please visit: http://www.analytixlabs.co.in/course-registration/

For more information, please contact us: http://www.analytixlabs.co.in/contact-us/

Or email: info@analytixlabs.co.in
Call us we would love to speak with you: (+91) 9555219007

Join us on:
Twitter - http://twitter.com/#!/AnalytixLabs
Facebook - http://www.facebook.com/analytixlabs
LinkedIn - http://www.linkedin.com/in/analytixlabs
Blog - http://www.analytixlabs.co.in/category/blog/