CS698o

Machine Learning Tools and Techniques

Krithika Venkataramani
krithika@cse.iitk.ac.in
CSE, IIT Kanpur
http://web.cse.iitk.ac.in/~cs698o/

Semester 1, 2011-12
Mon Thu 1200-1320 @CS102

krithika@cse.iitk.ac.in (CSE, IITK)

CS698o: Course Contents

2011-2012

1/8

General information
Pre-requisites
Linear Algebra
Probability and Statistics

Course based on machine learning tools

Familiarity with programming a must
Tools include machine learning functions in MATLAB and WEKA
Weekly coding assignments of 1-2 problems on real data

Do assignments individually
Participate in class
Attend class regularly
Discuss and ask questions

Appointments: email me at krithika@cse.iitk.ac.in and put

CS698o in subject
No extension of deadlines
For illness, follow IITK rules
krithika@cse.iitk.ac.in (CSE, IITK)

CS698o: Course Contents

2011-2012

2/8

Course Material
Books
Text Book
Pattern Classification by Duda, Hart and Stork, 2nd Edition

Reference Books
Pattern Recognition by Theodoridis and Koutroumbas
Pattern Recognition and Machine Learning by Bishop
The Elements of Statistical Learning: Data mining, inference and
prediction, by Hastie, Tibshirani and Friedman, 2nd Edition
Statistical Signal Processing by Scharf

Slides
Class work

krithika@cse.iitk.ac.in (CSE, IITK)

CS698o: Course Contents

2011-2012

3/8

Course Contents
Decision trees
Bayesian Decision Theory
Minimum error rate classification
Minimax Criterion
Neyman Pearson Criterion
Normal densities: Discriminant functions and Decision surfaces
Continuous and Discrete features, Missing and Noisy features

Maximum Likelihood and Bayesian Parameter Estimation

Parameter Estimation for Normal Density
Sufficient Statistics
Expectation Maximization
Problems of Dimensionality, Training sample size, Overfitting
Hidden Markov Models

Non-parametric Techniques
k Nearest Neighbor Estimation
Nearest Neighbor Classification
Distance Metrics
Fuzzy Classification
krithika@cse.iitk.ac.in (CSE, IITK)

CS698o: Course Contents

2011-2012

4/8

Course Contents (contd.)

Component Analysis and Discriminant Functions
Principal Component Analysis
Fisher Linear Discriminant
Generalized Linear Discriminant Functions
Linear Programming Algorithms
Support Vector Machines
Independent Component Analysis
Multi-Dimensional Scaling
Multi-category Generalizations

Neural Networks
Feed-forward Operation
Back-propagation Algorithm
Practical Techniques to Improve Back-Propagation
Additional Networks

krithika@cse.iitk.ac.in (CSE, IITK)

CS698o: Course Contents

2011-2012

5/8

Course Contents (contd.)

Unsupervised Learning and Clustering
Maximum Likelihood Estimates and Applications to Normal Densities
Criterion Functions for Clustering and Similarity Metrics
Hierarchical Clustering

Algorithm Independent Machine Learning

Bias and Variance
Resampling for estimating statistics and classifier design
Estimating and Comparing Classifiers
Combining Classifiers

krithika@cse.iitk.ac.in (CSE, IITK)

CS698o: Course Contents

2011-2012

6/8

Grading policy
Assignments: 25%
Exams: 25%
Mid-sem: 10%
End-sem: 15%

Class participation: 5%
Attendance
Discussions in class

Quizzes: 10%
Project: 35%
Results 15%
Presentation 10%
Report 10%

krithika@cse.iitk.ac.in (CSE, IITK)

CS698o: Course Contents

2011-2012

7/8

Grading policy
Assignments: 25%
Exams: 25%
Mid-sem: 10%
End-sem: 15%

Class participation: 5%
Attendance
Discussions in class

Quizzes: 10%
Project: 35%
Results 15%
Presentation 10%
Report 10%

Projects
May be done in groups of size at most 2
Deadlines on initial idea, mid-term report and final submission must be
followed
krithika@cse.iitk.ac.in (CSE, IITK)

CS698o: Course Contents

2011-2012

7/8

Suggestions
What are your interests?
How would you like to learn?

krithika@cse.iitk.ac.in (CSE, IITK)

CS698o: Course Contents

2011-2012

8/8