271A -
Statistical Learning I

 

 

             

This course provides an introduction to pattern recognition and statistical learning. Topics covered include: Bayesian decision theory; parameter estimation; maximum likelihood; the bias-variance trade-off; Bayesian parameter estimation; the predictive distribution; conjugate and non-informative priors; dimensionality and dimensionality reduction; principal component analysis; Fisher's linear discriminant analysis; density estimation: parametric vs. kernel-based methods; mixture models; expectation-maximization; applications.

Lectures: TuTh, 3:30-5:00, WLH 2206
Instructor: Nuno Vasconcelos
n u n o @ e c e . u c s d . e d u, EBU1-5603
office hours: Fri 9:30-11:00 AM
TA: Vijay Mahadevan
v m a h a d e v @ u c s d . e d u
office hours: Wed 5pm EBU1 5706
Text: Pattern Classification (2nd ed.)
R. Duda, P. Hart, and D. Stork, Wiley Interscience, 2000
Syllabus: [ps, pdf]
Homework: Problem set 1 [ps, pdfdata, intro slides]
Problem set 2 [ps, pdfdata]
Problem set 3 [ps, pdfdata]
Problem set 4 [ps, pdf]
Problem set 5 [ps, pdf]
Cheetah Day:  December 7
 Style: Example paper [pdf]
 LaTeX/Word Templates (gzipped tar file)
 LaTeX/Word Templates (zip file):
Readings: Lecture 1: introduction (DHS, chapter 1)
Lecture 2: Bayesian decision theory (DHS, chapter 2) [slides]
Lecture 3: Bayesian decision theory (DHS, chapter 2) [slides]
Lecture 4: Gaussian classifier (DHS, chapter 2) [slides]
Lecture 5: Maximum-likelihood estimation (DHS, chapter 3) [slides]
Lecture 6: Bias and variance (DHS, chapter 9) [slides]
Lecture 7: Bayesian parameter estimation (DHS, chapter 3) [slides]
Lecture 8: mid-term review [pdf]
Lecture 9: mid-term
Lecture 10: Bayesian parameter estimation (DHS, chapter 3) [slides]
Lecture 11: Conjugate and non-informative priors [slides]
Lecture 12: Conjugate and non-informative priors [slides]
Lecture 13: Kernel-based density estimates (DHS, chapter 4) [slides]
Lecture 14: Mixture models [slides]
Lecture 15: Expectation-maximization [slides]
Lecture 16: Expectation-maximization [slides]
Lecture 17: Applications [slides(ppt|pdf)]
Lecture 18: Cheetah Day