6.437  Inference & Information

Introduction to principles of Bayesian and non-Bayesian statistical inference. Hypothesis testing and parameter estimation, sufficient statistics; exponential families; EM algorithm. Log-loss inference criterion, entropy and model capacity.  Kullback-Leibler distance and information geometry. Asymptotic analysis and large deviations theory. Model order estimation; nonparametric statistics. Computational issues and approximation techniques; Monte Carlo methods. Selected special topics such as universal prediction and compression.

Access to the website is limited to the students enrolled in the course as LISTENERS or FOR CREDIT. Please talk to us in class about registering and getting access to the web site. You can download the general information handout by clicking on the "General Info" tab on the left, even if you are not enrolled in the course.