6.437 Inference and Information
Spring 2013
Reverend Thomas Bayes
Instructor: Gregory W Wornell
TAs: Milutin Pajovic, Atulya Yellepeddi
Lecture:
Tuesdays and Thursdays, 9.30-11am
(32-155)
Recitations: Fridays 10-11am or 11am-noon
(26-204)
Office Hours (TA): Mondays 4:30-6:30 and Thursdays 4:30-6:30
(32-044B)
Office Hour (Greg): Wednesdays 1:30-2:30
(36-677)
Information:
Introduction to principles of Bayesian and non-Bayesian statistical inference. Hypothesis testing and parameter estimation, sufficient statistics; exponential families; EM algorithm. Log-loss inference criterion, entropy and model capacity. Kullback-Leibler distance and information geometry. Asymptotic analysis and large deviations theory. Model order estimation; nonparametric statistics. Computational issues and approximation techniques; Monte Carlo methods. Selected special topics such as universal prediction and compression.
ACCESS TO THE WEBSITE is limited to the students enrolled in the course as LISTENERS or FOR CREDIT. Please talk to us in class about registering and getting access to the web site. You can download the general information handout by clicking on the "General Info" tab on the left, even if you are not enrolled in the course.
Announcements
Please Check gradebooks
Hi All,As we begin finalizing grades, we wanted to send out one final reminder to check your gradebooks. You should see all the assignments that you submitted, except for the final. Please check that these are correct.
I think everyone who already emailed me about this should see
the changes reflected at this point.
Atulya
Announced on 16 May 2013 5:19 p.m. by Atulya Yellepeddi
PS8
Graded PSet 8 can be picked up at Office hours today. Also, old psets and midterm are at office hours to pick up. As a reminder Office Hours are 2PM-6PM, 36-153Announced on 14 May 2013 1:21 p.m. by Atulya Yellepeddi
Office Hours for Final
Hi All,The end of the semester dawns! We hope everyone is managing to stay sane.
In the interest of helping your sanity (hopefully), here are Office Hours for next week, where we will answer any questions regarding the material or PSets.
Monday, May 13 4:30PM to 6:30PM in 32-044B
Tuesday, May 14 2:00PM to 6:00PM in 36-153
Wednesday, May 15 10:00AM to 12:00PM in 36-144
The exam, of course, is 7:00PM to 10:00PM Wednesday in the lecture room.
As always, while we'll be glad to answer any and all questions any time, please don't leave major conceptual doubts for Wednesday!
Good luck!
Announced on 10 May 2013 5:10 p.m. by Atulya Yellepeddi
Office Hours for Final
Hi All,The end of the semester dawns! We hope everyone is managing to stay sane.
In the interest of helping your sanity (hopefully), here are Office Hours for next week, where we will answer any questions regarding the material or PSets.
Monday, May 13 4:30PM to 6:30PM in 32-044B
Tuesday, May 14 2:00PM to 6:00PM in 36-153
Wednesday, May 15 10:00AM to 12:00PM in 36-144
The exam, of course, is 7:00PM to 10:00PM Wednesday in the lecture room.
As always, while we'll be glad to answer any and all questions any time, please don't leave major conceptual doubts for Wednesday!
Good luck!
Announced on 10 May 2013 5:10 p.m. by Atulya Yellepeddi
Code to Format Strings Added
Hi Class,We've uploaded a small m-file that has code that will format a
plaintext to a suitable form for the project- for example, it will
remove extra spaces, make it lowercase, etc. This is just so that
you can test your code on other plaintexts that you may want to
use.
Additionally: Please note that this is a somewhat quick-and-dirty solution to formatting the text- it's not been tested for robustness! Please check that the plaintext it produces does indeed satisfy the constraints specified in the project description (Part II). Those constraints will be met by all test texts.
Announced on 30 April 2013 10:06 p.m. by Atulya Yellepeddi
