Course Calendar

For readings marked with a bold (C), critical comments are due before the class meeting.

Date Topic Assigned Readings Supplemental Readings Lecture Materials
9/08 Course Overview   Ghahramani UAI 2005 Sudderth
9/13 Gaussian Process (GP)
Regression & Classification		 Rasmussen & Williams 2006:
2.1-2.6, 3.1-3.4, 3.7		 Bishop 2007: 6 Sudderth
9/15 GP Latent Variable Models,
GP Density Estimation		 Lawrence JMLR 2005
Adams NIPS 2008		 Rasmussen NIPS 2001 Kim & Pacheco
Hughes
9/20 Dirichlet Process (DP),
DP Mixture Models		 Ghosal BNP 2010: 2.1-2.3
Escobar JASA 1995		 Jordan NIPS 2005
Sudderth PhD 2006: 2.5		 Sudderth
9/22 Chinese Restaurant Process,
DP Mixture Gibbs Samplers		 Rasmussen NIPS 2000
Neal JCGS 2000 (C)		 Andrieu ML 2003
MacKay 1999		 Sudderth
9/27 Stick Breaking Processes,
Truncated Gibbs Samplers		 Ishwaran JASA 2001 (C)
Porteous UAI 2006		 Ishwaran Biometrika 2000
Ishwaran Sankhya 2003		 Johnson & Sun
Oesper
9/29 DP Stick Breaking,
Pitman-Yor (PY) Process		 Sethuraman Stat. Sin. 1994
Goldwater NIPS 2006 (C)		 Ferguson An. Stat. 1973
Blackwell An. Stat. 1973		 Sudderth
J. Li
10/04 Hierarchical DP,
Transformed DP		 Teh JASA 2006 (C)
Sudderth NIPS 2006		 Teh BNP 2010
Sudderth IJCV 2008		 Jordan
Sudderth
10/06 Nested DP,
Mixtures of GP Experts		 Rodriguez JASA 2008 (C)
Meeds NIPS 2006		 MacEachern 1999 Sudderth
Kernfeld
10/11 Variational Methods,
Mean Field for DP Mixtures		 Jordan ML 1999: 1-4, 6
Blei Bayes Analysis 2006 (C)		 Wainwright 2008 Sudderth
Changpinyo & Klein
10/13 Collapsed Inference,
Search-based Inference,
Hierarchical Inference
 Kurihara IJCAI 2007
Daume AIStats 2007
Heller ICML 2005 (C)		 Xu AIStats 2009 Barhomi
Zhang
Ghosh
10/18 Mixtures of GP Experts,
Distance Dependent CRP		 Rasmussen NIPS 2002
Blei JMLR 2011 (C)		 Sudderth
X. Li & Moussavi
10/20 Indian buffet process (IBP),
Sparse Factor Analysis		 Ghahramani Bayes 2007 (C)
Knowles ICA 2007		 Griffiths TR 2005
Ghahramani BNP 2009		 Sudderth
Buller
10/25 Nested CRP,
Hierarchical PY		 Blei JACM 2010 (C)
Teh ACL 2006		 Bryant & Wang
Wu
10/27 Infinite Markov Models,
Sequence Memoizer,
Coagulation & Fragmentation		 Mochihashi NIPS 2008
Wood ICML 2009 (C)
Gasthaus NIPS 2011		 Gasthaus DCC 2010 Sudderth
Allen
Kahn
11/01 Sticky HDP-HMM,
HDP-HMT		 Fox AOAS 2011 (C)
Kivinen ICCV 2007		 Beal NIPS 2002
Fox NIPS 2008		 Sudderth
11/03 Slice sampling:
DP Mixtures, HDP-HMM		 Kalli Stat. Comp. 2011 (C)
Van Gael ICML 2008		 Walker Comm. Stat. 2007
Neal An. Stat. 2003		 Kernfeld & Sun
Johnson
11/08 Infinite Trees,
Adaptor Grammars,
Infinite PCFG		 Finkel ACL 2007
Johnson NIPS 2007
Liang EMNLP 2007 (C)		 Goldwater JMLR 2011 Moussavi
Zhang
Allen
11/10 Coalescent Processes,
Hierarchical Clustering		 Berestycki 2009: 1-2 (C)
Teh NIPS 2007		 Nordborg 2000
Neal Bayes 2003		 Klein & Oesper
Sudderth
11/15 IBP Stick Breaking,
IBP Variational Methods,
Hierarchical Beta Processes		 Teh AIStats 2007
Doshi-Velez AIStats 2009
Thibaux AIStats 2007 (C)		 Kingman Pac. J. Math 1967
Hjort An. Stat. 1990		 Wu
Changpinyo
Hughes
11/17 IBP Power Laws,
BP Stick Breaking		 Broderick TR 2011 (C)
Paisley ICML 2010		 Teh NIPS 2009
Paisley ICML 2011		 J. Li & Wang
Bryant
11/22 No Class      
11/24 Thanksgiving      
11/29 Infinite Factorial HMM,
BP Dynamical Systems,
Deep Sparse Models		 Van Gael NIPS 2009
Fox NIPS 2009
Adams AIStats 2010 (C)		 Kahn
Sudderth
Ghosh
12/01 Normalized gamma processes,
Infinite Logistic Normal,
Spatial PY Processes		 Rao NIPS 2009
Paisley AIStats 2011 (C)
Sudderth NIPS 2008		 Ishwaran Can. Stat. 2002
Duan Biometrika 2007		 Kim
X. Li
Sudderth
12/06 Course Review & Outlook Sudderth
12/08 No Class      
12/09 Project Presentations      
12/18 Project Reports Due      

Readings