Carnegie Mellon University 16-824 Visual Learning and Recognition

Fall 2021

[ Home | Schedule | Assignments and Resources | Piazza]

This schedule is preliminary and subject to change as the term evolves.

Date	Topics	Course Materials	Instructor	Deadlines
Week 1
Lecture 1 Tuesday 08/31/21	Introduction	Slides [CMU only] Recording [CMU only] No Readings	Jun-Yan
Lecture 2 Thursday 09/02/21	Theories and History I	Slides [CMU only] Recording [CMU only] Optional Readings: #1： Lecture 1, 2 (Svetlana Lazebnik's course) #2: William T. Freeman et.al.	Jun-Yan
Week 2
Lecture 3 Tuesday 09/07/21	Theories and History II	Slides [CMU only] Recording [CMU only] Optional Readings: Lecture 3, 4 (Svetlana Lazebnik's course)	Jun-Yan
Lecture 4 Thursday 09/09/21	Introduction to Data	Slides [CMU only] Recording [CMU only] Readings: #1: Alon Halevy, Peter Norvig, Fernando Pereira #2: Antonio Torralba, Alexei A. Efros #3: Timnit Gebru et.al.	Jun-Yan
Week 3
Lecture 5 Tuesday 09/14/21	Neural Networks	Slides [CMU only] Readings: #1: Backpropagation: Olah and 231n #2: Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton	Jun-Yan
Lecture 6 Thursday 09/16/21	Convolutional Neural Network	Slides [CMU only] Readings: #1: Karen Simonyan, Andrew Zisserman #2: Kaiming He et.al.	Jun-Yan
Week 4
Bonus Lecture Monday 09/20/21	AWS/GCP and PyTorch Tutorial	AWS/GCP Tutorial[CMU only] Pytorch Tutorial[CMU only]	TAs	HW1 out
Lecture 7 Tuesday 09/21/21	Recipes for Training Deep Networks	Slides [CMU only] Readings: #1: Diederik P. Kingma, Jimmy Ba #2: Gao Huang, Zhuang Liu, et al.	Jun-Yan
Lecture 8 Thursday 09/23/21	Visualizing and Understanding Neural Nets	Slides [CMU only] Readings: #1: Aravindh Mahendran, Andrea Vedaldi #2: David Bau, Bolei Zhou, et al. #3: Olah et al.	Jun-Yan
Week 5
Lecture 9 Tuesday 09/28/21	Attention and Transformers	Slides [CMU only] Readings: #1: Ashish Vaswani et al. #2: Alexey Dosovitskiy et al. Optional Readings: #1: Sepp Hochreiter, et al #2: Thomas N. Kipf, Max Welling #3: Xiaolong Wang et al.	Jun-Yan
Lecture 10 Thursday 09/30/21	Image Segmentation	Slides [CMU only] Readings: #1: Jonathan Long, Evan Shelhamer, Trevor Darrell #2: Kaiming He et al. #3: Olaf Ronneberger et al.	Jun-Yan
Week 6
Lecture 11 Tuesday 10/05/21	Object Detection	Slides [CMU only] Readings: #1: Pedro F Felzenszwalb et.al. #2: Ross Girshick et.al. #3: Joseph Redmon et al.	Jun-Yan	HW1 due HW2 out
Lecture 12 Thursday 10/07/21	3D Image Understanding I	Slides [CMU only] Readings: #1: Derek Hoiem, Alexei A. Efros, Martial Hebert #2: David Eigen, Rob Fergus #3: Georgia Gkioxari, Jitendra Malik, Justin Johnson	Jun-Yan
Week 7
Lecture 13 Tuesday 10/12/21	3D Image Understanding II	Slides [CMU only] Readings: #1: Charles R. Qi*, Hao Su* et al. #2: Yue Wang et al. #3: Jeong Joon Park et al.	Jun-Yan	Project Proposal Due
Lecture 14 Thursday 10/14/21	Mid-Semester Break; No Classes
Week 8
Lecture 15 Tuesday 10/19/21	Generative Models I	Slides [CMU only] Readings: #1: Alec Radford, Luke Metz, Soumith Chintala #2: Diederik P Kingma, Max Welling #3: Diederik P. Kingma, Prafulla Dhariwal	Jun-Yan
Lecture 16 Thursday 10/21/21	Generative Models II	Slides [CMU only] Readings: #1: Joshua B. Tenenbaum, William T. Freeman #2: Aditya Ramesh et al. #3: Phillip Isola et al.	Jun-Yan
Week 9
Lecture 17 Tuesday 10/26/21	Guest Lecture (NeRF, view synthesis)	Slides [CMU only] Optional Readings: #1: Shenchang Eric Chen #2: Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik, et al. #3: Jonathan T. Barron et al.	Pratul Srinivasan （Google)	HW2 due HW3 out
Lecture 18 Thursday 10/28/21	Action Recognition and Videos	Slides [CMU only] Readings: #1: Karen Simonyan, Andrew Zisserman #2: Du Tran et al. #3: Joao Carreira, Andrew Zisserman	Jun-Yan
Week 10
Lecture 19 Tuesday 11/02/21	Transfer Learning	Slides [CMU only] Readings: #1: Jeff Donahue et al. #2: Eric Tzeng et al. #3: Chelsea Finn et al.	Jun-Yan
Lecture 20 Thursday 11/04/21	Self-supervised Learning I	Slides [CMU only] Readings: #1: Deepak Pathak et al. #2: Richard Zhang et al. #3: Jeff Donahue, Karen Simonyan	Jun-Yan
Week 11
Lecture 21 Tuesday 11/09/21	Self-supervised Learning II	Slides [CMU only] Readings: #1: Ting Chen et al. #2: Kaiming He et al. #3: Aaron van den Oord, Yazhe Li, Oriol Vinyals	Jun-Yan
Lecture 22 Thursday 11/11/21	Vision and Language	Slides [CMU only] Readings: #1: Kelvin Xu et al. #2: Stanislaw Antol*, Aishwarya Agrawal*, et al. #3: Ethan Perez et al.	Jun-Yan
Week 12
Lecture 23 Tuesday 11/16/21	Sound/Touch and Vision	Slides [CMU only] Readings: #1: Andrew Owens et al. #2: Hang Zhao et al. #3: Roberto Calandra et al.	Jun-Yan
Lecture 24 Thursday 11/18/21	Guest Lecture (contrastive learning, transformers)	Slides [CMU only] Optional Readings: #1: Kaiming He et al. #2: Xinlei Chen et al. #3: Xinlei Chen et al. #4: Kaiming He et al.	Xinlei Chen (FAIR)
Week 13
Lecture 25 Tuesday 11/23/21	Conclusion and Summary	Slides No Readings	Jun-Yan	HW3 due
Lecture 26 Thursday 11/25/21	Thanksgiving holidays. No classes.
Week 14
Lecture 27 Tuesday 11/30/21	Course Project Presentation I		Students
Lecture 28 Thursday 12/02/21	Course Project Presentation II		Students	Final Project Due (Dec 09 2021)