Carnegie Mellon University

16-824 Visual Learning and Recognition

Fall 2021

[ Home | Schedule | Assignments and Resources | Piazza | Previous Offerings]

This schedule is preliminary and subject to change as the term evolves.

Date Topics Course Materials Instructor Deadlines
Week 1
Lecture 1
Tuesday 08/31/21
Introduction Slides [CMU only]
Recording [CMU only]
No Readings
Jun-Yan
Lecture 2
Thursday 09/02/21
Theories and History I Slides [CMU only]
Recording [CMU only]
Optional Readings:
#1: Lecture 1, 2 (Svetlana Lazebnik's course)
#2: Bill Freeman et.al.
Jun-Yan
Week 2
Lecture 3
Tuesday 09/07/21
Theories and History II Slides [CMU only]
Recording [CMU only]
Optional Readings:
Lecture 3, 4 (Svetlana Lazebnik's course)
Jun-Yan
Lecture 4
Thursday 09/09/21
Introduction to Data Slides [CMU only]
Recording [CMU only]
Readings:
#1: Alon Halevy, Peter Norvig, Fernando Pereira
#2: Antonio Torralba, Alexei A. Efros
#3: Timnit Gebru et.al.
Jun-Yan
Week 3
Lecture 5
Tuesday 09/14/21
Neural Networks Slides [CMU only]
Readings:
#1: Backpropagation: Olah and 231n
#2: Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton
Jun-Yan
Lecture 6
Thursday 09/16/21
Convolutional Neural Network Slides [CMU only]
Readings:
#1: Karen Simonyan, Andrew Zisserman
#2: Kaiming He et.al.
Jun-Yan
Week 4
Bonus Lecture
Monday
09/20/21
AWS/GCP and PyTorch Tutorial AWS/GCP Tutorial[CMU only]
Pytorch Tutorial[CMU only]
TAs HW1 out
Lecture 7
Tuesday 09/21/21
Recipes for Training Deep Networks Slides [CMU only]
Readings:
#1: Diederik P. Kingma, Jimmy Ba
#2: Gao Huang, Zhuang Liu, et al.
Jun-Yan
Lecture 8
Thursday 09/23/21
Visualizing and Understanding Neural Nets Slides [CMU only]
Readings:
#1: Aravindh Mahendran, Andrea Vedaldi
#2: David Bau, Bolei Zhou, et al.
#3: Olah et al.
Jun-Yan
Week 5
Lecture 9
Tuesday 09/28/21
Attention and Transformers Slides [CMU only]
Readings:
#1: Ashish Vaswani et al.
#2: Alexey Dosovitskiy et al.
Optional Readings:
#1: Sepp Hochreiter, et al
#2: Thomas N. Kipf, Max Welling
#3: Xiaolong Wang et al.
Jun-Yan
Lecture 10
Thursday 09/30/21
Image Segmentation Slides [CMU only]
Readings:
#1: Jonathan Long, Evan Shelhamer, Trevor Darrell
#2: Kaiming He et al.
#3: Olaf Ronneberger et al.
Jun-Yan
Week 6
Lecture 11
Tuesday 10/05/21
Object Detection Slides [CMU only]
Readings:
#1: Pedro F Felzenszwalb et.al.
#2: Ross Girshick et.al.
#3: Joseph Redmon et al.
Jun-Yan HW1 due
HW2 out
Lecture 12
Thursday 10/07/21
3D Image Understanding I Slides [CMU only]
Readings:
#1: Derek Hoiem, Alexei A. Efros, Martial Hebert
#2: David Eigen, Rob Fergus
#3: Georgia Gkioxari, Jitendra Malik, Justin Johnson
Jun-Yan
Week 7
Lecture 13
Tuesday 10/12/21
3D Image Understanding II Slides
Readings:
#1: Charles R. Qi*, Hao Su* et al.
#2: Yue Wang et al.
#3: Jeong Joon Park et al.
Jun-Yan Project Proposal Due
Lecture 14
Thursday 10/14/21
Mid-Semester Break; No Classes
Week 8
Lecture 15
Tuesday 10/19/21
Generative Models I Slides
Readings:
#1: Alec Radford, Luke Metz, Soumith Chintala
#2: Diederik P Kingma, Max Welling
#3: Diederik P. Kingma, Prafulla Dhariwal
Jun-Yan
Lecture 16
Thursday 10/21/21
Generative Models II Slides
Readings:
#1: JB Tenenbaum, WT Freeman
#2: Aditya Ramesh et al.
#3: Phillip Isola et al.
Jun-Yan
Week 9
Lecture 17
Tuesday 10/26/21
Guest Lecture (NeRF, view synthesis) Slides
Readings:
TBD
Pratul Srinivasan (Google) HW2 due
HW3 out
Lecture 18
Thursday 10/28/21
Action Recognition and Videos Slides
Readings:
TBD
Jun-Yan
Week 10
Lecture 19
Tuesday 11/02/21
Few-shot and Zero-Shot Learning Slides
Readings:
TBD
Jun-Yan
Lecture 20
Thursday 11/04/21
Self-supervised Learning I Slides
Readings:
TBD
Jun-Yan
Week 11
Lecture 21
Tuesday 11/09/21
Self-supervised Learning II Slides
Readings:
TBD
Jun-Yan HW3 due
Lecture 22
Thursday 11/11/21
Language and Vision Slides
Readings:
TBD
Jun-Yan
Week 12
Lecture 23
Tuesday 11/16/21
Sound/Touch and Vision Slides
Readings:
TBD
Jun-Yan
Lecture 24
Thursday 11/18/21
Guest Lecture (contrastive learning, transformers) Slides
Readings:
TBD
Xinlei Chen (FAIR)
Week 13
Lecture 25
Tuesday 11/23/21
Conclusion and Summary Slides
Readings:
TBD
Jun-Yan
Lecture 26
Thursday 11/25/21
Thanksgiving holidays. No classes.
Week 14
Lecture 27
Tuesday 11/30/21
Course Project Presentation I Students
Lecture 28
Thursday 12/02/21
Course Project Presentation II Students Final Project Due