Carnegie Mellon University

16-824 Visual Learning and Recognition

Spring 2021

[ Home | Schedule | Assignments and Resources | Piazza ]

This schedule is preliminary and subject to change as the term evolves.

Date Topics Course Materials Instructor Deadlines
Week 1: History and Philosophy of Computer Vision
Lecture 1
Monday 02/01/21
Introduction to the class Slides [CMU only]
No Readings
Abhinav & Deepak
Lecture 2
Wednesday 02/03/21
Theories of Vision I Slides [CMU only]
Optional Readings:
Lecture 1, 2 (Svetlana Lazebnik's course)
Abhinav
Week 2: Evolution of Computer Vision Approaches
Lecture 3
Monday 02/08/21
Theories of Vision II Slides [CMU only]
Optional Readings:
Lecture 3, 4 (Svetlana Lazebnik's course)
Abhinav
Lecture 4
Wednesday 02/10/21
Introduction to Data Slides [CMU only]
Readings:
#1: Halevy, Norvig & Pereira
#2: Torralba & Efros
Abhinav
Week 3: Introduction to Deep Learning
Lecture 5
Monday 02/15/21
Neural Nets and Backprop Slides [CMU only]
Readings:
#1: Backpropagation:Olah and 231n
#2: Krizhevsky, Sutskever & Hinton
Deepak
Lecture 6
Wednesday 02/17/21
CNN Architectures Slides [CMU only]
Readings:
#1: Simonyan & Zisserman
#2: He et.al.
Deepak
Week 4: Training Deep Nets
Lecture 7
Monday 02/22/21
Recipes for Training Deep Networks Slides [CMU only]
Readings:
#1: Mahendran & Vedaldi
#2: Kingma & Ba
Deepak HW1 (10%)
Release Date
Lecture 8
Wednesday 02/24/21
Visualizing and Understanding Deep Nets Slides [CMU only]
Readings:
#1: Sutskever, Vinyals & Le
#2: Kipf & Welling

Optional:
Hochreiter & Schmidhuber
Karpathy et.al.
Deepak
Bonus Lecture
Friday
02/26/21
AWS and PyTorch Tutorial Slides [CMU only]

Resources
TAs (Sudeep, Ziyan, Sanil)
Week 5: Advanced Architectures and Object Detection
Lecture 9
Monday 03/01/21
RNN, GNN, GCN, Attention and Transformers Slides [CMU only]
Readings:
#1: Vaswani et.al.
#2: Dosovitskiy et.al.
Deepak
Lecture 10
Wednesday 03/03/21
Image and Pixel Classication (Segmentation) Slides [CMU only]
Readings:
#1: Long*, Shelhamer* & Darrell
#2: He et.al.
Deepak
Week 6:
Lecture 11
Monday 03/08/21
Object Detection Slides [CMU only]
Readings:
#1: Felzenszwalb et.al.
#2: Girshick et.al.
Abhinav HW1 Due Date
HW2 (15%)
Release Date
Lecture 12
Wednesday 03/10/21
3D Image Understanding - 1 Slides [CMU only]
Readings:
#1: Hoiem, Efros & Hebert
#2: Eigen & Fergus
Abhinav Project Proposal
(1 page)
Due Date
Week 7:
Lecture 13
Monday 03/15/21
3D Image Understanding - 2 Slides [CMU only]
Readings:
#1: Girdhar et al.
#2: Qi et al.
Abhinav
Lecture 14
Wednesday 03/17/21
Action Recognition and Videos Slides [CMU only]
Readings:
#1: Karpathy et al.
#2: Simonyan & Zisserman

Optional Readings:
Carreira & Zisserman
Abhinav
Week 8:
Lecture 15
Monday 03/22/21
Human Pose Estimation Slides [CMU only]
Readings:
#1: Cao et al.
#2: Carreira et al.
Guest Lecture - Hanbyul Joo
Lecture 16
Wednesday 03/24/21
Generative Models I Slides [CMU only]
Readings:
#1: Carl Doersch
#2: Radford, Metz, & Chintala
Deepak
Week 9:
Lecture 17
Monday 03/29/21
Generative Models II & Video Prediction Slides [CMU only]
Readings:
#1: van der Oord et al.
#2: Zhu, Park, Isola & Efros
Deepak HW2 Due Date
HW3 (25%)
Release Date
Lecture 18
Wednesday 03/31/21
Few-shot and Zero-Shot Learning Slides [CMU only]
Readings:
#1: Romera-Paredes & Torr
#2: Finn, Abbeel & Levine
Deepak
Week 10:
Lecture 19
Wednesday 04/07/21
Self-supervised Learning I Slides [CMU only]
Readings:
#1: Pathak et al.
#2: Wang & Gupta
Abhinav
Week 11:
Lecture 20
Monday 04/12/21
Self Supervised Learning II Slides [CMU only]
Readings:
#1: Chen et al.
#2: OpenAI
Abhinav
Lecture 21
Wednesday 04/14/21
Multimodal I: Language and Vision Slides [CMU only]
Readings:
#1: Xu et al.
#2: Andreas, et al.
Guest Lecture - Marcus Rohrbach
Week 12:
Lecture 22
Monday 04/19/21
Multimodal II: Action and Vision; DeepRL + Robotics Slides [CMU only]
Readings:
#1: Pathak et al.
#2: Mnih et al.
Deepak
Lecture 23
Wednesday 04/21/21
Multimodal III: Sound/Touch and Vision Slides [CMU only]
Readings:
#1: Owens et al.
#2: Calandra et al.
Deepak
Week 13:
Lecture 24
Monday 04/26/21
Continual Lifelong Learning: Towards Generalists Machines Slides [CMU only]
No Readings!
Deepak HW3 Due Date
Lecture 25
Wednesday 04/28/21
Conclusion and Summary Slides [CMU only]
No Readings!
Deepak
Week 14:
Lecture 26
Monday 05/03/21
Final Presentations N/A Students
Lecture 27
Wednesday 05/05/21
Final Presentations TBD Students