Carnegie Mellon University

16-824 Visual Learning and Recognition

Spring 2021
[ Home | Schedule | Assignments and Resources | Piazza ]

This schedule is preliminary and subject to change as the term evolves.

Date Topics Course Materials Instructor Deadlines
Week 1: History and Philosophy of Computer Vision
Lecture 1
Monday 02/01/21		 Introduction to the class Slides [CMU only]
No Readings		 Abhinav & Deepak
Lecture 2
Wednesday 02/03/21		 Theories of Vision I Slides [CMU only]
Optional Readings:
Lecture 1, 2 (Svetlana Lazebnik's course)		 Abhinav
Week 2: Evolution of Computer Vision Approaches
Lecture 3
Monday 02/08/21		 Theories of Vision II Slides [CMU only]
Optional Readings:
Lecture 3, 4 (Svetlana Lazebnik's course)		 Abhinav
Lecture 4
Wednesday 02/10/21		 Introduction to Data Slides [CMU only]
Readings:
#1: Halevy, Norvig & Pereira
#2: Torralba & Efros		 Abhinav
Week 3: Introduction to Deep Learning
Lecture 5
Monday 02/15/21		 Neural Nets and Backprop Slides [CMU only]
Readings:
#1: Backpropagation:Olah and 231n
#2: Krizhevsky, Sutskever & Hinton		 Deepak
Lecture 6
Wednesday 02/17/21		 CNN Architectures Slides [CMU only]
Readings:
#1: Simonyan & Zisserman
#2: He et.al.		 Deepak
Week 4: Training Deep Nets
Lecture 7
Monday 02/22/21		 Recipes for Training Deep Networks Slides [CMU only]
Readings:
#1: Mahendran & Vedaldi
#2: Kingma & Ba		 Deepak HW1 (10%)
Release Date
Lecture 8
Wednesday 02/24/21		 Visualizing and Understanding Deep Nets Slides [CMU only]
Readings:
#1: Sutskever, Vinyals & Le
#2: Kipf & Welling

Optional:
Hochreiter & Schmidhuber
Karpathy et.al.		 Deepak
Bonus Lecture
Friday
02/26/21		 AWS and PyTorch Tutorial Slides [CMU only]

Resources		 TAs (Sudeep, Ziyan, Sanil)
Week 5: Advanced Architectures and Object Detection
Lecture 9
Monday 03/01/21		 RNN, GNN, GCN, Attention and Transformers Slides [CMU only]
Readings:
#1: Vaswani et.al.
#2: Dosovitskiy et.al.		 Deepak
Lecture 10
Wednesday 03/03/21		 Image and Pixel Classication (Segmentation) Slides [CMU only]
Readings:
#1: Long*, Shelhamer* & Darrell
#2: He et.al.		 Deepak
Week 6:
Lecture 11
Monday 03/08/21		 Object Detection Slides [CMU only]
Readings:
#1: Felzenszwalb et.al.
#2: Girshick et.al.		 Abhinav HW1 Due Date
HW2 (15%)
Release Date
Lecture 12
Wednesday 03/10/21		 3D Image Understanding - 1 Slides [CMU only]
Readings:
#1: Hoiem, Efros & Hebert
#2: Eigen & Fergus		 Abhinav Project Proposal
(1 page)
Due Date
Week 7:
Lecture 13
Monday 03/15/21		 3D Image Understanding - 2 Slides [CMU only]
Readings:
#1: Girdhar et al.
#2: Qi et al.		 Abhinav
Lecture 14
Wednesday 03/17/21		 Action Recognition and Videos Slides [CMU only]
Readings:
#1: Karpathy et al.
#2: Simonyan & Zisserman

Optional Readings:
Carreira & Zisserman		 Abhinav
Week 8:
Lecture 15
Monday 03/22/21		 Human Pose Estimation Slides [CMU only]
Readings:
#1: Cao et al.
#2: Carreira et al.		 Guest Lecture - Hanbyul Joo
Lecture 16
Wednesday 03/24/21		 Generative Models I Slides [CMU only]
Readings:
#1: Carl Doersch
#2: Radford, Metz, & Chintala		 Deepak
Week 9:
Lecture 17
Monday 03/29/21		 Generative Models II & Video Prediction Slides [CMU only]
Readings:
#1: van der Oord et al.
#2: Zhu, Park, Isola & Efros		 Deepak HW2 Due Date
HW3 (25%)
Release Date
Lecture 18
Wednesday 03/31/21		 Few-shot and Zero-Shot Learning Slides [CMU only]
Readings:
#1: Romera-Paredes & Torr
#2: Finn, Abbeel & Levine		 Deepak
Week 10:
Lecture 19
Wednesday 04/07/21		 Self-supervised Learning I Slides [CMU only]
Readings:
#1: Pathak et al.
#2: Wang & Gupta		 Abhinav
Week 11:
Lecture 20
Monday 04/12/21		 Self Supervised Learning II Slides [CMU only]
Readings:
#1: Chen et al.
#2: OpenAI		 Abhinav
Lecture 21
Wednesday 04/14/21		 Multimodal I: Language and Vision Slides [CMU only]
Readings:
#1: Xu et al.
#2: Andreas, et al.		 Guest Lecture - Marcus Rohrbach
Week 12:
Lecture 22
Monday 04/19/21		 Multimodal II: Action and Vision; DeepRL + Robotics Slides [CMU only]
Readings:
#1: Pathak et al.
#2: Mnih et al.		 Deepak
Lecture 23
Wednesday 04/21/21		 Multimodal III: Sound/Touch and Vision Slides [CMU only]
Readings:
#1: Owens et al.
#2: Calandra et al.		 Deepak
Week 13:
Lecture 24
Monday 04/26/21		 Continual Lifelong Learning: Towards Generalists Machines Slides [CMU only]
No Readings! 		Deepak HW3 Due Date
Lecture 25
Wednesday 04/28/21		 Conclusion and Summary Slides [CMU only]
No Readings! 		Deepak
Week 14:
Lecture 26
Monday 05/03/21		 Final Presentations N/A Students
Lecture 27
Wednesday 05/05/21		 Final Presentations TBD Students