| Date |
Topics |
Course Materials |
Instructor |
Deadlines |
| Week 1 |
Lecture 1
Monday 08/24/26 |
Introduction |
No Readings |
Jun-Yan |
|
Lecture 2
Wednesday 08/26/26 |
Introduction to Data |
Readings:
#1: Alon Halevy, Peter Norvig, and Fernando Pereira
#2: Antonio Torralba & Alexei A. Efros
#3: Chen Sun et al.
#4: Timnit Gebru et al. |
Jun-Yan |
|
| Week 2 |
Lecture 3
Monday 08/31/26 |
Convolutional Neural Network |
Readings:
#1: Alex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton
#2: Karen Simonyan, Andrew Zisserman
#3: Kaiming He et.al.
#4: Zhuang Liu et al. |
Jun-Yan |
|
Bonus Lecture
Wednesday 09/02/26 |
PyTorch and AWS Tutorial |
|
Avigyan, Shen |
|
| Week 3 |
Monday 09/07/26 |
Labor Day; No class. |
|
|
|
Lecture 4
Wednesday 09/09/26 |
Visualizing and Understanding Neural Nets |
Readings:
#1: Aravindh Mahendran, Andrea Vedaldi
#2: David Bau, Bolei Zhou, et al.
#3: Ramprasaath R. Selvaraju et al.
#4: Olah et al. |
Jun-Yan |
|
| Week 4 |
Lecture 5
Monday 09/14/26 |
Attention and Transformers I |
Readings:
#1: Ashish Vaswani et al.
#2: Ilya Sutskever, Oriol Vinyals, Quoc V. Le
#3: Dzmitry Bahdanau, KyungHyun Cho, Yoshua Bengio
Optional Readings:
#4: Jianlin Su et al. |
Jun-Yan |
|
Lecture 6
Wednesday 09/16/26 |
Attention and Transformers II |
Readings:
#1: Alexey Dosovitskiy et al.
#2: Ze Liu et al.
Optional Readings:
#3: Timothee Darcet et al.
#4: Ilya Tolstikhin et al.
#5: Andrew Jaegle et al. |
Jun-Yan |
HW1 Out (Classification + Detection) |
| Week 5 |
Lecture 7
Monday 09/21/26 |
Segmentation and Detection I |
Readings:
#1: Jonathan Long, Evan Shelhamer, Trevor Darrell (FCN)
#2: Olaf Ronneberger et al. (U-Net)
#3: Bowen Cheng et al. (Mask2Former)
Optional Readings:
#4: Sixiao Zheng et al. (SETR)
#5: Enze Xie et al. (SegFormer) |
Jun-Yan |
|
Lecture 8
Wednesday 09/23/26 |
Segmentation and Detection II |
Readings:
#1: Pedro F Felzenszwalb et al. (DPM)
#2: Ross Girshick et al. (R-CNN)
#3: Joseph Redmon et al. (YOLO)
#4: Nicolas Carion et al. (DETR)
Optional Readings:
#5: Shaoqing Ren et al. (Faster R-CNN)
#6: Xingyi Zhou, et al. (CenterNet) |
Jun-Yan |
|
| Week 6 |
Lecture 9
Monday 09/28/26 |
Segmentation and Detection III |
Readings:
#1: Kaiming He et al. (Mask R-CNN)
#2: Alexander Kirillov et al. (SAM)
Optional Readings:
#3: Alexander Kirillov et al. (Panoptic Segmentation)
#4: Nikhila Ravi et al. (SAM 2) |
Jun-Yan |
|
Lecture 10
Wednesday 09/30/26 |
Generative Models I |
Readings:
#1: Ian J. Goodfellow et al.
#2: Tero Karras, et al. (StyleGAN1)
#3: Phillip Isola et al.
Optional Readings:
#4: Tero Karras, et al. (StyleGAN2)
#5: Tero Karras, et al. (StyleGAN3)
#6: Jun-Yan Zhu*, Taesung Park* et al. |
Jun-Yan |
|
| Week 7 |
Lecture 11
Monday 10/05/26 |
Generative Models II |
Readings:
#1: Diederik P Kingma, Max Welling
#2: Aaron van den Oord et al.
#3: Patrick Esser et al.
Optional Readings:
#4: Diederik P. Kingma, Max Welling
#5: Aaron van den Oord et al. |
Jun-Yan |
|
Lecture 12
Wednesday 10/07/26 |
Generative Models III |
Readings:
#1: Jonathan Ho, Ajay Jain, Pieter Abbeel
#2: William Peebles, Saining Xie
Optional Readings:
#3: Yang Song et al.
#4: Jascha Sohl-Dickstein et al.
#5: Xingchao Liu et al. |
Jun-Yan |
HW2 Out |
| Week 8 |
Monday 10/12/26 |
Fall Break. No class. |
|
|
|
Wednesday 10/14/26 |
Fall Break. No class. |
|
|
|
| Week 9 |
Lecture 13
Monday 10/19/26 |
Self-Supervised Learning I |
Readings:
#1: Deepak Pathak et al.
#2: Richard Zhang et al.
#3: Kaiming He et al.
Optional Readings:
#4: Jeff Donahue, Karen Simonyan
#5: Mark Chen et al. |
Jun-Yan |
|
Lecture 14
Wednesday 10/21/26 |
Self-Supervised Learning II |
Readings:
#1: Ting Chen et al.
#2: Kaiming He et al.
#3: Aaron van den Oord, Yazhe Li, Oriol Vinyals
Optional Readings:
#4: Mathilde Caron et al.
#5: Xinlei Chen and Kaiming He
#6: Maxime Oquab et al. |
Jun-Yan |
HW1 Due |
| Week 10 |
Lecture 15
Monday 10/26/26 |
Vision-Language Model I |
Readings:
#1: Stanislaw Antol*, Aishwarya Agrawal*, et al.
#2: Alec Radford et al.
#3: Haotian Liu et al.
Optional Readings:
#4: Junnan Li et al. |
Jun-Yan |
|
Wednesday 10/28/26 |
Guest Lecture I |
|
Eliahu Horwitz |
|
| Week 11 |
Lecture 16
Monday 11/02/26 |
Vision-Language Model II |
Readings:
#1: Elman Mansimov et al.
#2: Robin Rombach et al.
#3: Aditya Ramesh et al.
Optional Readings:
#4: Chitwan Saharia et al.
#5: Kang et al. |
Jun-Yan |
HW3 Out |
Lecture 17
Wednesday 11/04/26 |
Transfer Learning, Visual Prompting I |
Readings:
#1: Jake Snell, Kevin Swersky, Richard S. Zemel
#2: Eric Tzeng et al.
#3: Chelsea Finn et al. |
|
HW2 Due |
| Week 12 |
Monday 11/09/26 |
Guest Lecture II |
|
|
|
Lecture 18
Wednesday 11/11/26 |
Transfer Learning, Visual Prompting II |
|
Jun-Yan |
|
| Week 13 |
Lecture 19
Monday 11/16/26 |
Action Recognition and Videos I |
|
|
|
Lecture 20
Wednesday 11/18/26 |
Action Recognition and Videos II |
|
|
HW3 Due |
| Week 14 |
Lecture 21
Monday 11/23/26 |
Efficient Deep Learning |
|
|
|
Wednesday 11/25/26 |
Thanksgiving holiday. No Class. |
|
|
|
| Week 15 |
Lecture 22
Monday 11/30/26 |
Course Project Presentation I |
|
|
|
Lecture 23
Wednesday 12/02/26 |
Course Project Presentation II |
|
|
Final Proj Due (12/9) |