Lectures

Time: MWF 12:00pm – 12:50pm
Location: Solomon DECI (Room 101)
Course offered in person with recordings made available for the online session. Zoom will be used for some invited speakers.
Date Topic Slides Recording
Week 1 Introduction
W, 9/8 Rosh Hashanah, no class
F, 9/10 Introduction to deep learning pdf
Week 2 Deep Learning Fundamentals
M, 9/13 Perceptrons pdf recording
W, 9/15 Loss functions and backpropagation pdf recording
F, 9/17 Optimization I pdf recording
Week 3 Feed-Forward Neural Networks + Tensorflow
M, 9/20 Optimization II pdf recording
W, 9/22 AutoDiff, Life Cycle of Machine Learning Systems pdf recording
F, 9/24 Life Cycle of Machine Learning Systems pdf recording
Week 4 Convolutional Neural Networks
M, 9/27 Deep Learning Hardware and Software pdf recording
W, 9/29 Introduction to Convolutional Neural Networks pdf recording
F 10/1 Convolutional neural networks, from MNIST to ImageNet (1) pdf recording
Week 5 CNNs, Language Models
M, 10/4 Convolutional neural networks, from MNIST to ImageNet (2) pdf recording
W, 10/6 Training convolutional neural networks pdf recording
F, 10/8 Training convolutional neural networks (2) pdf recording
Week 6 Language Models, Recurrent Networks
M, 10/11 No class, Indigenous Peoples' Day
W, 10/13 Word Embeddings pdf recording
F, 10/15 Feed-forward Language Models pdf recording
Week 7 Recurrent Networks, Sequence-to-Sequence Models
M, 10/18 Recurrent Neural Networks pdf recording
W, 10/20 LSTMs and GRUs pdf recording
F, 10/22 Machine translation pdf recording
Week 8 Sequence-to-Sequence Models
M, 10/25 Attention pdf recording
W, 10/27 Transformers pdf recording
F, 10/29 Transformers, Graph neural networks pdf recording
Week 9 Self-supervised Learning, Generative Models
M, 11/1 Graph neural networks pdf recording
W, 11/3 Guest Lecture by Dr. Been Kim recording
F, 11/5 Self-supervised Learning, Variational Autoencoders pdf recording
Week 10 Generative Models
M, 11/8 Variational Autoencoders (2) pdf recording
W, 11/10 Generative adversarial networks pdf recording
F, 11/12 Introduction to reinforcement learning pdf recording
Week 11 Reinforcement Learning
M, 11/15 (Deep) Q-Learning pdf recording
W, 11/17 Guest Lecture by Prof. Shuran Song recording
F, 11/19 Policy gradient methods pdf recording
Week 12 Thanksgiving Week
M, 11/22 Actor-critic Method pdf recording
W, 11/24 No class ,Thanksgiving 🦃🦃🦃
F, 11/26 No class, Thanksgiving 🦃🦃🦃
Week 13 Reinforcement Learning
M, 11/29 Chen shares his research recording
W, 12/1 Miscellaneous Topics pdf recording
F, 12/3 Guest Lecture by Prof. Hang Zhao recording
Week 14 Reinforcement Learning
M, 12/6 Guest Lecture by Prof. David Bau recording
W, 12/8 Conclusion pdf / STA recording
F, 12/10 Deep Learning Day