Lectures
Time: MWF 12:00pm – 12:50pmLocation: Solomon DECI (Room 101)
Course offered in person with recordings made available for the online session. Zoom will be used for some invited speakers.
Date | Topic | Slides | Recording |
---|---|---|---|
Week 1 | Introduction | ||
W, 9/8 | Rosh Hashanah, no class | ||
F, 9/10 | Introduction to deep learning | ||
Week 2 | Deep Learning Fundamentals | ||
M, 9/13 | Perceptrons | recording | |
W, 9/15 | Loss functions and backpropagation | recording | |
F, 9/17 | Optimization I | recording | |
Week 3 | Feed-Forward Neural Networks + Tensorflow | ||
M, 9/20 | Optimization II | recording | |
W, 9/22 | AutoDiff, Life Cycle of Machine Learning Systems | recording | |
F, 9/24 | Life Cycle of Machine Learning Systems | recording | |
Week 4 | Convolutional Neural Networks | ||
M, 9/27 | Deep Learning Hardware and Software | recording | |
W, 9/29 | Introduction to Convolutional Neural Networks | recording | |
F 10/1 | Convolutional neural networks, from MNIST to ImageNet (1) | recording | |
Week 5 | CNNs, Language Models | ||
M, 10/4 | Convolutional neural networks, from MNIST to ImageNet (2) | recording | |
W, 10/6 | Training convolutional neural networks | recording | |
F, 10/8 | Training convolutional neural networks (2) | recording | |
Week 6 | Language Models, Recurrent Networks | ||
M, 10/11 | No class, Indigenous Peoples' Day | ||
W, 10/13 | Word Embeddings | recording | |
F, 10/15 | Feed-forward Language Models | recording | |
Week 7 | Recurrent Networks, Sequence-to-Sequence Models | ||
M, 10/18 | Recurrent Neural Networks | recording | |
W, 10/20 | LSTMs and GRUs | recording | |
F, 10/22 | Machine translation | recording | |
Week 8 | Sequence-to-Sequence Models | ||
M, 10/25 | Attention | recording | |
W, 10/27 | Transformers | recording | |
F, 10/29 | Transformers, Graph neural networks | recording | |
Week 9 | Self-supervised Learning, Generative Models | ||
M, 11/1 | Graph neural networks | recording | |
W, 11/3 | Guest Lecture by Dr. Been Kim | recording | |
F, 11/5 | Self-supervised Learning, Variational Autoencoders | recording | |
Week 10 | Generative Models | ||
M, 11/8 | Variational Autoencoders (2) | recording | |
W, 11/10 | Generative adversarial networks | recording | |
F, 11/12 | Introduction to reinforcement learning | recording | |
Week 11 | Reinforcement Learning | ||
M, 11/15 | (Deep) Q-Learning | recording | |
W, 11/17 | Guest Lecture by Prof. Shuran Song | recording | |
F, 11/19 | Policy gradient methods | recording | |
Week 12 | Thanksgiving Week | ||
M, 11/22 | Actor-critic Method | recording | |
W, 11/24 | No class ,Thanksgiving 🦃🦃🦃 | ||
F, 11/26 | No class, Thanksgiving 🦃🦃🦃 | ||
Week 13 | Reinforcement Learning | ||
M, 11/29 | Chen shares his research | recording | |
W, 12/1 | Miscellaneous Topics | recording | |
F, 12/3 | Guest Lecture by Prof. Hang Zhao | recording | |
Week 14 | Reinforcement Learning | ||
M, 12/6 | Guest Lecture by Prof. David Bau | recording | |
W, 12/8 | Conclusion | pdf / STA | recording |
F, 12/10 | Deep Learning Day |