Lectures
Lectures
Time: MWF 12:00pm – 12:50pmLocation: Solomon DECI (Room 101)
Course offered in person with recordings made available for the online session. Zoom will be used for some invited speakers.
| Date | Topic | Slides | Recording |
|---|---|---|---|
| Week 1 | Introduction | ||
| W, 9/8 | Rosh Hashanah, no class | ||
| F, 9/10 | Introduction to deep learning | ||
| Week 2 | Deep Learning Fundamentals | ||
| M, 9/13 | Perceptrons | recording | |
| W, 9/15 | Loss functions and backpropagation | recording | |
| F, 9/17 | Optimization I | recording | |
| Week 3 | Feed-Forward Neural Networks + Tensorflow | ||
| M, 9/20 | Optimization II | recording | |
| W, 9/22 | AutoDiff, Life Cycle of Machine Learning Systems | recording | |
| F, 9/24 | Life Cycle of Machine Learning Systems | recording | |
| Week 4 | Convolutional Neural Networks | ||
| M, 9/27 | Deep Learning Hardware and Software | recording | |
| W, 9/29 | Introduction to Convolutional Neural Networks | recording | |
| F 10/1 | Convolutional neural networks, from MNIST to ImageNet (1) | recording | |
| Week 5 | CNNs, Language Models | ||
| M, 10/4 | Convolutional neural networks, from MNIST to ImageNet (2) | recording | |
| W, 10/6 | Training convolutional neural networks | recording | |
| F, 10/8 | Training convolutional neural networks (2) | recording | |
| Week 6 | Language Models, Recurrent Networks | ||
| M, 10/11 | No class, Indigenous Peoples' Day | ||
| W, 10/13 | Word Embeddings | recording | |
| F, 10/15 | Feed-forward Language Models | recording | |
| Week 7 | Recurrent Networks, Sequence-to-Sequence Models | ||
| M, 10/18 | Recurrent Neural Networks | recording | |
| W, 10/20 | LSTMs and GRUs | recording | |
| F, 10/22 | Machine translation | recording | |
| Week 8 | Sequence-to-Sequence Models | ||
| M, 10/25 | Attention | recording | |
| W, 10/27 | Transformers | recording | |
| F, 10/29 | Transformers, Graph neural networks | recording | |
| Week 9 | Self-supervised Learning, Generative Models | ||
| M, 11/1 | Graph neural networks | recording | |
| W, 11/3 | Guest Lecture by Dr. Been Kim | recording | |
| F, 11/5 | Self-supervised Learning, Variational Autoencoders | recording | |
| Week 10 | Generative Models | ||
| M, 11/8 | Variational Autoencoders (2) | recording | |
| W, 11/10 | Generative adversarial networks | recording | |
| F, 11/12 | Introduction to reinforcement learning | recording | |
| Week 11 | Reinforcement Learning | ||
| M, 11/15 | (Deep) Q-Learning | recording | |
| W, 11/17 | Guest Lecture by Prof. Shuran Song | recording | |
| F, 11/19 | Policy gradient methods | recording | |
| Week 12 | Thanksgiving Week | ||
| M, 11/22 | Actor-critic Method | recording | |
| W, 11/24 | No class ,Thanksgiving 🦃🦃🦃 | ||
| F, 11/26 | No class, Thanksgiving 🦃🦃🦃 | ||
| Week 13 | Reinforcement Learning | ||
| M, 11/29 | Chen shares his research | recording | |
| W, 12/1 | Miscellaneous Topics | recording | |
| F, 12/3 | Guest Lecture by Prof. Hang Zhao | recording | |
| Week 14 | Reinforcement Learning | ||
| M, 12/6 | Guest Lecture by Prof. David Bau | recording | |
| W, 12/8 | Conclusion | pdf / STA | recording |
| F, 12/10 | Deep Learning Day |