Winter 2025
  • Canvas
  • Gradescope
  • Syllabus
  • Prior Years
    • Winter 2023

CSCI 1051: Deep Learning

Deep learning from theoretical foundations to state-of-the-art applications.


Instructor: R. Teal Witter. Please call me Teal.

Class Times: We meet Monday, Tuesday, Wednesday, and Thursday in 75 Shannon St Room 202. The lecture is from 10am to noon and the discussion is from 2 to 4pm.

Office Hours: I will hold office hours in 75 Shannon St Room 221 from 3 to 4pm.

Participation: I expect you to engage in class, ask questions, and make connections. So I can check in with you, please fill out this form every lecture.

Scribed Notes: Notes are a great resource for augmenting your in-class learning. Since I updated the material in this course, I would like to ask for your help in writing these notes. You can find the assignment here.

Assignments: You will receive one problem per class. I expect you to solve the problem with your group during the discussion (I’ll be there to answer questions). Once you have solved the problem, you should write up your solution on your own. In addition, there will be a project on a lecture topic of your choice.

Assignment Due
Problem Set 1 (LaTeX) Friday 1/10
Problem Set 2 (LaTeX) Friday 1/17
Problem Set 3 (LaTeX) Friday 1/24
Problem Set 4 (LaTeX) Wednesday 1/29
Project Proposal Sunday 1/26
Project Friday 1/31
Class Topic Slides Resources
The Three-Step Framework
Monday 1/6 Linear Regression and Mean Squared Error Slides My Notes
Tuesday 1/7 Logistic Regression and Cross Entropy Loss Slides Student Notes
Wednesday 1/8 Gradient Descent and Neural Networks Slides Chinmay’s Notes
Thursday 1/9 Back-propagation and Optimization Slides Chinmay’s Notes
Language Generation
Monday 1/13 Language Embeddings and Contrastive Learning Slides
Tuesday 1/14 Transformers and Positional Encoding Slides Student Notes
Wednesday 1/15 Low Rank Approximation Slides Student Notes
Thursday 1/16 Watermarking Slides Student Notes
Image Generation
Tuesday 1/21 Convolutional Neural Networks and Image Embeddings Slides Student Notes
Wednesday 1/22 Diffusion Slides Student Notes
Thursday 1/23 Schrödinger Bridges and CLIP Slides Student Notes
AI Safety
Monday 1/27 Interpretability Slides Student Notes
Tuesday 1/28 Project Preparation
Wednesday 1/29 Project Preparation
Thursday 1/30 Project Presentations