The Convolutional Neural Network in this example is classifying images live in your browser using Javascript, at about 10 milliseconds per image. It takes an input image and transforms it through a series of functions into class probabilities at the end. The transformed representations in this visualization can be loosely thought of as the activations of the neurons along the way. The parameters of this function are learned with backpropagation on a dataset of (image, label) pairs. This particular network is classifying
CIFAR-10 images into one of 10 classes and was trained with
ConvNetJS. Its exact architecture is [conv-relu-conv-relu-pool]x3-fc-softmax, for a total of 17 layers and 7000 parameters. It uses 3x3 convolutions and 2x2 pooling regions. By the end of the class, you will know exactly what all these numbers mean.
Course Description
Computer Vision has become ubiquitous in our society, with applications in search, image understanding, apps, mapping, medicine, drones, and self-driving cars. Core to many of these applications are visual recognition tasks such as image classification, localization and detection. Recent developments in neural network (aka “deep learning”) approaches have greatly advanced the performance of these state-of-the-art visual recognition systems. This course is a deep dive into the details of deep learning architectures with a focus on learning end-to-end models for these tasks, particularly image classification. During the 10-week course, students will learn to implement and train their own neural networks and gain a detailed understanding of cutting-edge research in computer vision. Additionally, the final assignment will give them the opportunity to train and apply multi-million parameter networks on real-world vision problems of their choice. Through multiple hands-on assignments and the final course project, students will acquire the toolset for setting up deep learning tasks and practical engineering tricks for training and fine-tuning deep neural networks.
Coursework
Prerequisites
- Proficiency in Python
All class assignments will be in Python (and use numpy) (we provide a tutorial here for those who aren't as familiar with Python). If you have a lot of programming experience but in a different language (e.g. C/C++/Matlab/Javascript) you will probably be fine.
- College Calculus, Linear Algebra (e.g. MATH 19 or 41, MATH 51)
You should be comfortable taking derivatives and understanding matrix vector operations and notation.
- Basic Probability and Statistics (e.g. CS 109 or other stats course)
You should know basics of probabilities, gaussian distributions, mean, standard deviation, etc.
Assignments (50%)
See the Assignment page for details regarding assignments, late days and collaboration policies.
Midterm (15%)
Detailed information regarding the midterm will be made available as an announcement on Piazza in the coming weeks.
Final Project (35%)
See the Project page for more details regarding the final course project.
Participation (3%)
We appreciate student participation in the class! We'll be awarding up to 3% in extra credit to the top ~20 Piazza contributors.
Regrade Requests
If you feel you deserved a better grade on an assignment, you may submit a regrade request on Gradescope within 3 days of the grade release. Your request should briefly summarize why you feel the original grade was unfair. Your TA will re-evaluate your assignment as soon as possible, and then issue a decision.
Late Policy
- All students have 4 free late days for the quarter.
- You may use up to 2 late days per assignment with no penalty.
- You may use late days for the assignments, project proposal, and project milestone.
- You may not use late days for the final project report.
-
Once you have exhausted your free late days, we will deduct a late penalty of 25% per additional late day.
- For example: you submit A1 one day late, submit A2 three days late, and submit A3 two days late.
You receive no penalty for A1, and exhaust one of your free late days.
For A2 the first two late days exhaust two of your free late days; the third day late incurs a 25% penalty.
For A2 the first late day exhausts your final free late day; the second late day incurs a 25% penalty.
- For the project proposal and milestone, we will deduct late days from each group member independently.
