Optimization for Machine Learning
M2 MIAGE ID Apprentissage, Université Paris Dauphine-PSL, 2024-2025
Aim of the course
Study the main optimization techniques used in machine learning and data science, as well as their underlying principles.
Course project (deadline: March 21, 2025)
Assignment
PDF
Course material
Lecture notes (updated regularly)
PDF
Exercise sheet 1 (Around gradient descent)
PDF with solutions
Exercise sheet 2 (Stochastic gradient)
PDF with solutions
Exercise sheet 3 (from 2023-2024 exam)
PDF Updated version with solutions
Virtual board 1 (Intro to optimization)
PDF
Virtual board 2 (Gradient descent)
PDF
Virtual board 3 (More on gradient descent)
PDF
Virtual board 4 (Stochastic gradient)
PDF
Lab material
Lab session 1
ZIP/
Solutions
Lab session 2
ZIP/
Solutions
Lab session 3
ZIP/
Solutions
Materials on this page are available under Creative Commons
CC BY-NC 4.0 license.
La version française de cette page se trouve
ici.