Optimization for Machine Learning
M2 MIAGE ID Apprentissage, Université Paris Dauphine-PSL, 2024-2025
Aim of the course
Study the main optimization techniques used in machine learning and data science, as well as their underlying principles.
Course material
Lecture notes (updated regularly)
PDF
Exercise sheet 1 (Around gradient descent)
PDF with solutions
Exercise sheet 2 (Stochastic gradient)
PDF with solutions
Exercise sheet 3 (from 2023-2024 exam)
PDF
Virtual board 1 (Intro to optimization)
PDF
Virtual board 2 (Gradient descent)
PDF
Virtual board 3 (More on gradient descent)
PDF
Virtual board 4 (Stochastic gradient)
PDF
Lab material
Lab session 1
ZIP/
Solutions
Lab session 2
ZIP/
Solutions
Lab session 3
ZIP/
Solutions
Materials on this page are available under Creative Commons
CC BY-NC 4.0 license.
La version française de cette page se trouve
ici.