CPSC 5XX - Numerical Optimization for Machine Learning (July, 2022)
Thursdays at 3pm in ICICS X836.
July 7:
How many iterations of gradient descent do we need?
(Related papers:
Cauchy's 1847 paper
,
Lipschitz relationships
,
practical line-searches
,
PL condition
)
July 14: Momentum, acceleration, and second-order methods.
Additional notes:
Convex Sets and Convex Functions
(
norms
,
linear/quadratic gradients/Hessians
).
Mark Schmidt
>
Courses
> CPSC 5XX