CPSC 5XX - Numerical Optimization for Machine Learning (July, 2022)

• July 7: How many iterations of gradient descent do we need? (Related papers: Cauchy's 1847 paper, Lipschitz relationships, practical line-searches, PL condition)
• July 14: Momentum, acceleration, and second-order methods.

• Convex Sets and Convex Functions (norms, linear/quadratic gradients/Hessians).