Skip to yearly menu bar Skip to main content


Orals and spotlights
in
Workshop: OPT 2021: Optimization for Machine Learning

Contributed talks in Session 4 (Zoom)

Quanquan Gu · Agnieszka Słowik · Jacques Chen · Neha Wadia · Difan Zou


Abstract:

Oral (10 min)

  • On the Relation between Distributionally Robust Optimization and Data Curation, Agnieszka Slowik

Spotlights (5 min)

  • Heavy-tailed noise does not explain the gap between SGD and Adam on Transformers, Jacques Chen
  • Optimization with Adaptive Step Size Selection from a Dynamical Systems Perspective, Neha Wadia
  • Understanding the Generalization of Adam in Learning Neural Networks with Proper Regularization, Difan Zou

There will be a Q&A in the last 5 minutes for all speakers. Abstracts for the talks are below the schedule.