May 6, 2017 22:00
Abstract
Title: Implicit Regularization in Matrix Factorization
Abstract: This talk will explore ideas on “implicit regularization” in under-determined problems where the optimization objective has multiple global minima. We specifically study optimization of a quadratic loss over a matrix with gradient descent on the factorized space. We conjecture and provide empirical and theoretical evidence that with small enough step sizes and initialization close enough to the origin, gradient descent on a full dimensional factorization converges to the minimum nuclear norm solution.
More Information
| Date | June 14, 2017 (Wed) 14:00 - 15:00 |
| URL | https://c5dc59ed978213830355fc8978.doorkeeper.jp/events/60343 |
