1. The Big Table of Convergence Rates

    Fri 01 August 2014

    In the past 50+ years of convex optimization research, a great many algorithms have been developed, each with slight nuances to their assumptions, implementations, and guarantees. In this article, I'll give a shorthand comparison of these methods in terms of the number of iterations required to reach a desired accuracy …