Approximate level method

Peter Richtarik, CORE

Abstract:
In this paper we propose and analyze a variant of the level method, which is an algorithm for minimizing nonsmooth convex functions. The main work per iteration is spent on 1) minimizing a piecewise-linear model of the objective function and on 2) projecting onto a polyhedron arising as a level set of the model. We show that by replacing exact computations in both cases by approximate computations, in relative scale, the theoretical iteration complexity increases only by the factor of four. This means that while spending less work on the subproblems, the new approach still retains the good theoretical properties of the algorithm.