×

Smooth minimization of non-smooth functions. (English) Zbl 1079.90102

Summary: In this paper we propose a new approach for constructing efficient schemes for non-smooth convex optimization. It is based on a special smoothing technique, which can be applied to functions with explicit max-structure. Our approach can be considered as an alternative to black-box minimization. From the viewpoint of efficiency estimates, we manage to improve the traditional bounds on the number of iterations of the gradient schemes from \(O(\frac1{\varepsilon^2})\) to \(O(\frac 1\varepsilon)\), keeping basically the complexity of each iteration unchanged.

MSC:

90C25 Convex programming
90C60 Abstract computational complexity for mathematical programming problems
49J52 Nonsmooth analysis
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Ben-Tal, A., Nemirovskii, A.: Lectures on Modern Convex Optimization: Analysis, Algorithms, and Engineering Applications. (SIAM, Philadelphia, 2001) · Zbl 0986.90032
[2] Bertsekas, D.P.: Constrained optimization and Lagrange multiplier methods. (Academic Press, New York, 1982) · Zbl 0572.90067
[3] Goffin, J.-L.: On the convergence rate of subgradient optimization methods. Mathematical Programming 13, 329-347 (1977) · Zbl 0368.90119 · doi:10.1007/BF01584346
[4] Hiriart-Urruty, J.-B., Lemarechal, C.: Convex Analysis and Minimization Algorithms. (Springer-Verlag, 1993)
[5] Polyak, B.: On Bertsekas? method for minimization of composite function. In: Bensoussan, A., Lions, J.L. (eds) Inter. Symp. Systems Opt. 1979, Analysis Springer, pp. 179-186
[6] Polyak, R.: Nonlinear rescaling vs. smoothing technique in convex optimization. Mathematical Programming Ser. A 92, 197-235 (2002) · Zbl 1022.90014 · doi:10.1007/s101070100293
[7] Polyak, B.: Introduction to Optimization. (Optimization Software, Inc., Publications Division, New York, 1987) · Zbl 0708.90083
[8] Nemirovsky, A., Yudin, D.: Informational Complexity and Efficient Methods for Solution of Convex Extremal Problems. (J. Wiley & Sons, New York, 1983)
[9] Nesterov, Yu.: A method for unconstrained convex minimization problem with the rate of convergence Doklady AN SSSR (translated as Soviet Math. Docl.) 269, 543-547 (1983)
[10] Nesterov, Yu.: Introductory Lectures on Convex Optimization: Basic course. (Kluwer, Boston, 2003)
[11] Shor, N.: Minimization Methods for Non-Differentiable Functions. (Springer-Verlag, Berlin, 1985) · Zbl 0561.90058
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.