CMA-ES – a Stochastic Second-Order Method for Function-Value FreeNumerical Optimization

Add to your list(s) Download to your calendar using vCal

• Nikolaus Hansen, INRIA
• Wednesday 09 November 2011, 14:00-15:00
• Small lecture theatre, Microsoft Research Ltd, 7 J J Thomson Avenue (Off Madingley Road), Cambridge.

If you have a question about this talk, please contact Microsoft Research Cambridge Talks Admins.

This event may be recorded and made available internally or externally via http://research.microsoft.com. Microsoft will own the copyright of any recordings made. If you do not wish to have your image/voice recorded please consider this before attending

We consider black-box optimization with little assumptions on the underlying objective function. Further, we consider sampling from a distribution to obtain new candidate solutions. Under mild assumptions, solving the original black-box optimization problem coincides with optimizing a parametrized family of distributions of our choice. Choosing the family of multivariate normal distributions on the continuous search domain, a natural gradient descent on this family leads to an instantiation of the so-called CMA ES algorithm (covariance matrix adaptation evolution strategy). In this talk, the continuous black-box optimization problem will be introduced and the CMA -ES algorithm will be illustrated. The CMA -ES adapts a second-order model of the underlying objective function. On convex-quadratic functions, the resulting covariance matrix resembles the inverse Hessian matrix of the function. In contrast to Quasi-Netwon methods, this can be accomplished derivative and even function-value free. The CMA -ES reveals the same invariance properties as the famous Nelder-Mead simplex downhill method, is robust and works reliably not only in low dimensions and is surprisingly efficient on convex as well as non-convex, highly ill-conditioned problems.

This talk is part of the Microsoft Research Cambridge, public talks series.

This talk is included in these lists:

• All Talks (aka the CURE list)
• Cambridge Big Data
• Cambridge University Engineering Department Talks
• Centre for Smart Infrastructure & Construction
• Chris Davis' list
• Featured lists
• Guy Emerson's list
• Methodology in design research
• Microsoft Research Cambridge, public talks
• PMRFPS's
• School of Technology
• Small lecture theatre, Microsoft Research Ltd, 7 J J Thomson Avenue (Off Madingley Road), Cambridge
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• rp587

Note that ex-directory lists are not shown.