University of Cambridge > Talks.cam > Microsoft Research Cambridge, public talks > Probabilistic Line Searches for Stochastic Optimisation.

  Browse A-Z

Log in

University Account External (via Google)

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹ️ Information

Probabilistic Line Searches for Stochastic Optimisation.

Download to your calendar using vCal

If you have a question about this talk, please contact Microsoft Research Cambridge Talks Admins .

 Please be aware that this event may be recorded. Microsoft will own the copyright of any recording and reserves the right to distribute it as required.

In deterministic optimisation, line searches are a standard tool ensuring stability and efficiency. Where only stochastic gradients are available, no direct equivalent has so far been formulated, because uncertain gradients do not allow for a strict sequence of decisions collapsing the search space. We construct a probabilistic line search by combining the structure of existing deterministic methods with notions from Bayesian optimization. Our method retains a Gaussian process surrogate of the univariate optimization objective, and uses a probabilistic belief over the Wolfe conditions to monitor the descent. The algorithm has very low computational cost, and no user-controlled parameters. Experiments show that it effectively removes the need to define a learning rate for stochastic gradient descent. Paper available: http://arxiv.org/abs/1502.02846

This talk is part of the Microsoft Research Cambridge, public talks series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

PMP Project seminars Google is taking over Curtis Auditorium, Clare College, University of Cambridge

Other talks

Tea and Coffee Break Fairy Tales Diasporic Divas: Performing Race, Gender, and Sexuality from the 18th Century to Today Quantum graphs with a time asymmetry: spectral optimization and spectral statistics Why people with schizophrenia die earlier? Mortality and accelerated ageing Classical Reductions and Converse Bounds in Quantum Hypothesis Testing
 

© 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity