Bayesian optimisation in many dimensions with bespoke probabilistic programs
- đ¤ Speaker: Valentin Dalibart
- đ Date & Time: Friday 10 February 2017, 11:00 - 12:00
- đ Venue: CBL Room BE-438, Department of Engineering
Abstract
In this talk, I will present a collection of techniques to make Bayesian optimisation converge in grey-box optimisation problems with many dimensions. First, I will discuss how better priors of the objective function can lead to orders of magnitude improvements in convergence. I will use probabilistic programming to build probabilistic models that have good convergence and can leverage many observable properties of the objective function for inference. I will introduce a class of probabilistic programs that are both useful for Bayesian optimisation and support inference at a reasonable computational cost. Second, I will discuss techniques to help the numerical optimisation stage of the Bayesian optimisation converge, when algorithms such as DIRECT or CMA -ES are not sufficient.
I will present applications of these techniques to optimise the configuration of computer systems, such as TensorFlow, and maximise their computational performance. The techniques will be exemplified using the BOAT framework (a framework to build BespOke Auto-Tuners) which is open source and available at https://github.com/VDalibard/BOAT.
Series This talk is part of the Machine Learning @ CUED series.
Included in Lists
- All Talks (aka the CURE list)
- Biology
- bld31
- Cambridge Centre for Data-Driven Discovery (C2D3)
- Cambridge Forum of Science and Humanities
- Cambridge Language Sciences
- Cambridge Neuroscience Seminars
- Cambridge talks
- CBL important
- CBL Room BE-438, Department of Engineering
- Chris Davis' list
- Creating transparent intact animal organs for high-resolution 3D deep-tissue imaging
- dh539
- dh539
- Featured lists
- Guy Emerson's list
- Hanchen DaDaDash
- Inference Group Summary
- Information Engineering Division seminar list
- Interested Talks
- Joint Machine Learning Seminars
- Life Science
- Life Sciences
- Machine Learning @ CUED
- Machine Learning Summary
- ML
- ndk22's list
- Neuroscience
- Neuroscience Seminars
- Neuroscience Seminars
- ob366-ai4er
- Required lists for MLG
- rp587
- Seminar
- Simon Baker's List
- Stem Cells & Regenerative Medicine
- Trust & Technology Initiative - interesting events
- yk373's list
- yk449
Note: Ex-directory lists are not shown.
![[Talks.cam]](/static/images/talkslogosmall.gif)


Friday 10 February 2017, 11:00-12:00