University of Cambridge > Talks.cam > Microsoft Research Cambridge, public talks > Bandits with Switching Costs: T^{2/3} Regret

  Browse A-Z

Log in

University Account External (via Google)

🔐 Log In

Information on

Subscribing to talksdetails Finding a talkdetails Adding a talkdetails Disseminating talksdetails Help and Documentationdetails

ℹ️ Information

Bandits with Switching Costs: T^{2/3} Regret

Download to your calendar using vCal

If you have a question about this talk, please contact Microsoft Research Cambridge Talks Admins .

This event may be recorded and made available internally or externally via http://research.microsoft.com. Microsoft will own the copyright of any recordings made. If you do not wish to have your image/voice recorded please consider this before attending

Consider the adversarial two-armed bandit problem in a setting where the player incurs a unit cost each time he switches actions. We prove that the player’s T-round regret in this setting (i.e., his excess loss compared to the better of the two actions) is T (up to a log term). In the corresponding full-information problem, the minimax regret is known to grow at a slower rate of T{1/2} . The difference between these two rates indicates that learning with bandit feedback (i.e. just knowing the loss from the player’s action, not the alternative) can be significantly harder than learning with full-information feedback. It also shows that without switching costs, any regret-minimizing algorithm for the bandit problem must sometimes switch actions very frequently. The proof is based on an information-theoretic analysis of a loss process arising from a multi-scale random walk.

(Joint work with Ofer Dekel, Jian Ding and Tomer Koren, to appear in STOC 2014 available at http://arxiv.org/abs/1310.2997)

This talk is part of the Microsoft Research Cambridge, public talks series.

This talk is included in these lists:

Note that ex-directory lists are not shown.

Other lists

MR21, Centre for Mathematical Sciences, Wilberforce Road, Cambridge Queens' college, Angevin room Lewin Stroke & Rehabilitation Unit, Seminar Room, R2, Addenbrooke's Hospital

Other talks

There is no such thing as weather: a historical and cultural geography of weather (and health) Teams Announced Dwarf Galaxies in the Local Universe CSAR lecture: Beyond Net Zero: Can We Repair The Climate? Quantum optics with organic molecules “Find him if you can!”: Havergal Brian’s The Tigers as ‘autobiopera’
 

© 2006-2025 Talks.cam, University of Cambridge. Contact Us | Help and Documentation | Privacy and Publicity