Investigating the interdependencies between DNN architectures and optimisation methods for Large Vocabulary Speech Continuous Speech Recognition

Add to your list(s) Download to your calendar using vCal

• Adnan Haider, University of Cambridge
• Monday 31 October 2016, 12:00-13:00
• Department of Engineering - LR3A.

If you have a question about this talk, please contact Anton Ragni.

The problem of Large Vocabulary Continuous Speech Recognition (LVCSR) can be cast as a general problem of supervised learning where given some seen examples, the task is to learn the relationship between the input space and the output space from the data. Ideally, we wish to choose a prediction function that avoids rote memorization and instead generalizes the concepts that can be learned from a given set of utterances. This involves choosing an appropriate prediction function from a space of predictive functions that minimizes a risk measure over an adequately selected family of prediction functions. In practice, rather than consider a variational optimization problem over a generic family of prediction functions, we assume that the prediction function has a fixed form which in the context of LVCSR corresponds to Hybrid HMM -Deep Neural Networks models of different network topologies. The focus of this work is to investigate an effective coupling between the use of various optimisation methods and network topologies for effective training of large hours of speech data. In this work, we will particularly investigate optimisation methods that try to combine the best properties of batch and stochastic algorithms while making careful considerations towards the computational time and number of updates.

This talk is part of the CUED Speech Group Seminars series.

This talk is included in these lists:

• CUED Speech Group Seminars
• Cambridge Centre for Data-Driven Discovery (C2D3)
• Cambridge Forum of Science and Humanities
• Cambridge Language Sciences
• Cambridge talks
• Chris Davis' list
• Department of Engineering - LR3A
• Guy Emerson's list
• Information Engineering Division seminar list
• Interested Talks
• PhD related
• Trust & Technology Initiative - interesting events
• bld31
• ndk22's list
• ob366-ai4er
• rp587

Note that ex-directory lists are not shown.