On the Benefits of Confidence Visualization in Speech Recognition

Add to your list(s) Download to your calendar using vCal

• Keith Vertanen and Per Ola Kristensson (University of Cambridge)
• Monday 17 March 2008, 11:15-11:30
• TCM Seminar Room, Cavendish Laboratory, Department of Physics.

If you have a question about this talk, please contact Philip Sterne.

In a typical speech dictation interface, the recognizer’s best-guess is displayed as normal, unannotated text. This ignores potentially useful information about the recognizer’s confidence in its recognition hypothesis. Using a confidence measure (which itself may sometimes be inaccurate), we investigated providing visual feedback about low-confidence portions of the recognition using shaded, red underlining. An evaluation showed, compared to a baseline without underlining, underlining low-confidence areas did not increase user’s speed or accuracy in detecting errors. However, we found that when recognition errors were correctly underlined, they were discovered significantly more often than baseline. Conversely, when errors failed to be underlined, they were discovered less often. Our results indicate confidence visualization can be effective – but only if the confidence measure has high accuracy. Further, since our results show that users tend to trust confidence visualization, designers should be careful in its application if a high accuracy confidence measure is not available.

The paper and videos can be found here

Even more details can be found in chapter 2 of my thesis

This will be a 10-minute CHI practice talk.

This talk is part of the Machine Learning Journal Club series.

This talk is included in these lists:

• Cambridge talks
• Guy Emerson's list
• Hanchen DaDaDash
• Inference Group Journal Clubs
• Inference Group Summary
• Interested Talks
• ML
• Machine Learning Journal Club
• Machine Learning Summary
• Quantum Matter Journal Club
• TCM Seminar Room, Cavendish Laboratory, Department of Physics
• TQS Journal Clubs
• rp587
• yk373's list

Note that ex-directory lists are not shown.