Audio-Visual Intent to Speak Detection for Human-Computer Interaction
P. de Cuetos, C. Neti, A. Senior
presented at ICASSP 2000, Istanbul 2000.
This paper introduces a practical system that aims to detect a user's intent to speak to a computer, by considering both audio and visual cues. The whole system is designed to intuitively turn on the microphone for speech recognition without needing to click on a mouse, thus improving the humanlike communication between users and computers. The first step is to detect a frontal face through a simple desktop video camera image, by using some wellknown image processing techniques for face and facial feature detection on one image. The second step is an audiovisual speech event detection that combines both visual and audio indications of speech. In this paper, we consider visual measures of speech activity as well as audio energy to determine if the previously detected user is actually speaking or not.