05362683

a

05362683 Butko, Taras Temko, Andrey Nadeu, Climent Canton, Cristian Inclusion of video information for detection of acoustic events using the fuzzy integral. Popescu-Belis, Andrei (ed.) et al., Machine learning for multimodal interaction. 5th international workshop, MLMI 2008, Utrecht, The Netherlands, September 8--10, 2008. Proceedings. Berlin: Springer (ISBN 978-3-540-85852-2/pbk). Lecture Notes in Computer Science 5237, 74-85 (2008). 2008 Berlin: Springer EN acoustic event detection fuzzy integral multimodality support vector machines hidden Markov models video 3D tracking

doi:10.1007/978-3-540-85853-9_7

Summary: When applied to interactive seminars, the detection of acoustic events from only audio information shows a large amount of errors, which are mostly due to the temporal overlaps of sounds. Video signals may be a useful additional source of information to cope with that problem for particular events. In this work, we aim at improving the detection of steps by using two audio-based Acoustic Event Detection (AED) systems, with SVM and HMM, and a video-based AED system, which employs the output of a 3D video tracking algorithm. The fuzzy integral is used to fuse the outputs of the three detection systems. Experimental results using the CLEAR 2007 evaluation data show that video information can be successfully used to improve the results of audio-based AED.