Video to the rescue of audio: shot boundary assisted speaker change detection

Amjad Samour; Mustafa Karaman; Lutz Goldmann; Thomas Sikora

doi:10.1117/12.703114

29 January 2007 Video to the rescue of audio: shot boundary assisted speaker change detection

Amjad Samour, Mustafa Karaman, Lutz Goldmann, Thomas Sikora

Proceedings Volume 6506, Multimedia Content Access: Algorithms and Systems; 650609 (2007) https://doi.org/10.1117/12.703114
Event: Electronic Imaging 2007, 2007, San Jose, CA, United States

Abstract

Speaker change detection (SCD) is a preliminary step for many audio applications such as speaker segmentation and recognition. Thus, its robustness is crucial to achieve a good performance in the later steps. Especially, misses (false negatives) affect the results. For some applications, domain-specific characteristics can be used to improve the reliability of the SCD. In broadcast news and discussions, the cooccurrence of shot boundaries and change points provides a robust clue for speaker changes. In this paper, two multimodal approaches are presented that utilize the results of a shot boundary detection (SBD) step to improve the robustness of the SCD. Both approaches clearly outperform the audio-only approach and are exclusively applicable for TV broadcast news and plenary discussions.

Citation Download Citation

Amjad Samour, Mustafa Karaman, Lutz Goldmann, and Thomas Sikora "Video to the rescue of audio: shot boundary assisted speaker change detection", Proc. SPIE 6506, Multimedia Content Access: Algorithms and Systems, 650609 (29 January 2007); https://doi.org/10.1117/12.703114

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available