Optimized sign language video coding based on eye-tracking analysis

Dimitris Agrafiotis; C. Nishan Canagarajah; David R. Bull; Matt Dye; Helen Twyford; Jim Kyle; James Chung How

doi:10.1117/12.503107

23 June 2003 Optimized sign language video coding based on eye-tracking analysis

Dimitris Agrafiotis, C. Nishan Canagarajah, David R. Bull, Matt Dye, Helen Twyford, Jim Kyle, James Chung How

Proceedings Volume 5150, Visual Communications and Image Processing 2003; (2003) https://doi.org/10.1117/12.503107
Event: Visual Communications and Image Processing 2003, 2003, Lugano, Switzerland

Abstract

The imminent arrival of mobile video telephony will enable deaf people to communicate - as hearing people have been able to do for a some time now - anytime/anywhere in their own language sign language. At low bit rates coding of sign language sequences is very challenging due to the high level of motion and the need to maintain good image quality to aid with understanding. This paper presents optimised coding of sign language video at low bit rates in a way that will favour comprehension of the compressed material by deaf users. Our coding suggestions are based on an eye-tracking study that we have conducted which allows us to analyse the visual attention of sign language viewers. The results of this study are included in this paper. Analysis and results for two coding methods, one using MPEG-4 video objects and the second using foveation filtering are presented. Results with foveation filtering are very promising, offering a considerable decrease in bit rate in a way which is compatible with the visual attention patterns of deaf people, as these were recorded in the eye tracking study.

Citation Download Citation

Dimitris Agrafiotis, C. Nishan Canagarajah, David R. Bull, Matt Dye, Helen Twyford, Jim Kyle, and James Chung How "Optimized sign language video coding based on eye-tracking analysis", Proc. SPIE 5150, Visual Communications and Image Processing 2003, (23 June 2003); https://doi.org/10.1117/12.503107

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available