Advanced human machine interaction for an image interpretation workstation

S. Maier; M. Martin; F. van de Camp; E. Peinsipp-Byma; J. Beyerer

doi:10.1117/12.2223565

12 May 2016 Advanced human machine interaction for an image interpretation workstation

S. Maier, M. Martin, F. van de Camp, E. Peinsipp-Byma, J. Beyerer

Proceedings Volume 9851, Next-Generation Analyst IV; 985105 (2016) https://doi.org/10.1117/12.2223565
Event: SPIE Defense + Security, 2016, Baltimore, MD, United States

Abstract

In recent years, many new interaction technologies have been developed that enhance the usability of computer systems and allow for novel types of interaction. The areas of application for these technologies have mostly been in gaming and entertainment. However, in professional environments, there are especially demanding tasks that would greatly benefit from improved human machine interfaces as well as an overall improved user experience. We, therefore, envisioned and built an image-interpretation-workstation of the future, a multi-monitor workplace comprised of four screens. Each screen is dedicated to a complex software product such as a geo-information system to provide geographic context, an image annotation tool, software to generate standardized reports and a tool to aid in the identification of objects. Using self-developed systems for hand tracking, pointing gestures and head pose estimation in addition to touchscreens, face identification, and speech recognition systems we created a novel approach to this complex task. For example, head pose information is used to save the position of the mouse cursor on the currently focused screen and to restore it as soon as the same screen is focused again while hand gestures allow for intuitive manipulation of 3d objects in mid-air. While the primary focus is on the task of image interpretation, all of the technologies involved provide generic ways of efficiently interacting with a multi-screen setup and could be utilized in other fields as well. In preliminary experiments, we received promising feedback from users in the military and started to tailor the functionality to their needs

Citation Download Citation

S. Maier, M. Martin, F. van de Camp, E. Peinsipp-Byma, and J. Beyerer "Advanced human machine interaction for an image interpretation workstation", Proc. SPIE 9851, Next-Generation Analyst IV, 985105 (12 May 2016); https://doi.org/10.1117/12.2223565

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available