Using deep learning to bridge the gap between perception and intelligence

Arne J. Suppé; Martial Hebert

doi:10.1117/12.2262252

5 May 2017 Using deep learning to bridge the gap between perception and intelligence

Arne J. Suppé, Martial Hebert

Proceedings Volume 10195, Unmanned Systems Technology XIX; 1019503 (2017) https://doi.org/10.1117/12.2262252
Event: SPIE Defense + Security, 2017, Anaheim, CA, United States

Abstract

We propose a method to for robot planning using deep learning to integrate object detection and natural language understanding. This is different from other techniques, such the RCTA World Model,¹ which explicitly defines the interfaces between each module. These boundaries simplify the design and testing of complex robotic systems, but also introduce constraints that may reduce overall system performance. For example, perception tasks generate large amounts of data, but much of it is discarded to simplify interpretation by higher level tasks, e.g., a 3D object becomes a point in space, or a distribution over classifications is reduced to its mode. Further, errors in the robot’s overal task are not back-propagated to lower level tasks, and therefore, these tasks never adapt themselves to improve robot performance. We intend to address this by using a deep learning framework to replace these interfaces with learned interfaces that select what data is shared between modules and allow for error back-propagation that could adapt each module to the robot’s task. We will do this in a simplified system that accepts aerial orthographic images and simple commands and generates paths to achieve the command. Paths are learned from expert example via inverse optimal control. In time, we hope to evolve this simplified architecture towards something more complex and practical.

Conference Presentation

Citation Download Citation

Arne J. Suppé and Martial Hebert "Using deep learning to bridge the gap between perception and intelligence", Proc. SPIE 10195, Unmanned Systems Technology XIX, 1019503 (5 May 2017); https://doi.org/10.1117/12.2262252

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available