On-chip normal flow computation with aperture problem compensation circuitry

Viktor Gruev; Ralph Etienne-Cummings

doi:10.1117/12.609531

31 May 2005 On-chip normal flow computation with aperture problem compensation circuitry

Proceedings Volume 5783, Infrared Technology and Applications XXXI; (2005) https://doi.org/10.1117/12.609531
Event: Defense and Security, 2005, Orlando, Florida, United States

Abstract

Extracting relevant visual information about the operating environment of a roving robot at the focal plane is a challenging problem. We present two image processing architectures for motion computation at the focal plane. The first imaging architecture, composed of 250 x 250 active pixel sensors, has spatiotemporal difference computation capabilities at the focal plane. This spatiotemporal difference imager, fabricated in a 0.35μ process, contains in-pixel storage elements for previous and current frames and difference computational units outside the imaging array. A novel scan out technique allows for parallel computation of spatial and temporal 1-D derivatives on the read out. The final motion estimation based on the image brightness constancy equation, which is approximated as the ratio of the temporal and spatial derivates, is computed off chip, but it can be easily implemented on-chip. This approach can only determine the motion component normal to the spatial gradient. In order to address this ill-posed problem, known as the aperture problem, we propose a second imaging architecture, which is an extension of the first imaging architecture. The latter imaging architecture contains in-pixel memory for storing partial computational results. Hence, the motion vectors are stored back into the pixel memories after an initial scan; iterative algorithms can be applied to the stored computational results to solve the aperture problem. Experimental data from both imaging architectures are presented to validate the accuracy of the magnitude and angle of the computed target velocities.

Citation Download Citation

Viktor Gruev and Ralph Etienne-Cummings "On-chip normal flow computation with aperture problem compensation circuitry", Proc. SPIE 5783, Infrared Technology and Applications XXXI, (31 May 2005); https://doi.org/10.1117/12.609531

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Imaging systems

Transistors

Computer architecture

Sensors

Motion estimation

Image processing

Capacitors

Show All Keywords

Keywords/Phrases

Search In:

Publication Years