Fusion-based depth estimation from a sequence of monocular images

Jen-yu Shieh; Hanqi Zhuang; Raghavan Sudhakar

doi:10.1117/12.135080

1 March 1992 Fusion-based depth estimation from a sequence of monocular images

Jen-yu Shieh, Hanqi Zhuang, Raghavan Sudhakar

Proceedings Volume 1608, Intelligent Robots and Computer Vision X: Neural, Biological, and 3-D Methods; (1992) https://doi.org/10.1117/12.135080
Event: Robotics '91, 1991, Boston, MA, United States

Abstract

This paper reports the development of a general depth estimation system directly using image sequence. We combine the direct depth estimation method with the optical flow based method. More specifically, the optical flow on or near moving edges are computed using a correlation technique. The optical flow information is then fused with gradient information to estimate depth not only on moving edges but also in internal regions. The depth estimation problem is formulated as a discrete Kalman filter problem and is solved in three stages. In the prediction stage, the depth map estimated for the current frame, together with knowledge of the camera motion, are used to predict the depth variance at each pixel in the next frame. In the estimation stage, a vector-version of Kalman filter formulation is adopted and then simplified under the assumption of a diagonized error covariance. The resulting estimation algorithm takes into account of the information from the neighboring pixels and therefore is much more robust than the scalar-version Kalman filter implementation. In the smoothing stage, morphological filtering is applied to the estimated depth map to reduce the measurement noise and fill in the untrustable areas based on the error covariance information. Simulation results illustrate the effectiveness of the presented method.

Citation Download Citation

Jen-yu Shieh, Hanqi Zhuang, and Raghavan Sudhakar "Fusion-based depth estimation from a sequence of monocular images", Proc. SPIE 1608, Intelligent Robots and Computer Vision X: Neural, Biological, and 3-D Methods, (1 March 1992); https://doi.org/10.1117/12.135080

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available