Accurate and real-time depth video acquisition using Kinect–stereo camera fusion

Williem Williem; Yu-Wing Tai; In Kyu Park

doi:10.1117/1.OE.53.4.043110

30 April 2014 Accurate and real-time depth video acquisition using Kinect–stereo camera fusion

Williem Williem, Yu-Wing Tai, In Kyu Park

Author Affiliations +

Funded by: National Research Foundation of Korea (NRF) funded by the Ministry of Education

Optical Engineering, Vol. 53, Issue 4, 043110 (April 2014). https://doi.org/10.1117/1.OE.53.4.043110

Abstract

This paper presents a Kinect–stereo camera fusion system that significantly improves the accuracy of depth map acquisition. The typical Kinect depth map suffers from missing depth values and errors, resulting from a single Kinect input. To ameliorate such problems, the proposed system couples a Kinect with a stereo RGB camera to provide an additional disparity map. Kinect depth map and the disparity map are efficiently fused in real time by exploiting a spatiotemporal Markov random field framework on a graphics processing unit. An efficient temporal data cost is proposed to maintain the temporal coherency between frames. We demonstrate the performance of the proposed system on challenging real-world examples. Experimental results confirm that the proposed system is robust and accurate in depth video acquisition.

Citation Download Citation

Williem Williem, Yu-Wing Tai, and In Kyu Park "Accurate and real-time depth video acquisition using Kinect–stereo camera fusion," Optical Engineering 53(4), 043110 (30 April 2014). https://doi.org/10.1117/1.OE.53.4.043110

Published: 30 April 2014

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE