Phase-based frame rate up-conversion for depth video

Lunan Zhou; Rui Sun; Xiang Tian; Yaowu Chen

doi:10.1117/1.JEI.27.4.043036

2 August 2018 Phase-based frame rate up-conversion for depth video

Lunan Zhou, Rui Sun, Xiang Tian, Yaowu Chen

Author Affiliations +

Journal of Electronic Imaging, Vol. 27, Issue 4, 043036 (August 2018). https://doi.org/10.1117/1.JEI.27.4.043036

Abstract

Due to the limits of frame rate sampling like time-of-flight and transmission bandwidth constraints of depth video, depth frame rate up-conversion is imperative. Most researches interpolate the depth frames using the motion information of the texture images, which require well-rectified images. They usually find dense correspondences to synthesize an in-between frame. Estimating the correspondences is sensitive to occlusion, disocclusion, and color or luminance changes. This paper proposes a phase-based method to interpolate depth frames without explicitly finding correspondences. Combining top-down phase difference preservation and bottom-up phase difference correction, varying amounts of motions are well modeled in a complex-steerable pyramid decomposition. The pixel amplitude is also shifted and interpolated based on the phase information. Finally, a depth value correction is employed to correct the inaccurate depth value. Experimental results show that the depth video interpolated by our proposed approach provides better subjective and objective qualities.

Citation Download Citation

Lunan Zhou, Rui Sun, Xiang Tian, and Yaowu Chen "Phase-based frame rate up-conversion for depth video," Journal of Electronic Imaging 27(4), 043036 (2 August 2018). https://doi.org/10.1117/1.JEI.27.4.043036

Received: 19 April 2018; Accepted: 16 July 2018; Published: 2 August 2018

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available