A point cloud based pipeline for depth reconstruction from autostereoscopic sets

Cédric Niquin; Stéphanie Prévost; Yannick Remion

doi:10.1117/12.838844

24 February 2010 A point cloud based pipeline for depth reconstruction from autostereoscopic sets

Cédric Niquin, Stéphanie Prévost, Yannick Remion

Proceedings Volume 7524, Stereoscopic Displays and Applications XXI; 75241O (2010) https://doi.org/10.1117/12.838844
Event: IS&T/SPIE Electronic Imaging, 2010, San Jose, California, United States

Abstract

This is a three step pipeline to construct a 3D mesh of a scene from a set of N images, destined to be viewed on auto-stereoscopic displays. The first step matches the pixels to create a point cloud using a new algorithm based on graph-cuts. It exploits the data redundancy of the N images to ensure the geometric consistency of the scene and to reduce the graph complexity, in order to speed up the computation. It performs an accurate detection of occlusions and its results can then be used in applications like view synthesis. The second step slightly moves the points along the Z-axis to refine the point cloud. It uses a new cost including both occlusion positions and light variations deduced from the matching. The Z values are selected using a dynamic programming algorithm. This step finally generates a point cloud, which is fine enough for applications like augmented reality. From any of the two previously defined point clouds, the last step creates a colored mesh, which is a convenient data structure to be used in graphics APIs. It also generates N depth maps, allowing a comparison between the results of our method with those of other methods.

Citation Download Citation

Cédric Niquin, Stéphanie Prévost, and Yannick Remion "A point cloud based pipeline for depth reconstruction from autostereoscopic sets", Proc. SPIE 7524, Stereoscopic Displays and Applications XXI, 75241O (24 February 2010); https://doi.org/10.1117/12.838844

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available