Face recognition on 3D point clouds

Ziyu Zhang; Feipeng Da; Chenxing Wang; Jian Yu; Yi Yu

doi:10.1117/12.2541704

16 October 2019 Face recognition on 3D point clouds

Ziyu Zhang, Feipeng Da, Chenxing Wang, Jian Yu, Yi Yu

Proceedings Volume 11205, Seventh International Conference on Optical and Photonic Engineering (icOPEN 2019); 112051O (2019) https://doi.org/10.1117/12.2541704
Event: Seventh International Conference on Optical and Photonic Engineering (icOPEN 2019), 2019, Phuket, Thailand

Abstract

Point cloud has achieved great attention in 3D object classification, segmentation and indoor scene semantic parsing. In terms of face recognition, although image-based algorithm become more accurate and faster, open world face recognition still suffers from the influences i.e. illumination, occlusion, pose, etc. 3D face recognition based on point cloud containing both shape and texture information can compensate these shortcomings. However training a network to extract discriminative 3D feature is model complex and time inefficient due to the lack of large training dataset. To address these problems, we propose a novel 3D face recognition network(FPCNet) using modified PointNet++ and a 3D augmentation technique. Face-based loss and multi-label loss are used to train the FPCNet to enhance the learned features more discriminative. Moreover, a 3D face data augmentation method is proposed to synthesize more identity-variance and expression-variance 3D faces from limited data. Our proposed method shows excellent recognition results on CASIA-3D, Bosphorus and FRGC2.0 datasets and generalizes well for other datasets.

Citation Download Citation

Ziyu Zhang, Feipeng Da, Chenxing Wang, Jian Yu, and Yi Yu "Face recognition on 3D point clouds", Proc. SPIE 11205, Seventh International Conference on Optical and Photonic Engineering (icOPEN 2019), 112051O (16 October 2019); https://doi.org/10.1117/12.2541704

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available