Eye in-painting using WGAN-GP for face images with mosaic

Cheng-Hsuan Wu; Hsien-Tsung Chang; Ammar Amjad

doi:10.1117/12.2580635

10 November 2020 Eye in-painting using WGAN-GP for face images with mosaic

Cheng-Hsuan Wu, Hsien-Tsung Chang, Ammar Amjad

Proceedings Volume 11584, 2020 International Conference on Image, Video Processing and Artificial Intelligence; 115840O (2020) https://doi.org/10.1117/12.2580635
Event: Third International Conference on Image, Video Processing and Artificial Intelligence, 2020, Shanghai, China

Abstract

In order to protect personal privacy, news reports often use the mosaics upon the face of the protagonist in the photo. However, readers will feel uncomfortable and awkward to this kind of photos. In this research, we detect the eye mosaic and try to use eye complementing which is not the same with original picture but matches the nearby texture. It can arouse readers' interest in reading. Traditional in-painting research is not suitable for filling special or large objects, such as eyes or boxes on the ground. They only can fill a small area of missing parts or a single background refer to nearby textures, such as landscape photos. We use WGAN-GP that can refer to nearby textures to generate special objects for in-painting eyes. We also divide the training set into male and female according to gender to avoid eye makeup appearing in all pictures. The experiment result shows our method get higher score in blind testing.

Citation Download Citation

Cheng-Hsuan Wu, Hsien-Tsung Chang, and Ammar Amjad "Eye in-painting using WGAN-GP for face images with mosaic", Proc. SPIE 11584, 2020 International Conference on Image, Video Processing and Artificial Intelligence, 115840O (10 November 2020); https://doi.org/10.1117/12.2580635

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available