CONFERENCE PROCEEDINGS
Advanced Search
Home > Proceedings > Volume 12509 > Article
Paper
12 January 2023 Improvements on style transfer from photographs to Chinese ink wash paintings based on generative adversarial networks
Tianyi Zhang
Author Affiliations +
Proceedings Volume 12509, Third International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI 2022); 125091I (2023) https://doi.org/10.1117/12.2656019
Event: Third International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI 2022), 2022, Guangzhou, China
Abstract
Although voids play an important role in Chinese paintings, when generating Chinese ink wash paintings from real life photos of horses, background detection and void-leaving remain challenges in producing more credible paintings. To address the problem, a model with a two-stage framework is proposed in this paper. The framework divides the generation process into background lightening and style transformation. In the first stage, by training a pix2pix model with paired original photos and background-lightened photos, the pix2pix model is enabled to detect and lighten the background correctly in the style-transfer process, hinting where voids should be left. In the second stage, a Cycle-GAN model trained with unmatched photos and Chinese paintings achieves the style-transfer from pre-processed photos to Chinese ink wash paintings. In preparation for training the stage-Ⅰ model, the photos from a given dataset is processed in batches to get corresponding background-lightened photos. During the training of the stage-Ⅱ model, original photos instead of processed photos is used as comparatively data augmentation, making the model more robust and independent. Compared to the baseline model, the proposed model reaches a higher accuracy in both void-leaving and detail-enhancing in the experiments, resulting in more credible and delicate generated Chinese paintings.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Citation Download Citation
Tianyi Zhang "Improvements on style transfer from photographs to Chinese ink wash paintings based on generative adversarial networks", Proc. SPIE 12509, Third International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI 2022), 125091I (12 January 2023); https://doi.org/10.1117/12.2656019
ACCESS THE FULL ARTICLE
ORGANIZATIONAL
Sign in with credentials provided by your organization.
INSTITUTIONAL
Select your institution to access the SPIE Digital Library.
SELECT YOUR INSTITUTION
PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.
PERSONAL SIGN IN
No SPIE Account? Create one
PURCHASE THIS CONTENT
SUBSCRIBE TO DIGITAL LIBRARY
50 downloads per 1-year subscription
Members: $195
Non-members: $335 ADD TO CART
25 downloads per 1 - year subscription
Members: $145
Non-members: $250 ADD TO CART
PURCHASE SINGLE ARTICLE
Includes PDF, HTML & Video, when available
Members: $17.00
Non-members: $21.00 ADD TO CART
PROCEEDINGS
 9 PAGES
DOWNLOAD PAPER SAVE TO MY LIBRARY
GET CITATION
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Data modeling
Performance modeling
Photography
Image processing
Data processing
Process modeling
RELATED CONTENT
Subscribe to Digital Library
Receive Erratum Email Alert
Back to Top