Chinese image description evaluation method based on target domain semantic constraints

Zhenhao Wang; Wenyi Sun; Zhengsong Wang; Le Yang

doi:10.1117/12.3000808

9 August 2023 Chinese image description evaluation method based on target domain semantic constraints

Zhenhao Wang, Wenyi Sun, Zhengsong Wang, Le Yang

Proceedings Volume 12782, Third International Conference on Image Processing and Intelligent Control (IPIC 2023); 127820E (2023) https://doi.org/10.1117/12.3000808
Event: Third International Conference on Image Processing and Intelligent Control (IPIC 2023), 2023, Kuala Lumpur, Malaysia

Abstract

To address the problems of insufficient accuracy and difficulty of application in the current Chinese image description field, this paper proposes an evaluation method based on semantic constraints in the target domain. Unlike previous research, this method acts on the output stage of the model, and based on the extraction of key semantics in the target application domain, it is constrained by the macroscopic semantic space of that domain or by introducing external semantic information from other visual tasks. The experiments show that the proposed method effectively improves the semantic coherence between the model output description sentences and the input images in the target domain, and is helpful for the practical application of image description in specific domains.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Zhenhao Wang, Wenyi Sun, Zhengsong Wang, and Le Yang "Chinese image description evaluation method based on target domain semantic constraints", Proc. SPIE 12782, Third International Conference on Image Processing and Intelligent Control (IPIC 2023), 127820E (9 August 2023); https://doi.org/10.1117/12.3000808

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available