12 December 2023 No-reference quality assessment for depth image based rendering-synthesized images based on multi-feature fusion
Ling Wang, Fen Chen, Qing Lai, Mengyu Nie, Tingyan Tang, Zongju Peng
Author Affiliations +
Abstract

The depth image based rendering (DIBR) technique plays a crucial role in free viewpoint video. However, the DIBR technology is not yet mature and still needs to be improved. In addition, depth image acquisition is inaccurate and prone to distortion, which affects human visual perception. The DIBR-synthesized image quality assessment (IQA) method, which simulates the human visual perception system, can be used as feedback to improve the DIBR technique and depth video quality. The existing IQA algorithms are insensitive to the diversity of geometric distortion produced by the DIBR technique and do not consider the impact of geometric distortion on the image quality from multiple perspectives. In this work, a no-reference IQA method for DIBR-synthesized images based on multi-feature fusion is proposed. Different from the existing IQA algorithms, this paper focuses on the diversity of geometric distortions in DIBR-synthesized images, measures the distortions of the edge region and the hole region, and integrates the global sharpness and the natural mixed distortion. Specifically, the global sharpness is first measured, and the image is divided into blocks to further improve the accuracy of the results. Secondly, the geometric distortions of the edge and hole regions are measured comprehensively. In addition, considering the impact of the natural mixed distortion on the quality of the DIBR-synthesized image, a Gaussian mixed statistical model is used to extract the natural mixed distortion of the DIBR-synthesized image. Finally, the quality score of the DIBR-synthesized image is generated by pooling regression. Experimental results on two synthesized image databases demonstrate that the method proposed in this paper outperforms classical and state-of-the-art IQA methods and is more aligned with the human visual perception system.

© 2023 SPIE and IS&T
Ling Wang, Fen Chen, Qing Lai, Mengyu Nie, Tingyan Tang, and Zongju Peng "No-reference quality assessment for depth image based rendering-synthesized images based on multi-feature fusion," Journal of Electronic Imaging 32(6), 063026 (12 December 2023). https://doi.org/10.1117/1.JEI.32.6.063026
Received: 2 June 2023; Accepted: 22 November 2023; Published: 12 December 2023
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image quality

Distortion

Databases

Image fusion

Education and training

Image sharpness

Visualization

Back to Top