The use of neural encodings has the potential to replace the commonly used polynomial fitting in the analysis of artwork surface based on Reflectance Transformation Imaging (RTI), as it has proved to result in more compact encoding with better relight quality, but it is still not widely used due to the lack of efficient implementations available to practitioners. In this work, we describe an optimized system to encode/decode neural relightable images providing interactive visualization in a web interface allowing multi-layer visualization and annotation. To develop it, we performed several experiments testing different decoder architectures and input processing pipelines, evaluating the quality of the results on specific benchmarks to find the optimal tradeoff between relighting quality and efficiency. A specific decoder has been then implemented for the web and integrated into an advanced visualisation tool. The system has been tested for the analysis of a group of ancient Roman bronze coins that present scarce readability and varying levels of preservation and that have been acquired with a multispectral light dome. Their level of corrosion and degradation, which in some cases hinders the recognition of the images, numerals, or text represented on them, makes the system testing particularly challenging and complex. Testing on such a real case scenario, however, enables us to determine the actual improvement that this new RTI visualization tool can offer to numismatists in their ability to identify the coins.
Fluorescence is a photoluminescence phenomenon where light is absorbed at lower wavelengths and re-emitted at longer wavelengths. For classic artworks, fluorescence gives useful information about varnish and retouches. At the same time, modern artworks may employ synthetic fluorescent pigments because of their special appearance properties, such as increased brightness and vividness provoked by self-luminescence. Hence, it is relevant to investigate the fluorescent signals of cultural heritage objects when studying their appearance. This work proposes a variant to Reflectance Transformation Imaging (RTI) technique, namely Fluorescence Transformation Imaging. Reflectance Transformation Imaging method outputs a single-camera multi-light image collection of a static scene, which can be used to model the reflectance of the scene as a polynomial of the illumination directions. Similarly, Fluorescence Transformation Imaging aims to model the fluorescent signal based on a series of images with fixed scene and viewpoint and varying incident light directions - what changes with respect to RTI is that the wavelength of incident light needs to be shorter than the sensing wavelength. In the literature, there are works that explore the isotropic property of fluorescence in low-dimension multi-light imagery methods (such as Photometric Stereo) to model the appearance of an object with a first-order polynomial. This is because in the fluorescent mode the object gets closer to a Lambertian surface than in the reflective mode where non-Lambertian effects such as highlights are more likely to appear. Nonetheless, this assumption stands for single-object scenes, with uniform albedo and convex geometries. When there are multiple fluorescent objects in the scene, with concavities and non-uniform fluorescent component, then the fluorescence can become secondary light to the object and create interreflections. This paper explores the Reflectance and Fluorescence Transformation Imaging methods and the resulting texture maps for appearance rendering of heterogeneous non-flat fluorescent objects.
In this paper we analyze some problems related to the acquisition of multiple illumination images for Polynomial Texture Maps (PTM) or generic Reflectance Transform Imaging (RTI). We show that intensity and directionality nonuniformity can be a relevant issue when acquiring manual sets of images with the standard highlight-based setup both using a flash lamp and a LED light. To maintain a cheap and flexible acquisition setup that can be used on field and by non-experienced users we propose to use a dynamic calibration and correction of the lights based on multiple intensity and direction estimation around the imaged object during the acquisition.
Preliminary tests on the results obtained have been performed by acquiring a specifically designed 3D printed pattern in order to see the accuracy of the acquisition obtained both for spatial discrimination of small structures and normal estimation, and on samples of different types of paper in order to evaluate material discrimination.
We plan to design and build from our analysis and from the tools developed and under development a set of novel procedures and guidelines that can be used to turn the cheap and common RTI acquisition setup from a simple way to enrich object visualization into a powerful method for extracting quantitative characterization both of surface geometry and of reflective properties of different materials. These results could have relevant applications in the Cultural Heritage domain, in order to recognize different materials used in paintings or investigate the ageing status of artifacts’ surface.
We describe a complete pipeline for the detection and accurate automatic segmentation of the optic disc in digital fundus images. This procedure provides separation of vascular information and accurate inpainting of vessel-removed images, symmetry-based optic disc localization, and fitting of incrementally complex contour models at increasing resolutions using information related to inpainted images and vessel masks. Validation experiments, performed on a large dataset of images of healthy and pathological eyes, annotated by experts and partially graded with a quality label, demonstrate the good performances of the proposed approach. The method is able to detect the optic disc and trace its contours better than the other systems presented in the literature and tested on the same data. The average error in the obtained contour masks is reasonably close to the interoperator errors and suitable for practical applications. The optic disc segmentation pipeline is currently integrated in a complete software suite for the semiautomatic quantification of retinal vessel properties from fundus camera images (VAMPIRE).
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.