Convolutional neural network exploiting pixel surroundings to reveal hidden features in artwork NIR reflectograms

0562826 - ÚTIA 2023 RIV NL eng J - Journal Article
Karella, Tomáš - Blažek, Jan - Striová, J.
Convolutional neural network exploiting pixel surroundings to reveal hidden features in artwork NIR reflectograms.
Journal of Cultural Heritage. Roč. 58, November–December (2022), s. 186-198. ISSN 1296-2074. E-ISSN 1778-3674
R&D Projects: GA ČR GA21-03921S
Grant - others:AV ČR(CZ) StrategieAV21/1
Program: StrategieAV
Institutional support: RVO:67985556
Keywords : Signal separation * Concealed features visualization * Artwork analysis * Infrared reflectography * Convolutional neural networks
OECD category: Computer hardware and architecture
Impact factor: 3.1, year: 2022
Method of publishing: Limited access
https://www.sciencedirect.com/science/article/pii/S1296207422001637?via%3Dihub

Near-infrared reflectography (NIR) is a well-established non-invasive and non-contact imaging technique. The NIR methods are able to reveal concealed layers of artwork, such as a painter’s sketch or repainted canvas. The information obtained may be helpful to historians for studying artist technique, attributing an artwork reconstructing faded details. Our research presents the improved method previously developed that reveals the hidden features by removing the information content of the visible spectrum from
NIR. Based on convolutional neural networks (CNN), our model estimates the transfer function from visible spectra to NIR, which is nonlinear and specific for painting materials. Its parameters are learnt for particular paintings on the subsamples randomly selected across the canvas, and the model is further utilised to enhance the whole artwork. In addition to the previously developed model, our algorithm exploits each pixel’s surroundings to estimate its NIR response. This leads to more precise results and increased robustness to various noises. We demonstrate higher accuracy than the previous method on the historical paintings mock-ups and higher performance on well-known artworks such as Madonna dei Fusi attributed to Leonardo da Vinci.
Permanent Link: https://hdl.handle.net/11104/0335176