Unveiling the secrets of paintings: deep neural networks trained on high-resolution multispectral images for accurate attribution and authentication

Michael E. Sander; Tom Sander; Maxime Sylvestre

doi:10.1117/12.3000286

28 July 2023 Unveiling the secrets of paintings: deep neural networks trained on high-resolution multispectral images for accurate attribution and authentication

Michael E. Sander, Tom Sander, Maxime Sylvestre

Author Affiliations +

Proceedings Volume 12749, Sixteenth International Conference on Quality Control by Artificial Vision; 1274917 (2023) https://doi.org/10.1117/12.3000286
Event: Sixteenth International Conference on Quality Control by Artificial Vision, 2023, Albi, France

Abstract

Attribution and authentication of paintings are difficult tasks, often based on human expertise. In this work, we present SpectrumArt: a new dataset of multispectral (13 channels) image patches of paintings acquired at very high resolution (800 pixels per mm2 ). We train deep neural networks on SpectrumArt for attribution (i.e., authorship classification) and authentication (i.e., whether of undisputed origin). For attribution, we obtain an accuracy of 92% on a test set of patches coming from unseen paintings. We also propose two classification metrics for attribution of full paintings based on the prediction for the patches: majority vote and entropy weighted vote. Both metrics lead to an attribution score of 100% on unseen paintings. For authenticity testing, our model agrees with the experts’ conclusions on genuine and fake paintings, and provides new insights into the authenticity of paintings where the expert community is divided by proposing a spectral matching score between the painting and an artist. To validate the important advantage of our data collection method, we show that the use of 13 channels instead of 3 and the high resolution of the data significantly improve the accuracy of our models.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Michael E. Sander, Tom Sander, and Maxime Sylvestre "Unveiling the secrets of paintings: deep neural networks trained on high-resolution multispectral images for accurate attribution and authentication", Proc. SPIE 12749, Sixteenth International Conference on Quality Control by Artificial Vision, 1274917 (28 July 2023); https://doi.org/10.1117/12.3000286

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

RGB color model

Data modeling

Multispectral imaging

Neural networks

Image resolution

Data acquisition

Deep learning

Keywords/Phrases

Search In:

Publication Years