Multispectral Texture Synthesis using RGB Convolutional Neural Networks - Département Image, Données, Signal
Pré-Publication, Document De Travail Année : 2024

Multispectral Texture Synthesis using RGB Convolutional Neural Networks

Résumé

State-of-the-art RGB texture synthesis algorithms rely on style distances that are computed through statistics of deep features. These deep features are extracted by classification neural networks that have been trained on large datasets of RGB images. Extending such synthesis methods to multispectral images is not straightforward, since the pre-trained networks are designed for and have been trained on RGB images. In this work, we propose two solutions to extend these methods to multispectral imaging. Neither of them require additional training of the neural network from which the second order neural statistics are extracted. The first one consists in optimizing over batches of random triplets of spectral bands throughout training. The second one projects multispectral pixels onto a 3 dimensional space. We further explore the benefit of a color transfer operation upstream of the projection to avoid the potentially abnormal color distributions induced by the projection. Our experiments compare the performances of the various methods through different metrics. We demonstrate that they can be used to perform exemplar-based texture synthesis, achieve good visual quality and comes close to state-of-the art methods on RGB bands.
Fichier principal
Vignette du fichier
main.pdf (21.01 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04719766 , version 1 (14-10-2024)
hal-04719766 , version 2 (21-10-2024)

Identifiants

Citer

Sélim Ollivier, Yann Gousseau, Sidonie Lefebvre. Multispectral Texture Synthesis using RGB Convolutional Neural Networks. 2024. ⟨hal-04719766v2⟩
139 Consultations
14 Téléchargements

Altmetric

Partager

More