Spatial-spectral graph convolutional network for automatic pigment mapping of historical artifacts

作者：Bei Cao, David W. Messinger · 发表于：npj Heritage Science · 年份：2025 · DOI：10.1038/s40494-025-01629-7 · 被引用次数：5 · 研究领域：Cultural Heritage Materials Analysis、Remote-Sensing Image Classification、Image Retrieval and Classification Techniques

Hyperspectral image classification is a challenging task due to the lack of ground-truth labels and high dimensionality of spectral bands. For hyperspectral image (HSI) data of cultural heritage artifacts, which are generally man-made objects, we typically have much higher spatial resolution posing extra challenges. Aiming to differentiate subtle spectral differences between varied pigments with little manual effort, we propose a Spatial-Spectral Graph Convolutional Network (SSGCN) as a powerful learning framework for realizing automatic pigment mapping. First, we introduce a novel spatial pattern descriptor “Edge Response Map” to extract structural information of a training ROI, upon which a Spatial-Spectral graph is built by incorporating spatial node connections into the spectral-based graph. Then, we infuse the Spatial-Spectral graph into the graph convolutional network and build a SSGCN learning pipeline. We train the network on the training ROI via semi-supervised classification. By aggregating node features in terms of spectral affinity and spatial context, SSGCN is capable of learning the intrinsic community structures in a non-linear way, and thus can be directly applied to another region for pigment mapping without ground-truth labels required. Furthermore, the graph-based nature of the approach empowers the SSGCN with scalability to learn new pigment classes by flexibly extending the current model. The experiments on multiple ROIs in the Selden Map of China demonst...