DRCR Net: Dense Residual Channel Re-calibration Network with Non-local Purification for Spectral Super Resolution

作者：Jiaojiao Li, Songcheng Du, Chaoxiong Wu, Yihong Leng, Rui Song, Yunsong Li · 发表于：2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 年份：2022 · DOI：10.1109/cvprw56347.2022.00132 · 被引用次数：53 · 研究领域：Optical measurement and interference techniques、Advanced Image Processing Techniques、Image Processing Techniques and Applications

Spectral super resolution (SSR) aims to reconstruct the 3D hyperspectral signal from a 2D RGB image, which is prosperous with the proliferation of Convolutional Neural Networks (CNNs) and increased access to RGB/hyperspectral datasets. Nevertheless, most CNN-based spectral reconstruction (SR) algorithms can only per-form high reconstruction accuracy when the input RGB image is relatively ‘clean’ with foregone spectral response functions. Unfortunately, in the real world, images are contaminated by mixed noise, bad illumination conditions, compression, artifacts etc. and the existing state-of-the-art (SOTA) methods are no longer working well. To conquer these drawbacks, we propose a novel dense residual channel re-calibration network (DRCR Net) with non-local purification for achieving robust SSR results, which first per-forms the interference removal through a non-local purification module (NPM) to refine the RGB inputs. To be specific, as the main component of backbone, the dense residual channel re-calibration (DRCR) block is cascaded with an encoder-decoder paradigm through several cross-layer dense residual connections, to capture the deep spatial-spectral interactions, which further improve the generalization ability of the network effectively. Furthermore, we customize dual channel re-calibration modules (CRMs) which are embedded in each DRCR block to adaptively re-calibrate channel-wise feature response for pursuing high-fidelity spectral recovery. In the NTIRE 2022 Sp...