Semi-supervised correction model for turbulence-distorted images

作者：Yubo Wu, Kuanhong Cheng, Ting Cao, Zhao Dong, Junhuai Li · 发表于：Optics Express · 年份：2024 · DOI：10.1364/oe.524559 · 被引用次数：7 · 研究领域：Advanced Image Processing Techniques、Image Enhancement Techniques、Image and Video Quality Assessment

Significant progress has been made in addressing turbulence distortion in recent years, but persistent challenges remain. Firstly, existing methods heavily rely on fully supervised optimization strategies and synthetic datasets, posing difficulties in effectively utilizing unlabeled real data for training. Secondly, most approaches construct networks in a straightforward manner, overlooking the representation model of phase distortion and point spread function (PSF) in spatial and channel dimensions. This oversight restricts the potential for distortion correction. To address these challenges, this paper proposes a semi-supervised atmospheric turbulence correction method based on the mean-teacher framework. Our approach imposes constraints on the unlabeled data of student networks using pseudo-labels generated by teacher networks, thereby enhancing the generalization ability by leveraging information from unlabeled data. Furthermore, we introduce to use no-reference image quality assessment criterion to select the most reliable pseudo-label for each unlabeled sample by predicting physical parameters that indicating the level of degradation. Additionally, we propose to combine sliding window-based self-attention with channel attention to facilitate local-global context interaction. This design is inspired by the representation of phase distortion and PSF, which can be characterized by coefficients and basis functions corresponding to the channel-wise representation of convolut...