Re-Introducing BN Into Transformers for Vision Tasks

作者：Xue‐song Tang, Xianlin Xie · 发表于：IEEE Access · 年份：2023 · DOI：10.1109/access.2023.3283612 · 研究领域：3D Shape Modeling and Analysis、Advanced Neural Network Applications、Human Pose and Action Recognition

In recent years, Transformer-based models have exhibited significant advancements over previous models in natural language processing and vision tasks. This powerful methodology has also been extended to the 3D point cloud domain, where it can mitigate the inherent difficulties posed by the irregular and disorderly nature of the point clouds. However, the attention mechanism within the Transformer presents challenges for utilizing Batch Normalization (BN), as statistical information cannot be extracted efficiently from the data set. Thus, this study proposes a novel residual structure, ResBN, which can effectively handle 3D data. Additionally, to replace BN in the transformer for 2D image processing, we introduce the Patch Normalization (PN) technique. ResBN and PN are evaluated on 3D point cloud and 2D image datasets respectively through statistical experiments, demonstrating their efficacy in enhancing classification performance.