Agent Attention: On the Integration of Softmax and Linear Attention

作者：Dongchen Han, Tianzhu Ye, Yizeng Han, Zhuofan Xia, Siyuan Pan, Pengfei Wan, Shiji Song, Gao Huang · 发表于：Lecture notes in computer science · 年份：2024 · DOI：10.1007/978-3-031-72973-7_8 · 被引用次数：204 · 研究领域：Neural Networks and Applications、Reinforcement Learning in Robotics、Computability, Logic, AI Algorithms