Human Language Understanding & Reasoning

作者：Christopher D. Manning · 发表于：Daedalus · 年份：2022 · DOI：10.1162/daed_a_01905 · 被引用次数：163 · 研究领域：Fuzzy Logic and Control Systems、Robotics and Automated Systems

Abstract The last decade has yielded dramatic and quite surprising breakthroughs in natural language processing through the use of simple artificial neural network computations, replicated on a very large scale and trained over exceedingly large amounts of data. The resulting pretrained language models, such as BERT and GPT-3, have provided a powerful universal language understanding and generation base, which can easily be adapted to many understanding, writing, and reasoning tasks. These models show the first inklings of a more general form of artificial intelligence, which may lead to powerful foundation models in domains of sensory experience beyond just language.