ChatGPT-4 and Other LLMs in the Turing Test: A Critical Analysis

作者：Marco Giunti · 发表于：Minds and Machines · 年份：2025 · DOI：10.1007/s11023-026-09760-5 · 被引用次数：3 · 研究领域：Computer Science

This paper critically examines the recent publication “ChatGPT-4 in the Turing Test” by Restrepo Echavarría (Minds Mach 35:8, 2025. https://doi.org/10.1007/s11023-025-09711-6), challenging its central claims regarding the absence of minimally serious test implementations and the conclusion that ChatGPT-4 fails the Turing Test. The analysis reveals that criticisms based on rigid criteria and limited experimental data are not fully justified. More importantly, the paper makes several constructive contributions that enrich our understanding of Turing Test implementations. It demonstrates that two distinct formats, the three-player and two-player tests, are both valid, each with unique methodological implications. The work distinguishes between absolute criteria for passing the test—the machine’s probability of incorrect identification equals or exceeds the human’s probability of correct identification—and relative criteria—which measure how closely a machine’s performance approximates that of a human—, offering a more nuanced evaluation framework. Furthermore, the paper clarifies the probabilistic underpinnings of both test types by modeling them as Bernoulli experiments—correlated in the three-player version and uncorrelated in the two-player version. This formalization allows for a rigorous separation between the theoretical criteria for passing the test, defined in probabilistic terms, and the experimental data that require robust statistical methods for proper interpretation...