Rise of the Machines: The Prevalence and Disclosure of Artificial Intelligence–Generated Text in High-Impact Orthopaedic Journals

作者：Benjamin D. Pesante, Cyril Mauffrey, Joshua Alan Parry · 发表于：Journal of the American Academy of Orthopaedic Surgeons · 年份：2024 · DOI：10.5435/jaaos-d-24-00318 · 被引用次数：11 · 研究领域：Artificial Intelligence in Healthcare and Education、Diversity and Career in Medicine、Radiology practices and education

INTRODUCTION: While most orthopaedic journals permit the use of artificial intelligence (AI) in article development, they require that AI not be listed as an author, that authors take full responsibility for its accuracy, and that AI use be disclosed. This study aimed to assess the prevalence and disclosure of AI-generated text in abstracts published in high-impact orthopaedic journals. METHODS: Abstracts published from January 1, 2024, to February 19, 2024, in five orthopaedic journals were analyzed: the American Journal of Sports Medicine; the Journal of Arthroplasty; the Journal of Bone and Joint Surgery; the Knee Surgery, Sports, Traumatology, and Arthroscopy (KSSTA) journal; and the BMC Musculoskeletal Disorders (BMC MD) journal. Artificial intelligence detection software was used to evaluate each abstract for AI-generated text. Disclosure of AI use, country of origin, and article type (clinical, preclinical, review, or AI/machine learning) were documented. To evaluate the accuracy of AI detection software, 60 consecutive articles published in the Journal of Bone and Joint Surgery in 2014, before AI writing software was available, were also evaluated. These abstracts were evaluated again after being rewritten with AI writing software. The sensitivity and specificity of the software program for AI-generated text were calculated. RESULTS: A total of 577 abstracts were included in the analysis. AI-generated text was detected in 4.8% of abstracts, ranging from 0% to 12% by j...