论文标题

即将到来的AI革命中的短形式物理学论文的去世

The Death of the Short-Form Physics Essay in the Coming AI Revolution

论文作者

Yeadon, Will, Inyang, Oto-Obong, Mizouri, Arin, Peach, Alex, Testrow, Craig

论文摘要

最新的AI语言模块可以在几秒钟内产生原始的,高质量的全面形式($ 300 $ - 字)物理论文。这些技术(例如Chatgpt和Davinci-003)都可以免费提供具有互联网连接的任何人。在这项工作中,我们提供了AI产生的简短论文的证据,该论文在经认可的现有大学物理模块的论文写作评估中获得了一流的成绩。评估要求学生回答五个开放式问题,每篇简短,$ 300 $ - 单词的论文。生成了五十个AI答案,以创建十个由五个单独标记的独立标记的意见书。 AI生成的提交的平均成绩为$ 71 \ pm 2 \%$,与当前模块平均$ 71 \ pm 5%$达到了强烈同意。因此,典型的AI提交将获得一流的最高分类,这是英国大学提供的最高分类。 pla窃检测软件返回了窃得分在$ 2 \ pm 1 $%(Grammarly)和$ 7 \ pm 2 $%(Turnitin)之间。我们认为这些结果表明,当前的AI MLP代表着对短形式论文作为物理课程评估方法的忠诚度的重大威胁。

The latest AI language modules can produce original, high quality full short-form ($300$-word) Physics essays within seconds. These technologies such as ChatGPT and davinci-003 are freely available to anyone with an internet connection. In this work, we present evidence of AI generated short-form essays achieving first-class grades on an essay writing assessment from an accredited, current university Physics module. The assessment requires students answer five open-ended questions with a short, $300$-word essay each. Fifty AI answers were generated to create ten submissions that were independently marked by five separate markers. The AI generated submissions achieved an average mark of $71 \pm 2 \%$, in strong agreement with the current module average of $71 \pm 5 %$. A typical AI submission would therefore most-likely be awarded a First Class, the highest classification available at UK universities. Plagiarism detection software returned a plagiarism score between $2 \pm 1$% (Grammarly) and $7 \pm 2$% (TurnitIn). We argue that these results indicate that current AI MLPs represent a significant threat to the fidelity of short-form essays as an assessment method in Physics courses.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源