论文标题
民主化自然语言生成模型的道德评估
Democratizing Ethical Assessment of Natural Language Generation Models
论文作者
论文摘要
自然语言生成模型是计算机系统，当以一系列单词为上下文提示时，它们会产生连贯的语言。尽管它们无处不在和许多有益的应用，但语言产生模型也有可能通过产生歧视性语言，仇恨的言论，亵渎内容和其他有害物质来造成社会危害。因此，对这些模型的道德评估至关重要。但这也是一项艰巨的任务，需要在几个专业领域（例如计算语言学和社会正义）中拥有专业知识。虽然研究界在该领域取得了重大进展，但由于进入障碍很高，因此对更广泛的人口进行道德评估的可及性受到限制。本文介绍了一种新工具，以民主化和标准化自然语言生成模型的道德评估：语言生成模型的道德评估工具（TEAL）（TEAL），Credo AI Lens的组成部分，一个开源评估框架。
Natural language generation models are computer systems that generate coherent language when prompted with a sequence of words as context. Despite their ubiquity and many beneficial applications, language generation models also have the potential to inflict social harms by generating discriminatory language, hateful speech, profane content, and other harmful material. Ethical assessment of these models is therefore critical. But it is also a challenging task, requiring an expertise in several specialized domains, such as computational linguistics and social justice. While significant strides have been made by the research community in this domain, accessibility of such ethical assessments to the wider population is limited due to the high entry barriers. This article introduces a new tool to democratize and standardize ethical assessment of natural language generation models: Tool for Ethical Assessment of Language generation models (TEAL), a component of Credo AI Lens, an open-source assessment framework.
