论文标题
创建AI Factsheets的方法
A Methodology for Creating AI FactSheets
论文作者
论文摘要
随着AI模型和服务在越来越多的高风险领域中使用,围绕需要更清楚地记录这些模型和服务如何开发以增加信任的需求。已经出现了一些提高质量和更一致的AI文档的建议,以解决此类系统的道德和法律问题以及一般社会影响。但是,关于如何创建此文档的发表很少的工作。这是描述创建我们称为Factsheets的AI文档形式的方法的第一项工作。我们已经使用这种方法来为近二十个模型创建有用的事实表。本文描述了这种方法,并分享了我们收集的见解。在方法论的每个步骤中,我们描述了要考虑的问题以及与组织中的相关人员一起探索的问题,他们将在事实表中创建和消费AI事实。该方法将加速更广泛的透明AI文档。
As AI models and services are used in a growing number of highstakes areas, a consensus is forming around the need for a clearer record of how these models and services are developed to increase trust. Several proposals for higher quality and more consistent AI documentation have emerged to address ethical and legal concerns and general social impacts of such systems. However, there is little published work on how to create this documentation. This is the first work to describe a methodology for creating the form of AI documentation we call FactSheets. We have used this methodology to create useful FactSheets for nearly two dozen models. This paper describes this methodology and shares the insights we have gathered. Within each step of the methodology, we describe the issues to consider and the questions to explore with the relevant people in an organization who will be creating and consuming the AI facts in a FactSheet. This methodology will accelerate the broader adoption of transparent AI documentation.