论文标题
面具会引入语音技术偏见吗?说话能力自动评分的情况
Do face masks introduce bias in speech technologies? The case of automated scoring of speaking proficiency
论文作者
论文摘要
COVID-19的大流行导致全世界的面罩的使用急剧增加。面部覆盖物可以影响信号的声学特性以及语音模式,如果戴着面具的人试图使用语音处理技术,则会产生意外影响。在本文中,我们探讨了戴口罩对英语能力自动评估的影响。我们使用大规模口语测试中的数据集,在测试管理过程中,要求测试人员戴口罩,我们将其与匹配的控制型检查员的控制样本进行比较,这些测试人员在提出了相同的测试之前,请先接受相同的测试。我们发现,这两个样本在一系列声学测量中有所不同,并且在语音模式上也显示出很小但显着的差异。但是,这些差异不会导致英语能力的人类或自动化分数差异。偏见的几种度量表明两组之间的分数没有差异。
The COVID-19 pandemic has led to a dramatic increase in the use of face masks worldwide. Face coverings can affect both acoustic properties of the signal as well as speech patterns and have unintended effects if the person wearing the mask attempts to use speech processing technologies. In this paper we explore the impact of wearing face masks on the automated assessment of English language proficiency. We use a dataset from a large-scale speaking test for which test-takers were required to wear face masks during the test administration, and we compare it to a matched control sample of test-takers who took the same test before the mask requirements were put in place. We find that the two samples differ across a range of acoustic measures and also show a small but significant difference in speech patterns. However, these differences do not lead to differences in human or automated scores of English language proficiency. Several measures of bias showed no differences in scores between the two groups.