论文标题
基于音频的AI分类器没有显示出改进的COVID-19对简单症状检查器筛查的证据
Audio-based AI classifiers show no evidence of improved COVID-19 screening over simple symptoms checkers
论文作者
论文摘要
最近的工作报告说,接受音频记录的AI分类器可以准确预测严重的急性呼吸综合症冠状病毒2(SARSCOV2)感染状态。在这里,我们对基于音频的深度学习分类器进行了大规模研究,这是英国政府大流行反应的一部分。我们收集和分析了67,842名具有链接元数据的人的音频记录数据集,包括逆转录聚合酶链反应(PCR)测试结果,其中23,514个测试对SARS COV 2的测试呈阳性。受试者是通过英国政府通过英国政府进行了国家卫生服务测试和实时评估的社区传播范围(Recess-Recess-Recess consermist serillise serillise serillise serillise serillise serillise)的招募。在对数据集AI分类器的未经调整分析中,与先前研究的发现一致。但是,在与测量的混杂因素(例如年龄,性别和自我报告的症状)匹配之后,我们的分类器性能要弱得多(ROC-AUC 0.619 [0.594,0.644])。在量化实际设置中基于音频的分类器的效用后,我们发现根据用户报告的症状,它们的表现优于简单的预测分数。
Recent work has reported that AI classifiers trained on audio recordings can accurately predict severe acute respiratory syndrome coronavirus 2 (SARSCoV2) infection status. Here, we undertake a large scale study of audio-based deep learning classifiers, as part of the UK governments pandemic response. We collect and analyse a dataset of audio recordings from 67,842 individuals with linked metadata, including reverse transcription polymerase chain reaction (PCR) test outcomes, of whom 23,514 tested positive for SARS CoV 2. Subjects were recruited via the UK governments National Health Service Test-and-Trace programme and the REal-time Assessment of Community Transmission (REACT) randomised surveillance survey. In an unadjusted analysis of our dataset AI classifiers predict SARS-CoV-2 infection status with high accuracy (Receiver Operating Characteristic Area Under the Curve (ROCAUC) 0.846 [0.838, 0.854]) consistent with the findings of previous studies. However, after matching on measured confounders, such as age, gender, and self reported symptoms, our classifiers performance is much weaker (ROC-AUC 0.619 [0.594, 0.644]). Upon quantifying the utility of audio based classifiers in practical settings, we find them to be outperformed by simple predictive scores based on user reported symptoms.