论文标题

阿尔茨海默氏症的痴呆症检测来自音频和文本方式

Alzheimer's Dementia Detection from Audio and Text Modalities

论文作者

Campbell, Edward L., Docío-Fernández, Laura, Raboso, Javier Jiménez, García-Mateo, Carmen

论文摘要

当提取声波和内容的特征时,通过语音处理对阿尔茨海默氏症的痴呆进行自动检测。音频和文本转录已被广泛用于与健康相关的任务中,作为光谱和韵律语音特征以及语义和语言内容,传达了有关各种疾病的信息。因此,本文介绍了GTM-IVIGO研究小组的共同工作和Accexthible Startup在Interspeech 2020的地址挑战中的共同工作。提交的系统旨在从患者的语音和消息转录中检测出阿尔茨海默氏病的模式。已经构建和比较了六个不同的系统:其中四个是基于语音的,而其他两个系统基于文本。评估了X-vector,I-Vector和基于统计语音的功能功能功能。由于口语流利性是阿尔茨海默氏病患者的常见模式,因此还提出了节奏特征。为了进行转录分析,提出了两个系统:一种使用手套单词嵌入功能,另一个使用语言建模提取的几个功能。研究了几种模式内和模式间评分融合策略。介绍了单模式和多模式系统的性能。所达到的结果是有希望的,表现优于地址基线系统所取得的结果。

Automatic detection of Alzheimer's dementia by speech processing is enhanced when features of both the acoustic waveform and the content are extracted. Audio and text transcription have been widely used in health-related tasks, as spectral and prosodic speech features, as well as semantic and linguistic content, convey information about various diseases. Hence, this paper describes the joint work of the GTM-UVIGO research group and acceXible startup to the ADDReSS challenge at INTERSPEECH 2020. The submitted systems aim to detect patterns of Alzheimer's disease from both the patient's voice and message transcription. Six different systems have been built and compared: four of them are speech-based and the other two systems are text-based. The x-vector, i-vector, and statistical speech-based functionals features are evaluated. As a lower speaking fluency is a common pattern in patients with Alzheimer's disease, rhythmic features are also proposed. For transcription analysis, two systems are proposed: one uses GloVe word embedding features and the other uses several features extracted by language modelling. Several intra-modality and inter-modality score fusion strategies are investigated. The performance of single modality and multimodal systems are presented. The achieved results are promising, outperforming the results achieved by the ADDReSS's baseline systems.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源