论文标题

通过专家咨询甲状腺结节分类的多模式特征融合和知识驱动的学习

Multimodal Feature Fusion and Knowledge-Driven Learning via Experts Consult for Thyroid Nodule Classification

论文作者

Avola, Danilo, Cinque, Luigi, Fagioli, Alessio, Filetti, Sebastiano, Grani, Giorgio, Rodolà, Emanuele

论文摘要

计算机辅助诊断(CAD)正在成为协助跨越多个领域的临床医生的一种重要方法。这些自动化系统利用各种计算机视觉(CV)程序以及人工智能(AI)技术来制定给定图像的诊断,例如计算机断层扫描和超声检查。这两个领域的进步(CV和AI)都在使CAD系统的性能不断提高,这最终可以避免执行诸如细针吸入之类的侵入性程序。在这项研究中,提出了一个新颖的端到端知识分类框架。该系统着重于甲状腺超声检查生成的多模式数据,并通过将甲状腺结节分类分类为良性和恶性类别来充当CAD系统。具体而言,所提出的系统利用专家集团提供的提示来指导密度连接的卷积网络(Densenet)的学习阶段。该集合由在ImageNet上预估计的各种网络组成,包括Alexnet,Resnet,VGG等。先前计算的多模式特征参数用于通过转移学习,减少,减少,训练所需的样本数量来创建超声域专家。为了验证所提出的方法,进行了广泛的实验,为专家合奏和知识驱动的Densenet提供了详细的表演。如结果所证明的那样,拟议的系统在甲状腺结节分类任务的定性指标方面实现了相关性能,因此在制定诊断时会产生巨大的资产。

Computer-aided diagnosis (CAD) is becoming a prominent approach to assist clinicians spanning across multiple fields. These automated systems take advantage of various computer vision (CV) procedures, as well as artificial intelligence (AI) techniques, to formulate a diagnosis of a given image, e.g., computed tomography and ultrasound. Advances in both areas (CV and AI) are enabling ever increasing performances of CAD systems, which can ultimately avoid performing invasive procedures such as fine-needle aspiration. In this study, a novel end-to-end knowledge-driven classification framework is presented. The system focuses on multimodal data generated by thyroid ultrasonography, and acts as a CAD system by providing a thyroid nodule classification into the benign and malignant categories. Specifically, the proposed system leverages cues provided by an ensemble of experts to guide the learning phase of a densely connected convolutional network (DenseNet). The ensemble is composed by various networks pretrained on ImageNet, including AlexNet, ResNet, VGG, and others. The previously computed multimodal feature parameters are used to create ultrasonography domain experts via transfer learning, decreasing, moreover, the number of samples required for training. To validate the proposed method, extensive experiments were performed, providing detailed performances for both the experts ensemble and the knowledge-driven DenseNet. As demonstrated by the results, the proposed system achieves relevant performances in terms of qualitative metrics for the thyroid nodule classification task, thus resulting in a great asset when formulating a diagnosis.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源