论文标题
基于多模式转移学习的视网膜血管分割方法
Multimodal Transfer Learning-based Approaches for Retinal Vascular Segmentation
论文作者
论文摘要
在眼科中,视网膜微循环的研究是分析许多眼和全身性疾病(如高血压或糖尿病)的关键问题。这激发了研究改善视网膜脉管系统分割的研究。如今,完全卷积神经网络(FCN)通常代表最成功的图像分割方法。但是,这些模型的成功是由所使用的体系结构和技术的适当选择和适应以及大量注释数据的可用性的条件。将FCN应用于医学图像分割时,这两个问题变得特别相关,因为首先,存在的模型通常是根据摄影图像的广泛域应用调整的,其次,带注释的数据的量通常稀少。在这项工作中,我们提出了基于多模式转移学习的方法,用于视网膜血管分割,对最近的FCN体系结构进行了比较研究。特别是,为了克服带注释的数据稀缺性,我们提出了自我监管的网络预处理的新颖应用,该应用利用了现有的未标记的多模式数据。结果表明,自我监督的预处理的网络获得了更好的血管面膜,并且在目标任务中较少培训(独立于网络体系结构),并且某些FCN体系结构在广泛的领域应用中的动机并没有转化为对血管分割任务的重大改进。
In ophthalmology, the study of the retinal microcirculation is a key issue in the analysis of many ocular and systemic diseases, like hypertension or diabetes. This motivates the research on improving the retinal vasculature segmentation. Nowadays, Fully Convolutional Neural Networks (FCNs) usually represent the most successful approach to image segmentation. However, the success of these models is conditioned by an adequate selection and adaptation of the architectures and techniques used, as well as the availability of a large amount of annotated data. These two issues become specially relevant when applying FCNs to medical image segmentation as, first, the existent models are usually adjusted from broad domain applications over photographic images, and second, the amount of annotated data is usually scarcer. In this work, we present multimodal transfer learning-based approaches for retinal vascular segmentation, performing a comparative study of recent FCN architectures. In particular, to overcome the annotated data scarcity, we propose the novel application of self-supervised network pretraining that takes advantage of existent unlabelled multimodal data. The results demonstrate that the self-supervised pretrained networks obtain significantly better vascular masks with less training in the target task, independently of the network architecture, and that some FCN architecture advances motivated for broad domain applications do not translate into significant improvements over the vasculature segmentation task.