论文标题
基于深度学习的回归和在医学图像中自动具有里程碑意义的本地化的分类
Deep Learning-Based Regression and Classification for Automatic Landmark Localization in Medical Images
论文作者
论文摘要
在这项研究中,我们提出了一种快速准确的方法,可以在医学图像中自动定位解剖学地标。我们使用完全卷积神经网络(FCNN)采用全球到本地的定位方法。首先,全局FCNN通过分析图像贴片,同时执行回归和分类来定位多个地标。在回归中,确定了从图像斑块中心指向地标位置的位移向量。在分类中,建立了在贴片中有兴趣的地标。通过平均预测的位移向量获得了全局地标性位置,其中每个位移矢量的贡献是通过其指向贴片的后验分类概率加权的。随后,对于局部本地化的每个地标,进行本地分析。专业FCNN通过以类似的方式分析本地子图像,即同时进行回归和分类并结合结果,从而完善了全球地标地点。通过在CCTA扫描中的8个解剖标志性,嗅觉MR扫描中的2个地标和19个标记X射线中的19个地标进行评估。我们证明该方法的性能与第二个观察者类似,并且能够将地标在各种医学图像集中定位,图像方式,图像维度和解剖学覆盖率不同。
In this study, we propose a fast and accurate method to automatically localize anatomical landmarks in medical images. We employ a global-to-local localization approach using fully convolutional neural networks (FCNNs). First, a global FCNN localizes multiple landmarks through the analysis of image patches, performing regression and classification simultaneously. In regression, displacement vectors pointing from the center of image patches towards landmark locations are determined. In classification, presence of landmarks of interest in the patch is established. Global landmark locations are obtained by averaging the predicted displacement vectors, where the contribution of each displacement vector is weighted by the posterior classification probability of the patch that it is pointing from. Subsequently, for each landmark localized with global localization, local analysis is performed. Specialized FCNNs refine the global landmark locations by analyzing local sub-images in a similar manner, i.e. by performing regression and classification simultaneously and combining the results. Evaluation was performed through localization of 8 anatomical landmarks in CCTA scans, 2 landmarks in olfactory MR scans, and 19 landmarks in cephalometric X-rays. We demonstrate that the method performs similarly to a second observer and is able to localize landmarks in a diverse set of medical images, differing in image modality, image dimensionality, and anatomical coverage.