论文标题
在医学图像细分中持续学习有什么问题?
What is Wrong with Continual Learning in Medical Image Segmentation?
论文作者
论文摘要
持续的学习方案引起了医学成像界的越来越多的关注。在连续的环境中,在不同条件下获取的数据集顺序到达;每个都只能在有限的时间内使用。鉴于与医疗数据相关的固有隐私风险,该设置反映了深度学习诊断放射系统部署的现实。有许多技术可以连续学习以进行图像分类,并且已经适应了语义分割。然而,大多数人都在以有意义的方式积累知识。取而代之的是,他们专注于防止灾难性遗忘的问题,即使这会降低模型可塑性并因此负担训练过程。这质疑知识保存的额外开销是否值得 - 尤其是对于医学图像细分,计算要求已经很高 - 或者维护单独的模型是否是更好的解决方案。我们提出了UNEG,这是一个简单且广泛适用的多模型基准,该基准可维护每个培训阶段的单独分段和自动编码器网络。自动编码器是由与分割网络相同的架构构建的,在我们的情况下,该网络是一个完整的NNU-NET,以绕过任何其他设计决策。在推论过程中,重建误差用于为每个测试图像选择最合适的分段器。打开这个概念,我们为不同的持续学习环境制定了公平的评估方案,该方案超出了预防灾难性遗忘。我们在感兴趣的三个区域(前列腺,海马和右心室)的结果表明,Uneg的表现优于几种持续的学习方法,从而在持续的学习研究中强大了强大的基线。
Continual learning protocols are attracting increasing attention from the medical imaging community. In continual environments, datasets acquired under different conditions arrive sequentially; and each is only available for a limited period of time. Given the inherent privacy risks associated with medical data, this setup reflects the reality of deployment for deep learning diagnostic radiology systems. Many techniques exist to learn continuously for image classification, and several have been adapted to semantic segmentation. Yet most struggle to accumulate knowledge in a meaningful manner. Instead, they focus on preventing the problem of catastrophic forgetting, even when this reduces model plasticity and thereon burdens the training process. This puts into question whether the additional overhead of knowledge preservation is worth it - particularly for medical image segmentation, where computation requirements are already high - or if maintaining separate models would be a better solution. We propose UNEG, a simple and widely applicable multi-model benchmark that maintains separate segmentation and autoencoder networks for each training stage. The autoencoder is built from the same architecture as the segmentation network, which in our case is a full-resolution nnU-Net, to bypass any additional design decisions. During inference, the reconstruction error is used to select the most appropriate segmenter for each test image. Open this concept, we develop a fair evaluation scheme for different continual learning settings that moves beyond the prevention of catastrophic forgetting. Our results across three regions of interest (prostate, hippocampus, and right ventricle) show that UNEG outperforms several continual learning methods, reinforcing the need for strong baselines in continual learning research.