论文标题

从有限训练样本中的生物图像分类和可视化的深度低射击学习

Deep Low-Shot Learning for Biological Image Classification and Visualization from Limited Training Samples

论文作者

Cai, Lei, Wang, Zhengyang, Kulathinal, Rob, Kumar, Sudhir, Ji, Shuiwang

论文摘要

预测建模是有用的,但由于获得和标记培训数据的高成本,在生物图像分析中非常具有挑战性。例如,在果蝇胚胎发生的基因相互作用和调节的研究中,当比较了来自同一发育阶段的原位杂交(ISH)基因表达模式图像时,该分析在生物学上是最有意义的。但是,即使对于主题生物学家,将培训数据标记为精确的阶段也很耗时。因此,一个关键的挑战是如何从有限的培训样本中构建准确的计算模型来为精确的发展阶段分类。此外,需要对发展地标的识别和可视化,以使生物学家能够解释预测结果并校准模型。为了应对这些挑战,我们建议使用有限的训练图像准确地对ISH图像进行精确分类。具体而言,为了在有限的培训样本上进行准确的模型培训,我们将任务作为一个深度低的学习问题,并开发了一种新颖的两步学习方法,包括数据级学习和功能级学习。我们使用深层剩余网络作为基础模型,并在ISH图像的精确阶段预测任务中实现了改善的性能。此外,可以通过计算显着图来解释深层模型,这些图由图像对其预测结果的贡献组成。在我们的任务中,显着图用于协助识别和可视化发展地标。我们的实验结果表明,所提出的模型不仅可以做出准确的预测,而且可以产生有意义的解释。我们预计我们的方法可以通过小型培训数据集易于推广到其他生物图像分类任务。

Predictive modeling is useful but very challenging in biological image analysis due to the high cost of obtaining and labeling training data. For example, in the study of gene interaction and regulation in Drosophila embryogenesis, the analysis is most biologically meaningful when in situ hybridization (ISH) gene expression pattern images from the same developmental stage are compared. However, labeling training data with precise stages is very time-consuming even for evelopmental biologists. Thus, a critical challenge is how to build accurate computational models for precise developmental stage classification from limited training samples. In addition, identification and visualization of developmental landmarks are required to enable biologists to interpret prediction results and calibrate models. To address these challenges, we propose a deep two-step low-shot learning framework to accurately classify ISH images using limited training images. Specifically, to enable accurate model training on limited training samples, we formulate the task as a deep low-shot learning problem and develop a novel two-step learning approach, including data-level learning and feature-level learning. We use a deep residual network as our base model and achieve improved performance in the precise stage prediction task of ISH images. Furthermore, the deep model can be interpreted by computing saliency maps, which consist of pixel-wise contributions of an image to its prediction result. In our task, saliency maps are used to assist the identification and visualization of developmental landmarks. Our experimental results show that the proposed model can not only make accurate predictions, but also yield biologically meaningful interpretations. We anticipate our methods to be easily generalizable to other biological image classification tasks with small training datasets.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源