论文标题

ML-SIM:用于重建结构化照明显微镜图像的深神经网络

ML-SIM: A deep neural network for reconstruction of structured illumination microscopy images

论文作者

Christensen, Charles N., Ward, Edward N., Lio, Pietro, Kaminski, Clemens F.

论文摘要

结构化照明显微镜(SIM)已成为光学超分辨率成像的重要技术,因为它允许在兼容的实用细胞成像的速度下将图像分辨率加倍。但是,SIM图像的重建通常很慢且容易产生人工制品。在这里,我们提出了一种多功能重建方法ML-SIM,该方法利用机器学习。该模型是一个端到端的深残留神经网络,在模拟数据集中训练,该集合不含常见的SIM模具。因此,ML-SIM在原始SIM输入帧的照明模式下对噪声和不规则性具有鲁棒性。重建方法广泛适用,不需要获取实验培训数据。由于训练数据是根据来自通用库的图像的SIM过程模拟生成的,因此该方法可以有效地适应特定的实验SIM实现。将我们方法启用的重建质量与传统的SIM重建方法进行了比较,我们证明了模拟和实验输入的噪声,重建保真度和对比度方面的优势。此外,一个SIM框架的重建通常只需约100毫秒即可使用现代NVIDIA图形卡在PC上执行,从而使该技术与实时成像兼容。完整的实施和受过训练的网络可在http://ml-sim.com上找到。

Structured illumination microscopy (SIM) has become an important technique for optical super-resolution imaging because it allows a doubling of image resolution at speeds compatible for live-cell imaging. However, the reconstruction of SIM images is often slow and prone to artefacts. Here we propose a versatile reconstruction method, ML-SIM, which makes use of machine learning. The model is an end-to-end deep residual neural network that is trained on a simulated data set to be free of common SIM artefacts. ML-SIM is thus robust to noise and irregularities in the illumination patterns of the raw SIM input frames. The reconstruction method is widely applicable and does not require the acquisition of experimental training data. Since the training data are generated from simulations of the SIM process on images from generic libraries the method can be efficiently adapted to specific experimental SIM implementations. The reconstruction quality enabled by our method is compared with traditional SIM reconstruction methods, and we demonstrate advantages in terms of noise, reconstruction fidelity and contrast for both simulated and experimental inputs. In addition, reconstruction of one SIM frame typically only takes ~100ms to perform on PCs with modern Nvidia graphics cards, making the technique compatible with real-time imaging. The full implementation and the trained networks are available at http://ML-SIM.com.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源