论文标题

带有侧面信息的图像分离:基于自动编码器的方法

Image Separation with Side Information: A Connected Auto-Encoders Based Approach

论文作者

Pu, Wei, Sober, Barak, Daly, Nathan, Sabetsarvestani, Zahra, Higgitt, Catherine, Daubechies, Ingrid, Rodrigues, Miguel R. D.

论文摘要

X射线照相术(X射线成像)是一种在艺术研究中广泛使用的成像技术。它可以提供有关绘画状况的信息,以及对艺术家的技术和工作方法的见解,通常会揭示肉眼看不见的隐藏信息。在本文中,我们处理的是分离源自双面绘画的X射线摄影的混合X射线图像的问题。使用从绘画的每一侧使用可见的颜色图像(RGB图像),我们提出了一个基于“连接”自动编码器的新神经网络体系结构,旨在将混合X射线图像分离为对应于每一侧的两个模拟X射线图像。在此提出的架构中,卷积自动编码从RGB图像提取功能。然后,这些特征用于(1)重现两个原始的RGB图像,(2)重建假设分离的X射线图像,以及(3)再生混合X射线图像。该算法以一种完全自我监督的方式运行,而无需包含混合X射线图像和分离图像的样品集。该方法是在\ textsl {Ghent altarpiece}的双面翼板上的图像上测试的,该图由Hubert兄弟和Jan van Eyck兄弟在1432年绘制。这些测试表明,所提出的方法优于其他用于艺术调查应用的最先进的X射线图像分离方法。

X-radiography (X-ray imaging) is a widely used imaging technique in art investigation. It can provide information about the condition of a painting as well as insights into an artist's techniques and working methods, often revealing hidden information invisible to the naked eye. In this paper, we deal with the problem of separating mixed X-ray images originating from the radiography of double-sided paintings. Using the visible color images (RGB images) from each side of the painting, we propose a new Neural Network architecture, based upon 'connected' auto-encoders, designed to separate the mixed X-ray image into two simulated X-ray images corresponding to each side. In this proposed architecture, the convolutional auto encoders extract features from the RGB images. These features are then used to (1) reproduce both of the original RGB images, (2) reconstruct the hypothetical separated X-ray images, and (3) regenerate the mixed X-ray image. The algorithm operates in a totally self-supervised fashion without requiring a sample set that contains both the mixed X-ray images and the separated ones. The methodology was tested on images from the double-sided wing panels of the \textsl{Ghent Altarpiece}, painted in 1432 by the brothers Hubert and Jan van Eyck. These tests show that the proposed approach outperforms other state-of-the-art X-ray image separation methods for art investigation applications.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源