论文标题
Xraysyn:从单个X光片到CT先验的现实视图合成
XraySyn: Realistic View Synthesis From a Single Radiograph Through CT Priors
论文作者
论文摘要
X光片通过使用X射线来可视化患者的内部解剖结构,该X射线将3D信息投射到2D平面上。因此,X光片分析自然要求医生将大约3D人体解剖学与2D X光片相关联。在较小范围内综合新的射线照相视图可以帮助医生更可靠地解释解剖学。但是,X光片视图合成是严重的,缺乏配对数据,并且缺乏可区分的操作来利用基于学习的方法。为了解决这些问题,我们使用计算机断层扫描(CT)进行X光片模拟并设计了可区分的投影算法,这使我们能够实现X射线照相和CT域之间的几何一致转换。我们的方法Xraysyn可以通过在真实的X光片上的逼真的模拟和鉴定结合结合对真实的射线照相综合新观点。据我们所知,这是X光片视图合成的第一部作品。我们表明,通过了解3D空间中的X射线照相,我们的方法可以应用于射线照相骨萃取和抑制,而无需地面骨标签。
A radiograph visualizes the internal anatomy of a patient through the use of X-ray, which projects 3D information onto a 2D plane. Hence, radiograph analysis naturally requires physicians to relate the prior about 3D human anatomy to 2D radiographs. Synthesizing novel radiographic views in a small range can assist physicians in interpreting anatomy more reliably; however, radiograph view synthesis is heavily ill-posed, lacking in paired data, and lacking in differentiable operations to leverage learning-based approaches. To address these problems, we use Computed Tomography (CT) for radiograph simulation and design a differentiable projection algorithm, which enables us to achieve geometrically consistent transformations between the radiography and CT domains. Our method, XraySyn, can synthesize novel views on real radiographs through a combination of realistic simulation and finetuning on real radiographs. To the best of our knowledge, this is the first work on radiograph view synthesis. We show that by gaining an understanding of radiography in 3D space, our method can be applied to radiograph bone extraction and suppression without groundtruth bone labels.