论文标题
从五方面的草图重建3D形状
3D Shape Reconstruction from Free-Hand Sketches
论文作者
论文摘要
草图是现实世界对象的最抽象的2D表示。尽管草图通常具有几何变形并且缺乏视觉提示，但人类可以轻松地从中设想3D对象。这表明草图编码重建3D形状所需的信息。尽管通过无失真线图（例如CAD和Edge Maps）在3D重建中取得了巨大进展，但几乎没有努力从手边草图中重建3D形状。我们研究此任务并旨在增强与3D相关应用程序（例如Interactive Design和VR/AR游戏）中草图的力量。 与以前的作品（主要研究无失真线图）不同，我们的3D形状重建是基于自由绘制的草图。自由绘制草图3D重建的主要挑战来自培训数据不足和自由手素描多样性，例如个性化的草图样式。因此，我们提出了数据生成和标准化机制。合成的草图不是无失真的线图，而是作为输入训练数据。此外，我们提出了一个草图标准化模块来处理不同的草图扭曲和样式。广泛的实验证明了我们的模型的有效性及其对各种自由手素描的强有力。我们的代码可在https://github.com/samaonline/3d-shape-reconstruction-from-from-free-free-sketches上公开获取。
Sketches are the most abstract 2D representations of real-world objects. Although a sketch usually has geometrical distortion and lacks visual cues, humans can effortlessly envision a 3D object from it. This suggests that sketches encode the information necessary for reconstructing 3D shapes. Despite great progress achieved in 3D reconstruction from distortion-free line drawings, such as CAD and edge maps, little effort has been made to reconstruct 3D shapes from free-hand sketches. We study this task and aim to enhance the power of sketches in 3D-related applications such as interactive design and VR/AR games. Unlike previous works, which mostly study distortion-free line drawings, our 3D shape reconstruction is based on free-hand sketches. A major challenge for free-hand sketch 3D reconstruction comes from the insufficient training data and free-hand sketch diversity, e.g. individualized sketching styles. We thus propose data generation and standardization mechanisms. Instead of distortion-free line drawings, synthesized sketches are adopted as input training data. Additionally, we propose a sketch standardization module to handle different sketch distortions and styles. Extensive experiments demonstrate the effectiveness of our model and its strong generalizability to various free-hand sketches. Our code is publicly available at https://github.com/samaonline/3D-Shape-Reconstruction-from-Free-Hand-Sketches.
