论文标题

立面的半监督代表区域纹理提取

Semi-Supervised Representative Region Texture Extraction of Façade

论文作者

Ni, Zhen, Cao, Guitao, Duan, Ye

论文摘要

通过语义信息在立面周围进行的分析和解析,以丰富了立面模型的3D特征,在社区中引起了一些关注,其主要思想是生成具有相似形状和纹理的较高分辨率组件,以增加总体分辨率,以牺牲重建精度为代价。尽管这种方法适用于窗户和门等组件,但目前尚无解决立面背景的解决方案。在本文中,我们介绍了代表性区域纹理的概念,可以在上面的建模方法中使用铺在立面区域周围的代表性纹理,并提出一种半监督的方法来从立面图像中进行代表性区域纹理提取。只要给出语义信息,我们的方法不需要任何其他标记的数据才能训练,而传统的端到端模型则需要大量数据来提高其性能。我们的方法可以从任何重复的图像中提取纹理,而不仅仅是立面,它在端到端模型中都不能够依赖于训练集的分布。引入加权距离的聚类是为了进一步提高噪声或不精确的分割的鲁棒性,使提取的纹理具有更高的分辨率,更适合平铺。我们在各种立面图像上验证了我们的方法,结果表明,与仅在立面上的随机作物相比,我们的方法具有显着的性能提高。我们还展示了一些应用程序场景,并提出了具有代表性区域纹理的立面建模工作流程,该纹理可以更好地分辨出常规立面的视觉分辨率。

Researches of analysis and parsing around façades to enrich the 3D feature of façade models by semantic information raised some attention in the community, whose main idea is to generate higher resolution components with similar shapes and textures to increase the overall resolution at the expense of reconstruction accuracy. While this approach works well for components like windows and doors, there is no solution for façade background at present. In this paper, we introduce the concept of representative region texture, which can be used in the above modeling approach by tiling the representative texture around the façade region, and propose a semi-supervised way to do representative region texture extraction from a façade image. Our method does not require any additional labelled data to train as long as the semantic information is given, while a traditional end-to-end model requires plenty of data to increase its performance. Our method can extract texture from any repetitive images, not just façade, which is not capable in an end-to-end model as it relies on the distribution of training set. Clustering with weighted distance is introduced to further increase the robustness to noise or an imprecise segmentation, and make the extracted texture have a higher resolution and more suitable for tiling. We verify our method on various façade images, and the result shows our method has a significant performance improvement compared to only a random crop on façade. We also demonstrate some application scenarios and proposed a façade modeling workflow with the representative region texture, which has a better visual resolution for a regular façade.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源