论文标题
通过多解决实例歧视,无监督的3D学习用于形状分析
Unsupervised 3D Learning for Shape Analysis via Multiresolution Instance Discrimination
论文作者
论文摘要
尽管无监督的功能学习已经证明了其在许多领域中减少数据标记和网络设计工作量的优势,但现有的无监督的3D学习方法仍然无法为具有竞争性绩效的各种形状分析任务提供通用网络。在本文中,我们提出了一种无监督的方法,用于学习用于不同形状分析任务的通用和高效的编码网络。我们方法的关键思想是从未标记的3D点云中共同编码和学习形状和点特征。为此,我们将HR-NET调整为基于OCTREE的卷积神经网络,以通过融合的多解析子网结合形状和点特征,并设计一个简单效率的多解析实例歧视(中),以共同学习形状和点特征。我们的网络将3D点云作为输入和输出形状和点特征。训练后,网络与简单的特定任务后端层加入,并进行了微调,以进行不同的形状分析任务。我们通过一组形状分析任务,包括形状分类,语义形状分割以及形状注册任务来评估我们方法的疗效和通用性,并验证我们的网络和损失设计。借助简单的后端,我们的网络展示了所有无监督的方法中的最佳性能,并在监督方法中实现了竞争性能,尤其是在具有小标签数据集的任务中。对于细颗粒的形状分割,我们的方法甚至超过了现有的监督方法。
Although unsupervised feature learning has demonstrated its advantages to reducing the workload of data labeling and network design in many fields, existing unsupervised 3D learning methods still cannot offer a generic network for various shape analysis tasks with competitive performance to supervised methods. In this paper, we propose an unsupervised method for learning a generic and efficient shape encoding network for different shape analysis tasks. The key idea of our method is to jointly encode and learn shape and point features from unlabeled 3D point clouds. For this purpose, we adapt HR-Net to octree-based convolutional neural networks for jointly encoding shape and point features with fused multiresolution subnetworks and design a simple-yet-efficient Multiresolution Instance Discrimination (MID) loss for jointly learning the shape and point features. Our network takes a 3D point cloud as input and output both shape and point features. After training, the network is concatenated with simple task-specific back-end layers and fine-tuned for different shape analysis tasks. We evaluate the efficacy and generality of our method and validate our network and loss design with a set of shape analysis tasks, including shape classification, semantic shape segmentation, as well as shape registration tasks. With simple back-ends, our network demonstrates the best performance among all unsupervised methods and achieves competitive performance to supervised methods, especially in tasks with a small labeled dataset. For fine-grained shape segmentation, our method even surpasses existing supervised methods by a large margin.