论文标题

像素面:3D面重建的大规模高分辨率基准

Pixel-Face: A Large-Scale, High-Resolution Benchmark for 3D Face Reconstruction

论文作者

Lyu, Jiangjing, Li, Xiaobo, Zhu, Xiangyu, Cheng, Cheng

论文摘要

3D面部重建是一项基本任务,可以促进许多应用,例如健壮的面部分析和增强现实。由于缺乏高质量的数据集,这也是一项具有挑战性的任务,这些数据集可以推动当前的基于深度学习的方法。但是,现有数据集的数量,现实性和多样性受到限制。为了避免这些障碍,我们介绍了像素面,这是一个大规模,高分辨率和不同的3D面部数据集,并带有大量注释。具体而言,像素面包含855名年龄从18到80的受试者。每个受试者都有20多个带有各种表达的样本。每个样品由具有各种表达式的高分辨率多视频RGB图像和3D网格组成。此外,我们为每个数据收集精确的地标注释和3D注册结果。为了证明像素面的优势,我们使用收集的数据将3D形态模型(3DMM)重新分配到Pixel-3DM中。我们表明,所获得的像素-3DM在建模各种面部形状和表达方面更好。我们还仔细根据数据集上的现有3D面对重建方法进行基准测试。此外,像素面是有效的培训来源。我们观察到,使用我们新收集的数据进行微调后,当前面部重建模型的性能在现有基准和像素面上显着改善。广泛的实验证明了像素-3DM的有效性和像素面的实用性。

3D face reconstruction is a fundamental task that can facilitate numerous applications such as robust facial analysis and augmented reality. It is also a challenging task due to the lack of high-quality datasets that can fuel current deep learning-based methods. However, existing datasets are limited in quantity, realisticity and diversity. To circumvent these hurdles, we introduce Pixel-Face, a large-scale, high-resolution and diverse 3D face dataset with massive annotations. Specifically, Pixel-Face contains 855 subjects aging from 18 to 80. Each subject has more than 20 samples with various expressions. Each sample is composed of high-resolution multi-view RGB images and 3D meshes with various expressions. Moreover, we collect precise landmarks annotation and 3D registration result for each data. To demonstrate the advantages of Pixel-Face, we re-parameterize the 3D Morphable Model (3DMM) into Pixel-3DM using the collected data. We show that the obtained Pixel-3DM is better in modeling a wide range of face shapes and expressions. We also carefully benchmark existing 3D face reconstruction methods on our dataset. Moreover, Pixel-Face serves as an effective training source. We observe that the performance of current face reconstruction models significantly improves both on existing benchmarks and Pixel-Face after being fine-tuned using our newly collected data. Extensive experiments demonstrate the effectiveness of Pixel-3DM and the usefulness of Pixel-Face.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源