论文标题

内眼可以进行人体温度筛查

Inner Eye Canthus Localization for Human Body Temperature Screening

论文作者

Ferrari, Claudio, Berlincioni, Lorenzo, Bertini, Marco, Del Bimbo, Alberto

论文摘要

在本文中,我们提出了一种自动方法,用于将内眼的定位在热面图像中。我们首先检测到与眼睛中心,Nosetip和耳朵相对应的5个面部关键点。然后,我们使用3D形态的面部模型(3DMM)计算稀疏的2D-3D点对应关系。该对应关系用于将整个3D面投射到图像上,然后定位内眼。检测此位置允许使用热摄像机的人获得最精确的体温测量。我们在提供手动注释地标的热面数据集上评估了该方法。但是,这种手动注释通常被认为是为了识别眼睛,鼻子和嘴巴等面部零件,并且不是专门针对局部定位的canthus区域而定制的。作为额外的贡献,我们通过使用带注释的地标将3DMM变形并将3DMM投射到图像上来丰富原始数据集。然后,通过手动选择对应于眼睛的小区域,我们用其他注释丰富了数据集。通过使用手动地标,我们确保3DMM投影的正确性,可以用作将来评估的基础真相。此外,我们为数据集提供了3D头姿势和每点可见性掩模,以检测自我估计。数据将公开发布。

In this paper, we propose an automatic approach for localizing the inner eye canthus in thermal face images. We first coarsely detect 5 facial keypoints corresponding to the center of the eyes, the nosetip and the ears. Then we compute a sparse 2D-3D points correspondence using a 3D Morphable Face Model (3DMM). This correspondence is used to project the entire 3D face onto the image, and subsequently locate the inner eye canthus. Detecting this location allows to obtain the most precise body temperature measurement for a person using a thermal camera. We evaluated the approach on a thermal face dataset provided with manually annotated landmarks. However, such manual annotations are normally conceived to identify facial parts such as eyes, nose and mouth, and are not specifically tailored for localizing the eye canthus region. As additional contribution, we enrich the original dataset by using the annotated landmarks to deform and project the 3DMM onto the images. Then, by manually selecting a small region corresponding to the eye canthus, we enrich the dataset with additional annotations. By using the manual landmarks, we ensure the correctness of the 3DMM projection, which can be used as ground-truth for future evaluations. Moreover, we supply the dataset with the 3D head poses and per-point visibility masks for detecting self-occlusions. The data will be publicly released.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源