论文标题

3D视觉跟踪以量化人与人之间的身体接触互动

3D Visual Tracking to Quantify Physical Contact Interactions in Human-to-Human Touch

论文作者

Xu, Shan, Xu, Chang, McIntyre, Sarah, Olausson, Håkan, Gerling, Gregory J.

论文摘要

在许多社交场合中,我们以自然和直观的方式触摸其他人,以分享思想和情感,例如轻拍以引起人们的注意或抚摸自己的焦虑。对这些人对人类相互作用的更深入的了解将需要在某种程度上确切地测量皮肤对皮肤的身体接触。在先前的努力中,每种测量方法都表现出某些限制,例如,运动跟踪器不会捕获皮肤表面的精确形状,而压力传感器会阻碍直接皮肤接触。相比之下,这项工作使用深度摄像头开发了无干扰的3D视觉跟踪系统,以测量触摸器的裸手和接收器前臂之间的接触属性。通过将手模型拟合以检测到3D接头,将触摸器的手跟踪为姿势和定位的网格,而前臂则作为详细的3D表面提取。基于点云的接触模型,时空接触变化被分解为六个高分辨率的时间序列属性,即接触面积,压痕深度,绝对速度和三个正交速度组件以及接触持续时间。为了检查系统的功能和局限性,进行了两个实验。首先,为了评估其辨别人类触摸的能力,一个人通过他们首选的手势传达了社交信息,例如幸福,愤怒,同情。结果表明,消息,手势和单个触摸器很容易从其接触属性中辨别。其次,针对独立设备(包括电磁跟踪器,压力垫和激光传感器)验证了测量精度。尽管在社会交流的背景下进行了验证,但该系统可扩展到人类的互动,例如对婴儿的孕产妇护理和按摩疗法。

Across a plethora of social situations, we touch others in natural and intuitive ways to share thoughts and emotions, such as tapping to get one's attention or caressing to soothe one's anxiety. A deeper understanding of these human-to-human interactions will require, in part, the precise measurement of skin-to-skin physical contact. Among prior efforts, each measurement approach exhibits certain constraints, e.g., motion trackers do not capture the precise shape of skin surfaces, while pressure sensors impede direct skin contact. In contrast, this work develops an interference-free 3D visual tracking system using a depth camera to measure the contact attributes between the bare hand of a toucher and the forearm of a receiver. The toucher's hand is tracked as a posed and positioned mesh by fitting a hand model to detected 3D joints, whereas the forearm is extracted as a detailed 3D surface. Based on a contact model of point clouds, the spatiotemporal contact changes are decomposed as six high-resolution time-series attributes, i.e., contact area, indentation depth, absolute velocity, and three orthogonal velocity components, together with contact duration. To examine the system's capabilities and limitations, two experiments were performed. First, to evaluate its ability to discern human touches, one person delivered cued social messages, e.g., happiness, anger, sympathy, to another using their preferred gestures. The results indicated that messages, gestures, and the individual touchers, were readily discerned from their contact attributes. Second, the measurement accuracy was validated against independent devices, including an electromagnetic tracker, pressure mat, and laser sensor. While validated here in the context of social communication, this system is extendable to human touch interactions such as maternal care of infants and massage therapy.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源