Decoding of facial strains via conformable piezoelectric interfaces
Decoding of facial strains via conformable piezoelectric interfaces
复制标题
DOI：
10.1038/s41551-020-00612-w
复制
发表时间：
2020-10-01
影响因子：
28.1
通讯作者：
Dagdeviren, Canan
中科院分区：
文献类型：
--
作者：
Sun, Tao;Tasnim, Farita;Dagdeviren, Canan
促进非语言交流的设备通常需要高计算负荷或具有不适合在面部或其他曲线身体表面上使用的刚性和笨重的形状因子。在这里，我们报告的设计和试点测试的集成系统解码面部应变和面部运动学预测。该系统由可大规模制造的，适形压电薄膜的应变映射;多物理场建模分析之间的非线性机械相互作用的适形设备和表皮;和三维数字图像相关性重建软组织表面下的动态变形，以及通知设备的设计和放置。在健康个体和肌萎缩侧索硬化症患者中，我们证明了压电薄膜，再加上用于实时检测和分类不同皮肤变形特征的算法，能够可靠地解码面部运动。该集成系统可适用于临床环境中使用的非语言通信技术或用于监测神经肌肉conditions.An整合系统包括顺应压电器件，三维数字图像相关，多物理建模和实时分类算法预测面部运动学和解码面部变形。
Devices that facilitate nonverbal communication typically require high computational loads or have rigid and bulky form factors that are unsuitable for use on the face or on other curvilinear body surfaces. Here, we report the design and pilot testing of an integrated system for decoding facial strains and for predicting facial kinematics. The system consists of mass-manufacturable, conformable piezoelectric thin films for strain mapping; multiphysics modelling for analysing the nonlinear mechanical interactions between the conformable device and the epidermis; and three-dimensional digital image correlation for reconstructing soft-tissue surfaces under dynamic deformations as well as for informing device design and placement. In healthy individuals and in patients with amyotrophic lateral sclerosis, we show that the piezoelectric thin films, coupled with algorithms for the real-time detection and classification of distinct skin-deformation signatures, enable the reliable decoding of facial movements. The integrated system could be adapted for use in clinical settings as a nonverbal communication technology or for use in the monitoring of neuromuscular conditions.An integrated system consisting of conformable piezoelectric devices, three-dimensional digital image correlation, multiphysics modelling and real-time classification algorithms predicts facial kinematics and decodes facial deformations.