EAGER: Physio-linguistic Models of Deception Detection

这个探索性研究的早期概念基金的目标是探索新一代的计算工具，用于人类行为的生理和语言信号的联合建模。这是第一个研究欺骗分析的生理语言模型的项目。为了实现这一目标，本文将追求以下三个研究目标。首先，建立了一个新的欺骗物理语言数据集，涵盖了几个不同的领域。其次，探索基于规则的欺骗检测分类器，使用生理特征（例如，心率，呼吸速率，皮肤电反应，皮肤温度）以及语言特征。第三，利用早期、晚期和时间融合模型的最新进展，开发了用于多模态欺骗检测的数据驱动学习方法。该项目在本质上是探索性的，并作为新的研究问题的催化剂。首先，它探索了从生理和语言模态中提取的丰富的多模态特征集，分析了它们在欺骗识别中的有效性。其次，它还探索了多种生理语言模式的整合，通过基于规则和数据驱动技术的实验，将多模式特征融合到联合欺骗分析模型中。为了应对多模态研究工作的挑战，这个项目的团队汇集了来自生物传感器、计算语言学、生理学和行为科学领域的专家。该项目具有很高的潜在回报，因为欺骗检测模型具有广泛的适用性，包括：为刑事司法、情报和安全等领域的各种应用开发关键工具；增强可能因存在欺骗而受到负面影响的应用程序，例如意见分析或人类交流建模；对人类行为的基本方面有更深入的了解，这对精神病学和心理学的医学应用有积极的影响。在这个项目中产生的工具和数据集将免费提供给研究界。欲了解更多信息，请参阅该项目的网站：http://web.eecs.umich.edu/~mihalcea/deceptiondetection/

The goal of this Early-concept Grant for Exploratory Research is to explore a new generation of computational tools for joint modeling of physiological and linguistic signals of human behavior. The project is the first to investigate physio-linguistic models for deception analysis. To achieve this goal, the following three research objectives are pursued. First, a novel physio-linguistic dataset of deceit is built, covering several different domains. Second, rule-based classifiers for deception detection are explored, using physiological features (e.g., heart rate, respiration rate, galvanic skin response, skin temperature), as well as linguistic features. Third, data-driven learning approaches for multimodal deception detection are developed, taking advantage of the recent progress in early, late, and temporal fusion models. The project is exploratory in nature, and acts as a catalyst for novel research problems. First, it explores rich sets of multimodal features extracted from physiological and linguistic modalities, analyzing their effectiveness in the recognition of deceit. Second, it also explores the integration of multiple physio-linguistic modalities, through experiments with rule-based and data-driven techniques that fuse multimodal features into joint deception analysis models. To address the challenges of multimodal research work, the team working on this project brings together experts from the fields of bio-sensors, computational linguistics, and physiology and behavioral sciences.The project has high potential payoffs, as models of deception detection have broad applicability, including: the development of critical tools for various applications in fields such as criminal justice, intelligence, and security; the enhancement of applications that can be negatively affected by the presence of deceit, such as opinion analysis or modeling of human communication; and a deeper understanding of fundamental aspects of human behavior, which can positively impact medical applications in psychiatry and psychology. The tools and datasets produced during this project will be made freely available for the research community.For further information see the project web site at: http://web.eecs.umich.edu/~mihalcea/deceptiondetection/