SHB: Medium: Quantitative Observational Practice in Family Studies: The Case of Reactivity

与普遍的单模态观点相反，该项目侧重于定量整合驻留在多种模态中的信息，以产生从全球类别到时间连续行为抽象的观察行为分析描述，并为识别和建模在现实环境中引发的沟通和情感互动动态提供新的算法和模型。 计算挑战是多重的，从通过对所感测信息的特定领域解释的模型来自动感知情感丰富的行为和认知，到通过将人类的知识和专业知识与机器的信息处理能力相结合来采取行动。该研究影响了以人类状态和交互的观察为中心的广泛应用，例如，该项目还为本科生和研究生提供多学科培训。 预期成果包括通过新的信息增强对心理学的好处，通过改进智能和强大的人类行为计算对技术的好处，以及通过引入转换工具对观察实践的好处。

In contrast to the prevalent uni-modal perspective, the project focuses on quantitatively integrating information residing in multiple modalities to yield observational behavior analysis descriptions that range from global categories to time continuous behavioral abstractions and contributes novel algorithms and models for recognizing and modeling communicative and affective interaction dynamics elicited in realistic settings of couples and family therapy. The computational challenges are multiple from automated perception of emotionally rich behaviors and cognition through models for domain specific interpretation of the sensed information, to action through combining the knowledge and expertise of humans with the information processing abilities of the machine.The research impacts a wide range of applications centered on observations of the human state and interactions, e.g., mental health applications, business customer services, negotiation tactics, law enforcement (interviews), etc. The project also provides multi-disciplinary training for undergraduate and graduate students. The expected outcomes include benefits to psychology through novel information augmentation, in technology through improved intelligent and robust human behavior computing, and in observational practice through the introduction of transformational tools.