Off body affective and cognitive monitoring for adaptive applications

这个参与项目希望有助于开发创新的应用程序，可以监测情感和认知状态的基础上声乐韵律。这种应用程序将是有益的，因为它将揭示有关两个人的互动信息，即满意度或挫折感，这可能需要调整策略和压力检测或高工作量，这可能需要重新分配任务和需求。Cortex Medias的应用程序已经包括了语音内容识别。添加基于语音韵律（说话的方式，而不是口语的实际语言意义）的情绪和认知状态的在线监测将大大提高其应用的有效性。我们的方法结合了实验心理学和认知工效学，将语音韵律特征的自动计算和在线评估整合起来，用于识别情绪和认知特征。首先，该应用程序将通过集成自动计算和在线监测两个人之间互动过程中的情绪和认知状态的算法来进一步开发。用于评估的两个维度是满意度和工作量。第二，该项目将允许细化和验证的实施算法，从韵律特征使用physiologicalmeasures和面部表情系统的确证评价。这个项目的结果将为设计应用程序提供指导和建议，包括基于韵律特征识别用户的情感和认知状态。该项目的成果将对加拿大的技术、金融和教育部门以及公共安全、智能辅导、电子健康和游戏业等其他领域产生积极影响。

This Engage Project wishes to contribute to the development of innovative applications that can monitoremotional and cognitive states based on vocal prosody. Such applications will be beneficial since it will revealinformation about the interaction of two individuals, i.e. satisfaction or frustration, which can require anadjustment in strategy and stress detection or high workload, which can require reallocation of tasks anddemands. Cortex medias' application already includes verbal content recognition. Adding the online monitoringof emotional and cognitive states based on vocal prosody (the way something is said as opposed to the actuallinguistic meanings of the spoken words) will greatly enhance the validity of their application. Our approachcombines experimental psychology and cognitive ergonomics to integrate the automatic calculation and onlineassessment of vocal prosodic features for the recognition of emotions and cognitive traits. First, the applicationwill be further developed by integrating algorithms for the automatic calculation and online monitoring ofemotional and cognitive states during interactions between two individuals. The two dimensions used for theassessment will be satisfaction and workload. Second, the project will allow the refinement and validation ofthe implemented algorithms by corroborating evaluation from the prosodic features using physiologicalmeasures and a facial expression system. Results of this proposed project will define guidelines andrecommendations for designing applications that include recognition of users' emotional and cognitive statesbased on prosodic features. The outcomes of the project will positively impact the Canadian technological,financial and education sectors, as well as other areas such as public security, intelligent tutoring, e-health andthe gaming industry.