What does the human face tell the human brain?

1)研究背景的简要描述，包括潜在的影响了解大脑功能的实验在很大程度上仅限于单人研究，由于设备的限制，仅限于令人望而却步的扫描仪。功能性近红外光谱(FNIRS)的兴起使我们有机会在更生态有效的情况下更深入地研究我们对大脑的理解。这在社交场景中尤为重要。所有社交互动的基础都是由参与者的面部表情形成的。因此，观察神经通路在受到不同面部刺激时的功能，可以让我们有机会更深入地了解典型的大脑是如何工作的。2)目的和目的因此，该项目的目标是开发多模式的综合方法，将脑电、fNIRS、眼球跟踪、眼神接触、主题报告和面部分类结合到高级面部动力学、人类交流和行为的模型中。将进行研究，以检查和绘制面部对大脑功能反应和皮质位置的反应，在实验中，参与者既有表情，也有其他人的情绪表情。将探索机器学习方法，以应用计算框架对与面部表情有关的神经特征进行分类。还将开发信号处理和统计技术，以便有效地将多模式设备数据相互关联并进行分析。3)研究方法的新颖性项目的新颖性在于实验方法和数据分析的计算方法。与其他神经成像方法相比，fNIRS的一个显著好处是有机会同时检查与两个人进行的社交互动背后的神经关联；众所周知，两个人互动的皮质过程与一个人观察视频或图片有很大不同。考虑到这一点，研究两人神经反应的方法还不够发达。因此，将研究、开发和应用新的机器学习方法，目的是分离神经对面部表情的反应。此外，由于我们将开发一个多模式套件来调查多个生理参数，将开发计算工具来整合所获得的数据并对其进行分析。4)与EPSRC的战略和研究领域保持一致该项目在EPSRC战略的优化治疗重大挑战中发挥了作用。具体地说，该项目的长期影响涉及开发和改进具有高灵敏度、特异度和可靠性的新型低成本诊断设备，用于及时和准确的诊断，改进干预选择和降低干预成本，并增加成功健康结果的可能性。此外，数据分析方法从人口数据中识别疾病表型和相关的治疗反应，允许以证据为基础选择治疗方案，降低成本和发病率，并改善健康结果。短期内，该项目专注于理解复杂医疗数据的新方法，以及开发用于诊断、监测和治疗应用的新一代成像技术；提高准确性、可负担性并采用新模式。5)任何参与该项目的公司或合作伙伴本项目与岛津公司和位于康涅狄格州纽黑文的耶鲁医学院脑功能实验室合作。

1) Brief description of the context of the research including potential impactExperiments to understand how the brain functions have largely been limited to single person studies, confined to prohibitive scanners due to limitations with equipment. The rise of functional near-infrared spectroscopy (fNIRS) has allowed us the opportunity to delve deeper into our understanding of the brain in more ecologically valid scenarios. This is especially important in social scenarios. The foundation of all social interactions is formed from the facial expressions of those involved. Therefore, observing how neural pathways function when presented with different facial stimuli grants us the opportunity to gain a deeper understanding of how the typical brain works. With this understanding fNIRS can be used to provide insight into how neurological disorders progress, in real time, in the case of stroke patients, dementia or a multitude of neurological disorders.2) Aims and objectivesThus, the aims of the project are to develop multi-modal integrative approaches, combining the use of EEG, fNIRS, eye-tracking, eye-contact, subject reports, and facial classifications into models of high-level facial dynamics, human communication and behaviour. Studies will be performed to examine and map facial responses to brain functional responses and cortical locations, in experiments were participants both emote expressions and observe emoted expressions from others. Machine Learning methodologies will be explored to apply a computational framework for the classification of neural signatures in relation to facial expressions. Signal processing and statistical techniques will also be developed to effectively relate the multi-modal equipment data with each other and for analysis. 3) Novelty of the research methodologyThe novelty of the project lies with the experimental methodology and the computational methods to analyse data. A significant benefit of fNIRS over other neuroimaging modalities is the opportunity to examine the neural correlates underlying social interactions with two people simultaneously; it is known that the cortical processes of two-person interactions are significantly different to one person observing a video or picture. Considering this, the methodologies of investigating two-person neurological responses are underdeveloped. As such novel machine learning approaches will be investigated, developed, and applied with the aim of isolating neural responses to facial expressions. Additionally, as we will be developing a multi-modal suite to investigate multiple physiological parameters, computational tools will be developed to integrate the obtained data and to perform analysis on it. 4) Alignment to EPSRC's strategies and research areasThis project plays a role in the Optimising Treatment grand challenge of the EPSRC strategies. Specifically, the long term impact of this project relates to the development and improvement of novel, low-cost diagnostic devices, with high sensitivity, specificity and reliability, for timely and accurate diagnosis, improving the choice and reducing the cost of intervention, and increasing the likelihood of successful health outcomes. Additionally, data analytic methods to identify disease phenotypes and associated responses to treatment from population data, allowing evidence-based selection of treatment options, with lower costs and morbidity, and improved health outcomes. Short-term the project focuses on new methodologies for making sense of complex healthcare data, aswell as the development of next generation imaging technologies for diagnostic, monitoring and therapeutic applications; with improved accuracy, affordability and incorporating new modalities.5) Any companies or collaborators involvedThis project is in collaboration with Shimadzu Corporation and the Brain Function Laboratory, Yale School of Medicine, New Haven, CT.