Impact of non-photorealistic rendering for the understanding of emotional facial expressions by children and adolescents with high-functioning Autism Spectrum Disorders

非真实感渲染对患有高功能自闭症谱系障碍的儿童和青少年理解情绪面部表情的影响

• 批准号: 233623354
• 负责人: Dr. Diana Arellano
• 金额: --
• 依托单位: Arbeitsgruppe Visual Computing
• 依托单位国家: 德国
• 项目类别: Research Grants
• 财政年份: 2013
• 资助国家: 德国
• 起止时间: 2012-12-31 至 2016-12-31
• 项目状态: 已结题
• 来源: https://gepris.dfg.de/gepris/projekt/233623354?language=en
• 关键词: Impact; non; photorealistic; rendering; understanding

The project deals with creating and animating computer-generated facial expressions in different levels of abstraction for the purpose of investigating how they are perceived by subjects with Attention-Deficit/Hyperactivity Disorder (ADHD) and Autism Spectrum Disorders (ASD). In a dialog with a virtual character we will test the ability of non-neurotypical children and young teenagers to read emotional states in the face of the characters. In contrast to previous works we want to conduct interactive experiments that allow the experimenter to adapt in real-time to the situation.The three partners provide unique expertise for this research project: the Filmakademie Baden-Württemberg is a world-known institution for computer animation that has to its credits the development of the Filmakademie Application Framework (Frapper), a system for facial animation, among other features, that is used in many films and that was also applied in a preliminary study with University of Freiburg for psychological experiments. The University of Freiburg is a leading center for investigating Attention-Deficit/Hyperactivity Disorder and Autism Spectrum Disorders, having obtained important results in the past. The University of Konstanz has great expertise in Non-photorealistic Rendering and computer-generated abstraction, becoming an important reference in the Computer Graphics community. It has an ongoing collaboration with Filmakademie Baden-Württemberg and already created prototypical artistic rendering methods in Frapper that were used in two animation films. The proposed project wants to bring together the three institutions in a three-year project. The University of Konstanz will develop coherent and steerable abstraction methods for facial animations in a number of styles. The Filmakademie will integrate these methods in their application framework to extend it and to integrate it into interactive experiments, allowing the experimenter to influence rendering style, level of abstraction, mental state of the virtual character. The University of Freiburg will use the virtual characters for their experiments, while providing help to Konstanz and the Filmakademie to design more accurate and effective abstraction methods for the framework.Aside from supporting psychological tests the abstraction methods for faces are also very important for Computer Graphics. Many applications ranging from Computer Animation, virtual Avatars to dialogue and help systems will benefit from characters that can be displayed in various degrees of detail in dependence to the application. The development of various steerable non-photorealistic rendering techniques and their integration into a real-time animation system will enable a new quality of human-computer interaction in which the displayed character is represented in an intended degree of abstraction.

该项目涉及在不同抽象层次上创建和动画计算机生成的面部表情，以调查注意力缺陷/多动症（ADHD）和自闭症谱系障碍（ASD）受试者如何感知它们。在与虚拟角色的对话中，我们将测试非神经正常儿童和青少年阅读角色面部情绪状态的能力。与之前的研究不同，我们希望进行交互式实验，让实验者能够实时适应情况。三位合作伙伴为这个研究项目提供了独特的专业知识：巴登-符滕贝格电影学院是世界知名的计算机动画机构，其开发了电影学院应用框架（Frapper），一种用于面部动画的系统，以及其他特征，这在许多电影中被使用，也被应用在弗赖堡大学的心理实验的初步研究中。弗赖堡大学是研究注意力缺陷/多动障碍和自闭症谱系障碍的领先中心，在过去取得了重要成果。康斯坦茨大学在非真实感渲染和计算机生成抽象方面拥有丰富的专业知识，成为计算机图形学社区的重要参考。它与巴登-符滕贝格电影学院有着持续的合作，并且已经在两部动画电影中使用了Frapper创建了原型艺术渲染方法。拟议的项目希望在一个为期三年的项目中将这三个机构聚集在一起。康斯坦茨大学将为多种风格的面部动画开发连贯和可操纵的抽象方法。Filmakademie将这些方法集成到他们的应用程序框架中，以扩展它并将其集成到交互式实验中，允许实验者影响渲染风格，抽象水平，虚拟角色的精神状态。弗赖堡大学将使用虚拟人物进行实验，同时帮助康斯坦茨和电影学院为框架设计更准确有效的抽象方法。除了支持心理测试外，面部抽象方法对计算机图形学也非常重要。从计算机动画、虚拟化身到对话和帮助系统的许多应用程序都将受益于可以根据应用程序以不同程度的细节显示的字符。各种可操纵的非真实感渲染技术的发展和它们集成到实时动画系统中将实现新的人机交互质量，其中显示的角色以预期的抽象程度表示。

项目成果

Depth-aware coherent line drawings

• DOI: 10.1145/2820903.2820909
• 发表时间: 2015-11
• 期刊: SIGGRAPH Asia 2015 Technical Briefs
• 作者: Marc Spicker;J. Kratt;Diana Arellano;O. Deussen

Emotion recognition in autism spectrum disorder: does stylization help?

自闭症谱系障碍的情绪识别：程式化有帮助吗？

• DOI: 10.1145/2931002.2931004
• 发表时间: 2016
• 期刊: Proceedings of the ACM Symposium on Applied Perception
• 作者: M. Spicker;D. Arellano;U. Schaller;R. Rauh;V. Helzle;O. Deussen
• 通讯作者: O. Deussen

The SARA Project: An Interactive Sandbox for Research on Autism

SARA 项目：用于自闭症研究的交互式沙箱

• DOI: 10.1145/2829875.2829884
• 发表时间: 2015
• 期刊: Proceedings of the XVI International Conference on Human Computer Interaction
• 作者: D. Arellano;V. Helzle;U. M. Schaller;R. Rauh;M. Spicker;O. Deussen
• 通讯作者: O. Deussen

On the Trail of Facial Processing in Autism Spectrum Disorders

自闭症谱系障碍的面部处理研究

• DOI: 10.1007/978-3-319-21996-7_46
• 发表时间: 2015
• 作者: D. Arellano;U. Schaller;R. Rauh;V. Helzle;M. Spicker;O. Deussen
• 通讯作者: O. Deussen