SoCS: Studying the Computability of Emotions by Harnessing Massive Online Social Data

大量人工评级和评论的视觉数据的出现，为探索人工智能领域的基本问题开辟了道路。该项目解决了自动推断视觉美学和情感的挑战，并发明了帮助公众创造性和决策活动的新系统。一个具有视觉建模、数据挖掘、心理学和计算科学专业知识的跨学科团队将构建工具，从视觉、文本和数字数据的组合中提取信息。根据已发表的文献和咨询领域专家的意见，将提取视觉特征来区分情绪类型。由此产生的系统可以根据美学和情感对视觉信息进行选择和排序。智力优势：该项目将使计算机科学家了解下一代计算机视觉美学和情感评估系统。美学和情感评估中内容、情境和主观性之间复杂的相互关系使得相应的学习问题特别具有挑战性，这可能会引发机器学习和统计建模的创新。这些功能将从根本上改变视觉信息的分析、处理和管理方式。该项目将促进我们对情绪可计算性的理解，并导致可以在各种环境中使用的新应用。更广泛的影响：这项研究将对信息检索、人机交互、信息处理、消费电子和设计等领域产生革命性的影响。该技术还可用于提炼作为教育资源的多媒体内容。该项目将传播研究成果，生成新的软件实现和收集的数据集，并提供可供研究人员、教育工作者和工业界使用的在线服务。教育工作包括制定跨学科课程、培训跨学科科学家以及让代表性不足的群体参与研究。

The emergence of massive human-rated and commented visual data has opened avenues for exploring fundamental questions in artificial intelligence beyond the horizon. This project tackles the challenge of automatically inferring visual aesthetics and emotions and inventing new systems that assist creative and decision-making activities of the general public. An interdisciplinary team, with expertise in visual modeling, data mining, psychology, and computational sciences will build tools to distill information from a combination of visual, textual, and numerical data. Visual features, selected based on published literature and consultation with domain experts, will be extracted for discriminating types of emotions. The resulting systems can select and rank visual information based on aesthetics and emotions.Intellectual Merits: This project will allow computer scientists to gain understanding of next-generation computerized visual aesthetics and emotion assessment systems. The complex inter-relationship among content, context, and subjectivity in aesthetics and emotion assessment makes the corresponding learning problems especially challenging, which is likely to trigger innovation in machine learning and statistical modeling. Such capabilities will fundamentally change the way visual information is analyzed, processed, and managed. The project will advance our understanding of the computability of emotions, and lead to new applications that can be used in a variety of settings.Broader Impacts: The research will have a transformative impact in the fields of information retrieval, human-computer interaction, information processing, consumer electronics, and design. The technology can also be used to refine multimedia content that serves as education resources. The project will disseminate research findings, generate new software implementations and collected datasets, and provide online services that can be used by researchers, educators, and industry. Education efforts include developing an interdisciplinary curriculum, training cross-disciplinary scientists, and involving underrepresented groups in research.