RI: Small: Addressing Visual Analogy Problems on the Raven's Intelligence Test

RI：小：解决乌鸦智力测试中的视觉类比问题

• 批准号: 1116541
• 负责人: Ashok Goel
• 金额: $ 45万
• 依托单位: Georgia Tech Research Corporation
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2011
• 资助国家: 美国
• 起止时间: 2011-08-01 至 2015-07-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1116541&HistoricalAwards=false
• 关键词: RI; Small; Addressing; Visual; Analogy

This proposal aims to create purely image-based reasoning methods for solving visual analogy problems, particularly so-called Raven's Progressive Matrices (RPM) problems. The project draws on recent results from the study of human cognition as well computer science and mathematics. Raven's Progressive Matrices consist wholly of visual analogy problems in which a matrix of geometric figures is presented with one entry missing, and the correct missing entry must be selected from a set of answer choices. Recent analysis of RPM data suggests that although in general the performance of individuals with autism on most intelligence tests is significantly inferior to that of typically developing individuals, on the Raven's test the performance of the two groups is comparable. This data is consistent with the "Thinking in Pictures" hypothesis that has been proposed as a potential, partial cognitive explanation of autism. In both artificial intelligence and psychology, current theories of solving RPM problems first convert the visual inputs into verbal representations and then process the verbal representations. In contrast, this project explores the hypothesis that many RPM problems can be solved using only visual representations, without extracting any verbal representations from the input images. This project will develop and analyze computational techniques for addressing RPM problems with only visual representations. In particular, this project will develop a novel algorithm based on affine transformations for addressing RPM problems as well as a second algorithm that makes use of fractal encodings. With both approaches -- affine and fractal -- the project seeks to achieve human-level performance on RPM in terms of percentages of problems solved correctly. The two algorithms will also be tested on the "odd-man-out" corpus that contains thousands of visual analogy problems. The project will formally characterize the set of visual analogy problems for which the affine and fractal algorithms are applicable, analyze the computational properties of the algorithms, construct proofs of their correctness for specific classes of problems, and compare the errors made by the two algorithms with those made by two groups of humans -- typically developing individuals and individuals with autism. The project will parameterize the visual algorithms to detect the settings under which the patterns of errors made by an algorithm on RPM problems most closely match the error patterns of the two human groupings. Autism is an important problem of growing social concern. While the thinking-in-pictures hypothesis has long been a significant insight into cognition in autism, and empirical evidence -- both behavioral and neuroimaging -- in its favor is increasing, there have been no computational models for it. The proposed research would help provide a computational form to this hypothesis and may help establish a disposition towards visual thinking with autism. RPM is considered one of the core tests of intelligence, and although there have been several suggestions about the visuospatial nature of RPM problems, all current computational models addressing such visual analogy problems use sequential processing on propositional representations of the input images. The algorithms from this project that rely on visual representations for RPM could provide new insights into intelligence testing. Lastly, while fractal encodings have been used in computer graphics for generating images and in computer vision for texture analysis in image processing, this project's use of fractal encodings for visual analogies on intelligence tests will contribute to knowledge of fractal computing.

这项建议旨在创建纯基于图像的推理方法来解决视觉类比问题，特别是所谓的乌鸦递进矩阵(RPM)问题。该项目借鉴了人类认知以及计算机科学和数学研究的最新成果。瑞文的递进矩阵完全由视觉类比问题组成，其中一个几何图形的矩阵被呈现时缺少一个条目，并且必须从一组答案选择中选择正确的缺失条目。最近对RPM数据的分析表明，尽管总的来说，自闭症患者在大多数智力测试中的表现明显逊于正常发育的人，但在瑞文测试中，两组人的表现是相当的。这一数据与“图画思维”假说是一致的，该假说被认为是自闭症的一种潜在的、部分的认知解释。在人工智能和心理学中，现有的解决RPM问题的理论都是先将视觉输入转换为语言表征，然后再对语言表征进行处理。相反，这个项目探索了这样一个假设，即许多RPM问题可以仅使用视觉表示法来解决，而不需要从输入图像中提取任何语言表示法。这个项目将开发和分析用于解决RPM问题的计算技术，仅使用视觉表示。特别是，这个项目将开发一种基于仿射变换的新算法来解决RPM问题，以及第二种利用分形编码的算法。使用这两种方法--仿射和分形--该项目寻求在正确解决问题的百分比方面实现人类在RPM上的表现。这两种算法还将在包含数千个视觉类比问题的“奇人出局”语料库上进行测试。该项目将正式描述仿射和分形算法适用的视觉类比问题集，分析算法的计算特性，针对特定类别的问题构建其正确性的证明，并将这两种算法所犯的错误与两组人--典型的发展中的个人和患有自闭症的人--所犯的错误进行比较。该项目将对视觉算法进行参数化，以检测在何种设置下，RPM问题上的算法所产生的错误模式与两个人类分组的错误模式最接近。自闭症是一个日益受到社会关注的重要问题。虽然图画思维假说长期以来一直是对自闭症认知的重要洞察，而且支持它的经验证据--包括行为和神经成像--正在增加，但还没有针对它的计算模型。这项拟议的研究将有助于为这一假设提供一种计算形式，并可能有助于建立自闭症患者对视觉思维的倾向。RPM被认为是智力的核心测试之一，尽管已经有一些关于RPM问题的视觉空间性质的建议，但目前所有解决此类视觉类比问题的计算模型都使用对输入图像的命题表征的顺序加工。这个项目的算法依赖于RPM的视觉表示，可以为智力测试提供新的见解。最后，虽然在计算机图形学中使用了分形编码来生成图像，并在计算机视觉中用于图像处理中的纹理分析，但这个项目在智力测试中使用分形编码来进行视觉类比将有助于学习分形计算的知识。