SHF: SMALL: Automated Discovery of Cross-Language Program Behavior Inconsistency

在软件行业中，存在数百种编程语言，其中许多程序员被要求精通。通常的假设是，一旦程序员了解了一种语言，他们就可以利用已经学到的概念和知识，轻松地学习另一种编程语言。不幸的是，实证研究发现这个过程是容易出错和无效的，由于概念和表达式之间的不精确的不匹配跨编程语言。该项目开发技术，通过识别和解释不同语言中代码的行为如何相关，来简化新编程语言的知识获取。预期的结果是，程序员将更快地学习新语言，并编写出错误更少的代码。除了受过良好教育的程序员的普遍利益外，计算机编程教学技术特别重要，因为编程是数字化社会的关键技能。本项目将开发自动识别两种编程语言之间的能力和潜在误解的技术。本项目将研究两项主要研究任务。第一个任务是开发一种方法，根据动态行为、可能的不变量、观察到的副作用和性能自动识别相似代码的集群。行为集群是由多种语言的代码片段组成的，这些代码片段在相同的输入上产生相同的输出。来自观察到的行为的可能不变量用于描述相似性和差异。第二个任务是开发一种技术来识别当程序员假设代码应该具有相同的行为但实际上没有时出现的误解。为了识别误解，该技术利用了来自代码相似性分析的行为集群和特征;看起来相似但在公开（行为）或隐藏（性能，副作用）方面表现不同的代码是候选者。该技术将根据出现的概率和可能的影响对误解进行排名。 最后，该技术将使用不变量，行为，副作用和性能来形成行为相似性和差异的自动解释。最后，这些技术和解释将被应用于两组真实的程序员：了解一种语言并需要学习一种新语言的转学生，以及使用多种编程语言来完成任务的数据科学家。对于学习新语言的程序员，无论是学生、专业人员还是业余爱好者，这项工作旨在提高他们获得编程语言知识的速度和可靠性。该奖项反映了NSF的法定使命，并通过使用基金会的智力价值和更广泛的影响审查标准进行评估，被认为值得支持。

In the software industry, hundreds of programming languages exist, many of which programmers are expected to be proficient in. The common assumption has been that once a programmer knows one language, they can leverage concepts and knowledge already learned and easily pick up another programming language. Unfortunately, empirical studies find this process to be error-prone and ineffective due to imprecise mismatches between concepts and expressions across programming languages. This project develops techniques to ease the acquisition of knowledge for new programming languages by identifying and explaining how the behaviors of code in different languages relate. The anticipated result is that programmers will learn new languages faster and write code with fewer bugs. Beyond the general benefit of better-educated programmers, techniques for teaching computer programming are important in particular because programming is a crucial skill for a digitally literate society.This project will develop techniques to automatically identify incapabilities and potential misconceptions between two programming languages. Two main research tasks will be investigated for this project. The first task is to develop an approach for automatically identifying clusters of similar code based on dynamic behavior, likely invariants, observed side effects, and performance. Behavioral clusters are formed from snippets in multiple languages that produce the same outputs on the same inputs. Likely invariants from observed behavior are used to describe similarities and differences. The second task is to develop a technique to identify misconceptions that emerge when a programmer assumes code should behave the same but it does not. To identify misconceptions, the technique leverages the behavior clusters and characterizations from the code similarity analysis; code that looks similar but behaves differently in overt (behavior) or insidious (performance, side effects) ways are candidates. The technique will rank misconceptions based on probability of appearing and likely impact. Finally, the technique will use invariants, behavior, side effects and performance to form automated explanations of behavioral similarities and differences. Finally, these techniques and explanations will be applied for the benefit of two groups of real programmers: transfer students who know one language and need to learn a new one, and data scientists who work with many programming languages to complete their tasks. For programmers learning a new language, in student, professional, or hobby capacities, this work aims to increase the speed and reliability with which they acquire knowledge of the programming language.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.