Test migration for efficient large-scale assessment of mobile app coding assignments
Test migration for efficient large-scale assessment of mobile app coding assignments
复制标题
DOI：
10.1145/3213846.3213854
复制
发表时间：
2018-07
期刊：
影响因子：
--
通讯作者：
Farnaz Behrang;A. Orso
中科院分区：
文献类型：
--
作者：
Farnaz Behrang;A. Orso
近年来，人们对利用互联网技术广泛普及教育的兴趣日益浓厚。无论是大规模开放在线课程（MOOC）还是使用在线平台向大量学生提供的大学课程，专注于教育的公司和大学通常相互合作，一直在在线教育方面进行了大量投资。事实上，数百名甚至数千名学生参加这些在线课程，这给评估学生作业带来了可扩展性挑战。在本文中，我们特别提出了一种技术（GUITestMigrator）来解决评估移动应用程序编码分配的挑战。给定一组实现相同规范但可以具有完全不同的用户界面的应用程序，教师通常必须手动运行和检查每个应用程序，以确保其行为正确并符合规范。相反，GUITestMigrator 允许为这些应用程序之一开发测试，并自动将这些测试迁移到其他应用程序，从而大大减轻教师的负担。我们为 Android 应用程序实现了 GUITestMigrator，并在由在线研究生水平软件工程课程的学生在三个不同学期开发的三组应用程序上对其进行了评估。我们的初步结果表明，我们的方法是有前途的，并激励了这一方向的进一步研究。本文还讨论了这种方法在实际应用程序的测试演进和测试迁移方面的可能应用。
In recent years, there has been a growing interest in making education widely accessible using Internet technologies. Whether it is Massive Open Online Courses (MOOCs) or simply college courses offered to a large student population using an online platform, both education-focused companies and universities, often in collaboration with one another, have been investing massively in online education. The fact that hundreds, and more often thousands, of students take these online courses raises scalability challenges in assessing student assignments. In this paper, in particular, we present a technique (GUITestMigrator) that addresses the challenge of assessing mobile app coding assignments. Given a set of apps that implement the same specification, but can have completely different user interfaces, instructors normally have to manually run and check each app to make sure it behaves correctly and according to the specification. GUITestMigrator, conversely, allows for developing tests for one of these apps and automatically migrating these tests to the other apps, thus dramatically reducing the burden on the instructor. We implemented GUITestMigrator for Android apps and evaluated it on three sets of apps developed over three different semesters by students of an online graduate-level software engineering course. Our initial results show that our approach is promising and motivates further research in this direction. The paper also discusses possible applications of this approach for test evolution and test migration for real-world apps.