UI Screens Identification and Extraction from Mobile Programming Screencasts
UI Screens Identification and Extraction from Mobile Programming Screencasts
复制标题
DOI：
10.1145/3387904.3389265
复制
发表时间：
2020-07
期刊：
影响因子：
--
通讯作者：
Mohammad D. Alahmadi;Abdulkarim Khormi;S. Haiduc
中科院分区：
文献类型：
--
作者：
Mohammad D. Alahmadi;Abdulkarim Khormi;S. Haiduc
移动的应用程序的需求正在上升，导致更多的程序员学习开发或必须维护这类程序。开发人员经常参考在线资源来寻找灵感或回答他们关于移动的编程主题的问题，屏幕视频是一种受欢迎的资源。然而，鉴于可用的屏幕视频众多，可能很难快速理解许多视频中的哪一个与一个人的需求相关。我们提出了一种新的方法，称为UISscreens，检测，提取，并提出了最具代表性的用户界面（UI）屏幕嵌入在移动的开发屏幕。这可以帮助开发人员快速理解视频中显示的应用程序是关于什么的，从而节省搜索有用视频的时间。UIScreens已经在两项关于iOS和Android编程截屏的实证研究中进行了评估。第一项研究调查了我们的UI提取的准确性，并表明我们的方法能够以94%的准确率检测和提取UI屏幕。第二项是对移动的应用程序开发人员进行的用户研究，他们评估了UI屏幕的准确性和有用性。他们一致认为UIScreens是准确的，并从视频中提取代表性的UI屏幕。他们认为，提取的UI屏幕对于理解视频是关于什么的以及它是否与搜索相关是有用的。我们的方法已经作为一个免费的在线工具实施。
Mobile applications demand is on the rise, leading to more programmers learning to develop or having to maintain this kind of programs. Developers often refer to online resources to find inspiration or answers to questions they have about mobile programming topics and screencasts are a popular resource. However, given the multitude of screencasts available, it can be difficult to quickly comprehend which of the many videos is relevant to one's needs. We propose a novel approach, called UIScreens, which detects, extracts, and presents the most representative user interface (UI) screens embedded in mobile development screencasts. This could help developers quickly comprehend what an app displayed in a video is about, therefore saving time searching for useful videos. UIScreens has been evaluated in two empirical studies on iOS and Android programming screencasts. The first study investigates the accuracy of our UI extraction and shows that our approach is able to detect and extract UI screens with an accuracy of 94%. The second is a user study with mobile app developers, who evaluated both the accuracy and the usefulness of UI Screens. They agreed that UIScreens is accurate and extracts representative UI screens from videos. They considered that the extracted UI screens are useful for understanding what a video is about and if it is relevant to a search. Our approach has been implemented as a free online tool.