Interactive Segmentation of User Interface Logs
Interactive Segmentation of User Interface Logs
复制标题
用户界面日志的交互式分段
DOI：
10.1007/978-3-030-91431-8_5
复制
发表时间：
2021
期刊：
影响因子：
--
通讯作者：
Andrea Marrella
中科院分区：
文献类型：
--
作者：
Simone Agostinelli;F. Leotta;Andrea Marrella
机器人流程自动化 (RPA) 是一项新兴技术，它依靠软件 (SW) 机器人来自动执行人类用户在其计算机系统的应用程序用户界面 (UI) 上执行的密集且重复的任务（即例程）。 RPA 工具能够在专用 UI 日志中捕获许多感兴趣例程的执行情况。 UI 日志由用户操作组成，这些操作以某种顺序混合，反映了用户执行操作的特定顺序，因此可能属于不同的例程。在 RPA 文献中，了解哪些用户操作有助于哪些例程并将其聚类为有界的例程跟踪的挑战是已知的细分。在本文中，我们提出了一种从未分段的 UI 日志中发现例程跟踪的新颖方法，该方法依赖于：（i）频繁模式识别技术自动导出记录到 UI 日志中的例程行为（也称为例程段），（ii）人机交互交互以过滤掉任何正在分析的现实世界例程不允许的段（即从 UI 日志中错误地发现），以及（iii）跟踪对齐技术对所有记录进行聚类将那些属于特定段的用户操作纳入例程跟踪中。我们评估我们的方法，显示其在支持的细分变体方面的有效性。
Robotic Process Automation (RPA) is an emerging technology that relies on software (SW) robots to automate intensive and repetitive tasks (i.e.,routines) performed by human users on the application’s User Interface (UI) of their computer systems. RPA tools are able to capture in dedicatedUI logsthe execution of many routines of interest. A UI log consists of user actions that are mixed in some order that reflects the particular order of their execution by the user, thus potentially belonging to different routines. In the RPA literature, the challenge to understand which user actions contribute to which routines and cluster them into well-boundedroutine tracesis known assegmentation. In this paper, we present a novel approach to the discovery of routine traces from unsegmented UI logs, which relies on:(i)a frequent-pattern identification technique to automatically derive the routine behaviors (a.k.a.routine segments) as recorded into a UI log,(ii)a human-in-the-loop interaction to filter out those segments not allowed (i.e., wrongly discovered from the UI log) by any real-world routine under analysis, and(iii)a trace alignment technique to cluster all those user actions belonging to a specific segment into routine traces. We evaluate our approach showing its effectiveness in terms of supported segmentation variants.