DiLogics: Creating Web Automation Programs with Diverse Logics
DiLogics: Creating Web Automation Programs with Diverse Logics
复制标题
DOI：
10.1145/3586183.3606822
复制
发表时间：
2023-08
期刊：
影响因子：
--
通讯作者：
Kevin Pu;Jim Yang;Angel Yuan;Minyi Ma;Rui Dong;Xinyu Wang;Yuanchun Chen;Tovi Grossman
中科院分区：
文献类型：
--
作者：
Kevin Pu;Jim Yang;Angel Yuan;Minyi Ma;Rui Dong;Xinyu Wang;Yuanchun Chen;Tovi Grossman
知识工作者经常遇到重复的Web数据输入任务，例如更新记录或下订单。 Web自动化提高了生产率，但是将任务转换为Web操作并将其扩展到新规格是具有挑战性的。现有工具可以自动化执行UI操作相同逻辑跟踪的任务（例如，按顺序输入文本），但不支持基于不同输入条件的不同执行任务的任务。我们提出DiLogics，这是一种逐示示例系统，利用NLP来帮助用户创建处理不同规格的Web自动化程序。 DILOGICS首先将语义段输入到结构化任务步骤。通过记录每个步骤的用户演示，Dilogics将Web宏推广到新颖但语义上相似的任务要求。我们的评估表明，非专家可以有效地使用DILOGICS创建满足各种输入指令的自动化程序。 DILOGICS为开发满足各种规格的Web自动化程序提供了一种有效，直观和表达的方法。
Knowledge workers frequently encounter repetitive web data entry tasks, like updating records or placing orders. Web automation increases productivity, but translating tasks to web actions accurately and extending to new specifications is challenging. Existing tools can automate tasks that perform the same logical trace of UI actions (e.g., input text in each field in order), but do not support tasks requiring different executions based on varied input conditions. We present DiLogics, a programming-by-demonstration system that utilizes NLP to assist users in creating web automation programs that handle diverse specifications. DiLogics first semantically segments input data to structured task steps. By recording user demonstrations for each step, DiLogics generalizes the web macros to novel but semantically similar task requirements. Our evaluation showed that non-experts can effectively use DiLogics to create automation programs that fulfill diverse input instructions. DiLogics provides an efficient, intuitive, and expressive method for developing web automation programs satisfying diverse specifications.