FMitF: Collaborative Research: User-Centered Verification and Repair of Trigger-Action Programs
FMITF:协作研究:以用户为中心的触发操作程序验证和修复
基本信息
- 批准号:1837120
- 负责人:
- 金额:$ 66.67万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Standard Grant
- 财政年份:2018
- 资助国家:美国
- 起止时间:2018-09-01 至 2022-08-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Modern data-centric systems, ranging from Internet-of-Things devices to online services, can benefit from helping people make clear their intent for how their devices and services should behave and interact with each other. Generally, this requires people to engage in some amount of end-user programming, or programming by people who are not typically trained in programming. Common examples of this include specifying that a light should only turn on when a room is occupied or that emails with certain words in the subject line should be routed into a particular folder. Trigger-action programming (TAP), which consists of "if-this-then-that" rules, is the most common model for end-user programming because it is relatively easy to write simple TAP programs. However, as the number and complexity of both rules and devices increases, TAP programs increasingly suffer from bugs and dependability problems and are hard to correct for inexperienced and trained programmers alike. This project's goal is to make TAP programming, and thus people's ability to interact with devices that act on their behalf, more robust through developing a better understanding of end users' needs and abilities to write and debug TAP programs, computational techniques to both better model user intents and suggest TAP programs that meet them, and tools that use those techniques to help people more easily create correct TAP programs. Apart from the potential benefits to people's well-being, the project will also provide educational benefits by developing course materials that increase awareness of both human aspects of, and formal methods for, programming. Further, the tangible nature of such devices and the familiarity of popular online services are a fertile domain for engaging the public and training undergraduate students, K-12 students, and early-career graduate students in the computer science research lifecycle.To accomplish these goals, the work combines techniques from formal methods, human-computer interaction, and machine learning. Contributions to formal methods include the design of systematic solutions to unique program repair, synthesis, and specification-refinement problems in the context of end-user programming. Contributions to cyber human systems include empirical studies and the design of data-driven interfaces for more accurately expressing intent. Specifically, the empirical human subjects studies seek to understand and improve the debugging process for trigger-action programming, create and distribute needed data sets of user-centric collections of trigger-action programs, and comparatively evaluate proposed interfaces. The interfaces developed in this work use data-driven methods to help users pinpoint and understand bugs in trigger-action programs, as well as to choose among candidates for automatically repaired trigger-action programs. Underlying these interfaces will be formal models of trigger-action programs, which are verified against specified properties written in linear temporal logic. The system developed will systematically synthesize program repairs, taking into account users' experiences and preferences. The system will also use a combination of machine learning and formal methods to automatically generate trigger-action programs and summarize specifications based on historical traces of user interaction with the system. In sum, helping non-technical users accurately communicate their intent through trigger-action programming benefits widely deployed end-user-programming systems for integrating internet-connected devices and online services.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
现代以数据为中心的系统,从物联网设备到在线服务,都可以从帮助人们明确他们的设备和服务应该如何运行和相互交互的意图中受益。 一般来说,这需要人们参与一些最终用户编程,或者由通常没有受过编程培训的人进行编程。 这方面的常见例子包括指定只有当房间被占用时才应该打开灯,或者主题行中包含某些单词的电子邮件应该被路由到特定文件夹中。 触发动作编程(TAP)由“if-this-then-that”规则组成,是最终用户编程最常见的模型,因为编写简单的TAP程序相对容易。 然而,随着规则和设备的数量和复杂性的增加,TAP程序越来越多地遭受错误和可靠性问题,并且对于没有经验和受过训练的程序员来说很难纠正。 该项目的目标是使TAP编程,从而使人们能够与代表他们的设备进行交互,通过更好地理解最终用户的需求和编写和调试TAP程序的能力,更强大的计算技术,以更好地模拟用户意图并建议满足他们的TAP程序,以及使用这些技术帮助人们更容易地创建正确的TAP程序的工具。 除了对人民福祉的潜在好处外,该项目还将通过编制课程材料,提高对方案拟订的人的方面和正式方法的认识,提供教育方面的好处。 此外,这些设备的有形性质和流行的在线服务的熟悉度是一个肥沃的领域,为从事公众和培训本科生,K-12学生,和早期职业研究生在计算机科学研究生命周期。为了实现这些目标,工作结合了正式的方法,人机交互和机器学习的技术。正式的方法的贡献包括独特的程序修复,合成和规范细化问题的最终用户编程的背景下,系统的解决方案的设计。对网络人类系统的贡献包括经验研究和数据驱动界面的设计,以更准确地表达意图。具体而言,经验人类受试者的研究旨在了解和改善调试过程中的动作编程,创建和分发所需的数据集的用户为中心的集合的动作程序,并比较评估建议的接口。在这项工作中开发的接口使用数据驱动的方法,以帮助用户查明和理解的错误,自动修复的自动操作程序,以及选择候选人。这些接口的基础将是正式的模型,这是验证对线性时序逻辑中编写的指定属性。所开发的系统将系统地综合程序修复,考虑到用户的经验和偏好。该系统还将使用机器学习和形式化方法的组合,自动生成用户操作程序,并根据用户与系统交互的历史痕迹总结规范。总而言之,帮助非技术用户准确地传达他们的意图,通过用户行动编程,有利于广泛部署的最终用户编程系统,以集成互联网连接的设备和在线服务。该奖项反映了NSF的法定使命,并已被认为是值得的支持,通过评估使用基金会的智力价值和更广泛的影响审查标准。
项目成果
期刊论文数量(8)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Visualizing Differences to Improve End-User Understanding of Trigger-Action Programs
- DOI:10.1145/3334480.3382940
- 发表时间:2020-04
- 期刊:
- 影响因子:0
- 作者:Valerie Zhao;Lefan Zhang;Bo Wang;Shan Lu;Blase Ur
- 通讯作者:Valerie Zhao;Lefan Zhang;Bo Wang;Shan Lu;Blase Ur
Understanding Trigger-Action Programs Through Novel Visualizations of Program Differences
- DOI:10.1145/3411764.3445567
- 发表时间:2021-05
- 期刊:
- 影响因子:0
- 作者:Valerie Zhao;Lefan Zhang;Bo Wang;M. Littman;Shan Lu;Blase Ur
- 通讯作者:Valerie Zhao;Lefan Zhang;Bo Wang;M. Littman;Shan Lu;Blase Ur
Supporting End Users in Defining Reinforcement-Learning Problems for Human-Robot Interactions (Extended Abstract)
支持最终用户定义人机交互的强化学习问题(扩展摘要)
- DOI:
- 发表时间:2022
- 期刊:
- 影响因子:0
- 作者:Zhao, Valerie;Littman, Michael L.;Lu, Shan;Sebo, Sarah;Ur, Blase
- 通讯作者:Ur, Blase
Helping Users Debug Trigger-Action Programs
- DOI:10.1145/3569506
- 发表时间:2022-12
- 期刊:
- 影响因子:0
- 作者:Lefan Zhang;Cyrus Zhou;M. Littman;Blase Ur;Shan Lu
- 通讯作者:Lefan Zhang;Cyrus Zhou;M. Littman;Blase Ur;Shan Lu
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Blase Ur其他文献
Forgotten But Not Gone: Identifying the Need for Longitudinal Data Management in Cloud Storage
被遗忘但并未消失:确定云存储中纵向数据管理的需求
- DOI:
10.1145/3173574.3174117 - 发表时间:
2018 - 期刊:
- 影响因子:0
- 作者:
Mohammad Taha Khan;Maria Hyun;Chris Kanich;Blase Ur - 通讯作者:
Blase Ur
Evaluating the Security Risks of Freedom on Social Networking Websites
评估社交网站上自由的安全风险
- DOI:
10.7282/t30v8h8j - 发表时间:
2009 - 期刊:
- 影响因子:0
- 作者:
Blase Ur;Crystal Maung;V. Ganapathy - 通讯作者:
V. Ganapathy
Measuring the Effectiveness of Privacy Tools for Limiting Behavioral Advertising
衡量限制行为广告的隐私工具的有效性
- DOI:
- 发表时间:
2012 - 期刊:
- 影响因子:0
- 作者:
Rebecca Balebako;P. Leon;Richard Shay;Blase Ur;Yang Wang - 通讯作者:
Yang Wang
Comprehension from Chaos: What Users Understand and Expect from Private Computation
从混沌中领悟:用户对私有计算的理解和期望
- DOI:
- 发表时间:
2022 - 期刊:
- 影响因子:0
- 作者:
Bailey Kacsmar;Vasisht Duddu;Kyle Tilbury;Blase Ur;F. Kerschbaum - 通讯作者:
F. Kerschbaum
Towards Supporting and Documenting Algorithmic Fairness in the Data Science Workflow
致力于支持和记录数据科学工作流程中的算法公平性
- DOI:
- 发表时间:
2019 - 期刊:
- 影响因子:0
- 作者:
Galen Harrison;Julia Hanson;Blase Ur - 通讯作者:
Blase Ur
Blase Ur的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Blase Ur', 18)}}的其他基金
Collaborative Research: Conference: 2024 Aspiring PIs in Secure and Trustworthy Cyberspace
协作研究:会议:2024 年安全可信网络空间中的有抱负的 PI
- 批准号:
2404950 - 财政年份:2024
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
EAGER: DCL: SaTC: Enabling Interdisciplinary Collaboration: Efficient Human-in-the-Loop Redaction of Language Development Corpora
EAGER:DCL:SaTC:实现跨学科协作:语言开发语料库的高效人机交互编辑
- 批准号:
2210193 - 财政年份:2022
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
Collaborative Research: SaTC: CORE: Medium: Methods and Tools for Effective, Auditable, and Interpretable Online Ad Transparency
协作研究:SaTC:核心:媒介:有效、可审核和可解释的在线广告透明度的方法和工具
- 批准号:
2149680 - 财政年份:2022
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
CAREER: Usable, Data-Driven Transparency and Access for Consumer Privacy
职业:可用、数据驱动的透明度和消费者隐私访问
- 批准号:
2047827 - 财政年份:2021
- 资助金额:
$ 66.67万 - 项目类别:
Continuing Grant
SaTC: CORE: Medium: Collaborative: Enabling Long-Term Security and Privacy through Retrospective Data Management
SaTC:核心:媒介:协作:通过回顾性数据管理实现长期安全和隐私
- 批准号:
1801663 - 财政年份:2018
- 资助金额:
$ 66.67万 - 项目类别:
Continuing Grant
CRII: SaTC: Multi-User Authentication and Access Control in the Internet of Things
CRII:SaTC:物联网中的多用户身份验证和访问控制
- 批准号:
1756011 - 财政年份:2018
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
相似海外基金
FMitF: Collaborative Research: RedLeaf: Verified Operating Systems in Rust
FMITF:协作研究:RedLeaf:经过验证的 Rust 操作系统
- 批准号:
2313411 - 财政年份:2023
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
Collaborative Research: FMitF: Track I: Game Theoretic Updates for Network and Cloud Functions
合作研究:FMitF:第一轨:网络和云功能的博弈论更新
- 批准号:
2318970 - 财政年份:2023
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
Collaborative Research: FMitF: Track I: Knitting Semantics
合作研究:FMitF:第一轨:针织语义
- 批准号:
2319182 - 财政年份:2023
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
Collaborative Research: FMitF: Track I: Towards Verified Robustness and Safety in Power System-Informed Neural Networks
合作研究:FMitF:第一轨:实现电力系统通知神经网络的鲁棒性和安全性验证
- 批准号:
2319242 - 财政年份:2023
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
Collaborative Research: FMitF: Track I: DeepSmith: Scheduling with Quality Guarantees for Efficient DNN Model Execution
合作研究:FMitF:第一轨:DeepSmith:为高效 DNN 模型执行提供质量保证的调度
- 批准号:
2349461 - 财政年份:2023
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
Collaborative Research: FMitF: Track I: Towards Verified Robustness and Safety in Power System-Informed Neural Networks
合作研究:FMitF:第一轨:实现电力系统通知神经网络的鲁棒性和安全性验证
- 批准号:
2319243 - 财政年份:2023
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
Collaborative Research: FMitF: Track I: Synthesis and Verification of In-Memory Computing Systems using Formal Methods
合作研究:FMitF:第一轨:使用形式方法合成和验证内存计算系统
- 批准号:
2319400 - 财政年份:2023
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
Collaborative Research: FMitF: Track I: Synthesis and Verification of In-Memory Computing Systems using Formal Methods
合作研究:FMitF:第一轨:使用形式方法合成和验证内存计算系统
- 批准号:
2319399 - 财政年份:2023
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
Collaborative Research: FMitF: Track I: A Formal Verification and Implementation Stack for Programmable Logic Controllers
合作研究:FMitF:第一轨:可编程逻辑控制器的形式验证和实现堆栈
- 批准号:
2425711 - 财政年份:2023
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant
Collaborative Research: FMitF: Track I: Simplifying End-to-End Verification of High-Performance Distributed Systems
合作研究:FMitF:第一轨:简化高性能分布式系统的端到端验证
- 批准号:
2318954 - 财政年份:2023
- 资助金额:
$ 66.67万 - 项目类别:
Standard Grant