RI: Small: Collaborative Research: Speeding Up Learning through Modeling the Pragmatics of Training

多年来，为了开发能够从奖励信号中学习的算法，已经产生了过多的技术，这些技术可以利用数值信号，这些数字信号的值根据性能而变化。最近使用这些技术向提供奖励的人类学习的努力进展较慢，部分原因是人类以离散的方式给出反馈，而不是通过数字。这个项目贡献了新的学习算法，专门设计来利用人类做出的选择中包含的信息，以提供这种离散的反馈。这些算法的灵感来自于人与狗的合作关系，以及人类能够仅使用离散的反馈和精心构建的任务序列就能教会狗的不可思议的事情。本项目正在开发的贝叶斯学习框架将利用反馈和任务序列中包含的实用含义，以更快地从人类反馈中学习。这项工作的最终目标是为人类提供一个更自然的范例，让人类告诉计算机他们想让计算机做什么。为此，项目的努力将导致布朗大学的一个教学模块？S学习交流(LE)。LE让本科生与未得到充分服务的少数族裔中学生一起工作，让他们参与STEM。他们是展示这部作品更广泛影响的完美观众。LE参与者学习使用Scratch环境和反馈范例相结合的编程来指导计算机，这表明了算法的强大程度。

Years of effort to develop algorithms capable of learning from reward signals have resulted in a plethora of techniques that can leverage numerical signals that vary in value based on performance. Recent efforts to use these techniques to learn from humans providing rewards have been slower to progress, in part, because humans give feedback discretely rather than numerically. This project contributes new learning algorithms designed specifically to leverage the information contained in the choices humans make to provide such discrete feedbacks. The algorithms are inspired by the human-canine partnership, and the incredible things that humans are able to teach dogs using only discrete feedback and carefully constructed sequences of tasks. The Bayesian learning framework being developed in this project will leverage the pragmatic implicatures contained in the feedbacks and tasks sequences to learn more quickly from human feedback. The ultimate goal of this work is to provide a more natural paradigm for humans to tell computers what they would like for them to do. To that end, project efforts will result in a teaching module for Brown University?s Learning Exchange (LE). The LE involves undergraduates working with underserved minority middle school students to engage them in STEM. They are a perfect audience to demonstrate the broader impacts of this work. LE participants learn to instruct computers using a combination of programming with the Scratch environment and the feedback paradigm, which shows how powerful the algorithms are.