CPS:Medium:Hybrid Systems for Modeling and Teaching the Language of Surgery

本研究的目的是开发新的原则来创建和比较熟练的人类活动模型，并将这些模型应用于教学、培训和帮助人类执行这些活动的系统。研究的模型将包括混合系统和基于语言的模型。该研究将集中在机器人微创手术过程中的手术操作建模上。手术任务的专家表现模型将来自记录的运动和视频数据。将学生数据与这些专家模型进行比较，并根据专家模型开发物理指导和信息显示方法来向学生提供反馈。这项工作的智力价值在于开发了一套新的数学工具来模拟人类的技能活动。这些工具将为人类运动中的技能，风格和内容之间的关系提供新的见解。额外的智力价值在于将混合系统建模与语言模型联系起来，创建自动化训练技术，以及评估新的训练方法。这项研究更广泛的影响将是创建自动化方法来建模和教授熟练的人体运动。这些方法将对美国劳动力的培训和再培训产生巨大影响。该项目还将影响许多多样性和外展活动，包括REU项目和k -12外展夏令营。该项目的高级人员还参加了机器人系统挑战赛和科学与工程领域的女性项目。

The objective of this research is to develop new principles forcreating and comparing models of skilled human activities, and toapply those models to systems for teaching, training and assistance ofhumans performing these activities. The models investigated willinclude both hybrid systems and language-based models. The researchwill focus on modeling surgical manipulations during robotic minimallyinvasive surgery. Models for expert performance of surgical tasks willbe derived from recorded motion and video data. Student data will becompared with these expert models, and both physical guidance andinformation display methods will be developed to provide feedback tothe student based on the expert model.The intellectual merit of this work lies in the development of a newset of mathematical tools for modeling human skilled activity. Thesetools will provide new insights into the relationship between skill,style, and content in human motion. Additional intellectual merit liesin the connection of hybrid systems modeling to language models, thecreation of techniques for automated training, and in the assessmentof new training methods.The broader impact of this research will be the creation of automatedmethods for modeling and teaching skilled human motion. These methodswill have enormous implications for the training and re-training ofthe US workforce. This project will also impact many diversity andoutreach activities, including REU programs and summer camps for K-12outreach. The senior personnel of this project also participate in theRobotic Systems Challenge and the Women in Science and Engineeringprogram.