CPS:Medium:Hybrid Systems for Modeling and Teaching the Language of Surgery

本研究的目的是开发新的原则，用于创建和比较熟练的人类活动的模型，并将这些模型应用到系统的教学，培训和援助ofhumans执行这些活动。研究的模型将包括混合系统和基于语言的模型。这项研究将集中在机器人微创手术过程中的手术操作建模。手术任务的专家性能模型将来自记录的运动和视频数据。学生数据将与这些专家模型进行融合，并将开发物理指导和信息显示方法，以根据专家模型向学生提供反馈。这项工作的智力价值在于开发一套新的数学工具，用于建模人类技能活动。这些工具将为人类运动中技能、风格和内容之间的关系提供新的见解。其他智力价值在于将混合系统建模与语言模型联系起来、创建自动化训练技术以及评估新的训练方法。这项研究的更广泛影响将是创建用于建模和教授熟练人体动作的自动化方法。这些方法将对美国劳动力的培训和再培训产生巨大的影响。 该项目还将影响许多多样性和推广活动，包括REU计划和K-12推广夏令营。该项目的高级人员还参加了机器人系统挑战赛和妇女在科学和工程计划。

The objective of this research is to develop new principles forcreating and comparing models of skilled human activities, and toapply those models to systems for teaching, training and assistance ofhumans performing these activities. The models investigated willinclude both hybrid systems and language-based models. The researchwill focus on modeling surgical manipulations during robotic minimallyinvasive surgery. Models for expert performance of surgical tasks willbe derived from recorded motion and video data. Student data will becompared with these expert models, and both physical guidance andinformation display methods will be developed to provide feedback tothe student based on the expert model.The intellectual merit of this work lies in the development of a newset of mathematical tools for modeling human skilled activity. Thesetools will provide new insights into the relationship between skill,style, and content in human motion. Additional intellectual merit liesin the connection of hybrid systems modeling to language models, thecreation of techniques for automated training, and in the assessmentof new training methods.The broader impact of this research will be the creation of automatedmethods for modeling and teaching skilled human motion. These methodswill have enormous implications for the training and re-training ofthe US workforce. This project will also impact many diversity andoutreach activities, including REU programs and summer camps for K-12outreach. The senior personnel of this project also participate in theRobotic Systems Challenge and the Women in Science and Engineeringprogram.