CPS:Medium:Hybrid Systems for Modeling and Teaching the Language of Surgery

这项研究的目的是开发新的原则来创建和比较有技能的人类活动的模型，并将这些模型应用于执行这些活动的人类的教学、培训和协助系统。研究的模型将包括混合系统和基于语言的模型。这项研究将集中在机器人微创手术过程中的手术操作建模。外科手术任务的专家执行模型将从记录的运动和视频数据中推导出来。学生数据将与这些专家模型进行比较，并将开发物理指导和信息显示方法，以基于专家模型向学生提供反馈。这项工作的智力价值在于开发了一套新的数学工具，用于模拟人类技能活动。这些工具将为人类运动中的技能、风格和内容之间的关系提供新的见解。其他的智力优势在于混合系统建模与语言模型的联系，自动化训练技术的创造，以及新训练方法的评估。这项研究的更广泛的影响将是为熟练的人体运动建模和教学的自动化方法的创建。这些方法将对美国劳动力的培训和再培训产生巨大影响。该项目还将影响许多多样性和外展活动，包括REU项目和K-12外展夏令营。该项目的高级人员还参加了机器人系统挑战赛和女性科学与工程项目。

The objective of this research is to develop new principles forcreating and comparing models of skilled human activities, and toapply those models to systems for teaching, training and assistance ofhumans performing these activities. The models investigated willinclude both hybrid systems and language-based models. The researchwill focus on modeling surgical manipulations during robotic minimallyinvasive surgery. Models for expert performance of surgical tasks willbe derived from recorded motion and video data. Student data will becompared with these expert models, and both physical guidance andinformation display methods will be developed to provide feedback tothe student based on the expert model.The intellectual merit of this work lies in the development of a newset of mathematical tools for modeling human skilled activity. Thesetools will provide new insights into the relationship between skill,style, and content in human motion. Additional intellectual merit liesin the connection of hybrid systems modeling to language models, thecreation of techniques for automated training, and in the assessmentof new training methods.The broader impact of this research will be the creation of automatedmethods for modeling and teaching skilled human motion. These methodswill have enormous implications for the training and re-training ofthe US workforce. This project will also impact many diversity andoutreach activities, including REU programs and summer camps for K-12outreach. The senior personnel of this project also participate in theRobotic Systems Challenge and the Women in Science and Engineeringprogram.