A Virtual Coach to Enhance Surgical Training using Human-Centric Modeling and Adaptive Haptic Guidance
A Virtual Coach to Enhance Surgical Training using Human-Centric Modeling and Adaptive Haptic Guidance
批准号:
10707099
负责人:
Ann Majewicz Fey
金额:
$36.1万
依托单位国家:
美国
项目类别:
财政年份:
2020
资助国家:
美国
项目状态:
已结题
起止时间:
2020-09-18 至 2024-06-30
关键词:
AlgorithmsAreaArtificial tissueBehaviorBilateralCause of DeathCessation of lifeClinicalClinical TrialsCognitiveCompetenceComplexCoupledCredentialingCuesDataDevelopmentDevicesDiscipline of obstetricsEducationEducational CurriculumEffectivenessEnvironmentEvaluationFeedbackFreedomFunding MechanismsFutureGoalsGynecologic OncologyGynecologyHandHospital CostsHumanIndividualInjuryIntelligenceIntuitionLearningMachine LearningMeasuresMedical ErrorsMedical centerMethodsModelingMorbidity - disease rateMotionMovementNatureObservational StudyOperative Surgical ProceduresOutcomePatient CarePatient-Focused OutcomesPatientsPerformancePhysiologicalPositioning AttributeProceduresProviderResearchResource-limited settingRobotRoboticsRotationSafetyShapesStandardizationSurgeonSurgical ErrorSurgical ModelsSurveysSystemTactileTechniquesTechnologyTestingTimeTissue ModelTrainingTranslationsTremorUnited StatesUrinary DiversionUrologyValidationVisualWorkWristdata-driven modeldesigneffectiveness evaluationemotional factorexperienceexperimental studyhaptic feedbackhapticshuman modelimprovedkinematicsmedical specialtiesmortalitynew technologynovelpredictive modelingpreferencepreventpublic health relevancerecruitrobotic systemrobotic trainingsimulationskillssuccessteleoperationvirtual coachvirtual realityvisual feedback
中文摘要
点击翻译按钮获取中文摘要
英文摘要
PROJECT SUMMARY
We aim to reduce surgical robotic errors by developing novel technology to coach experienced practitioners by using
real-time data-driven predictive models of operator behavior, task difficulty, and expertise levels during complex surgical
training tasks. This technology could increase the effectiveness of simulation-based training, particularly for practicing
clinicians, as the predictive models will inform the design of adaptive and personalized feedback for the surgeon.
Surgical training typically involves didactic learning, skills labs, and practice on live patients. Safety concerns asso-
ciated with training on patients has led to significant developments in simulation-based technology; however, existing
simulators may lack the ability promote mastery of skills for practicing providers. Improved training is important for both
the provider and the patient. An estimated 100,000 death per year occur due to preventable medical errors. In robotic
surgeries, the majority of patient injuries can be attributed to inexperience and lack of technical competence of the
attending surgeon. These errors could potentially be avoided through personalized and adaptive coaching.
In general, robotic systems can sense and adapt to their environment, even act autonomously to complete a task.
However, the majority of surgical robots used today are “teleoperated systems". These systems only perform tasks
directly commanded by the human operator, possibly with some scaling or tremor cancellation. There is a missed
opportunity to leverage the intelligence of robotic systems to sense and interpret the movements of the surgeon and
to enable some form of adaptive feedback for personalized coaching. Our prior work in human-centric modeling could
hold the key to the technical challenge of integrating intelligent methods into existing surgical robotic training platforms
by better understanding the technical strengths and weaknesses of the practicing surgeon in a data-driven manner.
The long-term goal of this project is to improve surgical training outcomes by developing a personalized
and adaptive surgical robotic coach capable of providing meaningful feedback to the practicing provider to
optimize learning and skill transfer. The specific aims of the proposal include: (1) evaluate the ability of human-
centric models to characterize surgeon performance using motion and video data, (2) design adaptive haptic or visual
guidance cues to provide learners with real-time feedback and to optimize learning, and (3) evaluate the effectiveness
of the adaptive technology coach through end-user validation using procedural-specific training models for general
surgery, urology, and gynecologic oncology. This project could significantly improve provider training in robotic surgery.
The project could also improve provider training for laparoscopic and open surgery as the models used to develop the
virtual coach are inherently human-centric and not tied to any specific surgical tasks or surgical platforms.
Our team is uniquely positioned to achieve success in this project, bringing together experts in surgical robotics,
human-centric modeling, machine learning, and advanced surgical training. We have conducted extensive preliminary
studies in areas related to this proposal, supporting feasibility of this project. Our integration with the Simulation Center
at UTSW will enable translation of successful outcomes of this project into the surgical training and retraining pipeline.
期刊论文(8)
专著(0)
科研奖励(0)
会议论文
登录
查看更多内容
DOI:
10.1109/iros47612.2022.9981611
发表时间:
2022-10
期刊:
2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
影响因子:
--
作者:
[Chang Shi;Y. Zheng;A. M. Fey]
通讯作者:
Chang Shi;Y. Zheng;A. M. Fey
DOI:
10.1109/biorob52689.2022.9925380
发表时间:
2022-08
期刊:
2022 9th IEEE RAS/EMBS International Conference for Biomedical Robotics and Biomechatronics (BioRob)
影响因子:
--
作者:
[Y. Zheng;Marzieh Ershad;A. M. Fey]
通讯作者:
Y. Zheng;Marzieh Ershad;A. M. Fey
Determining the Significant Kinematic Features for Characterizing Stress during Surgical Tasks Using Spatial Attention
使用空间注意力确定手术任务期间表征应力的重要运动学特征
DOI:
10.1142/s2424905x22410069
发表时间:
2022
期刊:
Journal of Medical Robotics Research
影响因子:
--
作者:
[Zheng, Yi, Leonard, Grey, Zeh, Herbert, Majewicz Fey, Ann]
通讯作者:
Majewicz Fey, Ann
Identifying Kinematic Markers Associated with Intraoperative Stress during Surgical Training Tasks
识别手术训练任务期间与术中应力相关的运动学标记
DOI:
10.1109/ismr48346.2021.9661482
发表时间:
2021
期刊:
International Symposium on Medical Robotics
影响因子:
--
作者:
[Zheng, Yi, Leonard, Grey, Tellez, Juan, Zeh, Herbert, Fey, Ann Majewicz]
通讯作者:
Fey, Ann Majewicz
Adaptive Surgical Robotic Training Using Real-Time Stylistic Behavior Feedback Through Haptic Cues
通过触觉提示使用实时风格行为反馈的自适应手术机器人训练
DOI:
10.1109/tmrb.2021.3124128
发表时间:
2021
期刊:
IEEE Transactions on Medical Robotics and Bionics
影响因子:
--
作者:
[Ershad, Marzieh, Rege, Robert, Fey, Ann Majewicz]
通讯作者:
Fey, Ann Majewicz
A Virtual Coach to Enhance Surgical Training using Human-Centric Modeling and Adaptive Haptic Guidance
-
批准号:10265456
-
项目类别:
-
资助金额:$30.8万
-
财政年份:2020
-
负责人:Ann Majewicz Fey
-
依托单位:
A Virtual Coach to Enhance Surgical Training using Human-Centric Modeling and Adaptive Haptic Guidance
-
批准号:10491714
-
项目类别:
-
资助金额:$36.09万
-
财政年份:2020
-
负责人:Ann Majewicz Fey
-
依托单位:
A Virtual Coach to Enhance Surgical Training using Human-Centric Modeling and Adaptive Haptic Guidance
-
批准号:10037429
-
项目类别:
-
资助金额:$32.73万
-
财政年份:2020
-
负责人:Ann Majewicz Fey
-
依托单位:
国内基金
海外基金
层出镰刀菌氮代谢调控因子AreA 介导伏马菌素 FB1 生物合成的作用机理
-
批准号:2021JJ40433
-
项目类别:省市级项目
-
资助金额:--
-
批准年份:2021
-
负责人:孙磊
-
依托单位:
寄主诱导梢腐病菌AreA和CYP51基因沉默增强甘蔗抗病性机制解析
-
批准号:32001603
-
项目类别:青年科学基金项目
-
资助金额:24.0万元
-
批准年份:2020
-
负责人:段真珍
-
依托单位:
AREA国际经济模型的移植.改进和应用
-
批准号:18870435
-
项目类别:面上项目
-
资助金额:2.0万元
-
批准年份:1988
-
负责人:史树中
-
依托单位: