# A Virtual Coach to Enhance Surgical Training using Human-Centric Modeling and Adaptive Haptic Guidance

> **NIH NIH R01** · UNIVERSITY OF TEXAS AT AUSTIN · 2021 · $308,003

## Abstract

PROJECT SUMMARY
We aim to reduce surgical robotic errors by developing novel technology to coach experienced practitioners by using
real-time data-driven predictive models of operator behavior, task difﬁculty, and expertise levels during complex surgical
training tasks. This technology could increase the effectiveness of simulation-based training, particularly for practicing
clinicians, as the predictive models will inform the design of adaptive and personalized feedback for the surgeon.
 Surgical training typically involves didactic learning, skills labs, and practice on live patients. Safety concerns asso-
ciated with training on patients has led to signiﬁcant developments in simulation-based technology; however, existing
simulators may lack the ability promote mastery of skills for practicing providers. Improved training is important for both
the provider and the patient. An estimated 100,000 death per year occur due to preventable medical errors. In robotic
surgeries, the majority of patient injuries can be attributed to inexperience and lack of technical competence of the
attending surgeon. These errors could potentially be avoided through personalized and adaptive coaching.
 In general, robotic systems can sense and adapt to their environment, even act autonomously to complete a task.
However, the majority of surgical robots used today are “teleoperated systems". These systems only perform tasks
directly commanded by the human operator, possibly with some scaling or tremor cancellation. There is a missed
opportunity to leverage the intelligence of robotic systems to sense and interpret the movements of the surgeon and
to enable some form of adaptive feedback for personalized coaching. Our prior work in human-centric modeling could
hold the key to the technical challenge of integrating intelligent methods into existing surgical robotic training platforms
by better understanding the technical strengths and weaknesses of the practicing surgeon in a data-driven manner.
 The long-term goal of this project is to improve surgical training outcomes by developing a personalized
and adaptive surgical robotic coach capable of providing meaningful feedback to the practicing provider to
optimize learning and skill transfer. The speciﬁc aims of the proposal include: (1) evaluate the ability of human-
centric models to characterize surgeon performance using motion and video data, (2) design adaptive haptic or visual
guidance cues to provide learners with real-time feedback and to optimize learning, and (3) evaluate the effectiveness
of the adaptive technology coach through end-user validation using procedural-speciﬁc training models for general
surgery, urology, and gynecologic oncology. This project could signiﬁcantly improve provider training in robotic surgery.
The project could also improve provider training for laparoscopic and open surgery as the models used to develop the
virtual coach are inherently human-centric and not tied to any speciﬁc surgic...

## Key facts

- **NIH application ID:** 10265456
- **Project number:** 5R01EB030125-02
- **Recipient organization:** UNIVERSITY OF TEXAS AT AUSTIN
- **Principal Investigator:** Ann Majewicz Fey
- **Activity code:** R01 (R01, R21, SBIR, etc.)
- **Funding institute:** NIH
- **Fiscal year:** 2021
- **Award amount:** $308,003
- **Award type:** 5
- **Project period:** 2020-09-18 → 2024-06-30

## Primary source

NIH RePORTER: https://reporter.nih.gov/project-details/10265456

## Citation

> US National Institutes of Health, RePORTER application 10265456, A Virtual Coach to Enhance Surgical Training using Human-Centric Modeling and Adaptive Haptic Guidance (5R01EB030125-02). Retrieved via AI Analytics 2026-05-23 from https://api.ai-analytics.org/grant/nih/10265456. Licensed CC0.

---

*[NIH grants dataset](/datasets/nih-grants) · CC0 1.0*
