# Simulated Clinician Assessment for Cognitive Behavioral Therapy Skills

> **NIH NIH R01** · SIMMERSION, LLC. · 2020 · $410,269

## Abstract

ABSTRACT
SIMmersion, in collaboration with Binghamton University, Northwestern University, the University of Chicago,
and experts from Brown University, propose to develop a standardized, online assessment tool to evaluate
Mental Health Clinicians' (MHCs') Cognitive Behavior Therapy skills related to the treatment of anxiety
disorders. The proposed project will utilize SIMmersion's PeopleSim technology to develop a series of Virtual
Client Sessions (VCS) that are assessed instantly using the Cognitive Therapy Rating Scale (CTRS). The
proposed VCS-CTRS provides an innovative approach to identifying and establishing MHC competence in
CBT for anxiety disorders, which are currently the most prevalent and highest costing mental health problem in
the US. With assistance from leading experts in CBT for anxiety disorders and coding with the CTRS, Aim 1
will focus on developing six virtual sessions with clients varying in age, race, ethnicity, gender, and diagnosis.
Using the 11 skill domains outlined in the CTRS, the development team will create 11 scoring algorithms that
will allow the VCS-CTRS to automatically generate a CTRS score each time the tool is used. Leveraging the
PeopleSim technology will allow MHCs to experience realistic and varied client responses each time the tool is
used. Thus, MHCs can use the tool repeatedly, without ever having the same conversation twice. During Aim
2, the research team will recruit 100 MHCs, from novice to expert levels, who will complete two randomly-
selected VCS-CTRS simulations and evaluate their experience. The automatic scores generated by the VCS-
CTRS will be compared to observer-rated CTRS scores through review of audio recordings and transcripts of
the VCS-CTRS sessions to validate the new automated and standardized assessment tool. During Aim 3, the
research team will evaluate the feasibility of using the VCS-CTRS, nationally and internationally, to assess
MHC's skills and provide feedback regarding areas in need of further development. Master and doctoral level
MHCs (N=300) will be recruited to play the two VCS-CTRS sessions that most closely match their self-
identified area of clinical expertise. MHCs scores and product evaluations will be analyzed to examine the
practical usability and reach of the VCS-CTRS. If successful, additional sessions can be developed to ensure
clients seeking counselling receive quality treatment for a range of mental health problems.

## Key facts

- **NIH application ID:** 9928501
- **Project number:** 5R01MH112625-04
- **Recipient organization:** SIMMERSION, LLC.
- **Principal Investigator:** Dale Edward Olsen
- **Activity code:** R01 (R01, R21, SBIR, etc.)
- **Funding institute:** NIH
- **Fiscal year:** 2020
- **Award amount:** $410,269
- **Award type:** 5
- **Project period:** 2017-07-01 → 2022-05-31

## Primary source

NIH RePORTER: https://reporter.nih.gov/project-details/9928501

## Citation

> US National Institutes of Health, RePORTER application 9928501, Simulated Clinician Assessment for Cognitive Behavioral Therapy Skills (5R01MH112625-04). Retrieved via AI Analytics 2026-05-24 from https://api.ai-analytics.org/grant/nih/9928501. Licensed CC0.

---

*[NIH grants dataset](/datasets/nih-grants) · CC0 1.0*