# Multi-modal cloud based system for detecting early signs of driver cognitive decline and/or high risk driving behaviors

> **NIH NIH R41** · PHYSICAL SCIENCES, INC · 2021 · $416,423

## Abstract

Project Summary/Abstract
 Physical Sciences Inc. (PSI), in collaboration with Michigan State University (MSU) and the University of
Michigan (U-M), proposes to develop a novel technology that will non-intrusively monitor driver cognitive
decline and/or high-risk driving behavior that is especially suited for seniors (aged >65). Contextual
physiological biomarkers along with computer vision based drive quality measurements will be obtained
through a cloud-based acquisition system. Real-time risk assessments that are measures of cognitive status
will be performed on the cloud to provide comprehensive analysis on drive quality metrics for seniors with
varying levels of cognitive impairment.
 Assessment of a driver’s cognitive status requires the use of a complex monitoring platform that can be
seamlessly installed into any automobile without interfering or adding complexity to driving. Therefore, our goal
is to develop a cloud-based, multi-modal routine cognitive/drive assessment system that combines a Smart
Steering Sleeve (S3), which monitors physiological biomarkers, along with a Computer Vision (CV) system that
provides contextual insight for biomarker changes and monitors a driver's habits. The Cloud-based Computer
Vision Smart Steering Sleeve (C-CVS3) sensor system will be capable of monitoring biomarkers such as heart
rate, hand gripping force, and the presence of excessive sweat from the skin surface indicating stress levels
affecting potential drive quality degradation, which are also factors expected to be associated with cognitive
impairment during critical events. Dash cameras provide temporal context including reaction times to
unexpected hazards in addition to driver’s safety measures, such as staying within the lane, and maintaining
distance to surrounding vehicles. The transmitted data to the cloud from both modalities will be used to derive
cognitive/drive quality indices (QI) for driving risks that can be associated with increased stress levels, attention
deficiency and/or cognitive decline in individuals. This modality will result in an add-on adaptive platform in
automobiles that gauges cognitive status/decline providing value to the auto insurance industry, RMV, as well
as to the caregivers of the cognitively impaired patient apart from the individual himself to identify a quantifiable
parameter before giving up driving or to seek additional cognitive diagnosis.
 The basic functions of this comprehensive drive monitoring system will be evaluated in Phase I on a
number of individuals in a driving simulator. The technology will be improved in Phase II and will be further
tested during real-world driving scenarios.

## Key facts

- **NIH application ID:** 10258737
- **Project number:** 1R41AG073222-01
- **Recipient organization:** PHYSICAL SCIENCES, INC
- **Principal Investigator:** GOPI N MAGULURI
- **Activity code:** R41 (R01, R21, SBIR, etc.)
- **Funding institute:** NIH
- **Fiscal year:** 2021
- **Award amount:** $416,423
- **Award type:** 1
- **Project period:** 2021-08-15 → 2023-07-31

## Primary source

NIH RePORTER: https://reporter.nih.gov/project-details/10258737

## Citation

> US National Institutes of Health, RePORTER application 10258737, Multi-modal cloud based system for detecting early signs of driver cognitive decline and/or high risk driving behaviors (1R41AG073222-01). Retrieved via AI Analytics 2026-05-23 from https://api.ai-analytics.org/grant/nih/10258737. Licensed CC0.

---

*[NIH grants dataset](/datasets/nih-grants) · CC0 1.0*
