# Multimodal Data Analysis and Integration

> **NIH NIH P50** · NATHAN S. KLINE INSTITUTE FOR PSYCH RES · 2024 · $310,788

## Abstract

ABSTRACT: This Conte Center proposal seeks to elucidate the role of slow brain network fluctuations
(SBNFs) across species and scales, and to establish computational models of neural circuit dynamics that
characterize SBNFs. Data collected in Projects 1-3 will span multiple modalities (EEG, fMRI, ECoG/LFP, and
single-unit recordings) and species (humans and nonhuman primates). The overarching goal of the Multimodal
Data Analysis & Integration Core (Core-B) is to address the challenge of integrating data across these multiple
modalities and analyses. To achieve this goal, Core-B will apply and develop multimodal alignment
frameworks that establish a common space for analysis across modalities, individuals, and species (to be used
in Projects 1-3), as well as integrate these data to facilitate computational modeling of neural dynamics (to be
used in Project 4). Aim 1 will leverage the functional alignment framework to construct a common space for
different modalities within- and between-subjects. Aim 2 will refine the cross-species alignment using the
functional data from the common tasks to provide the spatial transformation to link human data in Projects 1-2
and macaque data in Project 3. In addition to optimizing cross-modal and cross-species alignment, Aim 3 will
construct a framework for decomposing brain dynamics into spatiotemporal states and state-transitions derived
jointly from EEG, fMRI, and physiological signals. We will also leverage the cross-species transformation
between humans and macaques in Aim 2 to delineate the matched states across species and characterize the
species-specific temporal configurations. This framework will provide a state-space in which brain dynamics
and their causal properties can be interrogated across individuals and species. The alignment approach and
aligned data generated by this Core will be applied to the curated, quality-checked outputs received from Core
C after appropriate preprocessing (determined by domain experts from the individual Projects) and will be
distributed to Projects 1-4.

## Key facts

- **NIH application ID:** 10834838
- **Project number:** 5P50MH109429-07
- **Recipient organization:** NATHAN S. KLINE INSTITUTE FOR PSYCH RES
- **Principal Investigator:** Ting Xu
- **Activity code:** P50 (R01, R21, SBIR, etc.)
- **Funding institute:** NIH
- **Fiscal year:** 2024
- **Award amount:** $310,788
- **Award type:** 5
- **Project period:** 2017-04-15 → 2028-03-31

## Primary source

NIH RePORTER: https://reporter.nih.gov/project-details/10834838

## Citation

> US National Institutes of Health, RePORTER application 10834838, Multimodal Data Analysis and Integration (5P50MH109429-07). Retrieved via AI Analytics 2026-05-24 from https://api.ai-analytics.org/grant/nih/10834838. Licensed CC0.

---

*[NIH grants dataset](/datasets/nih-grants) · CC0 1.0*