# Neural dynamics underlying spatiotemporal cognitive integration

> **NIH NIH R01** · BOSTON CHILDREN'S HOSPITAL · 2021 · $429,225

## Abstract

Project Summary
 Our ability to visually interpret the world around us depends on bottom-up computations that extract
relevant information from the sensory inputs but it also depends on our accumulated core knowledge about the
world providing top-down signals based on prior experience. The goal of this proposal is to study the
mechanisms by which visual information is integrated spatially and temporally to combine bottom-up and top-
down knowledge. Towards this goal, we combine behavioral measurements, invasive neurophysiological
recordings, and computational models. The behavioral data will provide critical constraints about human
integrative abilities, particularly through eye movements and the dynamics of recognition. The invasive
neurophysiological data will provide high spatiotemporal resolution of neural activity along the inferior temporal
cortex and the interactions with pre-frontal cortex, which is hypothesized to be critical for conveying the type of
top-down signals required for recognition. Ultimately, a central goal of our proposal is to formalize our
understanding of these integrative process via a quantitative computational model. This computational model
should be able to capture the behavioral and physiological results and provide testable predictions. During the
current award, we have made significant progress towards elucidating the mechanisms underlying pattern
completion whereby the visual system is capable of inferring the identity of objects from partial information.
Here we consider a set of images and videos that are “minimal” in the sense that they are recognizable but
where any further reduction in the amount of spatial or temporal information renders them unrecognizable. We
have strong preliminary evidence that suggests that state-of-the-art purely bottom-up theories of recognition
instantiated by deep convolutional networks cannot explain human behavior and physiology. Therefore, these
types of stimuli provide an ideal arena to investigate how top-down signals, presumably from pre-frontal cortex,
modulate the responses along ventral visual cortex to orchestrate recognition. Understanding the neural
mechanisms by which core knowledge is incorporated into sensory processing is arguably one of the greatest
challenges in Cognitive Science and may have important implications for many neurological and psychiatric
conditions that are characterized by dysfunctional top-down signaling and remain poorly understood.

## Key facts

- **NIH application ID:** 10248436
- **Project number:** 5R01EY026025-06
- **Recipient organization:** BOSTON CHILDREN'S HOSPITAL
- **Principal Investigator:** Gabriel Kreiman
- **Activity code:** R01 (R01, R21, SBIR, etc.)
- **Funding institute:** NIH
- **Fiscal year:** 2021
- **Award amount:** $429,225
- **Award type:** 5
- **Project period:** 2016-03-01 → 2022-08-31

## Primary source

NIH RePORTER: https://reporter.nih.gov/project-details/10248436

## Citation

> US National Institutes of Health, RePORTER application 10248436, Neural dynamics underlying spatiotemporal cognitive integration (5R01EY026025-06). Retrieved via AI Analytics 2026-05-21 from https://api.ai-analytics.org/grant/nih/10248436. Licensed CC0.

---

*[NIH grants dataset](/datasets/nih-grants) · CC0 1.0*