# CAREER: Enabling Efficient AI Computing at Scale with Heterogeneous Retention-Aware Memory Systems

> **NSF 01002930DB NSF RESEARCH & RELATED ACTIVIT** · Stanford University (CA) · $730,000

## Abstract

Modern artificial intelligence (AI) systems are increasingly limited not by arithmetic, but by memory. As frontier AI models become more capable, they require far more data to be moved, stored, and accessed efficiently. These workloads systematically generate large volumes of short-lived data that are written in memory, consumed, and quickly discarded, as well as long-lived data that must be retained reliably across much longer time scales. Conventional memory systems are poorly optimized to this behavior, as they are typically designed as one-size-fits-all storage, resulting in excessive energy consumption and increasingly limited density scaling. This project addresses that mismatch by developing a computing infrastructure that treats data persistence as a central design consideration by statically and dynamically matching short-lived and long-lived data to differentiated memory architectures and technologies, each optimized for the appropriate retention window. The result is a more efficient and sustainable foundation for accelerating large-scale AI systems in both datacenter and edge settings. The project also supports education and workforce development through new course materials, industry engagement, and open-source resources that expand participation in next-generation AI hardware accelerator design and computer engineering.

The project develops a retention-aware computing stack that aligns AI application data lifetimes with heterogeneous memory architectures and technologies offering different retention times and densities. The research is organized around four integrated activities: (1) building a profiling framework to characterize how long different data values remain useful and to map those lifetimes onto suitable memory tiers; (2) developing algorithmic techniques that restructure computation and data movement to better satisfy retention constraints; (3) designing compilation and scheduling methods for retention-aware data placement across differen

## Key facts

- **NSF award ID:** 2541050
- **Awardee organization:** Stanford University (CA)
- **SAM.gov UEI:** HJD6G4D6TJY5
- **PI:** Thierry Tambe
- **Primary program:** 01002930DB NSF RESEARCH & RELATED ACTIVIT
- **All programs:** Artificial Intelligence (AI), CAREER-Faculty Erly Career Dev, HIGH-PERFORMANCE COMPUTING
- **Estimated total:** $730,000
- **Funds obligated:** $424,237
- **Transaction type:** Continuing Grant
- **Period:** 09/01/2026 → 08/31/2031

## Primary source

NSF Award Search: https://www.nsf.gov/awardsearch/showAward?AWD_ID=2541050

## Citation

> US National Science Foundation, Award 2541050, CAREER: Enabling Efficient AI Computing at Scale with Heterogeneous Retention-Aware Memory Systems. Retrieved via AI Analytics 2026-07-09 from https://api.ai-analytics.org/grant/nsf/2541050. Licensed CC0.

---

*[NSF Awards dataset](/datasets/nsf-awards) · CC0 1.0*