Collaborative Research: Learning to learn with rigor: foundations of amortized inference

NSF Award Search · 01002526DB NSF RESEARCH & RELATED ACTIVIT · $140,000 · view on nsf.gov ↗

Abstract

This research project seeks to develop a rigorous theoretical foundation for amortized inference, a recent and impactful paradigmatic development in machine learning, statistics, and simulation. Amortization enables efficient, real-time responses to statistical queries by learning a model-dependent mapping from data to distributions, avoiding the need for expensive computations every time new data are presented. This capability underpins modern advances in generative AI, including diffusion models and variational autoencoders, with applications also extending to scientific machine learning (SciML) and simulation-based decision-making in operations research. Despite its widespread empirical success, fundamental questions persist: When do these methods work well, and when might they fail? How robust are the mappings to properties of the underlying problem? What kinds of statistical guarantees can be made about learned mappings, embodied for instance by deep neural networks? The goals of this project are twofold: (1) to deepen our understanding of the mathematical principles that underpin amortized inference, and (2) to inform the design of improved methods with provable guarantees. The project comprises three interrelated thrusts: 1) Functional Guarantees: This thrust investigates foundational properties of mappings from data to distributions: Do they exist? Are they unique? How well can they be approximated by, for example, neural networks? These results will elucidate the

Key facts

NSF award ID
2503119
Awardee
University of Maryland, College Park (MD)
SAM.gov UEI
NPU8ULVAAS23
PI
Lizhen Lin
Primary program
01002526DB NSF RESEARCH & RELATED ACTIVIT
All programs
COMPUTATIONAL SCIENCE & ENGING, Artificial Intelligence (AI), Machine Learning Theory
Estimated total
$140,000
Funds obligated
$140,000
Transaction type
Standard Grant
Period
09/01/2025 → 08/31/2028