SHF: Small: Efficient Multi-Task Learning for Augmented Reality Systems

NSF Award Search · 01002526DB NSF RESEARCH & RELATED ACTIVIT · $600,000 · view on nsf.gov ↗

Abstract

Augmented Reality (AR) and Machine Learning (ML) are rapidly evolving fields that have potential to transform numerous industries by enabling immersive and intelligent applications. However, embedding advanced ML capabilities into AR devices is challenging because of limited hardware resources and the need to process large volumes of real-time sensor data. This award addresses these challenges by designing resource-efficient techniques that reduce computational load and energy consumption while maintaining high accuracy. The outcomes of this work have the potential to benefit a wide range of domains, including healthcare, education, and entertainment, by increasing the accessibility and reliability of AR technologies. In addition, the project includes a comprehensive education and outreach plan, which includes providing research experiences for undergraduate students, developing new computer engineering courses, engaging with high school students, and facilitating technology transfer to industry. This project focuses on a multi-task learning framework that integrates transformer- and convolution-based architectures with low-rank decomposition to enable efficient fine-tuning on resource-constrained AR devices. Task-aware dynamic feature sharing is employed to adaptively allocate computational resources, and quantization strategies are explored to balance performance and resilience against adversarial attacks. An adaptive policy network for inference is developed to accommod

Key facts

NSF award ID
2453413
Awardee
Brown University (RI)
SAM.gov UEI
E3FDXZ6TBHW3
PI
Sherief Reda
Primary program
01002526DB NSF RESEARCH & RELATED ACTIVIT
All programs
SMALL PROJECT, DES AUTO FOR MICRO & NANO SYST, EXP PROG TO STIM COMP RES
Estimated total
$600,000
Funds obligated
$600,000
Transaction type
Standard Grant
Period
07/01/2025 → 06/30/2028