# A framework to enhance radiology structured report by invoking NLP and DL:  Models and Applications

> **NIH NIH R00** · WEILL MEDICAL COLL OF CORNELL UNIV · 2021 · $236,549

## Abstract

PROJECT SUMMARY/ABSTRACT
 In radiology practices, timely and accurate formulation of reports is closely linked to patient satisfaction,
physician productivity, and reimbursement. While the American College of Radiology and the Radiological Soci-
ety of North America have recommended implementation of structured reporting to facilitate clear and consistent
communication between radiologists and referring clinicians, cumbersome nature of current structured reporting
systems made them unpopular amongst their users. Recently, the emerging techniques of deep learning have
been widely and successfully applied in many different natural language processing tasks (NLP). However, when
adopted in a certain speciﬁc domain, such as radiology, these techniques should be combined with extensive
domain knowledge to improve efﬁciency and accuracy. There is, therefore, a critical need to take advantage of
clinical NLP and deep learning to fundamentally change the radiology reporting. The long-term goal in this appli-
cation is to improve the form, content, and quality of radiology reports and to facilitate rapid generation of radiol-
ogy reports with consistent organization and standardized texts. The overall objective is to use radiology-speciﬁc
ontology, NLP and computer vision techniques, and deep learning to construct a radiology-speciﬁc knowledge
graph, which will then be used to build a reporting system that can assist radiologists to quickly generate struc-
tured and standardized text reports. The rationale for this project is that through integration of new clinical NLP
technologies, radiology-speciﬁc knowledge graphs, and development of new reporting system, we can build au-
tomatous systems with a higher-level understanding of the radiological world. The speciﬁc aims of this project are
to: (1) recognize and normalize named entities in radiology reports; (2) construct a radiology-speciﬁc knowledge
graph from free-text and images; and (3) build a reporting system that can dynamically adjust templates based
on radiologists' prior entries. The research proposed in this application is innovative, in the applicant's opinion,
because it combines deep learning, NLP techniques, and domain knowledge in a single framework to construct
comprehensive and accurate knowledge graphs that will enhance the workﬂow of the current reporting systems.
The proposed research is signiﬁcant because a novel reporting system can expedite radiologists' workﬂow and
acquire well-annotated datasets that facilitate machine learning and data science. To develop such a method,
the candidate, Dr. Yifan Peng, requires additional training and mentoring in clinical NLP and radiology. During
the K99 phase, Dr. Peng will conduct this research as a research fellow at the National Center for Biotechnology
Information. He will be mentored by Dr. Zhiyong Lu, a leading text mining and deep learning researcher, and co-
mentored by Dr. Ronald M. Summers, a leading radiologist and clinical informatics...

## Key facts

- **NIH application ID:** 10224953
- **Project number:** 5R00LM013001-03
- **Recipient organization:** WEILL MEDICAL COLL OF CORNELL UNIV
- **Principal Investigator:** Yifan Peng
- **Activity code:** R00 (R01, R21, SBIR, etc.)
- **Funding institute:** NIH
- **Fiscal year:** 2021
- **Award amount:** $236,549
- **Award type:** 5
- **Project period:** 2020-08-01 → 2023-07-31

## Primary source

NIH RePORTER: https://reporter.nih.gov/project-details/10224953

## Citation

> US National Institutes of Health, RePORTER application 10224953, A framework to enhance radiology structured report by invoking NLP and DL:  Models and Applications (5R00LM013001-03). Retrieved via AI Analytics 2026-05-23 from https://api.ai-analytics.org/grant/nih/10224953. Licensed CC0.

---

*[NIH grants dataset](/datasets/nih-grants) · CC0 1.0*
