Development of Evaluation Plan, Tools, and Protocols for the Sacramento State RISE Program

NIH RePORTER · NIH · R25 · $83,796 · view on reporter.nih.gov ↗

Abstract

Summary The Sacramento State RISE Program (RISE) team proposes to work with the Sacramento State Institute for Social Research (ISR) to build an evaluative infrastructure with two primary objectives: (1) to develop measurement tools, processes, and a long-term evaluation strategy that can be sustainably implemented by RISE staff after the end of this grant, and (2) to align and integrate the evaluation activities from other federally-funded programs aimed at UR students enrolled in STEM majors at Sacramento State so the measurement tools, data, and learning can be shared and leveraged across these programs. First, a comprehensive evaluation plan will be developed for RISE, incorporating both formative and outcome measures, which RISE staff can then implement on an annual basis. To inform the evaluation plan, ISR will review current RISE data collection efforts as well as other tools and data collected by on-campus federally-funded programs supporting UR students in STEM disciplines. The evaluation plan will include a detailed RISE program logic model, formative and outcome indicators, measurement instruments, a data collection timeline, and a data analysis plan. A comprehensive evaluation plan will ensure that all data collection activities are integrated and aligned with learning objectives and intended outcomes of the RISE program. Included in the evaluation plan are the following identified activities. Qualitative Formative Assessment Development. Focus group protocols will be developed to collect RISE Trainee perspectives on their program experiences, including Trainees’ reasons for pursuing a Ph.D. and how the RISE Program has helped toward that goal. Results will be used to identify any Trainee needs or gaps the program currently does not address, as well as how their experience in RISE intersects with other UR support programs they may also participate in. Quantitative Formative Assessment Development. ISR will develop a student survey in which to measure student perceptions and short-term outcomes, incorporating similar assessment scales used by other campus URM/STEM programs.1,2 A draft survey tool will be field tested. ISR will develop a code-book and basic analysis syntax in SPSS to automate survey results reporting. Designing Alum Data Collection Protocols. ISR will develop a protocol to count all RISE alums and all Sacramento State alums of majors related to biomedical research who go on to Ph.D. programs. This includes obtaining names and birth dates of Chemistry, Biochemistry, Microbiology, Cell & Molecular Biology, and General Biology alums from the Sacramento State Office of Institutional Research, then searching the Student Clearinghouse in a batch method. ISR will develop protocols to prepare the student record data for batch processing and then process the NSC data for analysis. These protocols can be used by RISE staff annually to track progress towards Strategic Aims and Measurable Objectives. ISR will also develop a survey ...

Key facts

NIH application ID
10393751
Project number
3R25GM122667-05S1
Recipient
CALIFORNIA STATE UNIVERSITY SACRAMENTO
Principal Investigator
Enid T Gonzalez-Orta
Activity code
R25
Funding institute
NIH
Fiscal year
2021
Award amount
$83,796
Award type
3
Project period
2021-08-01 → 2023-07-31