Once you clarify your research questions, you can then outline a crosswalk of research questions to data sources. This will help you see which questions you can answer now, and which ones you need to create new data sources or data collection strategies before being able to answer.
Research Question
Existing Data Sources
Limitations
Possible Future Data Sources / Goals for Future Evaluation Standardized system to capture basic participant data from all projects.
Possible Next Steps
Who participates in these training programs?
Basic Participant Data
Comes from 3 different data sources. Format not standardized. Time consuming to manually clean data to create reports. Only completed in some programs. Questions have varied.
Using TCOY and/or QPR, create desired standard format for data survey.
How effective are the instructors? (Instructor quality)
Pre / Post Survey
Standardize questions across mode of instruction to facilitate comparison across programs and mode of instruction.
Design a pre/post survey that assesses instructor effectiveness. Pilot within one program / expand to all.
How effective is the training? What do trainees learn? Do they utilize knowledge gained from these trainings afterwards?
Qualitative quotes entered into My Extension Program Reporting System
Rich data, but not comprehensive or representative.
Pre/Post survey of trainees’ knowledge
Conduct initial review of qualitative quotes to inform design subsequent more comprehensive data measure of knowledge gained.
Six-month survey of trainees re: knowledge utilized
Key informant interviews
Etc.
2
Powered by FlippingBook