Premium
Use of a Systematic 3‐Pronged Evaluation to Measure, Monitor, and Test Fidelity of the 5‐State iCook 4‐H Program
Author(s) -
Mathews Douglas,
FranzenCastle Lisa,
Kattelmann Kendra,
Colby Sarah,
Olfert Melissa,
White Adrienne
Publication year - 2015
Publication title -
the faseb journal
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.709
H-Index - 277
eISSN - 1530-6860
pISSN - 0892-6638
DOI - 10.1096/fasebj.29.1_supplement.395.8
Subject(s) - session (web analytics) , fidelity , test (biology) , psychology , intervention (counseling) , pilot test , physical therapy , medical education , medicine , applied psychology , computer science , telecommunications , paleontology , psychiatry , world wide web , biology
A 3‐pronged approach to evaluation was utilized to measure change (Program Evaluation [PE]), monitor feedback (Process Evaluation), and test Fidelity of Implementation (FOI). Family dyads (youth aged 9‐10 and adult food preparer) participated in an intervention promoting the focal areas of culinary skills, family meals, physical activity, and goal setting. The online PE tool (questions: youth=34; adult=15) was developed to measure change in focal areas and completed at pre and post‐test. Following sessions, dyads and leaders completed online process surveys (questions: youth=13; adult=21; leader=11) giving feedback on sessions and at home activities. At each session FOI (32 questions) was measured. Treatment youth increased PE scores (P<0.05). Treatment adults reported increases in family meals (P<0.05) and youth involvement in meals (P<0.05). Dyads reported more cooking, eating and playing together as the program progressed. Adults reported child's culinary skills were enhanced at each session. FOI evaluators reported session objectives were met 91% and focal areas were covered 90% of time. Dyads, leaders, and evaluators reported iCook was valuable in promoting positive learning. Using a systematic approach to design and implement evaluation tools resulted in evidence‐based outcomes to measure program impact.