In addition to our research and evaluation capacity building efforts, our lab regularly engages in planning and implementing high-quality evaluations for a variety of clients. We provide descriptions of these studies below – the majority of which focus on evaluating public health or educational efforts that strive to decrease disparities that relate to social inequities.
- Qualitative Evaluation of the Enrichment Markers of Better Relationships, Academics, and Cultural Enhancement (EMBRACE) Project
Cal State University, Fullerton’s School of Nursing was awarded funds by the U.S. Health Resources and Services Administration to plan and implement a project that puts into place various approaches to address social determinants that present challenges for disadvantaged and underrepresented minority students. As part of this project, we were subcontracted to conduct a qualitative evaluation to provide insights about the project implementation. As part of these efforts, we are gathering data through focus groups comprised of School of Nursing students, interviews with lead project team members, and content analyzing student mentor journals.
Lab team members involved: Colin Braman
- Evaluation of the Stronger Hearts™ Helpline Pilot
In September 2016, our team was approached by the National Forum for Heart Disease & Stroke Prevention to evaluate their pilot of the Stronger Hearts™ Helpline (SHH) in San Bernardino County, CA. The SHH is a 24/7 free, bilingual call center operated out of 2-1-1 San Bernardino County. It was designed to provide callers with information about heart failure and refer them to resources and services to help support self-management of this chronic health condition. Our team performed a formative, process evaluation which examined the costs of the SHH, who contacted the SHH and why, and tested several underlying assumptions of the intervention. Data collection and analysis efforts included a mixed methods approach using publicly available data about the demographics the population in San Bernardino County, interviews with health care providers and resource providers, focus groups with persons who have heart failure and their caregivers, document reviews of resources, site visits to service sites, a sample of patient data from the primary referral hospital, and budget documentation of revenue and operating costs. Support for this evaluation was provided by the Robert Wood Johnson Foundation.
Lab team members involved: Blake Beckmann, Heather Codd, Kathleen Doll, Carlos Echeverria-Estrada, Michael Fileta, Matthew Swope, Jennifer Villalobos
- Evaluation Plan for Stopping Diabetes in its Tracks
In April 2016, our team was awarded funds to develop an evaluation plan for Pomona Valley Hospital Medical Center’s (PVHMC) Stopping Diabetes in its Tracks. PVHMC received funding from the UniHealth Foundation to engage with several partners in their service area to develop an intervention to reduce the occurrence and progression of diabetes. Our team regularly engaged with the project partners to develop a strategy for evaluating the proposed intervention.
Lab team members involved: Piper Grandjean Targos, Phung Pham
- Evaluation of the Canadian Evaluation Society’s Credentialed Evaluator Designation
After several decades of debate about professionalization within the evaluation community, the Canadian Evaluation Society (CES) officially launched the Credentialed Evaluator (CE) professional designation in June 2009 with the goal of promoting ethical, high quality, and competent evaluation in Canada. Since the establishment of the CE designation in 2009, CES has iteratively discussed the potential strengths and drawbacks of the program while also inquiring about areas for future growth. In June 2015, CES commissioned the Claremont Evaluation Center at CGU to design and implement a formative evaluation to help them improve the design, resourcing, uptake, and outcomes. In collaboration with an evaluation steering committee created by the vice president of CES, the evaluation team developed several evaluation questions related to the evaluation principles of effectiveness, relevance/utility, efficiency, unintended impacts, and sustainability. The evaluation team collected data from a wide variety of stakeholder groups to respond to the evaluation questions. Two online surveys were created and disseminated to obtain input from evaluators who were current members of CES and from evaluators whose membership with CES had lapsed or who had never been CES members. In addition, we conducted 65 interviews with CES leadership, the CES Board of Directors, CES Credentialing Board (CB) members, commissioners of evaluation in Canada, employers of evaluators in Canada, potential/prospective partners for CES (with respect to the CE designation), and individuals who had spoken out critically in the past regarding the credential. In addition, our team reviewed secondary data sources where available.
Lab team members involved: Heather Codd
Technical Report: Fierro, L.A., Galport, N., Hunt, A., Codd, H., Donaldson, S.I. Canadian Evaluation Society Credentialed Evaluator Designation Program: Evaluation Report. January 25, 2016.
Click here to view the final evaluation report.
Click here to view the executive summary.