[Home ] [Archive]   [ فارسی ]  
:: Main :: About :: Current Issue :: Archive :: Search :: Submit :: Contact ::
Main Menu
Home::
Journal Information::
Articles archive::
For Authors::
Publication Ethics::
Editorial policy::
Contact us::
Site Facilities::
Reviewe::
::
Citation Impact
..
Search in website

Advanced Search
..
Receive site information
Enter your Email in the following box to receive the site news and information.
..
COPE Membership

AWT IMAGE

..
Creative Commons Licence
..
Open access
..
:: ::
Back to the articles list Back to browse issues page
From Evaluation to Meta‑Evaluation: A Secondary Analysis of a Group Health Education Program in the East Azerbaijan Provincial Health Center
Haidar Nadrian * , Marzieh Anousheh Bonab , Hoda Alinezhadmonfared , Manijeh Soleimani
Abstract:   (32 Views)
Background and Objectives: In recent years, group-based health education programs have been implemented across health centers in East Azerbaijan Province. However, the evaluation of these programs has faced notable challenges, including inconsistencies with established evaluation standards. To address these gaps, the present study undertakes a comprehensive meta-evaluation of the existing assessments. Meta-evaluation, as a structured and systematic methodology, facilitates the secondary appraisal of evaluation processes, outcomes, and methodological rigor, thereby informing improvements in program quality and supporting evidence-informed decision-making at the provincial level.

Materials and Methods:  The current research is a meta-evaluation study that was conducted through document review and also quantitatively and through a checklist and finally combining the results of these two stages. The first stage includes the review of the documents available in the health center of East Azarbaijan province using the qualitative content analysis method with the frame analysis approach, in which MAXQDA software was used in this part to manage the data analysis. In the second stage of meta-evaluation of the program, based on Hartz et al.'s checklist, including the dimension of usefulness  (in 7 areas), feasibility  (in 3 areas), competence  (in 8 areas), accuracy  (in 12 areas) and features  (in 5 areas), scoring was done and found. The results of reviewing and examining the documents along with the findings of the meta-evaluation phase were presented in a report and the weaknesses and strengths of the implementation process of the program were identified.

Result: The findings of the first stage of the study showed that in the evaluation program carried out in the health center of East Azarbaijan province, attention was paid to both the process and the outcome. But the evaluation of educational programs has been carried out quantitatively and qualitative and combined methods have not been used, and change has been considered at the individual and average level and has not been addressed at the macro level, and the main strategy of health education and communication is to use and organizational and political development and interdisciplinary studies have not been addressed. The results of the second stage also showed that the evaluation program in the area of Propriety standards with 81% scored the highest and in the area of accuracy standards with 56% the lowest score in the meta-evaluation process.

Conclusion: The present results showed that the evaluation of the group health education program of the health education and health promotion unit of the health center of East Azarbaijan Province is at a relatively favorable level. The standards of Propriety, specificity and feasibility are at a very good level, and the standards of utility and accuracy were evaluated at a good level. The evaluation program also has weaknesses, the main reasons of which are the lack of specific financial resources and the lack of support due to the provincial nature of this program. The findings of the research showed that allocating a budget line to the evaluation program and using external evaluators can improve the program evaluation process. The strengths of the program include the use of valid evaluation frameworks such as the CIPP and RE-AIM model, and according to the results obtained from this study, it is concluded that in addition to strengthening the standards that have obtained high scores More attention should be paid to accuracy standards, including unbiased reporting and the use of external evaluators, and description of measures to control biases and identify and report side effects of the program.

Open Access Policy: This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. To view a copy of this license, visit https://creativecommons.org/licenses/by/4.0/
Keywords: Evaluation, Community Health Education, Group Processes, Evaluation Models, Outcome Assessment
     
Type of Study: Research | Subject: Health Education & Health Promotion
Received: 2025/09/3 | Accepted: 2026/02/3
References
1. Glasgow RE, Harden SM, Gaglio B, Rabin B, Smith ML, Porter GC, et al. RE-AIM Planning and Evaluation Framework: Adapting to New Science and Practice With a 20-Year Review. Front Public Health. 2019;7:64. [DOI:10.3389/fpubh.2019.00064] [PMID] []
2. Stufflebeam DL. A Note on the Purposes, Development, and Applicability of the Joint Committee Evaluation Standards. American Journal of Evaluation. 2004;25 (1):99-102. https://doi.org/10.1016/j.ameval.2003.12.002 [DOI:10.1177/109821400402500107]
3. Sturges KM, Howley C. Responsive meta-evaluation: A participatory approach to enhancing evaluation quality. American Journal of Evaluation. 2017;38 (1):126-37. [DOI:10.1177/1098214016630405]
4. Hartz Z, Goldberg C, Figueiro AC, Potvin L. Multi-strategy in the evaluation of health promotion community interventions: an indicator of quality. Health promotion evaluation practices in the Americas: values and research: Springer; 2008. p. 253-67. [DOI:10.1007/978-0-387-79733-5_14]
5. Fawcett SB, Paine-Andrews A, Francisco VT, Schultz J, Richter KP, Berkley-Patton J, et al. Evaluating community initiatives for health and development. WHO regional publications European series. 2001 (92):241-70.
6. Yarbrough DB, Shulha LM, Caruthers F. Background and History of the Joint Committee's Program Evaluation Standards. New Directions for Evaluation. 2004;104:15-30. [DOI:10.1002/ev.133]
7. Aid B. Evaluation in Development Agencies. OECD; 2010.
8. Kumar S, Preetha G. Health promotion: an effective tool for global health. Indian journal of community medicine : official publication of Indian Association of Preventive & Social Medicine. 2012;37 (1):5-12. [DOI:10.4103/0970-0218.94009] [PMID] []
9. Iqbal Z, Anees M, Khan R, Wadood A, Malik S. A comparative analysis of the efficacy of three program-evaluation models-A review on their implication in educational programs. Humanities & Social Sciences Reviews. 2021;9 (3):326-36. [DOI:10.18510/hssr.2021.9333]
10. Wynn BO, Dutta A, Nelson MI. Challenges in program evaluation of health interventions in developing countries: Rand Corporation; 2006.
11. Kashmiri F, Mehrparvar A. Evaluation of development offices in educational colleges and hospitals: An internal evaluation. Jundishapur Ahvaz Journal of Educational Development. 2020;11 (2):157-70. (In persion)
12. Sudani M. Evaluation of life skills training program in Ahvaz secondary schools based on the SIP evaluation model. Psychological Achievements. 2019;26 (1):111-30. (In persion)
13. Rozita Firooznia, Hossein Dargahi, Zeinab Khaledian, Tohid Jafari-Koshki. Strengths and weaknesses of maternal health program evaluation tools in Iranian primary health care system. Payesh (Health Monitor) Journal. 2018;17 (5):521-30.
14. Sabsevari S. Metaevaluation and its Standards. Strides in Development of Medical Education. 2005;2 (2):116-25.
15. Kalantari H, Mojahed F, Nikjoo RG, Dadgar E, Bagheri S, Gharibi F. The Analysis of Maternity Health Program by Using Comprehensive Evaluation Model (CIPPI)-Tabriz, 1389. Depiction of Health. 2013;4 (1):14-20.
16. Sabzeh B, Bakhshi A. Goals of Life Skills Curriculum in Primary Education of Canada, Finland and Iran. Iranian Journal of Comparative Education. 2025;8 (2):3513-39.
17. Leesri T, Srisuphan W, Senaratana W, Vannarit T, Rerkasem K. CIPP model evaluation of a collaborative diabetic management in community setting. Global Journal of Medical and Clinical Research Articles. 2016;3 (1):029-34. [DOI:10.17352/2455-5282.000030]
18. Green-Morris G. An evaluation of the effectiveness of foot care education in rural clinics. Journal of diabetes and metabolic disorders. 2019;18 (1):207-15. [DOI:10.1007/s40200-019-00407-0] [PMID] []
19. Firooznia R, Dargahi H, Khaledian Z, JAFARI KT. Strengths and weaknesses of maternal health program evaluation tools in Iranian primary health care system. 2018.
20. Baartman LK, Prins FJ, Kirschner PA, Van Der Vleuten CP. Determining the quality of competence assessment programs: a self-evaluation procedure. Studies in Educational Evaluation. 2007;33 (3-4):258-81. [DOI:10.1016/j.stueduc.2007.07.004]
21. Glasgow RE, Harden SM, Gaglio B, Rabin B, Smith ML, Porter GC, et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Frontiers in public health. 2019;7:64. [DOI:10.3389/fpubh.2019.00064] [PMID] []
22. Costello ML, Slee EJ. Educational evaluation: Alternative approaches and practical guidelines: by Blaine R. Worthen and James R. Sanders. White Plains, New York: Longman, Inc., 1987, xiv+ 450 pp. ISBN 0-582-28551-8 (pbk) ISBN 0-8013-0128-9. Pergamon; 1991.
23. Hartz Z, Goldberg C, Figueiro AC, Potvin L. Multi-strategy in the evaluation of health promotion community interventions: an indicator of quality. Health promotion evaluation practices in the Americas: values and research. 2009:253-67. [DOI:10.1007/978-0-387-79733-5_14]
24. Tan S, Lee N, Hall D, editors. CIPP as a model for evaluating learning spaces2010.
25. Zhang G, Zeller N, Griffith R, Metcalf D, Williams J, Shea C, et al. Using the context, input, process, and product evaluation model (CIPP) as a comprehensive framework to guide the planning, implementation, and assessment of service-learning programs. Journal of Higher Education Outreach and Engagement. 2011;15 (4):57-84.
26. Moradi E, Pourbairamian G, Ramezani G, Sohrabi Z, Aalaa M, Norouzi A. Meta Evaluation of PhD Course in Medical Education. Journal of Medical Education and Development. 2022. [DOI:10.18502/jmed.v17i2.10608]
27. Cooksy LJ, Caracelli VJ. Meta-evaluation in Practice. Journal of multidisciplinary evaluation. 2009;6 (11):1-15. [DOI:10.56645/jmde.v6i11.211]
28. Allen LM, Hay M, Palermo C. Evaluation in health professions education-Is measuring outcomes enough? Medical Education. 2022;56 (1):127-36. [DOI:10.1111/medu.14654] [PMID]
29. de Moya M, Haukoos JS, Itani KMF. Practical Guide to Education Program Evaluation Research. JAMA Surgery. 2024;159 (6):706-7. [DOI:10.1001/jamasurg.2023.6702] [PMID]
30. Brutscher P-B, Wooding S, Grant J, RAND E. Health research evaluation frameworks: an international comparison: Rand Corporation California, Santa Monica; 2008.
Send email to the article author

Add your comments about this article
Your username or Email:

CAPTCHA

Ethics code: IR.TBZMED.REC.1400.417


XML   Persian Abstract   Print



Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Back to the articles list Back to browse issues page
فصلنامه آموزش بهداشت و ارتقاء سلامت ایران Iranian Journal of Health Education and Health Promotion
Persian site map - English site map - Created in 0.07 seconds with 44 queries by YEKTAWEB 4735