Methodology of evaluation of environmental education programmes

Authors

  • Jan Činčera

DOI:

https://doi.org/10.14712/18023061.149

Keywords:

program, logical model, targets and outputs, sumative evaluation, formative evaluation, evaluation areas, levels of evaluation

Abstract

Every year, public administration and self-government bodies spend funds to support formal and informal environmental education. Because the interest in the subsidy is always higher than the available resources, the responsible staff must select the projects they will support. However, as research between regional authorities and municipalities in 2009 showed (Činčera, Kulich & Gollová, 2009), the selection methods used do not guarantee that the most effective programs will actually be supported. As a rule, the responsible staff do not know how to evaluate the effectiveness of the programs or how to know from the project application whether there is a presumption that the program will meet its educational goals. The result is an environment that does not motivate grant applicants to improve their programs and in which part of the funds spent disappears without the expected effect.

In many countries, it is common for donors to require the recipient of financial support to demonstrate the effectiveness of the supported program. The basic means for this is evaluation research. Evaluation research is commissioned by program implementers or sponsors, usually at external organizations or entities. Based on them, information can be obtained about the effectiveness of the strategies used. These can then be used by the implementer to improve its program and the donor to decide on the further distribution of funds. In the long run, the whole community will gain in the evaluation research: the implementers will prepare better programs and the donors will get a higher effect for their money.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

References

ALLUM, Liz; LOWE, Barbara; ROBINSON, Louise. How do we know it’s working? A toolkit for measuring attitudinal change in global citizenship from early years to KS5. RISC, 2008. 115 s. ISBN 978-1-874709-10-6

Andrews, Kristen E., Tressler, Kurt D., Mintzes, Joel J. Assessing environmental understanding: an application of the concept mapping strategy. Environmental Education Research. Vol. 14, no. 5, October 2008, p. 519-536

AVERCH, H.A. Using Expert Judgment. In WHOLEY, J.S.; HATRY H.P.; NEWCOMER, K.E. Handbook of Practical Program Evaluation. San Francisco: Jossey-Bass, 2004. S. 292-309

BARCH, Brian; Duvall, Jason; Higgs, Amy; Wolske, Kim; ZINT, Michaela. Planning and Implementing an EE Evaluation. [online] [Poslední aktualizace 2007-11-06] [Cit. 2008-07-20]. Dostupné na http://66.135.39.45:7080/meera-dev/knowledge-base/plan-an-ee-evaluation/

BENNETT, Dean B. Evaluating Environmental Education in Schools. A practical guide for teachers. [online]. UNESCO - UNEP, Division of Science, Technical and Environmental Education, 1989. Dostupné na http://unesdoc.unesco.org/images/0006/000661/066120eo.pdf

Braus, j.E., wood, d. Environmental education in the schools – Creating a program that works! Washington: Peace Corps, 1993

BRUNI, Coral M.; SCHULTZ ,Wesley P.; SAUNDERS, Carol. CONPSYCHMeasures. Measurement Tools for Environmental Practioners. [online] Dostupné na http://www.conpsychmeasures.com/CONPSYCHMeasures/index.html

CACHELIN, Adrienne; PAISLEY, Karen; BLANCHARD, Angela. Using the Significant Life Experience Framework to Inform Program Evaluation: The Nature Conservancy’s Wings & Water Wetlands Education Program. The Journal of Environmental Education. Winter 2009, Vol. 40, n. 2., p. 2-15

CORBIN, Juliet; STRAUSS, Anselm. Basics of Qualitative Research. 3e. Techniques and Procedures for Developing Grounded Theory. Thousand Oaks: Sage, 2008. 400 s. ISBN 141290644X

CORDANO, M., WELCOMER, S. A., SCHERER, R. F. An analysis of the predictive validity of the new ecological paradigm scale. The Journal of Environmental Education. 2003, vol. 34, is. 3, s. 22–28. ISSN 0095-8964

ČINČERA, Jan. Evaluace programu Ekoškola [online]. Envigogika. Praha: Centrum pro otázky životního prostředí Univerzity Karlovy. Roč. 3, 2008, č. 2. Dostupné z < http://www.envigogika.cuni.cz > ISSN 1802-3061

ČINČERA, Jan; MACHÁČKOVÁ, Petra. Evaluace pobytového programu Podblanického ekocentra [online]. Envigogika. Praha: Centrum pro otázky životního prostředí Univerzity Karlovy. Roč. 4, 2009, č. 3. Dostupné z < http://www.envigogika.cuni.cz > ISSN 1802-3061

ČINČERA, Jan. Evaluační strategie středisek ekologické výchovy [online]. Envigogika. Praha: Centrum pro otázky životního prostředí Univerzity Karlovy. Roč. 3, 2008, č. 2. Dostupné z < http://www.envigogika.cuni.cz > ISSN 1802-3061

ČINČERA, Jan. Práce s hrou. Pro profesionály. Praha: Grada, 2007

ČINČERA, Jan. Výstupy či procesy. Paradigmatický (kvazi) spor environmentální výchovy [online]. Envigogika. Praha: Centrum pro otázky životního prostředí Univerzity Karlovy. Roč. 4, 2009, č. 2. Dostupné z < http://www.envigogika.cuni.cz > ISSN 1802-3061

ČINČERA, Jan; GILAR, Petr; SOKOLOVIČOVÁ, Júlia. Specializační studium pro koordinátory environmentální výchovy, vzdělávání a osvěty: interpretace a efektivita z pohledu absolventů. Envigogika. Praha: Centrum pro otázky životního prostředí Univerzity Karlovy. Roč. 5, 2010, č. 1. Dostupné z < http://www.envigogika.cuni.cz > ISSN 1802-3061

ČINČERA, Jan; KULICH, Jiří; GOLLOVÁ, Dita. Efektivita, evaluace a podpora programů environmentální výchovy [online]. Envigogika. Praha: Centrum pro otázky životního prostředí Univerzity Karlovy. Roč. 4, 2009, č. 2. Dostupné z < http://www.envigogika.cuni.cz > ISSN 1802-3061

ČINČERA. Jan; KOMÁRKOVÁ, Magdaléna. Využití kresby pro evaluaci programu na rozvíjení environmentální senzitivity mladších dětí. Envigogika. Praha: Centrum pro otázky životního prostředí Univerzity Karlovy. Roč. 5, 2010, č. 2. Dostupné z < http://www.envigogika.cuni.cz > ISSN 1802-3061

Does Your Project Make a Difference? [online] Sydney: Department of Environment and Conservation, 2004. [Cit. 2008-07-20]. Dostupné na http://www.environment.nsw.gov.au/resources/community/projecteval04110.pdf

DUNCAN, William R. A Guide to the Project Management Body of Knowledge. [online] Project Management Institute, 1996. Dostupné z < http://www.unipi.gr/akad_tmhm/biom_dioik_tech/files/pmbok.pdf >

Dunlap, R.E, Van Liere, K.D. The new environmental paradigm: a proposed measuring instrument and preliminary results. The Journal of Environmental Education, 1978, iss. 9, p. 10-19

DUNLAP, Riley E.; van LIERE, Kent D.; MERTIG, Angela G.; JONES, Robert E. Measuring Endorsement of the New Ecological Paradigm: A Revised NEP Scale – Statistical Data Included. Journal of Social Issues. 2000, Vol. 56, n. 3. ISSN 0022-4537

Excellence in Environmental Education - Guidelines for Learning (Pre K-12). North American Association for Environmental Education, 2004. [Cit. 2008-07-21]. Dostupné na http://www.naaee.org/npeee/learner_guidelines.php

FITZPATRICK, Jody L.; SANDERS, James R.; WORTHEN, Blaine R. Program Evaluation. Alternative Approaches and Practical Guidelines. Boston: Pearson Education, 2004. 555 p. ISBN 0-321-07706-7

FRANC, Daniel; ZOUNKOVÁ, Daniela; MARTIN, Andy. Učení zážitkem a hrou. Praktická příručka instruktora. Brno: Computer Press, 2007. ISBN 978-80-251-1701-9

FRECHTLING, Joy et. al. The 2002 User-Friendly Handbook for Project Evaluation. The National Science Foundation, 2002. [online] [Cit. 2009-01-05] Dostupné na http://www.nsf.gov/pubs/2002/nsf02057/nsf02057.pdf

GLASER, Barney B. Doing Grounded Theory: Issues and Discussions. Mill Valley: Sociology Press, 1998. ISBN 1884156118.

Guidelines for the Preparation and Professional Development of Environmental Educators. Washington: NAAEE, 2004

HART, Paul; NOLAN, Kathleen. A critical analysis of research in environmental education. Studies in Science Education, 1999, iss. 34, p. 1-69

HENDL, Jan. Kvalitativní výzkum. Základní teorie, metody a aplikace. Praha: Portál, 2008. ISBN 978-80-7367-485-4

HENDL, Jan. Přehled statistických metod zpracování dat. Praha: Portál, 2004

HENTON, Mary. Adventure in the Classroom. Using Adventure to Strengthen Learning and Build a Community of Life-Long Learners. Dubuque: Kendall/Hunt, 1996. ISBN 0-7872-2459-6

HOGAN, Christine. Practical facilitation. A toolkit of techniques. London: Kogan Page, 2003. ISBN 0-7494-3827-4

HORNOVÁ, Karolína. Evaluace výukového programu environmentální výchovy. Envigogika, 2007, č. 3. Dostupné na http://envigogika.cuni.cz . ISSN 1802-3061

HUNGERFORD, Harold R. The General Teaching Model (GTM). In HUNGERFORD, Harold H.; BLUHM, William J.; VOLK, Trudi L.; RAMSEY, John M. Essential Readings in Environmental Education. Champaign: Stipes, 2005. ISBN 1-58874-469-8. P. 423-443

CHRÁSKA, Miroslav. Metody pedagogického výzkumu. Praha: Grada, 2007

JANČAŘÍKOVÁ, Kateřina. Žákovské portfolio – vhodná forma hodnocení environmentální výchovy. [online] Envigogika, 2007, č. 3. Dostupné na http://envigogika.cuni.cz. ISSN 1802-3061

KOLB, David. Experiential Learning. Experience as The Source of Learning and Development. Prentice Hall, 1984.256 s

KOVALIK, Susan J.; OLSEN, Karen D. Kid’s eye view of science. A Teacher’s Handbook for Implementing an Integrated Thematic Approach to Teaching Science, K-6. Kent: Center for the Future of Public Education, 1994

KRAJHANZL, Jan. Děti a příroda: Prožívání a zkušenost [online]. . Dostupné na < http://www.vztahkprirode.cz/view.php?cisloclanku=2007050045 >

MÁCHAL, Aleš; ČINČERA, Jan; DAŇKOVÁ, Lenka; BROUKAL, Václav. Ekopedagogova osmero 2007. [Interní materiál]. Praha: Pavučina, 2008

MARCINKOWSKI, Thomas. Assessment in Environmental Education. In WILKE, Richard J. Environmental Education. Teacher Ressource Handbook. A Practical Guide for K-12 Environmental Education. Thousand Oaks: Corwin, 1997. P. 143-198

MARCINKOWSKI, T. Using a Logic Model to Review and Analyze an Environmental Education Program. Washington: North American Association for Environmental Education, 2004. ISBN 1-884008-86-0

MAREŠ, Jiří; GAVORA, Peter. Anglicko-český slovník pedagogický. Praha: Portál, 1999

McLAUGHLIN, J.A.; JORDAN, G.B. Using Logic Models. In WHOLEY, J.S.; HATRY H.P.; NEWCOMER, K.E. Handbook of Practical Program Evaluation. San Francisco: Jossey-Bass, 2004. S. 7-32

MEERA – My Environmental Education Evaluation Ressource Assisstent. University of Michigan, 2008. Dostupné na http://meera.snre.umich.edu

MIOVSKÝ, Michal. Kvalitativní přístup a metody v psychologickém výzkumu. Praha: Grada, 2006. ISBN 80-247-1362-4

Musser, Lynn M., Malkus, Amy J. The Children's Attitudes Toward the Environment Scale. The Journal of Environmental Education, 1994, vol. 25, no 3, p. 22-26

MUSSER, Lynn M.; DIAMOND, Karen E. The Children’s Attitudes Toward the Environment Scale for Preschool Children. The Journal of Environmental Education. 1999. Vol. 30, No. 2; p. 23-30. ISSN 0095-8964

PATTON, M. Q. Qualitative Research and Evaluation Methods. Thousand Oaks: Sage, 2002. 700 s.

PRůCHA, J., WALTEROVÁ, E., MAREŠ, J. Pedagogický slovník.6. aktualizované a rozšířené vyd. Praha : Portál, 2009. ISBN 978-80-7367-647-6

REICHARDT, C.S.; MARK, M.M. Quasi-Experimentation. In WHOLEY, J.S.; HATRY H.P.; NEWCOMER, K.E. Handbook of Practical Program Evaluation. San Francisco: Jossey-Bass, 2004. S. 126-149

REITMAYEROVÁ, Eva; BROUMOVÁ, Věra. Cílená zpětná vazba. Praha: Portál, 2007

Robottom, Ian. Evaluation in Environmental Education: Time for Change in Perspective? The Journal of Environmental Education, Fall 1985, vol. 17 n. 1, p. 31-36

ROSSI, P. H., lipsey, m.w., freeman, h.e. Evaluation. A Systemic Approach. Thousand Oaks: Sage, 2004

SELLERS, Jennifer. Goals. In MEERA Evaluation Glossary. [online] . Dostupné na http://meera.snre.umich.edu

Schueller, S.K.; Yaffee, S.L.; Higgs, S. J. ; Mogelgaard, K.; DeMattia, E.A. Evaluation Sourcebook: Measures of Progress for Ecosystem- and Community-Based Projects. Ann Argot: Ecosystem Management Initiative, University of Michigan, 2006

SIMMONS, Bora. Designing Evaluation for Education Projects. [online] Office of Education and Sustainable Development. [Cit. 2008-06-25] Dostupné na http://wateroutreach.uwex.edu/use/documents/NOAAEvalmanualFINAL.pdf

SMITH-SEBASTO, N.J.; SEMRAU, H.J. Evaluation of the Environmental Education Program at the New Jersey School of Conservation. The Journal of Environmental Education, Fall 2004, 36, 1, p. 3-6

Stokking, H.; van Aert, L.; Meijberg, W; Kaskens, A. Evaluating Evironmental Education [online]. IUCN Commission on Education and Communication CEC, 1999. Dostupné na http://www.iucn.org/wp2003/books/pdf/cec4.pdf

ŠVAŘÍČEK, Roman; ŠEĎOVÁ, Klára. Kvalitativní výzkum v pedagogických vědách. Praha: Portál, 2007

TAYLOR-POWELL, Ellen; RENNER, Marcus. Analysing qualitative data. [online] Madison: University of Wisconsin, 2003. [Cit. 2008-04-02] Dostupné na http://learningstore.uwex.edu/pdf/G3658-12.PDF

THOMSON, Gareth; HOFMAN, Jenn. Measuring the Success of Environmental Education Programs. [online] Canadian Parks and Wilderness Society; Sierra Club of Canada. [Cit. 2008-04-02] Dostupné na http://www.peecworks.org/PEEC/PEEC_Inst/I00052276.0/ee-success.pdf

USAID. Performance Monitoring and Evaluation Tips. Selecting Performance Indicators. [online] USAID Center for Development Information and Evaluation, c1996 [Cit. 2008-07-20] Dostupné na http://pdf.dec.org/pdf_docs/pnaby214.pdf

W.K. Kellog Foundation. Logic Model Development Guide. Using Logic Models to Bring Together Planning, Evaluation, and Action. [online] Battle Creek: W.K. Kellog Foundation, 2004. [Cit. 2008-07-20] Dostupné na http://www.wkkf.org

WHOLEY, J.S.; HATRY H.P.; NEWCOMER, K.E. Handbook of Practical Program Evaluation. San Francisco: Jossey-Bass, 2004

WILTZ, K. L. I need a bigger suitcase: The evalator role in nonformal evaluation. In New Directions for Evaluation. 2005, iss. 108, p. 13-28

ZAHRADNÍK, Martin; PACHMANOVÁ, Lenka. Příklad využití wiki-prostředí v environmentálním vzdělávání na vysoké škole: hodnocení kurzu Organizace a řízení ochrany životního prostředí. [online] Envigogika, 2009, roč. 4, č. 3. Dostupné na http://www.envigogika.cuni.cz . ISSN 1802-3061

Published

28. 12. 2010

How to Cite

Činčera, J. (2010). Methodology of evaluation of environmental education programmes. Envigogika, 5(3). https://doi.org/10.14712/18023061.149

Issue

Section

Methodologies

Most read articles by the same author(s)

<< < 1 2 3 4 5 > >>