Developing a Framework for Assessing Environmental Literacy
Total Page:16
File Type:pdf, Size:1020Kb
Developing a Framework for Assessing Environmental Literacy Copyright © 2011 by the North American Association for Environmental Education (NAAEE) 2000 P Street, N.W., Suite 540, Washington, D.C. 20036, USA http://www.naaee.net/ Commercial reproduction of any materials in this publication is strictly prohibited without written permission from the publisher, NAAEE. Educators may photocopy up to 100 copies of this material for non-commercial educational purposes. This material is based upon work supported by the National Science Foundation under Grant No. 1033934. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation. Suggested citation: Hollweg, K. S., Taylor, J. R., Bybee, R. W., Marcinkowski, T. J., McBeth, W. C., & Zoido, P. (2011). Developing a framework for assessing environmental literacy. Washington, DC: North American Association for Environmental Education. Available at http://www.naaee.net. Table of Contents PREFACE ....................................................................................................................................... ii INTRODUCTION ....................................................................................................................... 1-1 The importance of environmental literacy ............................................................................... 1-1 History of environmental literacy ............................................................................................ 1-1 Environmental education for youth and in schools ................................................................. 1-2 The need for data about the environmental literacy of youth .................................................. 1-3 The status of environmental literacy assessments ................................................................... 1-4 Challenges in developing this document ................................................................................. 1-5 DEFINING THE DOMAIN OF ENVIRONMENTAL LITERACY .......................................... 2-1 An international definition of literacy ..................................................................................... 2-1 Historical definitions of environmental education ................................................................... 2-1 Research and program frameworks ......................................................................................... 2-2 Defining the domain for this project ........................................................................................ 2-3 ORGANIZING THE DOMAIN OF ENVIRONMENTAL LITERACY .................................... 3-1 Dispositions ............................................................................................................................. 3-5 Competencies ........................................................................................................................... 3-7 Context ................................................................................................................................... 3-11 Environmentally responsible behavior .................................................................................. 3-12 ASSESSING THE DOMAIN OF ENVIRONMENTAL LITERACY ....................................... 4-1 Assessment decisions ............................................................................................................... 4-2 Research literature on instrument development ....................................................................... 4-8 Summary ................................................................................................................................ 4-13 ONE EXAMPLE: A PROPOSED FRAMEWORK FOR PISA 2015 ........................................ 5-1 REFERENCES ............................................................................................................................ 6-1 APPENDIX A. Workshop Participants and Reviewers APPENDIX B. Challenges of Developing this Document APPENDIX C. Guiding Questions for Developing an Environmental Literacy Assessment Framework i PREFACE This document presents a new, comprehensive, research-based description of environmental literacy and applies that work to the creation of a framework for an assessment of environmental literacy. The developers, who worked under the aegis of the North American Association for Environmental Education (NAAEE), sought to create materials that are broadly representative of, and build on, the environmental education literature, as well as insights derived from a broad range of disciplines. Their work was informed by: previous environmental education frameworks (e.g., Hungerford & Volk, 1990; Roth, 1992; Simmons, 1995; Wilke, 1995); recent national assessments of environmental literacy in the United States (e.g. Phases One and Two of the National Environmental Literacy Assessment Project (NELA); McBeth et al., 2008, 2011) and in other nations (e.g., South Korea: 2002-2003; Israel: 2004-2006: and Turkey: 2007-2009); and the Organisation for Economic Co-operation and Development’s (OECD’s) international assessments (e.g., the OECD report Green at Fifteen? How 15-Year-Olds Perform in Environmental Science and Geoscience in PISA 2006 [OECD, 2009]). In addition, the project brought together, for the first time, experts in research, assessment, and evaluation in the fields of social studies education, science education, environmental education, and related science and social science fields. These experts contributed to the work by critiquing early drafts, providing additional references, and suggesting revisions. This work is timely; it began as the United Nations (UN) Decade of Education for Sustainable Development (2005-2014) was coming to an end. In the United States, government agencies, professional organizations, educational institutions, and private corporations have demonstrated their interest in the enhancement of environmental literacy by investing hundreds of millions of dollars toward achieving that goal. Assessments for gauging our progress are needed; this material will provide guidance for the design of such assessments. Who is this work for and in what ways could it be used? This product is built on internationally accepted definitions of, and research pertaining to, environmental literacy. It is intended for use by those who work on the development of environmental literacy assessments at international (e.g., Programme for International Student Assessment [PISA]) and national (e.g. NELA) levels. By focusing on the competencies of environmentally literate individuals, this document and the analysis on which it rests guide specialists in developing assessments to answer the question: To what degree do these individuals have the knowledge, skills, dispositions, and behaviors for competently making decisions about, and acting on, local, regional, national, and global environmental issues? The document could also be useful to those designing such assessments at the state, provincial, or district level to determine the degree to which students have acquired these competencies (are becoming environmentally literate) by certain ages or grade levels. ii Another intended audience includes researchers and policy makers; they may use data from broad environmental literacy assessments based on this work to identify questions for investigation, or implications for education policies and funding, respectively. They could also use the material herein and the results of such assessments to help identify gaps in existing research, educational frameworks, and educational practice. These materials are not intended for use in developing tests to evaluate achievement of an intended or an implemented curriculum, that is, to answer the question posed by state tests and Trends in International Mathematics and Science Study (TIMSS) assessments: “Did the students learn what was taught?” Who developed this document? The United States’ National Science Foundation (NSF) awarded the NAAEE a grant (Grant No. 1033934) to coordinate the development of this product. The following team led the development effort: Karen S. Hollweg, North American Association for Environmental Education Jason R. Taylor, Nature Talks, L.L.C. Rodger W. Bybee, Biological Sciences Curriculum Study Thomas J. Marcinkowski, Florida Institute of Technology William C. McBeth, University of Wisconsin-Platteville Pablo Zoido, OECD/PISA We sincerely appreciate the interest and encouragement of our NSF program officer, David B. Campbell; the many contributions made to this work by the 17 experts who reviewed our drafts (they are listed in Appendix A); and the support of our partners at the OECD Indicators and Analysis Division and at the National Oceanic and Atmospheric Administration (NOAA) Office of Education. We also thank the project’s external evaluator, Joe Heimlich, Ohio State University Extension, for his dedication to the project and the formative insights he provided to the leadership team. As researchers and specialists pursue the assessment of environmental literacy, we believe it is imperative that there be sufficient consistency within and across assessments so that cross- comparisons can be made. With this document, we hope to promote such consistency enabling professionals working in our fields to accumulate evidence and develop understandings regarding the extent to which environmental literacy