Final Evaluation Report June 2010

Prepared by: Jacob Burgoon, Evaluator Northwest Ohio Center of Excellence in Science and Mathematics Education Bowling Green State University TABLE OF CONTENTS

List of Tables and Figures ...... ii Executive Summary ...... iii Introduction ...... 1 Overview of Project Pi r2 ...... 1 Overview of the Evaluation Design ...... 2 Data Collection Instruments and Procedures ...... 3 The Implementation of Project Pi r2 ...... 6 Teacher Participants ...... 6 Community Resources Workshop ...... 7 Inquiry Series Professional Development Sessions ...... 8 Classroom Outreach Programs ...... 11 The Impact of Project Pi r2 on Teachers ...... 16 Awareness and Use of Community Resources ...... 16 Science Content Knowledge ...... 18 Beliefs and Behaviors Regarding Science Teaching ...... 20 The Impact of Project Pi r2 on Students ...... 23 Evaluation Summary and Recommendations ...... 25

Appendices

Appendix A: NWO Inquiry Series Evaluation Survey Appendix B: Teacher Science Content Knowledge Test Appendix C: Teacher Belief Instrument Appendix D: Community Resources Workshop Survey and Monthly Follow‐up Survey Appendix E: Outreach Worksheet Appendix F: Classroom Observation Instrument Appendix G: Kindergarten Picture Card Interview Protocol Appendix H: 2009‐2010 NWO Inquiry Series Flyer

NWO Center of Excellence i June 2010 LIST OF TABLES AND FIGURES

Table 1. Demographic information for Project Pi r2 teachers ...... 7

Table 2. Participants’ attitudes regarding the implementation and personal impact of the CRW ...... 8

Table 3. Science content addressed during the Pi r2 sessions of the NWO Inquiry Series ...... 9

Table 4. Summary of teachers’ perceptions regarding the implementation of Project Pi r2 ...... 10

Table 5. Outreach programs provided by community science organizations for Project Pi r2 ...... 12

Table 6. Participants’ responses regarding their awareness and attitudes about community resources ...... 17

Table 7. Participants’ responses regarding their prior and future use of community resources ...... 17

Table 8. Summary of science content test analyses ...... 19

Table 9. Summary of TBI analyses ...... 22

Table 10. Summary of kindergarten student interview analysis ...... 24

Figure 1. Intended format for the implementation of outreach programs during Project Pi r2 ...... 11

Figure 2. Teachers’ monthly use of community resources in their classroom ...... 18

NWO Center of Excellence ii June 2010 EXECUTIVE SUMMARY

Project Pi r2 is a science teacher professional development project designed and implemented by the Northwest Ohio Center of Excellence in Science and Mathematics Education (NWO) and funded by the Ohio Board of Regents. The focus of Project Pi r2 is providing science teachers with high‐quality professional development and outreach services from community partners. As a result, the project aims to improve the overall quality of the participating teachers’ science lessons and thus increase the quantity and quality of the science learning done by the participating teachers’ students. Project Pi r2 is designed to meet five goals:

1. Help retain and support teachers in science and technology

2. Expose teachers to effective models in science instruction

3. Integrate educational resources in the region’s classrooms to model inquiry and increase class time spent on STEM subjects

4. Improve student inquiry science process skills and science achievement

5. Promote the use of research‐based best practices in science teaching in northwest Ohio classrooms consistent with local, state, and national standards

The evaluation of Project Pi r2 is designed to measure the implementation of the project’s activities as well as the impact of those activities on the participating teachers and their students. Therefore, several evaluation questions were developed based on that foundation:

1. How successful was