Impact Evaluation of the U.S. Department of Energy's Solar Decathlon Program
Total Page:16
File Type:pdf, Size:1020Kb
DOE/EE-0843 Impact Evaluation of the U.S. Department of Energy’s Solar Decathlon Program Submitted to: Office of Energy Efficiency and Renewable Energy U.S. Department of Energy 1000 Independence Avenue, S.W. Washington, D.C. 20585 Prepared by: Lockheed Martin Energy Services Energy Solutions Group 2277 Research Boulevard Rockville, MD 20850 FINAL REPORT December 2012 Acknowledgements This study has benefited from the contributions of many individuals. Jeff Dowd of the U.S. Department of Energy’s (DOE) Office of Energy Efficiency and Renewable Energy (EERE) initiated the study. Lockheed Martin performed the evaluation under subcontract to Sandia National Laboratories. Gretchen Jordan, Sandia National Laboratories’ study manager during most of the study, provided invaluable oversight and critical guidance that helped keep the project on track. The Lockheed Martin study team comprised Harley Barnes, principal investigator; Kelly Koser, statistician and principal analyst for the study; Nancy Hassett, statistician during the design phase; Bill Steigelmann, internal reviewer and engineering consultant; Todd Shea and Stephen Gilley, graphics; Tom Henkel, solar energy systems consultant; and Rosa Cassidy, Michael Pilat, and Hilary Haselden, who served as team interviewers and observers at the 2009 Solar Decathlon. David Schieren, President of Empower Solar led the efforts by the Solar Decathlon Alumni Association (SDAA) to develop a sample frame of Former Decathletes. As a result of SDAA’s efforts, the study benefited from the online survey input of more Former Decathletes than it probably would have obtained otherwise. Matt Beck of SDAA programmed the Former Decathlete online survey. The following members of the DOE staff took time to describe innovative ideas they observed at the Solar Decathlons and the prospects for turning the ideas into research: Richard King, Program Manager of the DOE Solar Decathlon, and Charles Hemmeline, Lew Pratsch, Terry Logee, and Robert Hassett of EERE. The following reviewers provided valuable input during the study. Those who reviewed the evaluation design provided advice that greatly helped the study team deal with the challenges of the research subject and evaluation design. The study team is grateful for their comments. Jeff Dowd, Program Evaluation Lead, Office of Strategic Programs, DOE/EERE Yaw Agyeman, Program Manager, Lawrence Berkeley National Laboratory Ed Vine, Program Director, Planning and Evaluation, California Institute for Energy and Environment Cheryl Oros, President Oros Consulting, LLC Michelle Fox, Chief Strategist for Education & Workforce Development, DOE/EERE Sheila Dillard, Senior Policy & Communications Analyst, DOE/EERE Richard King, Solar Decathlon Program Manager, DOE/EERE Jamie Vernon, American Association for the Advancement of Science (AAAS), Science & Technology Policy Fellow, DOE/EERE Ryan Kerney, AAAS, Science & Technology Policy Fellow, DOE/EERE The DOE would like to thank Carolyn Marton of New West Technologies, LLC for copy editing this report and preparing it for DOE publication. Any errors in the report remain the sole responsibility of the authors. i Notice This document was prepared as an account of work sponsored by an agency of the United States government. Neither the United States government nor any agency thereof, nor any of their employees, makes any warranty, express or implied, or assumes any legal liability or responsibility for the accuracy, completeness, usefulness, or any information, apparatus, product, or process disclosed, or represents that its use would not infringe privately owned rights. Reference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise does not necessarily constitute or imply its endorsement, recommendation, or favoring by the United States government or any agency thereof. The views and opinions of authors expressed herein do not necessarily state or reflect those of the United States government or any agency thereof. ii Table of Contents Solar Decathlon Impact Evaluation Table of Contents Executive Summary ................................................................................................................... ES.1 1. Introduction ................................................................................................................................ 1 1.1 The Solar Decathlon Program .......................................................................................... 1 1.2 Purposes of the Impact Evaluation ................................................................................... 2 1.3 Organization of the Evaluation Findings in This Report ................................................. 3 2. Evaluation Methodology ............................................................................................................ 4 2.1 Logic Model of the Solar Decathlon Program ................................................................. 4 2.2 Evaluation Research Design............................................................................................. 4 2.2.1 Solar Decathlon Audiences Selected for the Evaluation .......................................... 5 2.2.2 Research Design Issues and the Use of Multiple Sources of Evidence .................... 8 2.3 Research Questions ........................................................................................................ 17 2.4 Data Collection............................................................................................................... 20 2.5 A Word about the Terminology Used in This Report .................................................... 22 3. Findings Relevant to the Homeowner Objectives .................................................................... 24 3.1 Actions Denoting Awareness of the Opportunities that Solar Energy Systems Offer for Houses ............................................................................................................ 24 3.1.1 Impact of a Visit to the Solar Decathlon on the Homeowner Decision Process for Installing a Solar Energy System ........................................................ 26 3.1.2 Impact of the Media and Word-of-mouth-alone on Decisions to Install Solar Energy Systems by Aware Homeowners ............................................................... 32 3.2 Actions Denoting Awareness of the Opportunities that Energy-efficient Appliance Products and Lighting Equipment Offer for Houses ..................................................... 35 3.2.1 Impact of a Visit to the Solar Decathlon on Installations of Energy-efficient Products .................................................................................................................. 37 3.2.2 Impact of the Media and Word-of-mouth-alone on Installations of Energy-efficient Products....................................................................................... 46 3.3 Knowledge of Solar House Features and Energy-efficient Products ............................. 49 3.3.1 Impact of a Visit to the Solar Decathlon on Knowledge of Residential Solar Energy Systems and Energy-efficient Products ............................................ 50 3.3.2 Impact of the Media and Word-of-mouth Alone on Knowledge of Residential Solar Energy Systems and Energy-efficient Products ............................................ 53 3.4 Findings Relevant to the Homeowner Objectives—Conclusions .................................. 54 4. Findings Relevant to the Participating-student Objectives ...................................................... 62 4.1 Education Findings Related to the Opportunities Presented by Clean-energy Products.......................................................................................................................... 62 iii Table of Contents Solar Decathlon Impact Evaluation 4.1.1 Comparative Knowledge ........................................................................................ 63 4.1.2 Learning from the Solar Decathlon Compared to Regular Coursework ................. 64 4.2 Preparation of Decathletes to Enter the Clean-energy Workforce ................................. 65 4.2.1 Changing to a Major Related to Clean Energy ....................................................... 66 4.2.2 Career Choices........................................................................................................ 66 4.2.3 Impact of Participation in a Solar Decathlon on Getting a Job in the Clean-energy Workforce ........................................................................................ 68 4.3 Influence of Former Decathletes on Clean-energy Installations .................................... 69 4.3.1 Influence on the Installation of Renewable-energy Equipment .............................. 70 4.3.2 Impact on the Installation of Energy-efficient Equipment ..................................... 71 4.4 Findings Relevant to the Participating-student Objectives—Conclusions .................... 73 5. Participating Students’ Assessment of Their Solar Decathlon Experience .............................. 78 5.1 Summary of Former Decathlete Comments from the Online Survey ............................ 78 5.1.1 Comments about the Impact of the Solar Decathlon on the Former Decathletes ... 78 5.1.2 Suggestions for Future Solar Decathlons................................................................ 79 5.2 Summary of Faculty Advisor Comments from the Online Survey ...............................