CALMAC Study ID: CPU0019.02 Small Commercial Contract Group Direct Impact Evaluation Report Appendices A-D Prepared by Itron, Inc. ECONorthwest KEMA Inc. PA Consulting Summit Blue Robert Thomas Brown Co. For the California Public Utilities Commission Energy Division February 9, 2010 Table of Contents Appendix A Telephone Survey Instruments ...................................................... A-1 Appendix B Lighting Logger Field Installation .................................................. B-1 B.1 Overview, Objectives, and Theory .............................................................. B-1 B.1.1 Lighting HIMs/Technologies/Concepts ..................................................................... B-1 B.1.2 Targets and Quotas and Waves ...............................................................................B-3 B.1.3 DEER Activity Area Considerations .......................................................................... B-4 B.2 Equipment and Installation Materials .......................................................... B-6 B.2.1 Lighting Data Loggers ...............................................................................................B-6 B.2.2 Logger Installation Tools and Materials ....................................................................B-8 B.3 Data Logger Initialization and Programming Procedures ............................ B-9 B.3.1 DENT Data Logger Initialization Procedures ............................................................B-9 B.4 Logger Installation Guidelines ..................................................................... B-9 B.4.1 Pre-Visit Preparation .................................................................................................B-9 B.4.2 Logger Placement ...................................................................................................B-10 B.4.3 Logger Adjustment and Installation Procedures .....................................................B-15 B.5 Special Logger Installation Situations ....................................................... B-16 B.5.1 Fixtures/Lamps That Are Always or Mostly Off .......................................................B-16 B.5.2 Hotel/Motel (and Other Lodging) Guest Rooms ......................................................B-17 B.5.3 Inaccessible High-Ceiling and High Bay T5/T8 Lighting .........................................B-22 B.5.4 DENT Fiber Optic Attachment For Recessed Cans ................................................B-22 B.6 Logger Extraction Procedures ................................................................... B-24 B.6.1 Pilot Study Interim Logger Data Extraction and Data Review ................................B-24 B.6.2 Final Logger Extraction Procedure .........................................................................B-25 B.6.3 Logger Data File Naming Conventions ...................................................................B-32 B.7 Additional Non-Logger Study Tasks .......................................................... B-34 B.7.1 Marking of Screw-In CFLs for Possible Retention Study ........................................B-34 B.7.2 Ballast Make/Model for Linear Fluorescent Fixtures ...............................................B-35 B.7.3 Spot Fixture-Watt Measurement .............................................................................B-39 B.7.4 Investigating the Use of Existing Incandescents for CFL Baseline .........................B-39 Appendix C Pre-/Post-Retrofit Survey ............................................................... C-1 Appendix D Guidelines for Estimating Net-To-Gross Ratios Using the Self-Report Approaches and the Self-Report Free Ridership Algorithm ....................................................................................... D-1 D.1 Introduction ................................................................................................ D-1 D.2 Issues Surrounding the Validity and Reliability of Self-Report Techniques .............................................................................................. D-3 D.2.1 Timing of the Interview ............................................................................................. D-6 D.3 Identifying the Correct Respondent ............................................................ D-6 D.4 Set-Up Questions ....................................................................................... D-7 D.5 Use of Multiple Questions .......................................................................... D-8 D.6 Validity and Reliability ................................................................................ D-8 D.7 Consistency Checks .................................................................................. D-9 Table of Contents i Small Commercial Contract Group Direct Impact Evaluation Report D.8 Making the Questions Measure-Specific .................................................. D-10 D.9 Partial Free-Ridership .............................................................................. D-11 D.10 Deferred Free-Ridership ........................................................................ D-12 D.11 Scoring Algorithms ................................................................................. D-13 D.12 Handling Non-Responses and “Don’t Knows” ........................................ D-13 D.13 Weighting the NTGR .............................................................................. D-14 D.14 Ruling Out Rival Hypotheses ................................................................. D-14 D.15 Precision of the Estimated NTGR .......................................................... D-15 D.16 Pre-Testing Questionnaire ..................................................................... D-16 D.17 The Incorporation of Additional Quantitative and Qualitative Data in Estimating the NTGR ......................................................................... D-16 D.17.1 Data Collection ..................................................................................................... D-16 D.17.2 Establishing Rules for Data Integration ............................................................... D-18 D.17.3 Analysis ................................................................................................................ D-18 D.18 Qualified Interviewers............................................................................. D-19 D.19 References ............................................................................................. D-20 Appendix E Self-Report Free-Ridership Stability Indicators ............................. E-1 Appendix F Discrete Choice Analysis ................................................................. F-1 F.1 Discrete Choice Approach ........................................................................... F-1 F.1.1 The Discrete Choice Model ....................................................................................... F-1 F.1.2 Net-to-Gross Ratios ................................................................................................... F-7 Appendix G Lighting Logger Data Analysis ...................................................... G-1 G.1 Overview .................................................................................................... G-1 G.2 Data Sources ............................................................................................. G-1 G.3 Time of Use Monitoring .............................................................................. G-2 G.3.1 Sample Design......................................................................................................... G-2 G.3.2 Data Collection Content ........................................................................................... G-5 G.3.3 Post-Only On-Site Survey Data Collection Summary.............................................. G-7 G.3.4 Pre-Post On-Site Survey Data Collection Summary ............................................. G-13 G.3.5 Logger Equipment Installed ................................................................................... G-18 G.3.6 Logger Data Validation .......................................................................................... G-23 G.3.7 Logger Data Used in Analysis ............................................................................... G-28 G.4 Spot Watt Measurement .......................................................................... G-32 G.5 Additional On-Site Data Collection ........................................................... G-35 G.6 Verification Analysis ................................................................................. G-42 G.7 Lighting Logger Analysis Methodology .................................................... G-45 G.7.1 Development of 8760 Post-Retrofit Percent-On Load Shapes – By Program and Market Segment .................................................................................. G-46 G.7.2 Development of 8760 Pre-Retrofit Percent-On Load Shapes – By Program and Market Segment .................................................................................. G-63 G.7.3 Development of Pre- and Post-Retrofit Wattages – By Program and Measure .................................................................................................................... G-63 G.7.4 Development of Pre- and Post-Retrofit kW Load Shapes – By Program, ED DEER Market Segment and Measure ................................................................