FY 2012 Evaluation Annual Performance Report
Total Page：16
File Type：pdf, Size：1020Kb
FY 2012 Evaluation Annual Performance Report Submitted by Office of Educational Innovation and Evaluation June 30, 2012 Office of Educational Innovation and Evaluation (OEIE) 2323 Anderson Avenue, Suite 220 Kansas State University Manhattan, Kansas 66502 Phone: 785-532-5930 Fax: 785-532-7185 Kan-ed Evaluation Annual Performance Report (June 30, 2012) TABLE OF CONTENTS Table of Contents ...................................................................................................................i Summary ................................................................................................................................ii Appendix 1: Kan-ed 2.0 Connections Update ......................................................................1-8 Appendix 2: Membership Update .........................................................................................1-6 Appendix 3: 2011 Member Record Update ..........................................................................1-9 Appendix 4: Kan-ed Membership Database Manual Summary ...........................................1-3 Appendix 5: 2011 Equipment Grant Program Follow-up Survey ........................................1-17 Appendix 6: Kan-ed Study Committee Summary ................................................................1-15 Appendix 7: Legislative Post Audit Summary .....................................................................1-60 Appendix 8: Kan-ed Advisory Committee Summary ...........................................................1-19 Appendix 9: 2012 Legislative Session Summary .................................................................1-25 Appendix 10: Evaluation Snapshot: Fiscal Years 2004-2012 ..............................................1-19 Executive Summary - i - June 30, 2012 Office of Educational Innovation & Evaluation Kan-ed Evaluation Annual Performance Report Kan-ed Evaluation Annual Performance Report (June 30, 2012) This report provides summary information of the evaluation activities for Kan-ed conducted between July 1, 2011 and June 30, 2012. The data collection methods, instruments, and analyses are reported and compiled in the attached appendices so that essential information is easily accessible. The accomplishments for Fiscal Year 2012 are bulleted below. Brief summaries of the sections included in this report begin on page iv. FISCAL YEAR 2012 ACCOMPLISHMENTS Continued development of the Invoices and Reimbursements database (Billing Database) and the Membership Database. Documented status of Kan-ed member connections to Kan-ed 2.0. Updated an interactive online form to conduct Annual Member Record Update. Completed Annual Member Record Update and imported changes in Kan-ed Membership Database. Collected impact data that may be used to prepare impact stories related to connectivity. Completed Annual Membership Verification to verify eligibility of members in preparation for the 2012 Kansas Legislative Session. Coordinated and finalized the collection of Letter of Agency (LOA) and Children’s Internet Protection Act (CIPA) compliance (form 479) forms from Kan-ed members for Kan-ed E-Rate application. Developed surveys to gather feedback about the Kan-ed 2.0 connection process and usage of and satisfaction with Kan-ed network and other member services, for Hospital members and Higher Education members separately. Attended and documented two Kan-ed Study Committee meetings on September 13 and October 27. Attended and documented four Kan-ed Advisory Committee (KAC) meetings on September 16, December 7, January 27, and March 30. Provided requested data directly to the Legislative Post Audit (LPA) team as well as to other entities that were preparing information for LPA. Assisted in the development of a survey to gather input on members’ circuit utilization to assist in preparations for changes to the Kan-ed network. Prepared E-Rate training feedback form to administer to workshop participants. Provided feedback and updated data for documents prepared by Kan-ed staff for the legislature and other organizations. Updated legislative data sheets and impact statement sheet for 2012 Legislative Session. Compiled legislative packets and provided to Kan-ed staff for distribution to legislators at the beginning of the 2012 Legislative Session. Executive Summary - ii - June 30, 2012 Office of Educational Innovation & Evaluation Kan-ed Evaluation Annual Performance Report Provided requested data during the 2012 Legislative Session and updates for legislative link on Kan-ed website. Created GIS maps showing connections to the Kan-ed 2.0 network. Monitored legislation regarding Kan-ed during the 2012 Legislative Session. Conducted follow-up survey with 2011 Equipment Grant Program award recipients to evaluate the impact of the funds. Updated the Membership Database Governance, Associated Members, Legislative, and Evaluation tabs. Imported funding data from the Billing Database into the Membership Database to update the Funding tab. Imported LOA, CIPA, and Kan-ed Authorized Provider (KAP) Subsidy Program application forms into the Membership Database to update the Forms tab. Developed the Kan-ed Membership Database Manual, which includes user and administrator manuals. Developed survey items that could be included in a member needs assessment. Documented and refined site information, including GIS coordinates. Provided requested data and updates and attended required meetings. Project Description The Kan-ed Act was signed into law on April 21, 2001. Through the Kan-ed Act, the Kansas Board of Regents (KBOR) was charged with providing a “broadband technology-based network to which schools, libraries and hospitals may connect for broadband Internet access and intranet access for distance learning.” Kan-ed provides a private statewide network to which members connect for videoconferencing, distance learning, training, professional development, and virtual meetings. An enhanced version of this network, Kan-ed 2.0, was launched in Fiscal Year 2009. In addition to the network, Kan- ed provides grant funding for private network access and videoconferencing equipment as well as E-Rate consulting services. Kan-ed also has provided access to content services, specifically Educational and Research Databases; an authenticated portal called the Empowered Desktop that consolidates a variety of teaching and learning applications in one location; Live Tutor/Homework Kansas, which connects students of all ages with professional tutors seven days a week; and EMResource, a trauma diversion and resource tracking system that has been used in Kansas to address trauma care, emergency preparedness, and statewide communication. Due to significant cuts to the Kan-ed budget for Fiscal Year 2012, the funding for the content services was reduced this past year, between 50% and 100% depending on the service. These content services will no longer be available through Kan-ed as of July 1, 2012. The Director of Kan-ed contracted with the Office of Educational Innovation and Evaluation (OEIE) during Fiscal Year 2012 to serve as the external evaluator of Kan-ed. OEIE has served Kan-ed in this capacity since 2003. As demonstrated in the bullets above, a variety of evaluation and coordination tasks were performed by OEIE staff from July 1, 2011 through June 30, 2012. Executive Summary - iii - June 30, 2012 Office of Educational Innovation & Evaluation Kan-ed Evaluation Annual Performance Report A brief summary of each activity is included on the following pages, with data collection instruments and complete analyses reported and compiled in the attached appendices. Kan-ed 2.0 Connections Update OEIE tracks member connections to the Kan-ed network to keep this information up-to-date in the Membership Database. As of June 15, 2012, a total of 584 sites are directly connected to the Kan-ed 2.0 network. Each Kan-ed member can have multiple sites connected to the network; these 584 connected sites correspond to 445 unique Kan-ed members. Eight fewer members (including 22 fewer sites) are currently connected compared to the numbers reported in the December 2011 Biannual Evaluation Report. The breakdown of the currently connected members by constituent group and region, along with a list of connected members, is displayed in Appendix 1. Membership Update OEIE tracks Kan-ed membership on a continual basis and conducts an annual Membership Verification during which the eligibility of members is verified based on the Kan-ed legislative statute. The current Kan-ed membership, as of June 15, 2012, is comprised of 881 members. More information about the membership verification process and changes observed in the Kan- ed membership are included in Appendix 2. 2011 Member Record Update An annual Member Record Update is conducted by OEIE to verify and update contact information for each Kan-ed member organization’s Kan-ed contacts. The contacts serve as the principal contacts in a member organization for any Kan-ed related communication. These contacts are updated on an annual basis due to frequent changes in positions and/or their contact information. As in 2010, the 2011 Member Record Update process was conducted using an interactive online form. The update was completed by 850 Kan-ed members, and 443 of these members required changes to their information. A complete description of the process and results of the 2011 Member Record Update are included in Appendix 3. Kan-ed 2.0 Connection Process and Impact Survey OEIE developed a collection of surveys