Kaua I Community College s1

Kaua`i Community College Annual Program Review for Testing Center – Academic Year 2014

Program Description Testing Center Mission Statement: Kauai Community College’s Testing Center supports student and community success by providing academic and professional examination facilities both internally to faculty, staff, and students and externally to the Kauai community. The Testing Center is committed to maintaining the highest compliance with professional testing standards and practices, safeguarding confidentiality of records and exams, and creating an optimal testing environment. The TC was created as a joint effort between Student Services and Academic Support Services. It is staffed by one person with an additional 0.138 FTE of regular help from the University Center (UC). Staff from Computer Services, Media Services, University Center, and Student Services helps to provide services in the TC when regular staff is away. As part of the joint effort, Student Counseling & Advising handles appointment scheduling and paperwork for students taking COMPASS placement tests. Part I. Quantitative Indicators Quantitative Quantitative Quantitative Measure Measure Measure Testing DATA (Overall Health) 2011-2012 2012-2013 2013-2014 Student and Faculty Information Annual Unduplicated Student Headcount 1,718 1,801 1,828 Annual FTE Faculty 71 72 74 Annual FTE Staff 85 93 89 Annual FTE Student 780 802 814 Testing Demand Indicators (Health) Number of placement tests administered per year per student FTE 1.5 1.5 1.3 Number of Distance Learning tests administered per year per student FTE 0.9 1.1 1.4 Local campus tests proctored per year per student FTE 2.7 2.8 3.3 Testing Efficiency Indicators (Health) Number of test sessions administered per FTE testing center staff 3,834.2 4,371.6 Annual operational testing center budget allocation per number of test sessions administered $15.57 $8.76 Testing Effectiveness Indicators (Health) Satisfaction measurements using Common Survey questions Quantitative Quantitative Quantitative Measure Measure Measure Testing DATA (Overall Health) 2011-2012 2012-2013 2013-2014 1. The hours at the Testing Center meet my needs 96.2% 97.4% 2. The atmosphere at the Testing Center is conducive to testing 98.7% 98.0% 3. The services at the Testing Center are satisfactory 100.0% 100% 4. My test was administered in a timely and efficient manner 100.0% 100% Part II. Analysis of the Program The TC maintains 33 seats for testing, of which one is a hand-cranked adjustable height accessible table. Replacement of all testing stations in the TC was completed in July 2013 making more seats available for more varieties of tests which made scheduling much easier than when we still had our old equipment. I also no longer needed to borrow computers from the Library for Nursing’s HESI exam. Demand/Efficiency: Overall demand for testing services continues to increase as evidenced by the 11% increase in number of test sessions administered by FTE testing center staff. A total of 4,902 tests were administered to 1,513 different people during this reporting year. Distance Learning (DL) demand for testing services saw the largest increase at 18.8%. This number includes DL tests administered for all UH campuses (1,085 exams administered to 297 students) and those administered for Non-UH schools (79 exams administered to 36 students). Three students took tests both within the UH DL system and for Non-UH schools. Demand indicator for Local Campus tests now includes all sessions not included in the placement tests or DL tests number. Demand in this area increased by 10.8% with 2,691 local campus exams administered this past year. This included 2,538 KCC exams administered to 553 students and 153 professional exams administered 80 people. For professional exams:  34 Certified Nurses’ Aide exams were administered by a private contractor in the TC as part of the CNA program  Five National Restaurant Association ServSafe exams were administered to four community members and one student taking a UH DL course that required this exam  One State of Hawaii Department of Public Safety (SOH PSD) employment exam was administered as part of a new MOA between SOH PSD and UHCC System office signed March 6, 2014.  113 ASE exams were administered to 40 individuals, of which 60 exams were to attain new certifications and 53 were recertification exams. Demand for placement tests saw an 11.9% decline, however demand remains high. Placement tests include Compass placement tests (1,035 sessions administered to 870 people) and other placement tests such as Accuplacer or course placement tests not assessed by compass (12 tests administered to 8 people--six for KCC courses and six Accuplacer sessions for other schools). Demand for testing continues to grow and remains healthy. Efficiency also continues to remain healthy. Effectiveness: Satisfaction with TC services remains healthy. The Quiet Door acoustic barrier kit was finally installed on the door between the TC and C&A. Conversations from C&A, though still somewhat audible, is much quieter and harder to understand than before. Unfortunately, if they are talking loudly near the door, their conversation is still discernible. The automatic door sweep that came with the Quiet Door kit was installed on the TC’s glass main entry door. It closes the nearly ¾” gap that was under the door. This has helped reduce some of the noise from students at the C&A counter which is right outside the TC door, however it doesn’t do much against noise through that door from events in the OSC Lobby. Each testing seat is now equipped with noise reduction headsets, offering students another option against noise distractions. Significant Program Actions (new certificates, stop-out; gain/loss of positions, results of prior year’s action plan) Certificates/Exams: As mentioned earlier, a new MOA was signed between the UHCC System office and SOH Dept of Public Safety (PSD) to provide a testing location for applicants to take employment tests for PSD. So far we have only administered one exam. In an effort to support degree completion by returning/working students, we pursued a CLEP agreement with ETS. Our agreement for CLEP testing was completed in fall 2013; however we did not give any CLEP exams during this reporting year. As a service to the community, we also offer the DSST exam. KCC does not accept this exam for credit by examination; however a community member has taken this for another school. Our PearsonVue agreement was completed in spring 2014. However, we did not come “online” during this reporting year. Through the Perkins grant awarded to Mark Anderson, we were able to purchase a tall lockable storage cabinet and the admin/server station which required a digital signature pad and two webcams meeting PearsonVue standards. Hawaii Dept. of Transportation-Airports did not use our testing services during this reporting year. From a conversation with someone in their office, it seems they will no longer be using UH test centers for their promotions testing. Although these exams were not administered this reporting year, the TC is also offering Praxis and certification for Medical Assistants. According to Victoria Mathis, Medicare standards now require certification for Medical Assistants; thus the TC provides a certified proctor for this computer-based test as well. In the past, Praxis was offered by someone else on campus, not the TC. As with ASE, Praxis also discontinued paper/pencil exams and moved to computer-based testing only. Discontinuation of paper/pencil exams in favor of computer-based testing and professional certification requirements will probably continue to occur. Safety and Security: Lockers are used for some KCC exams and for professional exams. The stand-alone camera system provides an added measure of security. Though cheating in the TC doesn’t happen often, the camera system has also provided proof in these instances. Atmosphere/Accessibility: As demand for testing services continues to rise, disruptions from within the TC will only increase as more people call in or stop by to make appointments and to check-in/-out of the TC. However, with the increase in types of professional exams offered and their various atmosphere requirements along with the increase overall testing demand, the current one-big-room setup of the TC will become a bigger problem. In the past, the students needing readers were scheduled in alternate locations with someone to read their exam for them. With the purchase of reading software, students needing readers are provided with better scheduling options—they can take their exam in the TC during regular hours and no longer need to work around a reader’s schedule. This has also relieved some demand on the Disabilities Services Office for reading support. Most other accommodations requests are for time extensions. The TC provides one hand-cranked adjustable height accessible table. Staff Changes: Previous help from UC staff was lost at the end of December 2012, so evening hours were cut in Spring 2013 and part of Fall 2013. Staff from Academic Support and Student Services helped three hours per week to provide additional daytime service that would have otherwise been lost. Once new UC staff was hired in November 2013, the TC returned to offering evening hours twice a week. In Fall 2013, the TC offered 36.75 hours per week for testing, including one evening until 7:00. Once UC staff was hired in November 2013, the TC returned to offering 39.75 hours per week for regular testing, including two evenings until 7:00 PM. For Spring 2014, the TC increased service time to 40 hours per week, including two evenings until 7:00 PM. Off-duty hours allow for daily administrative and other duties, and a lunch break. As a one-person office, proctoring by appointment allows staff to work on other assigned duties and remain an active part of the Kauai CC community. Additional TC information and availability calendar may be found at www.tinyurl.com/kcctest. Part III. Action Plan All program goals identified in the 2013 APRU have been achieved. Regarding TC Goal 1: Access  The TC continues to provide an accessible location for students to complete their exams and has improved services with the addition of reading software.  The CLEP agreement was completed in fall 2013.  The PearsonVue Test Center agreement was completed in spring 2014. Regarding TC Goal 2: Learning & Teaching  A new storage cabinet provides additional secure storage of testing materials. Regarding TC Goal 3: Workforce Development  PearsonVue Test Center agreement was completed in spring 2014.  CLEP agreement was completed in fall 2013. Regarding TC Goal 3: Workforce Development  Keyed built-in locks were installed on lockers (lockers did not come with locks).  Video surveillance system is in use. Health indicators continue to remain high due to continued effort to provide the highest quality testing atmosphere and services. Goals for the current year remain the same. Though KCC accepts CLEP scores for credit-by-examination, there hasn’t been an easy, on-island way for students to take advantage of this opportunity. By offering CLEP, the TC can help increase persistence to graduation by shortening the timeline to get there. As always, the TC supports distance learning by providing proctoring services for exams. Action plans leading towards these goals are the proctor station “room” build out and additional safety/security measures (drop box & panic button). The biggest anticipated problem is lack of funds. Though the build-out has been on the TC APRU since 2011, higher priority items were requested first. The build-out helps to address some of the contract requirements we need to meet without having to inconvenience other offices by using their resources, space, and staff and without having to inconvenience the candidates by sending them to various offices to get checked-in or to take their exam. It also helps to increase exam integrity by reducing chances for cheating while unsupervised (going between offices). If the build-out is completed, the TC would not need additional funds for the wall between the proctor station and C&A office. It would serve as an extra acoustic layer for that wall and for the glass entry door (to reduce noise transfer from events in the OSC lobby). With this, satisfaction indicators should remain high and even increase. Action Plan Program Goal Action Item Resources Needed Person(s) Timeline Indicator of PLO Status & Campus Responsible Improvement impacted Strategic Priority or Goal Construction of sound booth or installation of Student comments on Soundproof/sound acoustic that will dampen Esther Miller / survey will be reduced KCC Goals 1, 2, 3, 5 dampening proctor station activities at the proctor Maintenance / Fall 2015 and question on PLO 2 & 3 TC1a - TC4a) area1 station while still allowing Carpentry? atmosphere will increase clear view of the testing to 99% area Student comments on 55% done (wall survey will be reduced KCC Goals 1, 2 Reduce noise from Esther Miller / behind proctor Acoustic panels Spring 2016 and question on PLO 2 TC1a & TC2a neighboring offices/hallway Maintenance needs to be atmosphere will increase treated)2 to 99% Faculty survey scores for KCC Goal 2 Provide alternate test drop Esther Miller / Summer Lockable drop box hours will be higher than PLO 1 50% done3 TC2b site/method for after hours Others 2015 40% satisfaction rate. Have some sort of assistance KCC Goal 2 Esther Miller / Improved safety of staff or panic button in case of Alert/panic button Spring 2015 PLO 1, 3 TC2c Pat Watase? and users emergency.4 KCC Goals 1, 2 Purchase specialized text NaturalReader Platinum Esther Miller Spring 2014 Decreased number of PLO 1 Done, S14 TC1a, TC2a-b reading software and OCR Version reading proctoring software sessions by DSO Counselor; use of software in TC by student with accommodations

Improve access to more Esther Miller / KCC Goals 1, 3, 5 Pursue CLEP and DSST test potential students- New computer stations Computer Fall 2013 PLO 1, 2 Done, F13 TC1b & TC3b site partnerships Administered tests Services increase from 4000. Student comments on Reduce noise transmitted survey will be reduced KCC Goals 1, 2 through door between Quiet Door installation kit Maintenance Fall 2012 and question on PLO 2, 3 Done, AY 2014 TC1a & TC2a Student Counseling & atmosphere will increase Advising and Test Center above 4.9% Reopen discussion with New computer stations Improve community KCC Goals 1, 3, 5 PRAXIS representative to Praxis provided necessary Esther Miller / Summer access to education. PLO 2 Done, Jul 2014 TC1c & TC3a offer internet based testing equipment (computers, Others 2014 Administered tests (iBT) etc.) increase from 4000. Provide secure storage for KCC Goals 2 Esther Miller / Summer Improve safety, security, testing supplies and Lockable storage cabinet PLO 2, 3 Done, Su14 TC2c Mark Anderson 2013 and proctoring additional equipment5 Purchase and install KCC Goals 2, 5 Camera system, network Esther Miller / Summer Improve safety, security, preconfigured multi-camera PLO 3 Done, AY 2014 TC2c & TC4a clearance Tom Kajihara 2013 and proctoring system. Action Plan Notes 1. Having an enclosed sound-barrier space will help us conduct business more efficiently while maintaining a high level of security. It will also help us maintain student confidentiality. Our current setup could be a hindrance in offering more professional testing seats and securing additional testing partnerships. The PearsonVue Test Center (PVTC) contract specifies that the administrator’s station must be separated from the testing area. The phone and printer must also be turned off during PVTC exams. This can mean over four hours of no phone access. As previously discussed, testing demand is rising; thus the need for a separated administration space is also increasing. 2. The wall between the TC and Counseling & Advising and Creighton’s office and the TC still needs to be treated with an acoustic barrier. However, a proctor station build-out/enclosure would negate the need for treating the TC/C&A wall. 3. A lockable drop box was installed in the OSC, outside the TC door, allowing instructors to drop off exams when the TC is closed for private use, lunch, or other duties. An outdoor, after-hours option still needs to be explored. 4. There is only one staff member on duty at any time. In situations where an examinee is imposing, emotional, or belligerent, staff and student safety is a concern. A panic button would make getting help while ensuring other students' safety more efficient. 5. The locking cabinet provides secure storage for testing equipment and supplies. The open “storage” table was given to C&A to use. In exchange the TC received a long table to use as barrier between the entry and admin station. It also provides additional information privacy since fewer students try to stand behind the proctor to view the screen, and additional work space. Part IV. Resource Implications Proctor station “room” build out, including acoustic barriers, double-paned viewing window, electrical/network, doors, labor. Estimate - $12,500. Part V. Program Learning Outcomes and Assessment Assessed Program Student Learning Outcomes this year? KCC Testing Center supports instructional and academic advising faculty by providing 1 Yes ADA-compliant access to course-related and COMPASS tests. KCC Testing Services supports professional and workforce development by providing 2 Yes professional certification examination facilities that meet requirements as set forth by test originators and professional agencies. KCC Testing Services provide and maintain a safe, secure testing environment in the 3 Yes highest compliance with professional testing standards and practices. A) Provide evidence of Industry Validation

B) What is the expected level of achievement for your PLOs? Since the baselines were set last year, expected levels of achievement are still being developed.

C) List the courses that have been assessed N/A

D) Describe the assessment methods or instrument used. Service Outcomes and Assessment Measures for Testing Center In 2012, the Testing Center formally developed three service outcomes. The first relates to supporting instructional faculty and academic advising faculty by providing ADA-compliant access to course-related and placement testing. Although we have always provided this service, it was not a formal outcome, nor something we tracked. Measurements will include the number of tests administered to students with documented accommodations forms per year per student FTE, contrasted with number of overall tests per student FTE. The second service outcome relates to supporting professional and workforce development by providing professional certification examination facilities that meet test vendors’ requirements. Measurements for this will include the number of professional tests administered per year for students and community members. The third service outcome relates to providing a secure testing environment in the highest compliance with academic and professional testing standards. Measurements will include student satisfaction survey results and inspection reports (when conducted) by external testing agencies.

E) Provide the results of program assessment. ADA Access - Tests to ADA students/FTE, tests/FTE Because the ADA Access numbers were not tracked in FY 2012, this estimation was created by cross-checking IDs of students who disclosed to the Disabilities Services Office against IDs in our appointment system. During FY 2012, 40 students with accommodations took an exam at the TC (38 KCC, 2 Non-UH). Of these 40, only 19 (17 KCC, 2 Non-UH) could be identified, with confidence, to have used their accommodation for their exam. These 19 students took 55 exams which granted and accommodation during FY 2012.

A new marker has since been added to our scheduling system to track students who were provided accommodated services. In FY 2014, 127 tests with accommodations were provided to 21 students (1 Non-UH student). Most of the accommodations were for extended time.

FY 2012: 55 tests with Accommodations / 780 FTE = 0.071 FY 2014: 127 tests with Accommodations / 814 FTE = 0.156

Pro Cert - # for students & community members FY2012 - 77 ASE, 20 Airport Fire Rescue – 97 exams administered FY 2013 - 198 ASE, 10 Airport Fire Rescue, 1 ServSafe, 10 CNA, 5 others - 224 exams administered FY 2014 – 113 ASE, 5 ServSafe, 34 CNA, 1 Dept. of Public Safety – 153 exams administered

Student Satisfaction results about environment/services Secure testing environment in highest compliance with academic & professional testing standards – student satisfaction, inspection reports (none yet)

Atmosphere is conducive to testing – F’12 is 4.79, F’13 is 98.7%, F’14 is 98.0% Services are satisfactory – F’12 is 4.86, F’13 is 100%, F’14 is 100%

F) Other comments. None

G) Describe your next steps. Continue to expand and improve services in all PLOs. Part VI. Programs Cost Per SSH

Part VII. Capacity

Not applicable.