2018-2019 SCHOOL PROGRESS REPORT User Guide 2018-2019 School Progress Report User Guide Welcome This guide is intended to help you understand the various components that make up the SPR and will cover the following topics: Topic Content Page SPR Components This section provides an overview of the SPR layout and its main 3 & Scoring Overview components. It also provides details on how each metric and domain are scored. Report Types There are four SPR report types. This section explains how a 7 school's report type is determined. Domains The SPR is organized into four domains: Achievement, Progress, 8 Climate, and (for high schools only) College & Career. This section provides a brief overview of each domain. Domain Weights This section explains how each domain is weighted. Because the 9 District is committed to ensuring that all students are learning, the Progress domain is weighted most heavily. Performance Tiers This section explains how a school's progress at the overall, 10 domain, and metric levels is categorized into four performance tiers: Intervene, Watch, Reinforce, and Model. Appendices Additional information on metric definitions; floors, targets, and 11 points possible; peer groups; and schools with consecutive years of overall score improvement. Page 1 2018-2019 School Progress Report User Guide SPR Components & Scoring Overview School Demographics & Performance Tiers Each School Progress Report begins with some basic information about the specific school being evalu- ated. It is formatted as in the sample below. School Name, Address, and The left side of the school demographics section provides all relevant contact Contact Information information for the school being evaluated, including address, phone and fax numbers, and the school's website. Sector This indicates whether the school is managed by the District or by a Charter organization. Report Type The school's report determines on which measures the school is evaluated. It is also associated with the grade levels that the school serves. Grades in Report These are the grades included in the report. Schools that serve multiple grade spans receive separate reports for each grade span. Enrollment This is the headcount for the school as of October 1, 2018. Admissions Category Information about the school's admissions category (Neighborhood, Special Admit, etc.). Turnaround Model Information about whether or not the school was in a Turnaround model in 2018-2019. Performance Tiers This is a guide for the four performance tiers, their colors, and their thresholds. These tiers are also applied to each metric in the SPR. Page 2 2018-2019 School Progress Report User Guide Domain Summaries Immediately below the school demographics, we provide summaries for each domain on which the school has been evaluated. The domain summaries are formatted as in the sample below. Domain Summary This section provides an overview of what each domain includes, as well as the score that the school received and its tier. In this particular example, the school received 55% of all possible points overall, which puts it in the \REINFORCE" tier for this domain. Three-Year Trend Graph This section provides a three-year line graph of the scores received by the 2016-2017 through 2018-2019 school in each domain, from school year 2016-2017 through 2018-2019. In this particular example, the school received 24% of all possible points in 2016-2017, 45% of all possible points in 2017-2018, and 55% of all possible points in 2018-2019. The graph is color-coded based on the tier that each score fell into for that particular year. 3-Year Average This section provides the overall and domain scores, averaged across each of the last three years. In the example above, the school's three-year average is 41.3%. Page 3 2018-2019 School Progress Report User Guide Metric Scores Following the Summary Page, there are pages for each domain on which the school has been evaluated. These domain-specific pages contain details on each performance measure within that domain. They are formatted as in the sample below. Metric The SPR includes multiple measures of school progress, organized by domain. Each of these measures, or metrics, provides information about a different aspect of the school. In this example, the first metric in the Climate domain is \% of Students Attending 95% or More of Instructional Days."The data points included to the right of the metric name provide additional detail. Metric Score The metric score is the actual value that a school received for a given metric. In the example above, 51% of students attended 95% or more of instructional days. Below the score, the number of students eligible for the metric is displayed. In the example above, 573 students were eligible for - and so included in - the calculation. Points Earned Each metric is assigned a point value or weight, which rolls up into the domain and overall scores. Each metric also has a set floor and target. The floor represents the minimum score needed to earn points, and the target represents the minimum score needed to earn all of the points. If a school's metric score is greater than or equal to the target, the school receives all possible points for that metric. The formula for points earned is: [(Metric Score-Floor)/(Target-Floor)] * Points Possible Points earned are calculated using the unrounded metric score. Tier The tier indicator is determined by the percentage of points that a school receives on a metric (see scale on page 10). In the example above, having 51% of students attending 95% or more of instructional days means that this school has earned 48% of all possible points on this metric, putting it in the \WATCH" tier. Page 4 2018-2019 School Progress Report User Guide Domain Scores The domain-specific scores are provided at the bottom of each domain-specific page. These scores are also provided on the Summary Page along with the school's three-year trend. On the domain pages, the domain scores are formatted as in the sample below: Domain Score The domain score is the aggregated percentage of points earned for each domain. In this example, the school received 63% of all points possible in the Climate domain. Points Earned The sum of all points earned for the domain (18.82), out of the sum of all possible points (30.00). Tier The tier is determined by the percentage of points that a school receives in a domain (see scale on page 10). In the example above, 63% of points earned puts this school in the \REINFORCE" tier for the Climate domain. Page 5 2018-2019 School Progress Report User Guide Report Types There are four SPR report types. A school's report type is determined by the grades it serves. Below is a list of sample grade spans that fall into each of the four report types. Elementary School K-1 j K-2 j K-4 j K-5 j K-6 j 3-5 K8 School K-8 j 1-8 j 2-8 Middle School 5-7 j 5-8 j 6-8 j 7-8 High School 9-10 j 9-12 j 10-12 Notes: 1. Schools that serve grade spans such as K-10, K-11, K-12, 1-12, 2-12, or 3-12 receive two reports: a K-8 School report and a High School report. 2. Schools that serve grades 5-12, 6-12, or 7-12 receive two reports: a Middle School report and a High School report. 3. Schools that serve one grade level within a grade span only do not receive a report for that grade level. Page 6 2018-2019 School Progress Report User Guide Domains There are four SPR domains. Achievement The Achievement domain measures performance on standardized assessments, including the Pennsylvania System of School Assessment (PSSA), Keystone Exams, ACCESS for ELLs 2.0, and reading assessments, including but not limited to Developmental Reading Assessment, 2nd Edition (DRA2) and Fountas & Pinnell. Progress The Progress domain measures growth on standardized assessments - including the PSSA, Keystone Exams, and ACCESS for ELLs 2.0 - and (for high schools only) progress towards graduation. Growth on the PSSA and Keystone Exams is measured using the Pennsylvania Value-Added Assessment System (PVAAS) Average Growth Index (AGI). Progress towards graduation is measured using credit accumulation for students in grades 9-11. Progress, On Equity is a sub-section of the Progress domain that measures growth on the PSSA and Key- stone Exams for the lowest-performing 33% of students in a school. The Pennsylvania Department of Education categorizes AGI values as follows: 2.0 or higher - Significant evidence that the student group gained ground 1.0 to 1.99 - Moderate evidence that the student group gained ground -1.0 to 0.99 - Evidence that the student group maintained -2.0 to -1.01 - Moderate evidence that the student group lost ground -2.01 or lower - Significant evidence that the student group lost ground Climate The Climate domain measures student engagement and school climate, focusing on student attendance, student retention, and in- and out-of-school suspensions. We have also introduced survey results measuring student and parent/guardian perceptions of school climate and parent/guardian engagement. College & Career (HS only) The College & Career domain measures college and career readiness and post-secondary outcomes. In addition to the four-year cohort graduation rate and the first-fall college matriculation rate, we have introduced three additional metrics: participation in and performance on advanced coursework (AP, IB, NOCTI, and Dual Enrollment), par- ticipation in and performance on standardized college entrance exams (ACT and SAT), and student readiness for college & careers.