Combining Achievement and Well-Being in the Assessment of Education Systems
Combining achievement and well-being in the assessment of education systems
Supplementary tables
1
Table S1.
List of variables used in the analysis
Variable / Description / Total % missing / Total Mean / Total S.D. / Average % missing by country / Average mean by country / Average S.D. by country /math / Student mathematics performance / 0.0% / 487.48 / 94.07 / 0.0% / 494.04 / 89.12 /
belong (^) / Students' index of sense of belonging / 35.1% / 0.01 / 0.99 / 35.3% / 0.00 / 0.97 /
female / Student is a girl (dummy variable) / 0.0% / 0.50 / 0.50 / 0.0% / 0.50 / 0.50 /
age / Age of the student (in years and months) / 0.0% / 15.77 / 0.29 / 0.0% / 15.77 / 0.29 /
immig / Student immigrant status (dummy variables: native, first generation or second generation immigrant student) / 2.8% / 0.89 / 0.32 / 2.9% / 0.89 / 0.27 /
lngother / Student speaks a language at home that is different from the language of the assessment (dummy variable) / 4.7% / 0.11 / 0.31 / 4.7% / 0.10 / 0.25 /
housecomp / Student household composition (dummy variables: bi-parental home, only mother, only father, lives with grandparents, other configuration). / 5.1% / 0.96 / 0.19 / 6.2% / 0.96 / 0.18 /
escs / Students' PISA index of economic, social and cultural status / 1.7% / -0.08 / 1.07 / 2.1% / 0.00 / 0.90 /
xescs / School average PISA index of economic, social and cultural status / 0.1% / -0.08 / 0.72 / 0.1% / 0.00 / 0.48 /
mother_isei / Mother's occupational status (ISEI) / 20.5% / 44.84 / 21.54 / 19.1% / 45.21 / 21.05 /
father_isei / Father's occupational status (ISEI) / 12.5% / 42.79 / 21.63 / 13.8% / 43.62 / 21.05 /
cultpos / Students' index of cultural possessions at home / 2.5% / -0.03 / 1.00 / 2.7% / 0.00 / 0.97 /
hedres / Students' index of educatonal resources at home / 1.5% / -0.09 / 1.03 / 1.7% / 0.00 / 0.94 /
homepos / Students' index of home possessions / 1.3% / -0.09 / 1.09 / 1.5% / 0.00 / 0.89 /
icthome / Students' index of ICT resources at home / 20.3% / -0.05 / 1.09 / 18.8% / 0.00 / 0.90 /
ictres / School ICT resources / 1.5% / -0.12 / 1.11 / 1.6% / 0.00 / 0.84 /
pared / Highest parent educational attainment (in years) / 3.3% / 13.26 / 3.29 / 3.9% / 13.49 / 2.65 /
wealth / Students' index of wealth / 1.3% / -0.07 / 1.11 / 1.5% / 0.00 / 0.85 /
graderep / Student has repeated a grade (dummy variable) / 5.3% / 0.15 / 0.36 / 7.6% / 0.13 / 0.30 /
agestrt / Age student started primary school / 5.8% / 5.98 / 0.84 / 5.7% / 6.08 / 0.60 /
preschool / Student attended pre-primary school (dummy variables: no, for one year or less, for at least a year). / 1.8% / 0.07 / 0.25 / 2.0% / 0.07 / 0.21 /
Table S1 (continued).
Variable / Description / Total % missing / Total Mean / Total S.D. / Average % missing by country / Average mean by country / Average S.D. by country /isced3 / Student attends ISCED 3 programme (dummy variable) / 0.0% / 0.57 / 0.50 / 0.0% / 0.54 / 0.26 /
grade / Grade level attended by student (dummy variable: at, above or below the modal grade) / 0.2% / -0.15 / 0.60 / 0.3% / -0.08 / 0.48 /
mathperiods (^) / Number of mathematics classes per week / 37.7% / 4.17 / 1.36 / 38.3% / 4.17 / 1.19 /
mmins (^) / Total mathematics learning time per week in school (in minutes) / 40.2% / 228.35 / 95.27 / 40.7% / 218.14 / 72.94 /
homework (^) / Time spent doing homework (in hours) / 36.7% / 5.38 / 5.15 / 36.7% / 4.90 / 4.37 /
lmins (^) / Total language learning time per week in school (in minutes) / 40.6% / 228.57 / 100.55 / 41.0% / 215.10 / 72.34 /
smins (^) / Total science learning time per week in school (in minutes) / 42.9% / 206.80 / 122.94 / 43.5% / 200.37 / 104.55 /
outhours (^) / Out of school study time (in hours) / 35.6% / 10.03 / 9.44 / 35.9% / 9.22 / 8.13 /
late / Student arrived late two school at least once in the previous week (dummy variable) / 1.5% / 0.36 / 0.48 / 1.6% / 0.35 / 0.46 /
atschl (^) / Students' index of attitudes toward school / 35.2% / 0.07 / 1.01 / 35.5% / 0.00 / 0.98 /
intmat (^) / Students' index of intrinsic motivation to learn mathematics / 34.6% / 0.07 / 1.00 / 34.9% / 0.00 / 0.97 /
instmot (^) / Students' index of instrumental motivation to learn mathematics / 34.7% / 0.05 / 1.00 / 35.0% / 0.00 / 0.96 /
matheff (^) / Students' index of mathematics self-efficacy / 34.7% / -0.01 / 0.97 / 35.0% / 0.00 / 0.98 /
selcon (^) / Students' index of mathematics self-concept / 35.0% / 0.02 / 0.99 / 35.3% / 0.00 / 0.98 /
failmat (^) / Students' index of attributions to failure in mathematics / 35.0% / -0.03 / 0.99 / 35.3% / 0.00 / 0.97 /
matbeh (^) / Students' index of mathematics behaviour / 35.0% / 0.03 / 0.99 / 35.3% / 0.00 / 0.97 /
matintfc (^) / Students' index of mathematics intentions / 37.7% / -0.02 / 0.99 / 38.3% / 0.00 / 0.99 /
matwketh (^) / Students' index of mathematics work ethic / 35.0% / 0.06 / 0.99 / 35.3% / 0.00 / 0.97 /
openps (^) / Students' index of openness to problem solving / 35.1% / -0.02 / 0.99 / 35.4% / 0.00 / 0.97 /
persev (^) / Students' index of perseverance / 35.0% / 0.05 / 1.00 / 35.3% / 0.00 / 0.96 /
subnorm (^) / Students' index of subjective norms in mathematics / 34.7% / 0.05 / 1.00 / 35.0% / 0.00 / 0.95 /
disclima (^) / Index of disciplinary climate / 35.0% / 0.00 / 0.99 / 35.3% / 0.00 / 0.98 /
studrel (^) / Index of student-teacher relations / 35.1% / 0.06 / 1.01 / 35.3% / 0.00 / 0.98 /
Table S1 (continued).
Variable / Description / Total % missing / Total Mean / Total S.D. / Average % missing by country / Average mean by country / Average S.D. by country /teachsup (^) / Index of teacher support / 34.8% / 0.08 / 1.01 / 35.1% / 0.00 / 0.96 /
cogact (^) / Index of cognitive activation by the part of teachers / 35.1% / 0.05 / 1.00 / 35.3% / 0.00 / 0.97 /
mactiv / Index of cognitive activation in mathematics / 3.5% / 2.33 / 1.45 / 4.0% / 2.36 / 1.17 /
mtsup / Index of teacher support in mathematics / 0.0% / 0.08 / 1.00 / 0.0% / 0.00 / 0.97 /
clsize / Class size / 4.1% / 27.72 / 9.36 / 4.1% / 26.88 / 5.90 /
ictsch / ICT availability in school / 20.4% / -0.06 / 1.06 / 18.8% / 0.00 / 0.92 /
schtype / School type (dummy variable: private independent, government dependent, public) / 4.2% / 0.05 / 0.22 / 4.4% / 0.04 / 0.14 /
govfund / Percentage of school funding that comes from government or public sources / 12.5% / 79.29 / 29.81 / 14.2% / 85.38 / 16.96 /
schsize / School size / 6.6% / 774.18 / 571.65 / 8.1% / 734.56 / 405.92 /
stratio / Student-teacher ratio / 10.2% / 14.68 / 12.93 / 10.2% / 13.32 / 4.73 /
smratio / Student-mathematics teacher ratio / 10.5% / 114.03 / 94.68 / 10.3% / 106.33 / 60.25 /
pcgirls / Percentage of girls in the school / 2.6% / 0.48 / 0.18 / 3.1% / 0.48 / 0.17 /
tqual_cert / Percentage of certified teachers / 0.0% / 0.84 / 0.31 / 0.0% / 0.87 / 0.17 /
tqual_isced / Percentage of teachers holding an ISCED 5 - level degree / 0.0% / 0.87 / 0.25 / 0.0% / 0.86 / 0.18 /
tmath_isced / Percentage of mathematics teachers holding and ISCED 5 - level degree / 0.0% / 0.57 / 0.38 / 0.0% / 0.59 / 0.31 /
tmath_prop / Percentage of mathematics teachers in the school / 0.0% / 0.16 / 0.13 / 0.0% / 0.17 / 0.08 /
city / School location (dummy variable: large city, city, town, rural area) / 2.7% / 0.25 / 0.43 / 3.0% / 0.24 / 0.40 /
selectiv / School selectivity (dummy variable: recommendation from feeder schools or prior academic achievement is never, sometimes or always used for admission into the school) / 4.1% / 0.33 / 0.47 / 4.8% / 0.32 / 0.39 /
choice_area / School choice: residence in school catchment area is used for admission into the school (dummy variable) / 4.0% / 0.37 / 0.48 / 4.8% / 0.39 / 0.40 /
choice_prnt / School choice: parental agreement with philosophical orientation of the school is used for admission into the school (dummy variable) / 4.3% / 0.17 / 0.38 / 5.1% / 0.16 / 0.32 /
choice_spec / School choice: students' special education needs is used for admission into the school (dummy variable) / 4.1% / 0.22 / 0.41 / 4.9% / 0.22 / 0.38 /
Table S1 (continued).
Variable / Description / Total % missing / Total Mean / Total S.D. / Average % missing by country / Average mean by country / Average S.D. by country /abgrp / Ability grouping in mathematics (dummy variable: students are grouped by ability in mathematics in all subjects, in some subjects or are not grouped at all) / 4.6% / 0.22 / 0.42 / 5.4% / 0.26 / 0.36 /
scmatedu / School index of educational resources / 3.5% / 0.01 / 1.04 / 4.0% / 0.05 / 0.92 /
scmatbui / School index of building infrastructure / 5.6% / -0.07 / 1.02 / 6.8% / -0.03 / 0.96 /
tcshort / School index of teacher shortage / 3.6% / -0.02 / 1.00 / 4.1% / -0.03 / 0.85 /
compweb / Ratio of computers connected to the web and number of computers in the school / 8.4% / 0.95 / 0.18 / 8.1% / 0.97 / 0.09 /
creactiv / School index of creative extracurricular activities / 3.6% / 1.79 / 1.05 / 4.2% / 1.81 / 0.88 /
mathexc (^) / School index of mathematics extracurricular activities / 34.9% / 2.49 / 0.63 / 35.1% / 2.46 / 0.59 /
studclim / School index of student factors affecting school climate / 0.0% / -0.06 / 0.95 / 0.0% / -0.08 / 0.91 /
teacclim / School index of teacher factors affecting school climate / 0.0% / -0.11 / 0.97 / 0.0% / -0.09 / 0.91 /
tcmorale / School index of teacher morale / 3.6% / -0.06 / 0.99 / 4.2% / 0.00 / 0.92 /
tmoni_studtest / Student assessments are used to monitor teacher practice (dummy variable) / 4.0% / 0.78 / 0.41 / 4.6% / 0.78 / 0.38 /
assmnt_inform / Student assessment results from standardised tests are used to inform parents of student progress (dummy variable) / 3.7% / 0.98 / 0.12 / 4.3% / 0.98 / 0.11 /
assmnt_retprom / Student assessment results from standardised tests are used to decide on student promotion or retention (dummy variable) / 3.8% / 0.81 / 0.39 / 4.3% / 0.77 / 0.31 /
assmnt_group / Student assessment results from standardised tests are used to decide on student ability grouping (dummy variable) / 4.0% / 0.55 / 0.50 / 4.5% / 0.51 / 0.43 /
assmnt_monit / Student assessment results from standardised tests are used to monitor teacher practice (dummy variable) / 3.9% / 0.83 / 0.38 / 4.5% / 0.81 / 0.33 /
assmnt_tcheff / Student assessment results from standardised tests are used to evaluate teacher effectiveness (dummy variable) / 4.2% / 0.50 / 0.50 / 4.7% / 0.50 / 0.45 /
assmnt_curr / Student assessment results from standardised tests are used to make decisions on the curriculum (dummy variable) / 3.9% / 0.83 / 0.37 / 4.5% / 0.80 / 0.36 /
assmnt_compsch / Student assessment results from standardised tests are used to compare to other schools or regional/national benchmarks (dummy variable) / 5.9% / 0.51 / 0.50 / 7.0% / 0.53 / 0.45 /
Table S1 (continued).
Variable / Description / Total % missing / Total Mean / Total S.D. / Average % missing by country / Average mean by country / Average S.D. by country /respcur / School index of autonomy in curriculum and assessment / 0.5% / -0.12 / 0.97 / 0.7% / -0.04 / 0.78 /
respres / School index of autonomy in resources / 0.5% / -0.14 / 0.91 / 0.7% / -0.05 / 0.69 /
leadcom / School index of principal leadership: framing and communicating schools' goals and curricular development / 4.1% / 0.06 / 1.01 / 4.8% / 0.01 / 0.89 /
leadinst / School index of principal leadership: instructional leadership / 4.3% / 0.01 / 1.02 / 5.0% / 0.00 / 0.90 /
leadpd / School index of principal leadership: promoting instructional improvements and professional development / 4.9% / 0.08 / 0.99 / 5.9% / -0.01 / 0.90 /
leadtch / School index of principal leadership: teacher participation in leadership / 5.1% / 0.04 / 1.00 / 6.1% / -0.02 / 0.90 /
tcfocst / Index of teacher focus / 4.0% / -0.14 / 1.01 / 4.7% / -0.13 / 0.94 /
tchbehfa (^) / Index of teacher behaviour: formative assessment / 35.0% / 0.04 / 1.01 / 35.3% / 0.00 / 0.97 /
tchbehso (^) / Index of teacher behaviour: student orientation / 35.0% / 0.05 / 1.00 / 35.2% / 0.00 / 0.96 /
tchbehtd (^) / Index of teacher behaviour: teacher-directed instruction / 34.9% / 0.02 / 1.01 / 35.2% / 0.00 / 0.98 /
tchparti / School index of teacher participation and autonomy / 2.9% / -0.08 / 0.98 / 3.5% / -0.02 / 0.85 /
Notes: As a result of questionnaire rotation, certain questions and indices (^) in the student questionnaire were answered by only 2/3 of the students in the sample. Indices are provided in the PISA 2012 Database and built from student or school-questionnaire responses (9, 25).
Source: Own calculations based on PISA 2012 Database.
1
Table S2.
Relationship between independent variables and mathematics performance in each of the 12 model countries
Variable / AUT / BEL / CAN / DEU / ESP / FIN / FRA / JPN / KOR / NOR / POL / USAintercept / 733.717 / 374.968 / 438.663 / 699.287 / 485.409 / 455.251 / 544.192 / 296.539 / 23.261 / 464.376 / 718.365 / 522.978
female / -19.988 / -9.075 / -2.210 / -12.945 / -16.918 / 8.011 / -6.821 / -2.925 / -5.727 / 5.541 / -6.353 / -7.163
age / -8.890 / 7.500 / 2.528 / -17.908 / -1.060 / 3.365 / -7.086 / 9.799 / 6.153 / 0.398 / -2.463 / -0.130
immig (native) / 11.056 / 22.891 / 9.016 / 13.701 / 9.984 / 30.580 / 16.170 / -8.932 / 440.464 / 26.493 / 12.720 / -11.545
immig (1st) / 14.720 / 0.930 / -0.400 / 5.990 / 1.630 / 5.680 / 6.650 / 10.130 / 1353.030 / -6.180 / 34.340 / -13.210
lngother / -18.514 / -5.130 / 4.818 / -14.419 / -8.657 / -13.565 / -3.652 / -66.636 / -48.541 / -8.820 / -3.874 / -2.909