A Path Towards Quality of Service in the Educational System

Total Page:16

File Type:pdf, Size:1020Kb

A Path Towards Quality of Service in the Educational System PONTIFICIA UNIVERSIDAD CATOLICA DE CHILE SCHOOL OF ENGINEERING USER EXPERIENCE MONITORING: A PATH TOWARDS QUALITY OF SERVICE IN THE EDUCATIONAL SYSTEM LEONARDO ANDRÉS MADARIAGA BRAVO Thesis submitted to the Office of Graduate Studies in partial fulfilment of the requirements for the Degree of Doctor in Engineering Sciences. Advisor: MIGUEL NUSSBAUM VOEHL Santiago, Chile, August 2018 Ó 2018, Leonardo Madariaga Bravo ii PONTIFICIA UNIVERSIDAD CATOLICA DE CHILE SCHOOL OF ENGINEERING USER EXPERIENCE MONITORING: A PATH TOWARDS QUALITY OF SERVICE IN THE EDUCATIONAL SYSTEM LEONARDO ANDRÉS MADARIAGA BRAVO Members of the Committee: MIGUEL NUSSBAUM LIOUBOV DOMBROVSKAIA MARCOS SEPÚLVEDA JOSÉ MANUEL ALLARD MARIJN JANSSEN Thesis submitted to the Office of Research and Graduate Studies in partial fulfilment of the requirements for the Degree of Doctor in Engineering Sciences Santiago, Chile, August 2018 iii To Carolina, Alonso and Felipe, for their support and providing purpose to this journey iv ACKNOWLEDGEMENTS I would like to thank everyone who has helped in my development as a researcher, particularly my family and friends. A special thank you to Professor Miguel Nussbaum, who has provided me with his unconditional support and dedication over the doctoral process. Without him, none of this would have been possible. I would also like to thank everyone who has worked with me in some way during my research: Isabelle Burq, Faustino Marañón, Manuel Aldunate, Tomás Ozzano, Cristóbal Alarcón and María Alicia Naranjo. I would also like to thank Pontifical Catholic University of Chile and particularly the Computer Science Department and the Engineering Graduate Studies Office for the support and delivering a superb learning experience over the course of these last years. Finally, the corresponding author would like to thank Comisión Nacional de Investigación Científica y Tecnológica (CONICYT) for financial support of his Doctoral studies. Grant: CONICYT-PCHA/ Doctorado Nacional/2016- 21160787. v INDEX ACKNOWLEDGEMENTS .................................................................................................................... IV RESUMEN .............................................................................................................................................. IX ABSTRACT ............................................................................................................................................ XI 1. INTRODUCTION ................................................................................................................................13 1.1 CONCEPTUAL FRAMEWORK: INFORMATION ARTIFACT .......................................................................13 1.2 USER EXPERIENCE AND QUALITY OF SERVICE ...................................................................................17 1.3 GENERAL AND SPECIFIC GOALS OF THE THESIS PROJECT ....................................................................20 1.4 QUALITY PROCESSES IN EDUCATION & INFORMATION DEMAND .........................................................21 1.5 INFORMATION FOR QUALITY: STAKEHOLDERS AND INTERACTIONS .....................................................25 1.6 USAGE OF INFORMATION ARTIFACTS: LEVELS OF INTERACTIVITY ......................................................32 1.7 TOWARDS QUALITY OF SERVICE: USER EXPERIENCE OF LOW LEVEL INTERACTIVITY ARTIFACTS..........36 1.8 PROBLEM STATEMENT ......................................................................................................................39 1.9 THESIS METHODOLOGY AND OUTLINE ..............................................................................................41 2. USER EXPERIENCE OF LEARNING MATERIALS: A FRAMEWORK FOR ASSESSMENT ....47 2.1 INTRODUCTION .................................................................................................................................47 2.2 THEORETICAL FRAMEWORK ..............................................................................................................49 2.2.1 User evaluation in Education ....................................................................................................49 2.2.2 Student perception of Learning Materials .................................................................................55 2.3 METHOD ..........................................................................................................................................58 2.3.1 Stages of the study ....................................................................................................................58 2.3.2 Participants..............................................................................................................................60 2.3.3 Development of Assessment Framework ....................................................................................61 2.3.4 Data Analysis ...........................................................................................................................64 2.4 RESULTS ..........................................................................................................................................66 2.4.1 Research Question 1 .................................................................................................................66 2.4.2 Research Question 2 .................................................................................................................68 2.5 CONCLUSION ....................................................................................................................................73 2.6 LIMITATIONS AND FUTURE WORK ......................................................................................................75 3. ONLINE SURVEY: A NATIONAL STUDY WITH SCHOOL PRINCIPALS .................................77 3.1 INTRODUCTION .................................................................................................................................77 3.2 LITERATURE REVIEW ........................................................................................................................79 3.2.1 Impact of email scheduling on response rate and response time ................................................79 3.2.2 Influence of embedding surveys in an email ..............................................................................84 3.3 RESEARCH METHOD ..........................................................................................................................85 3.3.1 Procedure for Study 1: Effect of email scheduling on response rate and response time ..............85 3.3.2 Procedure for Study 2: Effects of embedding the survey in an email on response rate and response time ....................................................................................................................................87 3.3.3 Participants..............................................................................................................................88 3.3.4 Measurements and data analysis...............................................................................................89 3.4. RESULTS .........................................................................................................................................90 3.4.1 Effects of email scheduling on response rate .............................................................................90 3.4.2 Effects of email scheduling on response time .............................................................................92 3.4.3 Effect of embedding survey in email on response rate and response time ...................................96 3.5 DISCUSSION AND CONCLUSIONS ........................................................................................................99 3.6 LIMITATIONS AND FUTURE WORK .................................................................................................... 102 vi 4. USER EXPERIENCE OF PUBLIC SERVICE INFORMATION .................................................... 103 4.1 INTRODUCTION ............................................................................................................................... 103 4.2 LITERATURE REVIEW ...................................................................................................................... 105 4.2.1. What is Public Service Information? ...................................................................................... 105 4.2.2 Public Service Information as Usable Products ....................................................................... 108 4.3 RESEARCH METHOD ....................................................................................................................... 114 4.3.1 Method used to answer the first research question: How can Public Service Information (PSI) materials be classified in terms of User Experience? ....................................................................... 116 4.3.2 Sample for first research question ........................................................................................... 116 4.3.3 Definition of dimensions for classifying UX............................................................................. 117 4.3.4 Method used to answer the second research question: How can the User Experience of PSI be monitored over time in order to inform design decisions? ................................................................ 121 4.3.5 Survey design: Dimensions for assessing User Experience .....................................................
Recommended publications
  • Chile • Chile Has One of the Smallest Shares of Tertiary-Educated Adults Across OECD Countries
    Education at a Glance: OECD Indicators (OECD, 2019[1]) is the authoritative source for information on the state of education around the world. It provides data on the structure, finances and performance of education systems in OECD and partner countries. Chile • Chile has one of the smallest shares of tertiary-educated adults across OECD countries. However, those who do attain a higher education enjoy above-average labour-market benefits. • Chile devotes 1.2% of its gross domestic product (GDP) to financing ECEC, one of the largest shares across OECD countries. Although enrolment in early childhood education and care (ECEC) has been increasing in recent years in Chile, it is still lower than on average across OECD countries. • The teaching workforce is young in Chile but working conditions are difficult: student-teacher ratios and statutory working hours are among the highest across OECD countries from pre-primary to upper secondary levels. This may discourage individuals from entering and remaining in the profession. • Chile’s total expenditure per student on primary to tertiary educational institutions is low and a large share of it is covered by private sources, particularly at tertiary level. Figure 1. Distribution of students benefiting from public/government-guaranteed loans and scholarships/grants in bachelor's and master's long first degrees or equivalent (2017/18) Percentage of students Note: Annual average (or most common) tuition fees charged by public institutions for national students at the bachelor's level are indicated in parenthesis (USD converted using PPPs). The year of reference may differ across countries and economies. Please see Annex 3 for details.
    [Show full text]
  • Teachers' Perceptions of Professional Development in Chilean State-Funded Early Childhood Education
    International Research in Early Childhood Education 21 Vol. 8, No. 1, 2017 Teachers’ Perceptions of Professional Development in Chilean State-Funded Early Childhood Education Mariel Gómez University of British Columbia, Vancouver, BC, Canada Laurie Ford University of British Columbia, Vancouver, BC, Canada Abstract This article presents the results of a study on professional development in Chilean state- funded early childhood education. Based on a multiple-case study design and drawing on qualitative methods we explored teachers’ perspectives on professional development at two early childhood educational centers. Two centers’ directors and four early childhood teachers employed at the two major institutions offering initial education in Chile described and discussed their experiences in a variety of professional development activities. Findings reveal that, although participants value professional development and have access to a wide range of activities, their experience of professional development could be improved in several ways. Conditions identified as critical to maximize the benefits derived from professional development include (a) access to ongoing training activities for a greater number of teachers, (b) greater duration and depth in professional development sessions, (c) more opportunities to receive training guided by experts, (d) more training focused in topics related to language and socioemotional development, (e) improvement of teacher’s preservice education, and (f) improvement of working conditions. The article concludes with suggestions for teacher education programs, professional development designers, and policymakers, offered in the light of the results. Keywords Professional development; early childhood teachers; initial education; state-funded early childhood education; Chile ISSN 1838-0689 online Copyright © 2017 Monash University education.monash.edu/research/publications/journals/irece International Research in Early Childhood Education 22 Vol.
    [Show full text]
  • The Street Art Culture of Chile and Its Power in Art Education
    Culture-Language-Media Degree of Master of Arts in Upper Secondary Education 15 Credits; Advanced Level “We Really Are Not Artists, We Are Military. We Are Soldiers” The Street Art Culture of Chile and its Power in Art Education “Vi är inte konstnärer, vi är militärer. Vi är sodlater” Gatukonstkulturen i Chile och dess påverkan på bildundervisning Granlund, Magdalena Silén, Maria Master of Art in Secondary Education: 300 Credits. Examiner: Edström, Ann-Mari. Opposition Seminar: 31/05/2018. Supervisor: Mars, Annette. Foreword We would like to give a big thanks to all those whom have helped made this thesis possible: to all the people we have been interviewing and that have been showing us the streets of Santiago and Valparaiso. To Kajsa, Micke and Robbin for making sure we met the right people while conducting this study. To Annette Mars for all the guidance prior- and during the conducting of this thesis. To Mauricio Veliz Campos for all the support we were given during the minor field studies scholarship application, as well as during our time in Santiago. To Vinboxgruppis for your constant support during the last five years. And last but not least to SIDA, for the trust and financial support. Thank you! This thesis is written during the spring of 2018. We, the writers behind this thesis, have both come up with the purpose, research questions, method, interview guide, as well as been taking visual street notes together. 2 Abstract This thesis describes the street art culture of Chile and its power in art education. The thesis highlights the didactic questions what, how and why.
    [Show full text]
  • Street Art Of
    Global Latin/o Americas Frederick Luis Aldama and Lourdes Torres, Series Editors “A detailed, incisive, intelligent, and well-argued exploration of visual politics in Chile that explores the way muralists, grafiteros, and other urban artists have inserted their aesthetics into the urban landscape. Not only is Latorre a savvy, patient sleuth but her dialogues with artists and audiences offer the reader precious historical context.” —ILAN STAVANS “A cutting-edge piece of art history, hybridized with cultural studies, and shaped by US people of color studies, attentive in a serious way to the historical and cultural context in which muralism and graffiti art arise and make sense in Chile.” —LAURA E. PERÉZ uisela Latorre’s Democracy on the Wall: Street Art of the Post-Dictatorship Era in Chile G documents and critically deconstructs the explosion of street art that emerged in Chile after the dictatorship of Augusto Pinochet, providing the first broad analysis of the visual vocabulary of Chile’s murals and graffiti while addressing the historical, social, and political context for this public art in Chile post-1990. Exploring the resurgence and impact of the muralist brigades, women graffiti artists, the phenomenon of “open-sky museums,” and the transnational impact on the development of Chilean street art, Latorre argues that mural and graffiti artists are enacting a “visual democracy,” a form of artistic praxis that seeks to create alternative images to those produced by institutions of power. Keenly aware of Latin America’s colonial legacy and Latorre deeply flawed democratic processes, and distrustful of hegemonic discourses promoted by government and corporate media, the artists in Democracy on the Wall utilize graffiti and muralism as an alternative means of public communication, one that does not serve capitalist or nationalist interests.
    [Show full text]
  • For-Profit Schooling and the Politics of Education Reform in Chile: When Ideology Trumps Evidence
    For-profit schooling and the politics of education reform in Chile: When ideology trumps evidence Gregory Elacqua Documento de Trabajo CPCE Nº 5 http://www.cpce.cl/ Julio, 2009 * Correo de contacto: [email protected] For-profit schooling and the politics of education reform in Chile: When ideology trumps evidence Gregory Elacqua Documento de Trabajo CPCE Nº 5 Julio, 2009 Abstract For-profit schooling is one of the most hotly debated issues in education policy discussions in Chile. Proponents argue that for-profit schools have incentives to reduce costs and to innovate, leading to both higher quality and greater efficiency in education. Critics maintain that for-profit schools cannot be trusted to place the interest of children over profitability. Buried in this position is the belief that for-profits would cut quality in the process of cutting costs. Researchers can gain insight into this debate by examining school systems where vouchers have been implemented on a large scale and where for-profit and non-profit school supply has increased. In 1981, Chile began financing public and most private schools with vouchers. Education in Chile occurs in a mixed market with 46 percent of students enrolled in public schools, 31 percent in for-profit voucher schools, 16 percent in non-profit (religious and secular) voucher schools, and 7 percent in private non-voucher schools. This paper compares the academic achievement of fourth and eighth-grade students across for-profit, non-profit and public schools. What I find is a mixed story. Initial results indicate that non-profits have a small advantage over for-profit and public schools and for- profit school students have slightly higher test scores than comparable public school students at fourth grade, once student and peer attributes and selection bias are controlled for.
    [Show full text]
  • Chilean Student Movements: Sustained Struggle to Transform a Market-Oriented Educational System
    Chilean Student Movements: Sustained Struggle to Transform a Market-oriented Educational System Cristián Bellei Cristian Cabalin University of Chile University of Chile During the last decade, Chilean society was shaken by sharply critical and powerful student movements: secondary students led the 2006 “Penguin Revolution” and university students led the 2011 “Chilean Winter.” This article describes and analyzes these student movements to illustrate how students can be highly relevant political actors in the educational debate. First, we explain the main features of the Chilean educational system, including its extreme degree of marketization, which provided the institutional context of the movements. Next, we analyze the key components and characteristics of the 2006 and 2011 student movements to describe basic features of the two movements and identify common elements of these movements, especially from an education policy perspective. We mainly focus on the link between students’ demands and discourses and the market-oriented institutions that prevail in Chilean education. Finally, we identify students’ impact on educational debates in Chile and examine general implications for policy-making processes in the educational arena. Introduction: Youth Apathy to Activism One of the most important changes in the Chilean political system in recent decades was the establishment of automatic registration and voluntary voting in 2012. A political objective of this project was to increase youth participation in elections, which has been low since democracy was restored in 1990. Indeed, the lack of political participation in elections among youth was explained during the 1990s as an expression of general apathetic behavior. These young people were considered “the ‘whatever’ generation” (La generación “No estoy ni ahí”) due to their supposed apolitical attitudes and limited motivation to be involved in public affairs (Muñoz Tamayo, 2011; Moulián, 2002).
    [Show full text]
  • Government of Chile Ministry of Education Department of Research and Statistics Attracting, Developing and Retaining Effective T
    Government of Chile Ministry of Education Planning and Budget Division Department of Research and Statistics Attracting, Developing and Retaining Effective Teachers OECD Activity Country Background Report for Chile November 2003 Country Background Report for Chile The preparation of this document for the OECD was conducted by the Department of Research and Statistics - Division of Budget and Planning - of the Ministry of Education and coordinated by Paula Darville, Mauricio Farías and Cesar Muñoz, under the supervision of Vivian Heyl and incorporating the cooperation of Iván Núñez and Xavier Vanni both from Minister of Education Cabinet, and Carlos Eugenio Beca from the Centre for Training, Experimentation and Pedagogical Research (CPEIP) of the Ministry of Education. This report also includes the collaboration of the following people from the Ministry of Education: Rodolfo Bonifaz Minister Cabinet adviser María Elvira Cornejo Higher Education Scholarships Program Rodrigo Díaz Department of Research and Statistics René Donoso Division of General Education Rodrigo González Juridical Department Carla Guazzini Department of Research and Statistics Sonia Marambio Juridical Department Claudio Molina Centre for Training, Experimentation and Pedagogical Research (CPEIP) Paulina Peña Program for Strengthening Initial Teachers’ Training Ana María Quiroz International Relationship Office (ORI) Cecilia Richards Division of General Education Fernando Ríos Centre for Training, Experimentation and Pedagogical Research (CPEIP) Miguel Rozas Division of
    [Show full text]
  • Quality of Education in Chile
    Quality of Education in Chile Jorge Manzi, Katherine Strasser, Ernesto San Martín and Dante Contreras Santiago, Chile February 2008 1 Table of Contents TABLE OF CONTENTS ............................................................................................................................. 2 1. INTRODUCTION AND GOALS ....................................................................................................... 3 2. BACKGROUND: THE CHILEAN EDUCATIONAL SYSTEM ................................................. 8 2.1 PROVIDERS , COVERAGE AND FINANCING ........................................................................................... 8 2.2 EVALUATIONS OF THE SYSTEM ............................................................................................................. 9 3. FAMILY, TEACHER AND SCHOOL EFFECTS ON PERFORMANCE IN STANDARDIZED TESTS ....................................................................................................................... 15 3.1 DATA AND ANALYSIS .......................................................................................................................... 15 3.1.1 Analytical approach ............................................................................................................. 15 3.1.2 Variables .................................................................................................................................. 15 3.1.3 Teacher evaluation variables ..........................................................................................
    [Show full text]
  • Decentralization of Education in Chile
    Decentralization of Education in Chile A case of institutionalized class segregation By Aleida van der Wal February 2007 This document was drafted by Ms. Aleida Ingrid van der Wal for Education International. It is a summarised version of her master thesis presented in February 2007 at Leiden University (Department of Public Administration and Public Affairs). EDUCATIONAL DECENTRALIZATION IN CHILE FOREWORD Teachers unions around the world are confronted with decentralisation processes in all their shapes and sizes. In many countries decentralisation policies are presented as part of an education reform agenda. They have great consequences for the education sector, educators and learners, not all of them positive. On the contrary, in some countries, it has led to the undermining of the fundamental rights of teachers unions. In other instances, it poses a serious threat to the provision of quality public education for all. Chile is a country where teachers and their unions have been experiencing the effects of decentralisation policies for over two decades. Initially Chile was a model country for those who strongly endorsed decentralisation, also called ‘municipalización’ or the handing over of responsibilities to the municipalities. Quite a number of studies have been carried out to 1 demonstrate the great successes of this policy. However, both the teachers’ unions and civil society organisations have expressed their hesitation and opposition to the implications of these policies. The study that you now have in your possession is an important contribution in support of the views of the unions. The study highlights one issue in particular: what impact has decentralisation in the education sector in Chile had on the social stratification of the country.
    [Show full text]
  • Language and Literacy Overview of the Education System
    CHILE Agencia de Calidad de la Educación División de Estudios Departamento de Estudios Internacionales Language and Literacy The main language in Chile is Spanish, and the Constitution does not recognize an official language. Almost the entire population of Chile speaks Spanish, and all national administrative documents are in Spanish. The predominant language of instruction in the national educational system from Grades 1 to 12 is Spanish. Because primary and secondary education in Chile are compulsory, the country has a high literacy rate (95.7 percent of the population over age 15 can read and write).1 According to the National Institute of Statistics, 4.6 percent of the population belongs to one of the eight official ethnic groups defined in Law No. 19.253: Aimara, Mapuche, Quechuas, Rapa Nui, Atacameños, Collas, Diaguita, Kawashkar, and Yagán. The first four groups have their own languages, which currently are used by them.2 Law No.19.253 stipulates that a system of intercultural bilingual education should be implemented in areas with a high Indigenous population, in order to prepare Indigenous learners to develop in an adequate way in their society of origin and in the global society.a,3 Consequently, the Ministry of Education implemented the Bilingual Intercultural Education Program, which stipulates the instruction of Indigenous languages in schools with a high level of Indigenous students. The teaching of Aimara, Mapudungun, Quechua, and Rapa Nui languages from Grades 1 to 7 is guided by a curriculum specially developed for this goal.4 Overview of the Education System The Chilean educational system is governed by the Quality Assurance System, which has the mandate of guaranteeing good quality education for all students.
    [Show full text]
  • A New Engineering for 2030
    IMPLEMENTATION OF THE STRATEGIC PLAN A NEW ENGINEERING FOR 2030 Name of the project: Research, Development, Innovation and Entrepreneurship to Meet Global Engineering Demands FIRST REPORT: PARTIAL RESULTS AND MILESTONE Recipient’s name: Name: Universidad de Chile Legal Name: Universidad de Chile Name of Representative : Ennio Vivaldi Véjar (Rector) Project’s Director: Name of the Director: Felipe Álvarez Daziano Institution: Facultad de Ciencias Físicas y Matemáticas (FCFM), Universidad de Chile Telephone: +56 2 2978 4419 Email: [email protected] Address: Torre Central, Beauchef 850, Santiago, Chile Operational contact information: Person of contact: Mauricio Morales Meza / Luis Salas Albornoz Telephone : +56 2 29771260 / +56 9 79 68 90 63 Email: [email protected] / [email protected] Address: Fundación para la Transferencia Tecnológica (UNTEC), Beauchef 993, Santiago, Chile TABLE OF CONTENTS EXECUTIVE SUMMARY 5 1 EMPHASIZED STRATEGIC APPROACH 9 1.1 General Strategy 10 1.1.1 Engineering & Sciences at the Beauchef Campus of UChile 10 1.1.2 An Overview on Institutional Commitment to Continuous Improvement 11 1.1.3 Brief Gap Analysis 13 1.1.4 Trajectory and Strategy to Overcome the Identified Gaps 14 1.1.5 Proposed Transformation Plan 16 IMPLEMENTATION OF THE STRATEGIC PLAN / A NEW ENGINEERING FOR 2030 OF THE STRATEGIC IMPLEMENTATION 1.1.6 Main Goals and Expected Results 17 1.2 Human Capital and Change Management 18 1.2.1 Change Management in Academia 18 1.2.2 Change Implementation, Organizational Change and Project Workforce
    [Show full text]
  • Education Reform in Chile
    Education Reform in Chile Common Enrollment in K-12 Education Graduate Policy Workshop Woodrow Wilson School of Public & International Affairs – Princeton University Authors: Amal Karim, B. Miller, Daniel Wick, Zohair Zaidi Workshop Advisor: John Londregan January 2016 2 TABLE OF CONTENTS Executive Summary...………………………………………………………...……...5 Introduction & Background…………………………….…………………………..6 Three Arguments For Education……………………………..….…...……...7 K-12 Educational Context in Chile.…………………………………..……...8 Ley de Inclusión…………………...……………………………………...….11 Common Enrollment Systems in Theory and Practice……………………..…....14 Overview of Common Enrollment System…………………….…….……..14 Strengths and Weaknesses from Theory………………………...……..…..15 Lessons from Practice………………………..…………..…..………….…..17 Recommendations…………………...…………..……………………………...…..19 Communication and Engagement……….……….…………………..….….19 Key Student Populations ………………………………..……..….……..….24 Other Considerations ………………………….………………………...….26 Monitoring and Evaluation …………….…………………..……………....27 3 ACKNOWLEDGEMENTS The authors wish to thank the many people both in the United States and Chile who took the time to speak to us about our research. Angelica Bosch Ministerio de Educación Chile Catalina Amenabar Ministerio de Educación Chile Christopher Neilson Assistant Professor of Economics & Public Affairs, Woodrow Wilson School of Public & International Affairs at Princeton University Daniel Hojman Assistant Professor of Public Policy, Harvard Kennedy School Dante Contreras Professor, Universidad de Chile Francisco
    [Show full text]