Intelligent Tutoring Systems 14Th International Conference, ITS 2018 Montreal, QC, Canada, June 11–15, 2018 Proceedings

Lecture Notes in Computer Science 10858

Commenced Publication in 1973 Founding and Former Series Editors: Gerhard Goos, Juris Hartmanis, and Jan van Leeuwen

Editorial Board David Hutchison Lancaster University, Lancaster, UK Takeo Kanade Carnegie Mellon University, Pittsburgh, PA, USA Josef Kittler University of Surrey, Guildford, UK Jon M. Kleinberg Cornell University, Ithaca, NY, USA Friedemann Mattern ETH Zurich, Zurich, Switzerland John C. Mitchell Stanford University, Stanford, CA, USA Moni Naor Weizmann Institute of Science, Rehovot, Israel C. Pandu Rangan Indian Institute of Technology Madras, Chennai, India Bernhard Steffen TU Dortmund University, Dortmund, Germany Demetri Terzopoulos University of California, Los Angeles, CA, USA Doug Tygar University of California, Berkeley, CA, USA Gerhard Weikum Max Planck Institute for Informatics, Saarbrücken, Germany More information about this series at http://www.springer.com/series/7408 Roger Nkambou • Roger Azevedo Julita Vassileva (Eds.)

Intelligent Tutoring Systems 14th International Conference, ITS 2018 Montreal, QC, Canada, June 11–15, 2018 Proceedings

123 Editors Roger Nkambou Julita Vassileva Université du Québec University of Saskatchewan Montreal, QC Saskatoon, SK Canada Canada Roger Azevedo NCSU Raleigh, NC USA

ISSN 0302-9743 ISSN 1611-3349 (electronic) Lecture Notes in Computer Science ISBN 978-3-319-91463-3 ISBN 978-3-319-91464-0 (eBook) https://doi.org/10.1007/978-3-319-91464-0

Library of Congress Control Number: 2018942342

LNCS Sublibrary: SL2 – Programming and Software Engineering

© Springer International Publishing AG, part of Springer Nature 2018 This work is subject to copyright. All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use. The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication. Neither the publisher nor the authors or the editors give a warranty, express or implied, with respect to the material contained herein or for any errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Printed on acid-free paper

This Springer imprint is published by the registered company Springer International Publishing AG part of Springer Nature The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland Preface

The 14th International Conference on Intelligent Tutoring Systems (ITS 2018) was held in the birth city of the ITS conferences, Montreal, Canada, during June 11–15, 2018. The theme of ITS 2018 was “A 30-Year Legacy of ITS Conferences” with an objective to celebrate the academic and research achievements as well as the ongoing scientific contributions and impact of the ITS conferences over a 30-year history in the field of intelligent systems in education and across other disciplines. The conference emphasized the use of advanced computer technologies and interdisciplinary research for enabling, supporting, and enhancing human learning. It promoted high-quality interdisciplinary research creating a forum for presenting and sharing challenges and novel advancements in artificial intelligence. It triggered an exchange of ideas in the field, reinforcing and expanding the international ITS network of researchers, aca- demics, and market representatives. The call for scientific papers solicited work presenting substantive new research results in using advanced computer technologies and interdisciplinary research for enabling, supporting, and enhancing human learning. A Posters Track was also organized, which provided an interactive forum for authors to present research prototypes to conference participants, as well as work in progress. The international Program Committee consisted of 93 leading members (43 senior and 50 regular) of the intelligent Tutoring Systems community, assisted by 33 external reviewers. The conference (general) chair was Roger Nkambou from the Université du Québec à Montréal (UQAM), Canada; the Program Committee chairs were Roger Azevedo from North Carolina State University, USA, and Julita Vassileva from the University of Saskatchewan, Canada. Research papers were reviewed by at least three reviewers (with the majority receiving four or more reviews) through a double-blind process. Only 26.5% of papers submitted as full paper were accepted; 21 were accepted as short papers with six pages published in the proceedings. We also accepted 29 posters presentations; some of them were directly submitted to the poster track chaired by Bob Hausman (Carnegie Learning) and Tanner Jackson (Educational, Testing Service, USA). We believe that the selected full papers describe some very significant research and the short papers some very interesting new ideas, while the posters present research in progress that deserves close attention. A separate Doctoral Consortium (DC) provided a forum in which PhD students could present and discuss their work during its early stages, meet peers with shared interests, and receive feedback from senior members of the field as mentors. The DC chairs were Maiga Chang from Athabasca University, Canada, and Éric Beaudry from UQAM, Canada. The DC Committee accepted six papers; each of them received at least five reviews with many (50%) receiving seven reviews. The management of the review process and the preparation of the proceedings was handled through EasyChair. VI Preface

Additionally, the ITS 2018 program included the following workshops and tutorials selected by the workshop and tutorial chairs, Nathalie Guin from the Université de Lyon 1, France, and Amruth Kumar from Ramapo College of New Jersey, USA: – W1: C&C-ITS - Context and Culture in Intelligent Tutoring Systems by Valéry Psyche, Isabelle Savard, Riichiro Mizoguchi and Jacqueline Bourdeau – W2: Learning Analytics: Building Bridges Between the Education and the Com- puting Communities by Sébastien Beland, Michel Desmarais and Nathalie Loye – W3: Exploring Opportunities for Caring Assessments by Diego Zapata-Rivera and Julita Vassileva – W6 (FD): Optimizing Human Learning: Workshop eliciting Adaptive Sequences for Learning (WeASeL), Jill-Jênn Vie and Fabrice Popineau – T1: Automating Educational Research Through Learning Analytics: Data Balancing and Matching Techniques by David Boulanger, Vivekanandan Kumar and Shawn Fraser – T2: Authoring, Deploying and Data Analysis of Conversational Intelligent Tutoring Systems by Xiangen Hu, Zhiqiang Cai, Arthur Graesser and Keith Shubeck. The ITS 2018 industry track included the following workshops selected by the industry track chair, Robert Sottilare from the US Army Research Laboratory, USA: – W7: ITS GIFT Workshop – W8: ITS Standards for Adaptive Instructional Systems Workshop Finally, we had three outstanding invited speakers in the plenary sessions: Yoshua Bengio (University of Montreal, Canada), a renowned figure in the field of deep learning, Vania Dimitrova (University of Leeds, UK), and Sidney D’Mello (University of Colorado Boulder, USA), both leaders in different specialized areas of the ITS field. In addition to the contributors mentioned above, we would like to thank all the authors, the various conference chairs, the members of the Program Committees of all tracks, the external reviewers, the Steering Committee members and in particular its chair, Claude Frasson. We would also like to acknowledge the Institute of Intelligent Systems (IIS), which acted as the conference organizer (particularly Kitty Panourgia and her excellent team for the permanent follow up of the organization), and the Université du Québec à Montréal (UQAM), the hosting institution. Last but not least, we express our gratitude to the conference sponsors, in particular the National Science Foundation (NSF), Springer, and Tourisme Montreal for their financial support.

June 2018 Roger Nkambou Roger Azevedo Julita Vassileva Organization

Conference Committees Conference (General) Chair Roger Nkambou Université du Québec à Montréal, Canada

Program Chairs Roger Azevedo North Carolina State University, USA Julita Vassileva University of Saskatchewan, Canada

Organization Chair Kitty Panourgia Neoanalysis, Greece

Workshop and Tutorial Chairs Nathalie Guin Université Lyon 1, France Amruth Kumar Ramapo College of New Jersey, USA

Posters and Demos Chairs G. Tanner Jackson Educational Testing Service, USA Bob Hausmann Carnegie Mellon, USA

Doctoral Consortium Chairs Maiga Chang Athabasca University, Canada Éric Beaudry Université du Québec à Montréal, Canada

Industry Track Chair Robert Sottilare US Army Research Laboratory, USA

Sponsorship and Exhibition Chairs Emmanuel Blanchard IDU Interactive Inc., Canada Sophie Callies Ellicom, Canada Valéry Psyché Téluq, Canada

Student Volunteer Chairs Ramla Gali Université du Québec à Montréal, Canada Ange Tato Université du Québec à Montréal, Canada VIII Organization

The conference is held under the auspices of the Institute of Intelligent Systems.

Program Committee Chairs Roger Azevedo North Carolina State University, USA Julita Vassileva University of Saskatchewan, Canada

Senior Program Committee Esma Aimeur University of Montreal, Canada Ivon Arroyo Worcester Polytechnic Institute, USA Kevin Ashley University of Pittsburgh, USA Ryan Baker Teachers College, Columbia University, USA Jacqueline Bourdeau TELU-UQAM, Canada Bert Bredeweg University of Amsterdam, The Netherlands Paul Brna University of Leeds, UK Stefano A. Cerri LIRMM: University of Montpellier and CNRS, France Maiga Chang Athabasca University, Canada Michaela Cocea University of Porthsmouth, UK Cristina Conati University of British Columbia, Canada Albert Corbett Carnegie Mellon University, USA Michel Desmarais Ecole Polytechnique de Montreal, Canada Vania Dimitrova University of Leeds, UK Benedict Du Boulay University of Sussex, UK Peter Dolog Aalborg University, Denmark Claude Frasson University of Montreal, Canada Gilles Gauthier Université du Québec à Montréal, Canada Art Graesser University of Memphis, USA Sabine Graf Athabasca University, Canada Jim Greer University of Saskatchewan, Canada Tsukasa Hirashima Hiroshima University, Japan Organization IX

W. Lewis Johnson Alelo Inc., USA Kinshuk Kinshuk University of North Texas, USA Vive Kumar Athabasca University, Canada Jean-Marc Labat Université Paris 6, France Susanne Lajoie McGill University, Canada James Lester North Carolina State University, USA Vanda Luengo Université Pierre et Marie Curie, France Gordon McCalla University of Saskatchewan, Canada Alessandro Micarelli University of Rome 3, Italy Riichiro Mizoguchi Japan Advanced Institute of Science and Technology, Japan Roger Nkambou Université du Québec à Montréal, Canada Anna Paiva Technical University of Lisbon, Portugal Niels Pinkwart Humboldt Universität zu Berlin, Germany Elvira Popescu University of Craiova, Romania Carolyn Rose Carnegie Mellon University, USA Demetrios Sampson University of Piraeus, Greece Stefan Trausan-Matu Politehnica University of Bucharest, Romania Kurt VanLehn Arizona State University, USA Julita Vassileva University of Saskatchewan, Canada Barbara Wasson University of Bergen, Norway Beverly Park Woolf University of Massachusetts, USA

Program Committee Mohammed Abdel King Abdulaziz University, Saudi Arabia Razek Fabio Akhras Renato Archer Center of Information Technology, Brazil Galia Angelova Bulgarian Academy of Sciences, Bulgaria Maria Lucia Instituto Tecnologico de Culiacan, Mexico Barron-Estrada Maria Bielikova Slovak University of Technology in Bratislava, Slovakia Emmanuel Blanchard IDÛ Interactive Inc., Canada Stephen B. Blessing University of Tampa, USA Mary Jean Blink TutorGen, Inc., USA François Bouchet Sorbonne University, France Ted Carmichael University of North Carolina at Charlotte, USA Chih-Kai Chang National University of Tainan, Taiwan Maher Chaouachi McGill University, Canada Min Chi North Carolina State University, USA Chih-Yueh Chou Yuan Ze University, Taiwan Mark Core University of Southern California, USA Evandro Costa Federal University of Alagoas, Brazil Alexandra Cristea University of Warwick, UK Diego Demerval Federal University of Alagoas, Brazil Cyrille Desmoulins Université Joseph Fourier, France X Organization

Philippe Dessus LSE, Grenoble, France Darina Dicheva Winston Salem State University, USA Sidney D’Mello University of Colorado Boulder, USA Stephen Fancsali Carnegie Learning, Inc., USA Robert Farrell IBM T.J. Watson Research Center, USA Mark Floryan University of Virginia, USA Davide Fossati Carnegie Mellon University, Qatar Ashok Goel Georgia Institute of Technology, USA Jason Harley University of Alberta, Canada Yusuke Hayashi Hiroshima University, Japan Cecily Heiner Southern Utah University, USA Seiji Isotani University of Sao Paulo, Brazil Patricia Jaques UNISINOS, Brazil Imène Jraidi University of Montreal, Canada Akihiro Kashihara University of Electro-Communications, Japan Nguyen-Thinh Le Humboldt Universität zu Berlin, Germany H. Chad Lane University of Illinois, Urbana-Champaign, USA Elise Lavoué University of Lyon, France Carla Limongelli University of Rome 3, Italy Fuhua Lin Athabasca University, Canada Tatsunori Matsui Waseda University, Japan Riccardo Mazza University of Lugano/University of Applied Sciences of Southern Switzerland Tassos Mikopoulos University of Ioannina, Greece Kazuhisa Miwa Nagoya University, Japan Luc Paquette University of Illinois, Urbana-Champaign, USA Zach Pardos UC Berkeley, USA Alexandra Poulovassilis Birkbeck University of London, UK Jonathan Rowe North Carolina State University, USA Olga C. Santos aDeNu Research Group, UNED, Spain Michelle Taub North Carolina State University, USA Ramon Zatarain Cabada Instituto Tecnologico de Culiacan, Mexico

Organizing Committee Chair Kitty Panourgia Coordination

Members Mara Gassel Conference Publicity/Website Management/Registration Alexia Kakourou Coordination on Site Katerina Milathianaki Preparation/Administration Dimitris Sevastakis IT Support Isaak Tselepis Website Architect Organization XI

Steering Committee Chair Claude Frasson University of Montreal, Canada

Members Stefano A. Cerri LIRMM: University of Montpellier and CNRS, France Isabel Fernandez-Castro University of the Basque Country, Spain Gilles Gauthier Université du Québec à Montréal, Canada Guy Gouardères University of Pau, France Tsukasa Hirashima University of Hiroshima, Japan Marc Kaltenbach Bishop’s University, Canada Alan Lesgold University of Pittsburgh, USA James Lester North Carolina State University, USA Alessandro Micarelli University of Rome 3, Italy Roger Nkambou Université du Québec à Montréal, Canada Giorgos Papadourakis Technological Educational Institute, Crete, Greece Fabio Paragua Federal University of Alagoas, Brazil Elliot Soloway University of Michigan, USA Daniel Suthers University of Hawaii, USA Stefan Trausen-Matu University Politehnica of Bucharest, Romania Beverly Woolf University of Massachusetts, USA

Advisory Committee

Luigia Carlucci Aiello University of Rome, Italy Maria Grigoriadou University of Athens, Greece Judy Kay University of Sydney, Australia Demetrios G. Sampson Curtin University, Australia

Poster and Interactive Event Committee Chairs Bob Hausmann Carnegie Mellon, USA G. Tanner Jackson Educational Testing Service, USA

Members Ryan Baker University of Pennsylvania, USA Scotty Craig Arizona State University, USA Reva Freedman Northern Illinois University, USA Chas Murray Carnegie Learning, Inc., USA Amy Johnson Arizona State University, USA Blair Lehman Educational Testing Service, USA Rod Roscoe Arizona State University, USA XII Organization

Doctoral Consortium Committee Chairs Éric Beaudry Université du Québec à Montréal, Canada Maiga Chang Athabasca University, Canada

Members Ben Chang National Central University, Taiwan Nian-Shing Chen National Sun Yat-sen University, Taiwan Xiaoqing Gu East China Normal University, China Gwo-Jen Hwang National Taiwan University of Science and Technology, Taiwan Kinshuk Kinshuk College of Information, University of North Texas, USA Vive Kumar Athabasca University, Canada Rita Kuo New Mexico Institute of Mining and Technology, USA Kuo-Chen Li CYCU Oscar Lin Athabasca University, Canada Wolfgang Mueller University of Education Weingarten, Germany Kuo-Liang Ou National Hsin-Chu University of Education, Taiwan Dongming Qian East China Normal University, China Dunwei Wen Athabasca University, USA

Additional Reviewers

Sungeun An Alexandra Luccioni Jason Bernard Leonardo Marques Joana Campos Samuel Mascarenhas Christopher Cassion Miki Matsumuro Joao Dias Nicholas Mudrick Bobbie Eicher Ivelina Nikolova Stephanie Frost Sydni Peterson Marissa Gonzales Diogo Rato Avery Harrison Tamra Ross Yugo Hayashi Hitomi Saito OluwabUKola Ishola Salvatore Vanini Ondrej Kaššák Naomi Wixon Sébastien Lallé Mohammad Belghis-Zadeh David Edgar Lelei Yuan Zhang Chen Lin Guojing Zhou Yang Liu Organization XIII

Conference Sponsors

The National Science Foundation awarded a grant to support travel expenses for American students from universities in the USA who participated in the Doctoral Consortium (DC) at ITS 2018.

Springer awarded a prize of 1,000 Euro for the best ITS 2018 full paper.

Tourisme Montreal sponsored the 14th International Conference on Intelligent Tutoring Systems providing 30 CAD per participant who came to attend the ITS 2018 Conference from any region outside the Province of Quebec. Invited Talks Deep Learning and Cognition

Yoshua Bengio

Department of Computer Science and Operational Research, University of Montreal, Montreal, Canada [email protected]

Abstract. Neural networks and deep learning have been inspired by brains, neuroscience and cognition, from the very beginning, starting with distributed representations, neural computation, and the hierarchy of learned features. More recently, it has been for example with the use of rectifying non-linearities (ReLU) – which enables training deeper networks – as well as the use of soft content-based attention – which allow neural nets to go beyond vectors and to process a variety of data structures and led to a breakthrough in machine translation. Ongoing research is now suggesting that brains may use a process similar to backpropagation for estimating gradients and new inspiration from cognition suggests how to learn deep representations which disentangle the underlying factors of variation, by allowing agents to intervene and explore in their environment.

Speaker Bio. Yoshua Bengio (computer science, 1991, McGill U; post-docs at MIT and Bell Labs, computer science professor at U. Montréal since 1993): he authored three books, over 300 publications (h-index over 100), mostly in deep learning, holds a Canada Research Chair in Statistical Learning Algorithms, is Ofﬁcer of the Order of Canada, recipient of the Marie-Victorin Quebec Prize 2017, he is a CIFAR Senior Fellow and co-directs its Learning in Machines and Brains program. He heads the Montreal Institute for Learning Algorithms (MILA), currently the largest academic research group on deep learning. He is on the NIPS foundation board (previously program chair and general chair) and co-created the ICLR conference (specialized in deep learning). He pioneered deep learning and his goal is to uncover the principles giving rise to intelligence through learning, as well as contribute to the development of AI for the beneﬁt of all. Yoshua Bengio is considered as one of the three fathers of an advanced subset of AI and machine learning called deep learning and has helped Montreal to become the Silicon Valley of AI! From Intelligent Tutors to Intelligent Mentors: Looking Back into the Future

Vania Dimitrova

University of Leeds, UK [email protected]

Abstract. 20 years ago in his invited talk at ITS98, John Self outlined the defining characteristics of intelligent tutoring systems, pointing that these systems adapt to the needs of learners and provide some degree of computational precision. I will revisit these characteristics in the light of 21st Century education challenges, pointing that the time is ripe for the emergence of a new breed of intelligent tutors that provide mentor-like features. Mentoring is seen as a highly effective method to support the development of transferable skills, to increase motivation and confidence, and to develop self-regulation and self-determination. However, mentoring does not scale and can be costly - while ‘everyone needs a mentor’ not everyone can have a mentor. With the abundance of digital content and digital traces that capture our behaviour in the physical world, there is an opportunity to develop intelligent mentors. They would require multi-faceted ‘learner sensing’ mechanisms to get sufficient under- standing of the learner’s engagement and motivation by analysing the various digital traces left by the learner or by other learners. Furthermore, intelligent mentors will embed strategies for promoting reflection and self-awareness through ‘personalised nudges’. I will illustrate this vision with two ongoing projects: the Active Video Watching project that develops interactive means for engaging with videos for transferable skills learning, and the myPAL project that provides a personalised adaptive learning companion for self-regulated learning.

Speaker Bio. Vania Dimitrova (PhD in AI in Education, Leeds) is Associate Professor in Intelligent Systems in the School of Computing, University of Leeds, Co-director of the Leeds University Research Centre in Digital Learning, and Director of Technology-enhanced learning strategy at the Leeds Institute of Medical Education. She leads a research activity on AI for augmenting human intelligence. This develops methods for knowledge capture, ontological modelling and reasoning, user/group modelling, and user-adaptive interactive systems. She is involved in several multi-disciplinary projects on (a) knowledge-enriched intelligent decision systems and (b) user behaviour modelling for intelligent support for self-regulation and soft skills learning. Her work is funded by a range of sources, e.g. EU, UK research councils, the UK technology strategy board. She coordinated ImREAL (EU) that developed culturally-enhanced personalised simulators for learning, and led personalisation for From Intelligent Tutors to Intelligent Mentors: Looking Back into the Future XIX decision making in Dicode (EU). She is associate editor of the International Journal of AI in Education (IJAIED), member of the editorial board of the personalisation journal (UMUAI), and was associate editor of IEEE Transactions on Learning Technologies (IEEE TLT). She is a member of the executive Committee of the International AI in Education society; and regularly acts as EU projects reviewer. Distributed Cognition in Multimodal Collaborative Learning Environments

Sidney K. D’Mello

Department of Computer Science and Institute of Intelligent Systems, University of Colorado Boulder, Boulder, USA [email protected]

Abstract. Distributed cognition (DCog) pertains to cognition that extends beyond the individual to collections of interacting individuals and their environment. It is distinct from traditional cognition in that the unit of analysis is a system not an individual. It involves socio-cognitive-affective processes that are multimodal, interact over multiple spatial and temporal scales, and are embed- ded in a constantly-changing environment. I will discuss projects aimed at uncovering basic principles of distributed cognition in multimodal collaborative learning environments with an eye towards incorporating insights into next-generation learning technologies that aim to improve collaborative processes and outcomes.

Speaker Bio. Sidney D’Mello (PhD in Computer Science) is an Associate Professor in the Institute of Cognitive Science and Department of Computer Science at the University of Colorado Boulder. He is interested in the dynamic interplay between cognition and emotion while individuals and groups engage in complex real-world tasks. He applies insights gleaned from this basic research program to develop intelligent technologies that help people achieve to their fullest potential by coordi- nating what they think and feel with what they know and do. D’Mello has co-edited six books and published over 220 journal papers, book chapters, and conference proceedings (13 of these have received awards). His work has been funded by numerous grants and he serves(d) as associate editor for four journals, on the editorial boards for six others, and has played leadership roles in several professional organizations. https://www.colorado.edu/ics/sidney-dmello. Contents

Full Papers

Programming Intelligent Embodied Pedagogical Agents to Teach the Beginnings of Industrial Revolution ...... 3 Ivan Luis Feix Baierle and João Carlos Gluz

Adaptive Clustering of Codes for Assessment in Introductory Programming Courses ...... 13 Alexandre de A. Barbosa, Evandro de B. Costa, and Patrick H. Brito

Recommendation in Collaborative E-Learning by Using Linked Open Data and Ant Colony Optimization ...... 23 Samia Beldjoudi, Hassina Seridi, and Nour El Islem Karabadji

Evaluating Adaptive Pedagogical Agents’ Prompting Strategies Effect on Students’ Emotions...... 33 François Bouchet, Jason M. Harley, and Roger Azevedo

Investigating the Role of Goal Orientation: Metacognitive and Cognitive Strategy Use and Learning with Intelligent Tutoring Systems ...... 44 Elizabeth B. Cloude, Michelle Taub, and Roger Azevedo

Game Scenes Evaluation and Player’s Dominant Emotion Prediction...... 54 René Doumbouya, Mohamed S. Benlamine, Aude Dufresne, and Claude Frasson

Disrupting the Rote Learning Loop: CS Majors Iterating Over Learning Modules with an Adaptive Educational Hypermedia ...... 66 Muhammad Mustafa Hassan and Adnan N. Qureshi

Gaze Feedback and Pedagogical Suggestions in Collaborative Learning: Investigation of Explanation Performance on Self’s Concept in a Knowledge Integration Task...... 78 Yugo Hayashi

Motivational Assessment Tool (MAT): Enabling Personalized Learning to Enhance Motivation...... 88 Elizabeth Lameier, Lauren Reinerman-Jones, Gerald Matthews, Elizabeth Biddle, and Michael Boyce

The Impact of Multiple Real-Time Scaffolding Experiences on Science Inquiry Practices ...... 99 Haiying Li, Janice Gobert, Rachel Dickler, and Raha Moussavi XXII Contents

The Allocation of Time Matters to Students’ Performance in Clinical Reasoning ...... 110 Shan Li, Juan Zheng, Eric Poitras, and Susanne Lajoie

Empirical Investigation of Cognitive Load Theory in Problem Solving Domain ...... 120 Kazuhisa Miwa, Hitoshi Terai, and Kazuaki Kojima

Data-Driven Learner Profiling Based on Clustering Student Behaviors: Learning Consistency, Pace and Effort...... 130 Shirin Mojarad, Alfred Essa, Shahin Mojarad, and Ryan S. Baker

Identifying How Metacognitive Judgments Influence Student Performance During Learning with MetaTutorIVH...... 140 Nicholas V. Mudrick, Robert Sawyer, Megan J. Price, James Lester, Candice Roberts, and Roger Azevedo

Predicting Learners’ Emotions in Mobile MOOC Learning via a Multimodal Intelligent Tutor...... 150 Phuong Pham and Jingtao Wang

Toward Tutoring Systems Inspired by Applied Behavioral Analysis ...... 160 Michela Ponticorvo, Angelo Rega, and Orazio Miglino

The Role of Negative Emotions and Emotion Regulation on Self-Regulated Learning with MetaTutor ...... 170 Megan J. Price, Nicholas V. Mudrick, Michelle Taub, and Roger Azevedo

Analysis of Permanence Time in Emotional States: A Case Study Using Educational Software ...... 180 Helena Reis, Danilo Alvares, Patricia Jaques, and Seiji Isotani

Scoring Summaries Using Recurrent Neural Networks ...... 191 Stefan Ruseti, Mihai Dascalu, Amy M. Johnson, Danielle S. McNamara, Renu Balyan, Kathryn S. McCarthy, and Stefan Trausan-Matu

Changes in Emotion and Their Relationship with Learning Gains in the Context of MetaTutor ...... 202 Jeanne Sinclair, Eunice Eunhee Jang, Roger Azevedo, Clarissa Lau, Michelle Taub, and Nicholas V. Mudrick

A Heuristic Approach for New-Item Cold Start Problem in Recommendation of Micro Open Education Resources ...... 212 Geng Sun, Tingru Cui, Dongming Xu, Jun Shen, and Shiping Chen Contents XXIII

How Do Different Levels of AU4 Impact Metacognitive Monitoring During Learning with Intelligent Tutoring Systems? ...... 223 Michelle Taub, Roger Azevedo, and Nicholas V. Mudrick

How Are Students’ Emotions Associated with the Accuracy of Their Note Taking and Summarizing During Learning with ITSs?...... 233 Michelle Taub, Nicholas V. Mudrick, Ramkumar Rajendran, Yi Dong, Gautam Biswas, and Roger Azevedo

Adaptive Feedback Based on Student Emotion in a System for Programming Practice...... 243 Thomas James Tiam-Lee and Kaoru Sumi

Learning by Explaining to a Digital Doppelganger ...... 256 Ning Wang, Ari Shapiro, Andrew Feng, Cindy Zhuang, Chirag Merchant, David Schwartz, and Stephen L. Goldberg

Short Papers

Impact of Tutor Errors on Student Engagement in a Dialog Based Intelligent Tutoring System ...... 267 Shazia Afzal, Vinay Shashidhar, Renuka Sindhgatta, and Bikram Sengupta

Enhancing the Clustering of Student Performance Using the Variation in Confidence ...... 274 Ani Aghababyan, Nicholas Lewkow, and Ryan S. Baker

Intelligent Virtual Reality Tutoring System Supporting Open Educational Resource Access ...... 280 Jae-wook Ahn, Ravi Tejwani, Sharad Sundararajan, Aldis Sipolins, Sean O’Hara, Anand Paul, Ravi Kokku, Jan Kjallstrom, Nam Hai Dang, and Yazhou Huang

Emotional State and Behavior Analysis in a Virtual Reality Environment: A Medical Application...... 287 Hamdi Ben Abdessalem, Marwa Boukadida, and Claude Frasson

Deep Learning in Automated Essay Scoring ...... 294 David Boulanger and Vivekanandan Kumar

A Hybrid Architecture for Non-technical Skills Diagnosis ...... 300 Yannick Bourrier, Francis Jambon, Catherine Garbay, and Vanda Luengo XXIV Contents

A Novel Learning Early-Warning Model Based on Random Forest Algorithm...... 306 Xiaoxiao Cheng, Zhengzhou Zhu, Xiao Liu, Xiaofang Yuan, Jiayu Guo, Qun Guo, Deqi Li, and Ruofei Zhu

Improving Inference of Learning Related Emotion by Combining Cognitive and Physical Information ...... 313 Ernani Gottardo and Andrey Ricardo Pimentel

Module Advisor: Guiding Students with Recommendations ...... 319 Nina Hagemann, Michael P. O’Mahony, and Barry Smyth

TUMA: Towards an Intelligent Tutoring System for Manual-Procedural Activities ...... 326 Zardosht Hodaie, Juan Haladjian, and Bernd Bruegge

SAT Reading Analysis Using Eye-Gaze Tracking Technology and Machine Learning ...... 332 Andrew Howe and Phong Nguyen

Determining What the Student Understands - Assessment in an Unscaffolded Environment ...... 339 C. W. Liew and H. Nguyen

Curriculum Pacing: A New Approach to Discover Instructional Practices in Classrooms...... 345 Nirmal Patel, Aditya Sharma, Collin Sellman, and Derek Lomas

Towards Embedding a Tutoring Companion in the Eclipse Integrated Development Environment ...... 352 Manohara Rao Penumala and Javier Gonzalez-Sanchez

Semantic Collaboration Trajectories in Communities of Practice ...... 359 Matheus Pereira, Rosa Maria Vicari, and João Luis Tavares da Silva

Predictors and Outcomes of Gaming in an Intelligent Tutoring System . . . . . 366 Chad Peters, Ivon Arroyo, Winslow Burleson, Beverly Woolf, and Kasia Muldner

Classifying Interaction Behaviors of Students and Conversational Agents Through Dialog Analysis ...... 373 Michael Procter, Robert Heller, and Fuhua Lin

Extraction of Relevant Resources and Questions from DBpedia to Automatically Generate Quizzes on Specific Domains ...... 380 Oscar Rodríguez Rocha, Catherine Faron Zucker, and Alain Giboin Contents XXV

A Planning-Based Approach to Generating Tutorial Dialog for Teaching Surgical Decision Making ...... 386 Narumol Vannaprathip, Peter Haddawy, Holger Schultheis, Siriwan Suebnukarn, Parichat Limsuvan, Atirach Intaraudom, Nattapon Aiemlaor, and Chontee Teemuenvai

Supporting Multiple Learning Experiences on a Childhood Vocabulary Tutoring Platform ...... 392 Aditya Vempaty, Tamer Abuelsaad, Allison Allain, and Ravi Kokku

Exploring Students’ Behaviors in Editing Learning Environment...... 399 Xuebai Zhang, Xiaolong Liu, Shyan-Ming Yuan, Chia-Chen Fan, and Chuen-Tsai Sun

Posters

Analysing Problem Sequencing Strategies Based on Revised Bloom’s Taxonomy Using Deep Knowledge Tracing ...... 407 Sweety Agrawal and Amar Lalwani

MetaMentor: A System Designed to Study, Teach, Train, and Foster Self-regulated Learning for Students and Experts Using Their Multimodal Data Visualizations...... 411 Roger Azevedo, Nicholas V. Mudrick, Michelle Taub, James Lester, Robert Taylor, Robert Sawyer, Kirby Culbertson, and Candice Roberts

What Can Eye Movement Patterns Reveal About Learners’ Performance? . . . 415 Asma Ben Khedher, Imène Jraidi, and Claude Frasson

“Hypocrates”: Virtual Reality and Emotions Analysis Towards a Personalized Learning ...... 418 Marwa Boukadida, Hamdi Ben Abdessalem, and Claude Frasson

Embedding Speech Technology into Intelligent Tutoring Systems Using the CloudCAST Speech Technology Platform ...... 421 André Coy, Phil Green, Stuart Cunningham, Heidi Christensen, José Joaquín Atria, Frank Rudzicz, Massimiliano Malavasi, and Lorenzo Desideri

Using E-learning System to Influence on User’s Behavior Toward the Cybersecurity Strategy ...... 425 Hasna Elkhannoubi and Mustapha Belaissaoui

Evolution of Methods of Evaluation in AI in Education...... 428 Reva Freedman XXVI Contents

Typing-Differences in Simultaneous Typed Chat...... 431 Michael Glass, Yesukhei Jagvaral, Chinedu Emeka, and Jung Hee Kim

Examining How Students’ Typical Studying Emotions Relate to Those Experienced While Studying with an ITS ...... 434 Jason M. Harley, François Bouchet, and Roger Azevedo

Examining How Typical Gaming Behavior Influences Emotions and Achievement During Gameplay ...... 438 Jason M. Harley, Mohamed S. Benlamine, Maher Chaouachi, Claude Frasson, Yang Liu, and Aude Dufresne

The Design of a Learning Analytics Pedagogical Dashboard to Enhance Instructors’ Facilitation in an Online Asynchronous Problem-Based Learning Environment ...... 442 Lingyun Huang, Stephen Bodnar, Juan Zheng, Maedeh Assadat Kazemitabar, Yuxin Chen, Gurpreet Birk, Cindy E. Hmelo-Silver, and Susanne P. Lajoie

A Framework to Recommend Appropriate Learning Materials from Stack Overflow Discussions ...... 446 Ashesh Iqbal, Mohammad Shamsul Arefin, and Mohammad Ali Akber Dewan

What Does It Mean to Provide the Right Level of Support During Tutorial Dialogue? ...... 450 Sandra Katz, Patricia Albacete, Irene-Angelica Chounta, Pamela Jordan, Dennis Lusetich, and Bruce M. McLaren

Building Student Models in a Non-scaffolded Testing Environment...... 454 H. Nguyen and C. W. Liew

Applying Human-Agent Team Concepts to the Design of Intelligent Team Tutoring Systems ...... 457 Kaitlyn Ouverson, Mariangely Iglesias Pena, Jamiahus Walton, Stephen Gilbert, and Michael Dorneich

Concept-Based Learning in Blended Environments Using Intelligent Tutoring Systems ...... 460 Ines Šarić, Ani Grubišić, Slavomir Stankov, and Timothy J. Robinson

Diagnosing Reading Deficiencies of Adults with Low Literacy Skills in an Intelligent Tutoring System ...... 463 Genghu Shi, Andrew J. Hampton, Su Chen, Ying Fang, and Arthur C. Graesser Contents XXVII

Everycoding: Combination of ITS and (M)OOC for Programming Education ...... 466 Dongeun Sun and Hyeoncheol Kim

Adaptive Virtual Tutor Based on the Inference of the Student’s Memory Content...... 470 Joanna Taoum, Elisabetta Bevacqua, and Ronan Querrec

Preliminary Evaluation of a Serious Game for Socio-Moral Reasoning...... 473 Ange Tato, Aude Dufresne, Roger Nkambou, Frédérick Morasse, and Miriam H. Beauchamp iMoodle: An Intelligent Moodle Based on Learning Analytics ...... 476 Ahmed Tlili, Fathi Essalmi, Mohamed Jemni, Maiga Chang, and Kinshuk

Doctoral Consortium

Analysis and Optimization of Brain Behavior in a Virtual Reality Environment ...... 483 Hamdi Ben Abdessalem

Enhancing EFL Students’ Collaboration in a Blended Learning Environment: A Design-Based Research ...... 486 Zexuan Chen and Jianli Jiao

Leveraging Mutual Theory of Mind for More Human-Like Intelligent Tutoring Systems ...... 490 Bobbie Lynn Eicher, David Joyner, and Ashok Goel

Effect of Learning Support System for Feature Words on Group Learning . . . 493 Shun Okuhara and Takayuki Ito

A New Approach to Testing Children with Autism Spectrum Disorder Using Affect...... 496 Veronica Rivera

Online Course Design to Support Learning Analytics in Facilitating Personalized Academic Help ...... 499 Hongxin Yan and Kinshuk

Workshops

C&C@ITS2018: International Workshop on Context and Culture in Intelligent Tutoring Systems ...... 505 Valéry Psyché, Isabelle Savard, Riichiro Mizoguchi, and Jacqueline Bourdeau XXVIII Contents

Learning Analytics: Building Bridges Between the Education and the Computing Communities ...... 507 Sébastien Béland, Michel Desmarais, and Nathalie Loye

Exploring Opportunities for Caring Assessments ...... 508 Diego Zapata-Rivera and Julita Vassileva

Making Sense Out of Synchronous and Asynchronous Discourse in Education (SADES)...... 510 Nia Dowell, Andrew Hampton, Xiangen Hu, and Christopher Brooks

Optimizing Human Learning ...... 511 Fabrice Popineau, Michal Valko, and Jill-Jênn Vie

Industrial Tracks

ITS Adaptive Instruction Systems (AIS) Standards Workshop...... 515

ITS Applications Workshop ...... 516

Tutorials

Automating Educational Research Through Learning Analytics: Data Balancing and Matching Techniques ...... 519 David Boulanger, Vivekanandan Kumar, and Shawn Fraser

Authoring, Deploying and Data Analysis of Conversational Intelligent Tutoring Systems ...... 520 Xiangen Hu, Zhiqiang Cai, Keith Shubeck, Kai-Chih Pai, Arthur Graesser, Bor-Chen Kuo, and Chen-Huei Liao

Author Index ...... 521