A Methodology for Comparing Mental Model Representations Linda Jane Smith

Total Page:16

File Type:pdf, Size:1020Kb

A Methodology for Comparing Mental Model Representations Linda Jane Smith Florida State University Libraries Electronic Theses, Treatises and Dissertations The Graduate School 2009 Graph and Property Set Analysis: A Methodology for Comparing Mental Model Representations Linda Jane Smith Follow this and additional works at the FSU Digital Library. For more information, please contact [email protected] FLORIDA STATE UNIVERSITY COLLEGE OF EDUCATION GRAPH AND PROPERTY SET ANALYSIS: A METHODOLOGY FOR COMPARING MENTAL MODEL REPRESENTATIONS By LINDA JANE SMITH A Dissertation su mitted to the Department of Educational Psychology and Learning Systems in partial fulfillment of the requirements for the degree of Doctor of Philosophy Degree Awarded, Spring Semester, .000 The mem ers of the Committee appro1e the Dissertation of Linda Jane Smith defended on No1em er .2, .008. J. Michael Spector Professor Directing Dissertation Ian Douglas Outside Committee Mem er Tristan E. Johnson Committee Mem er Vanessa P. Dennen Committee Mem er Appro1ed, A5ihito 6amata, Chair, Educational Psychology and Learning Systems The Office of Graduate Studies has 1erified and appro1ed the a o1e named committee mem ers. ii TABLE OF CONTENTS List of Ta les ................................................................................................................................. 1 List of Figures ............................................................................................................................... 1i A stract ...................................................................................................................................... 1iii CHAPTER 1 INTRODUCTION ...................................................................................................1 CHAPTER . LITERATURE REVIE8 ........................................................................................ 8 De1elopment of Mental Model Theory ............................................................................. 8 The Place of Models in Learning and Instruction ............................................................ 13 Conceptual Change and Mental Model Assessment Points ............................................. .. Importance of Mental Model Assessment for Instructional Design ................................ .5 Status of Mental Model Assessment ................................................................................ .8 Mental Model Assessment Needs Not Being Addressed with A1aila le Approaches .... 40 How the Proposed Methodology Addresses Some of the Assessment Needs ................. 44 CHAPTER 3 METHODS ............................................................................................................ 42 Research Focus ................................................................................................................ 48 Description of the Mental Model Comparison Methodology .......................................... 40 Study ................................................................................................................................ 5. CHAPTER 4 RESULTS .............................................................................................................. 20 Adequacy of Training ...................................................................................................... 20 The Mental Model Elicitation Process ............................................................................. 2. Mental Model Representations ........................................................................................ 24 Quantitati1e Comparison of Models ................................................................................ 7. Qualitati1e Comparison of Student Models to Their Professor>s Model ........................ 73 Comparisons of Student Bac5grounds and the Focus and Perspecti1es in Their Models 75 Conceptions and Possi le Misconceptions Identified in Student Models ....................... 72 Case Re1iew ? Creating a Mental Model Representation ............................................... 77 Inter1iews with the Three Experienced Designers .......................................................... 8. CHAPTER 5 DISCUSSION ........................................................................................................ 85 Research Question 1 ........................................................................................................ 85 The Role of Properties Data in Model Analysis .............................................................. 87 Quantitati1e Analysis in Model Comparisons ................................................................. 80 Qualitati1e Analysis in Model Comparisons ................................................................... 01 Additional Comments a out Mental Models and Their Representation ......................... 05 Research Question . ........................................................................................................ 02 Considerations for De1eloping a Mental Model Assessment Tool ................................. 08 iii Limitations ....................................................................................................................... 08 CHAPTER 2 CONCLUSION ................................................................................................... 100 Recommendations .......................................................................................................... 100 Future De1elopment and Research ................................................................................ 101 APPENDICES ........................................................................................................................... 107 A A Methodology for Comparing Mental Model Representations ............................. 107 B Application of Graph Theory for the Comparison of Model Representations, A Prototype Study Using Descriptions of Instructional Design......................................... 1.3 C Study Training Materials .......................................................................................... 13. D Human Su Aects Appro1al ....................................................................................... 130 E Report for Professor ................................................................................................. 148 REFERENCES .......................................................................................................................... 181 BIOGRAPHICAL S6ETCH ..................................................................................................... 187 i1 LIST OF TABLES Ta le 1. Assessment Points for Learner Mental Models.............................................................. .4 Ta le .. Summary of Current Approaches to Mental Model Assessment .................................. 38 Ta le 3.Milestones in the De1elopment and Formati1e E1aluation of the Methodology ........... 47 Ta le 4. Student Responses to the Post-training Questionnaire .................................................. 21 Ta le 5. Professor Responses to the Post-training Questionnaire ................................................ 21 Ta le 2. Student Responses to the Post-elicitation Questionnaire ............................................... 2. Ta le 7. Professor Responses to the Post-elicitation Questionnaire ............................................ 23 Ta le 8. Quantitati1e Comparisons of Student and Other Experienced Designer Models to the Model of the Professor Teaching the Class ....................................................................... 73 Ta le 0. Summary of Differences etween Professor and Student Models ................................. 74 Ta le 10. Summary of Bac5grounds and Student Graph Perspecti1es y Country .................... 75 Ta le 11. Summary of Bac5grounds and Student Graph Perspecti1es y Experience ................ 72 Ta le 1..Basic Voca ulary Tree ................................................................................................. 88 Ta le 13.Vertex Summary ......................................................................................................... 117 Ta le 14. Edge Summary ........................................................................................................... 118 Ta le 15.Model Comparison Summary ..................................................................................... 1.0 Ta le 12.Summary of the Model Comparison ........................................................................... 1.8 1 LIST OF FIGURES Figure 1. The effect of elicitation techniques on the le1el of similarity etween internal and external models....................................................................................................................... 3 Figure .. Internal and external models in learning and instruction ............................................. 14 Figure 3. Framewor5 for model ased learning for specific content goals C ased on Clement, .000D .................................................................................................................................... .1 Figure 4. Outcomes in the expression of a mental model ............................................................ 30 Figure 5. Examples of simple Pathfinder-style networ5s ............................................................ 3. Figure 2. Example of a cogniti1e map deri1ed from textual analysis ......................................... 34 Figure 7. Example of a concept map C ased on Jonassen, .004D ...............................................
Recommended publications
  • Social Norms and Social Influence Mcdonald and Crandall 149
    Available online at www.sciencedirect.com ScienceDirect Social norms and social influence Rachel I McDonald and Christian S Crandall Psychology has a long history of demonstrating the power and and their imitation is not enough to implicate social reach of social norms; they can hardly be overestimated. To norms. Imitation is common enough in many forms of demonstrate their enduring influence on a broad range of social life — what creates the foundation for culture and society phenomena, we describe two fields where research continues is not the imitation, but the expectation of others for when to highlight the power of social norms: prejudice and energy imitation is appropriate, and when it is not. use. The prejudices that people report map almost perfectly onto what is socially appropriate, likewise, people adjust their A social norm is an expectation about appropriate behav- energy use to be more in line with their neighbors. We review ior that occurs in a group context. Sherif and Sherif [8] say new approaches examining the effects of norms stemming that social norms are ‘formed in group situations and from multiple groups, and utilizing normative referents to shift subsequently serve as standards for the individual’s per- behaviors in social networks. Though the focus of less research ception and judgment when he [sic] is not in the group in recent years, our review highlights the fundamental influence situation. The individual’s major social attitudes are of social norms on social behavior. formed in relation to group norms (pp. 202–203).’ Social norms, or group norms, are ‘regularities in attitudes and Address behavior that characterize a social group and differentiate Department of Psychology, University of Kansas, Lawrence, KS 66045, it from other social groups’ [9 ] (p.
    [Show full text]
  • What's in a Mental Model of a Dynamic System? Conceptual Structure and Model Comparison
    What’s in a mental model of a dynamic system? Conceptual structure and model comparison Martin Schaffernicht Facultad de Ciencias Empresariales Universidad de Talca Avenida Lircay s/n 3460000 Talca, CHILE [email protected] Stefan N. Groesser University of St. Gallen Institute of Management System Dynamics Group Dufourstrasse 40a CH - 9000 St. Gallen, Switzerland Tel: +41 71 224 23 82 / Fax: +41 71 224 23 55 [email protected] Contribution to the International System Dynamics Conference 2009 Albuquerque, NM, U.S.A. Abstract This paper deals with the representation of mental models of dynamic systems (MMDS). Improving ’mental models’ has always been fundamental in the field of system dynamics. Even though a specific definition exists, no conceptual model of the structure of a MMDS has been offered so far. Previous research about the learning effects of system dynamics interventions have used two methods to represent and analyze mental models. To what extend is the result of these methods comparable? Can they be used to account for a MMDS which is suitable for the system dynamics methodology? Two exemplary MMDSs are compared with both methods. We have found that the procedures and results differ significantly . In addition, neither of the methods can account for the concept of feedback loops. Based on this finding, we propose a conceptual model for the structure of a MMDS, a method to compare them, and a revised definition of MMDS. The paper concludes with a call for more substantive research. Keywords : Mental models, dynamic systems, mental model comparison, graph theory, mental model measurement Introduction Mental models have been a key concept in system dynamics from the beginning of the field (Forrester, 1961).
    [Show full text]
  • Psychology, Meaning Making and the Study of Worldviews: Beyond Religion and Non-Religion
    Psychology, Meaning Making and the Study of Worldviews: Beyond Religion and Non-Religion Ann Taves, University of California, Santa Barbara Egil Asprem, Stockholm University Elliott Ihm, University of California, Santa Barbara Abstract: To get beyond the solely negative identities signaled by atheism and agnosticism, we have to conceptualize an object of study that includes religions and non-religions. We advocate a shift from “religions” to “worldviews” and define worldviews in terms of the human ability to ask and reflect on “big questions” ([BQs], e.g., what exists? how should we live?). From a worldviews perspective, atheism, agnosticism, and theism are competing claims about one feature of reality and can be combined with various answers to the BQs to generate a wide range of worldviews. To lay a foundation for the multidisciplinary study of worldviews that includes psychology and other sciences, we ground them in humans’ evolved world-making capacities. Conceptualizing worldviews in this way allows us to identify, refine, and connect concepts that are appropriate to different levels of analysis. We argue that the language of enacted and articulated worldviews (for humans) and worldmaking and ways of life (for humans and other animals) is appropriate at the level of persons or organisms and the language of sense making, schemas, and meaning frameworks is appropriate at the cognitive level (for humans and other animals). Viewing the meaning making processes that enable humans to generate worldviews from an evolutionary perspective allows us to raise news questions for psychology with particular relevance for the study of nonreligious worldviews. Keywords: worldviews, meaning making, religion, nonreligion Acknowledgments: The authors would like to thank Raymond F.
    [Show full text]
  • Notes on Pragmatism and Scientific Realism Author(S): Cleo H
    Notes on Pragmatism and Scientific Realism Author(s): Cleo H. Cherryholmes Source: Educational Researcher, Vol. 21, No. 6, (Aug. - Sep., 1992), pp. 13-17 Published by: American Educational Research Association Stable URL: http://www.jstor.org/stable/1176502 Accessed: 02/05/2008 14:02 Your use of the JSTOR archive indicates your acceptance of JSTOR's Terms and Conditions of Use, available at http://www.jstor.org/page/info/about/policies/terms.jsp. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained prior permission, you may not download an entire issue of a journal or multiple copies of articles, and you may use content in the JSTOR archive only for your personal, non-commercial use. Please contact the publisher regarding any further use of this work. Publisher contact information may be obtained at http://www.jstor.org/action/showPublisher?publisherCode=aera. Each copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission. JSTOR is a not-for-profit organization founded in 1995 to build trusted digital archives for scholarship. We enable the scholarly community to preserve their work and the materials they rely upon, and to build a common research platform that promotes the discovery and use of these resources. For more information about JSTOR, please contact [email protected]. http://www.jstor.org Notes on Pragmatismand Scientific Realism CLEOH. CHERRYHOLMES Ernest R. House's article "Realism in plicit declarationof pragmatism. Here is his 1905 statement ProfessorResearch" (1991) is informative for the overview it of it: of scientificrealism.
    [Show full text]
  • 'The Magic That Can Set You Free': the Ideology of Folk and the Myth of the Rock Community
    The magic that can set you free': the ideology of folk and the myth of the rock community by SIMON FRITH Rock, the saying goes, is 'the folk music of our time'. Not from a sociological point of view. If 'folk' describes pre-capitalist modes of music production, rock is, without a doubt, a mass-produced, mass- consumed, commodity. The rock-folk argument, indeed, is not about how music is made, but about how it works: rock is taken to express (or reflect) a way of life; rock is used by its listeners as a folk music - it articulates communal values, comments on shared social problems. The argument, in other words, is about subcultures rather than music- making; the question of how music comes to represent its listeners is begged. (I develop these arguments further in Frith 1978, pp. 191-202, and, with particular reference to punk rock, in Frith 1980.) In this article I am not going to answer this question either. My concern is not whether rock is or is not a folk music, but is with the effects of a particular account of popular culture - the ideology of folk - on rock's interpretation of itself. For the rock ideologues of the 1960s - musicians, critics and fans alike - rock 'n' roll's status as a folk music was what differentiated it from routine pop; it was as a folk music that rock could claim a distinctive political and artistic edge. The argument was made, for example, by Jon Landau in his influential role as reviews editor and house theorist of Rolling Stone.
    [Show full text]
  • Effectiveness of Holistic Mental Model Confrontation in Driving Conceptual Change
    Learning and Instruction xxx (2011) 1e15 Contents lists available at ScienceDirect Learning and Instruction journal homepage: www.elsevier.com/locate/learninstruc Effectiveness of holistic mental model confrontation in driving conceptual change Soniya Gadgil a,*, Timothy J. Nokes-Malach a, Michelene T.H. Chi b a Department of Psychology, Learning Research and Development Center, University of Pittsburgh, United States b Department of Psychology, Arizona State University, United States article info abstract Article history: Prior research on conceptual change has identified multiple kinds of misconceptions at different levels of Received 17 July 2010 representational complexity including false beliefs, flawed mental models, and incorrect ontological Received in revised form categories. We hypothesized that conceptual change of a mental model requires change in the system of 5 June 2011 relations between the features of the prior model. To test this hypothesis, we compared instruction aimed Accepted 8 June 2011 at revising knowledge at the mental model level called holistic confrontation e in which the learner compares and contrasts a diagram of his or her flawed mental model to an expert model e to instruction Keywords: aimed at revising knowledge at the false belief level e in which the learner is prompted to self-explain Learning Conceptual change the expert model alone. We found evidence that participants who engaged in holistic confrontation were Comparison more likely to acquire a correct mental model, and a deeper understanding of the systems of relations in Mental models the model than those who were prompted to self-explain the expert model. The results are discussed in Self-explanation terms of their implications for science instruction.
    [Show full text]
  • Mental Models in Expert Physics Reasoning. INSTITUTION California Univ., Berkeley
    DOCUMENT RESUME ED 285 736 SE 048 324 AUTHOR Roschelle, Jeremy; Greeno, James G. TITLE Mental Models in Expert Physics Reasoning. INSTITUTION California Univ., Berkeley. SPONS AGENCY Office of Naval Research, Washington, D.C. Personnel and Training Branch. REPORT NO GA-2 PUB DATE Jul 87 CONTRACT N00014-85-K-0095 NOTE 29p.; For related documents, see SE 048 323-327. PUB TYPE Reports Research/Technical (143) EDRS PRICE MF01/PCO2 Plus Postage. DESCRIPTORS *Physics; *Problem Solving; Science Education; *Science Instruction; Sciences IDENTIFIERS *Experts; *Mental Models ABSTRACT Proposed is a relational framework for characterizing experienced physicists' representations of physics problem situations and the process of constructing these representations. A representation includes a coherent set of relations among: (1) a mental model of the objects in the situation, along with their relevant properties and relations; (2) a mental model of theoretical idealizations of objects; and (3) parameter histories based on mental simulations of both models. Evidence from protocols and a small experiment support a conclusion that experienced physicists' processes of representing problem situations (a) use informal commonsense knowledge, including envisionment of objects in the situations, and (b) are interactive, with mutual. influences between informal knowledge and their technical, theorc.t.cal knowledge. Also described are characteristics of the mental models that represent problem situations and the process of constructing them, drawing from work by artificial intelligence researchers on qualitative process models, and specifying several categories of rules that would be needed for an implementation of the system as a simulation program. (Author/RH) ********************k****2********************************************* Reproductions supplied by EDRS are the best that can be made from the original document.
    [Show full text]
  • Ideology: the Challenge for Civic Literacy Educators by James A
    Volume 1, Issue 1 http://journals.iupui.edu/index.php/civiclit/index July 2014 Ideology: The Challenge for Civic Literacy Educators By James A. Duplass ABSTRACT: Commitment to open-mindedness, critical thinking, liberty, and social justice are proposed as four pillars of a democratic ideology. The highly charged and polarized discourse between left and right po- litical ideology among the media, politicians, educators, and public has intensified the challenge placed on social studies educators to transmit these goals to their students. A rendition of the philosophical trajectory of the ideas of liberty, social justice, and justice are provided and married with concepts from the philosophical foundations of American education, social studies education goals and strategies, and contemporary human- istic philosophy so as to articulate a new case that transmission of a democratic ideology is at the core of social studies education. The proposition is made that teaching social studies is unique because the development of an ideology requires teachers’ attention to values, virtues formation, and the liberation of the individual. Keywords: Ideology, critical thinking, liberty, social justice, justice The purpose of this essay is to explore the largely unexamined idea of a democratic ideology as an inherent goal of social studies education. The traditional meaning of competency and literacy established by many disciplines including social studies education (Duplass, 2006) do not fully convey the unique mission of social studies education to pass on an ideology - belief system - to successive generations. The formation of values (Apple, 2004; Duplass, 2008; McCarthy, 1994), the use of critical thinking (Dewey, 1890/1969), and July 2014 Ideology: The Challenge for Civic Literacy Educators 1 the goal of passing on democratic traditions (Dewey, 1939/1976; National Council for Social Studies, 2008) serve as an intersection for the formation of a democratic ideology, although such a term is seldom found in the social studies literature.
    [Show full text]
  • What Is Spirituality?
    fact sheets What is spirituality? Recognising the difference between spirituality and religion can be a great way to begin to understand what spirituality means to different people. There are many types of spirituality that people sometimes base their beliefs around and also many different reasons people practice spirituality. Spirituality is something that’s often debated and commonly misunderstood. Many people confuse spirituality with religion and so bring pre–existing beliefs about the impact of religion to discussions about spirituality. Though all religions emphasise spirituality as being an important part of faith, it’s possible to be ‘spiritual’ without necessarily being a part of an organised religious community. This might help if... What’s the difference between religion and › You’re looking for spirituality? information on spirituality Spirituality and religion can be hard to tell apart but there are some pretty defined differences between the two. › You want to know Religion is a specific set of organised beliefs and practices, usually shared the difference between by a community or group. spirituality and religion Spirituality is more of an individual practice and has to do with having a › You’d like to become a sense of peace and purpose. It also relates to the process of developing more spiritual person beliefs around the meaning of life and connection with others. One way that might help you to understand the relationship between Take action... spirituality and religion is imagine a game of football. The rules, referees, other players, and field markings help guide you as you play the game in › Learn more about a similar way that religion might guide you to find your spirituality.
    [Show full text]
  • Constructing Mental Model Paradigms for Teaching Electronic Resources
    Volume 2, 1999 Approved January 1999 ISSN: 1523-4320 www.ala.org/aasl/slr Constructing Mental Model Paradigms for Teaching Electronic Resources Julie I. Tallman, Associate Professor, Department of Instructional Technology, The University of Georgia, and Lyn Henderson, Senior Lecturer, School of Education, James Cook University of North Queensland, Australia Library media specialists activate numerous mental models when teaching electronic information literacy database access, research, and retrieval in the context of authentic school assignments. The paper identifies these models and examines what occurred when the mental models in a study sample interconnected in the complex changing environment of a lesson. Discussion focuses on the changes to the mental models the library media specialists held with respect to the electronic database, the role of the library media specialist, the lesson goals, and their teaching strategies. Findings suggest that (a) most of the library media specialists’ mental models of teaching with electronic databases were influenced by their models of teaching access, research, and retrieval with print resources and (b) even though many library media specialists identified the necessity to incorporate mental model changes for more effective teaching, these were not sufficient to counteract their habituated teaching behaviors. New policy thrusts in education are increasing the range of electronic learning technologies for use by students, placing them as central to the core curriculum, and calling for equitable access to information via these technologies (Tallman 1998). Part of this equity includes individualized instruction to help students “develop a systematic mode of inquiry to gain physical and intellectual access to information and ideas that reflect diversity of experiences, opinions, and social and cultural perspectives” (American Association of School Librarians and Association for Educational Communications and Technology 1988, 29).
    [Show full text]
  • Models in the Mind the Mental Models Theory of Reasoning
    Models in the Mind The Mental Models Theory of Reasoning: Refinements and Exten- sions. Edited by Walter Schaeken, Andr´eVandierendonck, Walter Schroyens, and G´eryd'Ydewalle. Mahwah, New Jersey: Lawrence Erlbaum Associates. How do people reason about the what follows from certain assumptions? How do they think about implications between statements. According to one theory, people try to use a small number of mental rules of inference to construct an argument for or proof of a relevant conclusion from the assump- tions (e.g., Rips 1994). According to a competing theory, people construct one or more mental models of the situation described in the assumptions and try to determine what conclusion fits with the model or models constructed (e.g., Johnson-Laird 1983, 2006). The present collection offers eleven con- tributions to the mental models theory. Specific theories about such reasoning can be tested by asking subjects what follows from certain assumptions. Subjects can also be asked whether a particular stated conclusion follows or is implied by the assumptions. And subjects can be given problems that seem to require such reasoning, such as the familiar the Wason (1966) selection task. In this task, four cards are placed before a subject on the table. The subject is told that the cards have a letter on one side and a number on the other wide. The subject sees only one side of the cards, e.g. \A 3 B 4". The subject is asked to indicate which of the cards need to be turned over in order to determine whether a certain claim about the cards is correct: for example, the claim that, if there is a vowel on one side, there is an even number on the other side.
    [Show full text]
  • Maintaining the Mental Model: an Exploratory Study of Dialogic Processes on Good Teaching Practice
    Pedagogy and the Human Sciences Volume 3 Issue 1 Article 1 2013 Maintaining the Mental Model: An Exploratory Study of Dialogic Processes on Good Teaching Practice Margaret Koepke Fox Suffolk University, [email protected] Debra A. Harkins Suffolk University, [email protected] Kurt W. Fischer Harvard University, [email protected] Follow this and additional works at: https://scholarworks.merrimack.edu/phs Recommended Citation Fox, M. K., Harkins, D. A., & Fischer, K. W. (2013). Maintaining the Mental Model: An Exploratory Study of Dialogic Processes on Good Teaching Practice. Pedagogy and the Human Sciences, 3 (1), 1-23. Retrieved from https://scholarworks.merrimack.edu/phs/vol3/iss1/1 This Feature Article is brought to you for free and open access by Merrimack ScholarWorks. It has been accepted for inclusion in Pedagogy and the Human Sciences by an authorized editor of Merrimack ScholarWorks. For more information, please contact [email protected]. Fox et al.: Dialogic Processes on Teaching Practice Pedagogy and the Human Sciences, 1, No. 3, 2013, pp. 1-23 Maintaining the Mental Model: An Exploratory Study of Dialogic Processes on Good Teaching Practice Margaret Koepke Fox,1 Debra A. Harkins,2 and Kurt W. Fischer3 Abstract. This paper presents some outcomes of an exploratory, mixed-method study that examined mental models of teaching and understanding of learning processes in 26 educators from a small suburb in the Northeastern United States. Participants, in semi- structured written interviews, were asked to rate variables contributing to their mental model of effective teaching. They were then presented with a specific educational problem and asked to provide pedagogic solutions.
    [Show full text]