Nishad Singhi Btech Thesis

Total Page:16

File Type:pdf, Size:1020Kb

Nishad Singhi Btech Thesis Computational Modeling of Decisions in Mixed Gambles Thesis submitted by Nishad Singhi 2016EE10107 under the guidance of Prof. Sumeet Agarwal Prof. Sumitava Mukherjee in partial fulfilment of the requirements for the award of the degree of Bachelor of Technology Department Of Electrical Engineering INDIAN INSTITUTE OF TECHNOLOGY DELHI July 2020 Contents ABSTRACT 2 1 INTRODUCTION 3 2 Computational models of decision making 5 2.1 Neurophysiology of Choice [BUZM07] . 5 2.2 Drift Diffusion Model . 5 2.3 The Leaky Competing Accumulator [UM01] . 6 3 Modeling mixed gambles using Drift Diffusion Model 8 3.1 Why do people reject mixed gambles? [ZWB18] . 8 3.1.1 Experimental Data . 8 3.1.2 Modeling . 8 3.1.3 Reported and replicated results . 9 3.2 Additional dataset . 11 3.2.1 Description of dataset . 11 3.2.2 DDM fitting results . 13 3.3 Discussion . 14 4 Modeling mixed gambles using LCA 15 4.1 LCA for value based decisions [UM04] . 15 4.1.1 Fitting Methods . 16 4.1.2 Experiments . 17 4.1.3 Discussion . 21 5 General Discussion 23 A Economics models of decision making 26 A.1 Expected Utility Hypothesis [MCWG+95] . 26 A.2 Prospect Theory [KT79] . 26 A.2.1 Value Function . 26 A.2.2 Weighting Function . 26 A.2.3 Evaluation of outcomes . 27 B Modeling of Loss Aversion for time 28 B.1 Introduction . 28 B.2 Experimental Design . 28 B.3 Stimuli . 28 B.4 Information given to participants . 29 ABSTRACT An important finding in behavioural economics is that people tend to reject mixed gambles. The predominant explanation for this phenomenon is loss aversion, i.e., decision-makers give more subjective weight to losses as compared to gains. However, other psychological mechanisms such as status-quo bias, loss attention, etc. provide alternate explanations for this finding. While experimental studies have provided some evidence for these hypotheses, how much they affect decision makers during mixed gambles is not clear. Moreover, it is difficult to investigate their effect on the decision process within the framework of Prospect theory – the central theory of behavioural economics – because it posits that people make decisions based on utility alone. In this thesis, I use two models of decision making called the Drift Diffusion Model and the Leaky, Competing, Accumulator model to tease apart the effects of these psychological mechanisms. Using data from two risky-choice experiments, I show that people require less evidence to reject gambles than to accept them, and that this bias is the most important mechanism underlying this behaviour, and that high rates of rejection in mixed gambles should not be understood in terms of loss aversion. 2 Chapter 1 INTRODUCTION Humans are required to make decisions in hundreds of risky situations every day. From deciding which route to take to work, to investing money in the stock market – we have to deal with risks all the time. For decades, people from various backgrounds and disciplines such as Economics, Psychology, Artificial Intelligence, etc. have tried to study how humans make decisions under uncertainty. One of the most important findings in behavioural economics is that decision makers tend to reject ‘mixed’ gambles having equal probability of resulting in a gain or a loss [KT79]. For instance, consider the following gamble: You have to choose between two options, S and R: S: gain Rs. 0 with 100% probability R: gain Rs. 1,00,000 with 50% probability lose Rs. 1,00,000 with 50% probability Even though the probability of winning Rs. 1,00,000 is the same as that of losing Rs. 1,00,000, most people choose S. This suggests that people tend to reject gambles that may potentially result in a loss. However, the nature of the psychological processes underlying this phenomenon is not properly understood. Several hypotheses have been proposed to explain this finding. According to expected utility theory (See A.1), this may indicate concavity of the utility function. However, this hypoth- esis cannot explain the high rates of rejection in small gambles, as that would require an unreasonably high degree of concavity in the utility function [Rab00]. Prospect theory (See A.2) [KT79] explains this finding by positing that losses are given more subjective value by decision makers than gains of equal magnitude, i.e., the value function for losses is steeper than gains. This idea – known as loss aversion – is the most widely accepted explanation for the high rates of rejection in mixed gambles. While loss aversion was originally proposed in the context of decisions under risk, it has been generalized to other settings, and has successfully explained numerous other findings such as Endowment effect [KS84]. The idea that losses and gains have different effects on our psychological state has been extended to other domains such as education, politics, marketing, etc. However, Prospect theory has several shortcomings. It does not comment upon the time 4 taken by a person to reach a decision. Moreover, while it aims to describe how people actually make decisions (i.e., it is a descriptive model) instead of being a normative model (like expected utility theory), there is no explanation of the psychological processes mentioned in it. It even fails to account for the role of aspects of cognition such as emotion, attention, etc. These issues undermine the role of loss aversion as the mechanism behind rejection of mixed gambles. In addition to the claims mentioned above, there is increasing evidence suggesting that loss aversion is not a ubiquitous phenomenon – as assumed by Prospect theory – and is context dependent. For example, [MSPS17] showed that losses loom larger than gains only for large magnitudes, and might even be valued less than gains for smaller magnitudes. [EE13] showed that loss aversion is not observed when the option of rejecting a gamble is presented explicitly as opposed to being the status quo. In addition to loss aversion, other mechanisms explaining the rejection of mixed gambles have been investigated. One of them is Loss Attention, which suggests that losses attract more attention than (but may not necessarily be weighted more than) gains of similar magnitude [YH13] [LSMPH19]. Another possible explanation is that people reject mixed gambles because of ‘psychological inertia’ or a status-quo bias. It is possible that the behavioural finding results from the interplay of these effects, and while there have been some empirical studies about these hypotheses, it is difficult to disentangle their effects from each other as well as from loss aversion using qualitative methods alone. Moreover, as has already been mentioned, economic models such as expected utility theory and prospect theory rely only on the utility of a prospect and cannot accommodate these psychological mechanisms. Hence, computational models that are grounded in psychological principles are required to study these mechanisms quantitatively. One class of computational models, which is quite attractive for this enterprise, is the family of evidence accumulation models. Essentially, these models assume that people accumulate noisy evidence from stimuli over time to make decisions. These models have been successful in explaining both choice and reaction time data in ‘perceptual decision’ making tasks, so it is possible that the brain uses a similar mechanism in economic decision making tasks. Moreover, these models are capable of incorporating mechanisms such as the status-quo bias or asymmetric attention for losses and gains. Additionally, some of these models have pro- vided elegant explanations for context effects in economic decision making [UM04], [BT93]. Finally, some of these models incorporate known principles of information processing in the brain, increasing their plausibility as models of economic decision making. In chapter 2, I briefly describe mechanisms of decision making in the brain and how they can inspire models of decision making. In chapters 3 and 4, I employ these models to investigate the mechanisms underlying people’s aversion to mixed gambles. This is followed by a general discussion in chapter 5. c 2021, Indian Institute of Technology Delhi Chapter 2 Computational models of decision making 2.1 Neurophysiology of Choice [BUZM07] Let us begin with a common perceptual decision making task (instead of value-based de- cisions that we have considered so far): participants are shown a cloud of identical dots moving on a screen. In every trial, a proportion of the dots are moving in the same di- rection, while the other dots are moving randomly. The task is to identify the direction of prevalent movement. Sensory neurons (such as those in the MT1 region in the brain) detect particular directions of movement. For instance, a neuron that is tuned to detect objects moving to the right will fire only when an object moving to the right appears in the visual field and not otherwise. The information coded by the these neurons is inherently noisy, so making a decision based on the information obtained at just one instant may cause errors. Instead, information sampled at different instants is used collectively to make a decision. It has been observed that the firing rates of some neurons in the lateral intraparietal area (LIP) and the frontal eye field (FEF) increases over time. Moreover, the easier the task, the larger is the rate of increase. These observations suggest that neurons in these areas might be integrating the information provided by the sensory neurons, averaging out the noise. 2.2 Drift Diffusion Model The Drift Diffusion Model is a very influential model that has been able to successfully account for accuracy and reaction-time data from a wide range of behavioural experiments involving decisions between two options. Parameters of the model represent components of information processing, so, studying these parameters (and their variation under differ- ent experimental conditions) can provide insights about the processes underlying decision- making.
Recommended publications
  • Education and Behavioural Failures
    Proceedings of ADVED 2017- 3rd International Conference on Advances in Education and Social Sciences 9-11 October 2017- Istanbul, Turkey EDUCATION AND BEHAVIOURAL FAILURES Venelin Terziev1*, Dimitar Kanev2 1Corresponding Member of the Russian Academy of Natural History, Moscow, Professor, Ph.D., D.Sc. (National Security), D.Sc. (Ec.), University of Rousse, Rousse, Bulgaria; National Military University, Veliko Tarnovo, Bulgaria; University of Telecommunications and Post, Sofia, Bulgaria, [email protected] 2Professor, Ph.D., D.Sc. (Ec.), Naval Academy, Varna, Bulgaria, [email protected] *Corresponding author Abstract The work defences the thesis that even ensured equal opportunities to invest in education and to get better life, even if this is the best life alternative for them, young people and their families would hardly take complete advantage of these opportunities. This particularly regards the ones in an unequal position. The reasons are looked for in behavioural failures connected to hyperbolic discounting and to focusing on the present, momentum, stereotypes, herd-instinct behaviour, the paralysis at the availability of numerous options and defects of will. The work also suggests solutions, which to help young people and their families to take adequate advantage of educational opportunities and to develop their potential, getting over or softening behavioural deformations and deviations from reality. Keywords: education, limited rationality, lack of foresight, momentum, herd-instinct behaviour 1. INTRODUCTION Target of the present work is education, and subject – behavioural failures in education decisions. What we make our aim is to study the behavioural deformations impact upon the effectiveness of individual decisions for education. We use the behavioural economy’s theoretical approach and verify the thesis that together with ensuring access to quality education, young people and their families are to be helped to take adequate advantage of that access, particularly those occupying low social-economic status.
    [Show full text]
  • Loss Aversion Down to Earth — a Comment on Gal & Rucker's
    Bringing (Contingent) Loss Aversion Down to Earth — A Comment on Gal & Rucker’s Rejection of “Losses Loom Larger Than Gains” Itamar Simonson Ran Kivetz Stanford University Columbia University Accepted by Sharon Shavitt, Associate Editor Although we disagree with some of Gal and Rucker’s (2018 – this issue) specific evidence and with their over- stated conclusion regarding loss aversion, their overarching message makes a worthwhile contribution. In par- ticular, loss aversion is less robust and universal than has been assumed while its most prominent empirical support — the endowment effect and the status quo bias — is susceptible to multiple alternative explanations. Instead of accepting loss aversion as true unless proven otherwise, we should treat it like other decision prop- erties and psychological accounts that are contingent on various moderators and call for an analysis of psy- chological mechanisms. In this commentary, we suggest that gatekeepers, such as reviewers, tend to favor loss aversion and other widely accepted tendencies, while demanding a much higher support-threshold for alternative or newer accounts. Although building on prior theories and concepts is of course important, the bias in favor of incumbent assumptions can impede scientific progress, bar new ideas from the literature, and reinforce well-established but contingent notions that may apply under some conditions but not others. Keywords Behavioral economics; Loss aversion; Judgment; Decision making; Behavioral decision theory; Contingent judgment properties Introduction: the Limitations of the Extant particular, as discussed further below, G&R’s Empirical Support for Loss Aversion claimed support for an endowment effect without loss aversion (using what is referred to as the “re- After reading David Gal and Derek Rucker’s target tention paradigm”) is itself open to rival accounts.
    [Show full text]
  • Testing the Endowment Effect in Law
    DePaul Law Review Volume 68 Issue 1 Fall 2018 Article 3 Bridging the Property-Contract Divide: Testing the Endowment Effect in Law Marco Jimenez Follow this and additional works at: https://via.library.depaul.edu/law-review Part of the Law Commons Recommended Citation Marco Jimenez, Bridging the Property-Contract Divide: Testing the Endowment Effect in Law, 68 DePaul L. Rev. (2019) Available at: https://via.library.depaul.edu/law-review/vol68/iss1/3 This Article is brought to you for free and open access by the College of Law at Via Sapientiae. It has been accepted for inclusion in DePaul Law Review by an authorized editor of Via Sapientiae. For more information, please contact [email protected]. \\jciprod01\productn\D\DPL\68-1\DPL103.txt unknown Seq: 1 7-JAN-19 10:03 BRIDGING THE PROPERTY-CONTRACT DIVIDE: TESTING THE ENDOWMENT EFFECT IN CONTRACT LAW Marco Jimenez* CONTENTS INTRODUCTION ................................................. 31 R I. THE ENDOWMENT EFFECT .............................. 35 R A. General Overview of the Endowment Effect......... 35 R B. Previous Experiments Testing the Endowment Effect ............................................... 38 R C. Contract Law and the Endowment Effect ........... 40 R II. TESTING THE ENDOWMENT EFFECT IN CONTRACT LAW ..................................................... 40 R A. Establishing Initial Preferences ...................... 40 R B. Registering the Strength of Initial Preferences ....... 42 R C. Distributing and Tracking Contracts ................ 44 R D. Trading Exercise .................................... 46 R E. Predicting the Number of Trades Absent an Endowment Effect .................................. 47 R III. RESULTS AND DISCUSSION .............................. 49 R A. Quantitative Evidence for the Presence of the Endowment Effect .................................. 49 R B. Quantitative Evidence for the Strength of the Endowment Effect .................................
    [Show full text]
  • Todd Zywicki1 George Mason University Foundation Professor of Law Antonin Scalia School of Law at George Mason University Senior Scholar, Cato Institute
    STATEMENT PREPARED FOR CONSUMER FINANCIAL PROTECTION BUREAU ABUSIVE ACTS OR PRACTICES SYMPOSIUM June 25, 2019 Todd Zywicki1 George Mason University Foundation Professor of Law Antonin Scalia School of Law at George Mason University Senior Scholar, Cato Institute 1 I would like to thank Karin Thrasher for her research assistance in preparation of this statement. 1 Enacted in response to the 2008 financial crisis, the Dodd-Frank regulatory reform law was one of the most consequential pieces of financial regulatory reform legislation since the Great Depression. Among its myriad provisions was the creation of the Bureau of Consumer Financial Protection Bureau (“CFPB”). Among the CFPB’s substantive powers is to ensure that “consumers are protected from unfair, deceptive, or abusive acts and practices.” The terms “unfair” and “deceptive” are well-established terms that despite their apparent vagueness have come to take on relatively predictable and determinate meaning over time. “Abusiveness,” however, is a novel term with limited predecessors. The CFPB, scholars, and commenters have struggled to define the term “abusive” in a manner that effectuates Congress’s language and intent in a predictable and consumer welfare-enhancing manner. During the tenure of Director Richard Cordray, the CFPB eschewed any settled or precise definition of the term but instead adopted a policy of defining the term on a case-by-case enforcement process. Still, the CFPB has struggled to define the term “abusive” so as to distinguish it from “unfair” and “deceptive” acts and practices. In light of the substantial penalties that the CFPB is entitled to mete out, the lack of a predictable definition of the term “abusive” has given rise to great consternation by regulated entities about basic due process rights and their ability to engage in useful transactions with their customers.
    [Show full text]
  • The Endowment Effect: Unique Predictions from a Cognitive
    ASSOCIATION FOR CONSUMER RESEARCH Labovitz School of Business & Economics, University of Minnesota Duluth, 11 E. Superior Street, Suite 210, Duluth, MN 55802 The Endowment Effect: Unique Predictions From a Cognitive Elaboration Account Christopher Cannon, University of Hawaii, USA Derek Rucker, Northwestern University, USA David Gal, University of Illinois at Chicago, USA The endowment effect is a widely documented phenomenon whereby sellers demand a higher price for the same good relative to buyers. This work proposes a novel account for the endowment effect based on cognitive elaboration. This cognitive elaboration account provides new predictions about when endowment increases versus decreases consumers’ evaluations. [to cite]: Christopher Cannon, Derek Rucker, and David Gal (2020) ,"The Endowment Effect: Unique Predictions From a Cognitive Elaboration Account", in NA - Advances in Consumer Research Volume 48, eds. Jennifer Argo, Tina M. Lowrey, and Hope Jensen Schau, Duluth, MN : Association for Consumer Research, Pages: 254-255. [url]: http://www.acrwebsite.org/volumes/2656006/volumes/v48/NA-48 [copyright notice]: This work is copyrighted by The Association for Consumer Research. For permission to copy or use this work in whole or in part, please contact the Copyright Clearance Center at http://www.copyright.com/. The Endowment Effect: Unique Predictions from a Cognitive Elaboration Account Christopher Cannon, University of Hawaii, USA Derek D. Rucker, Northwestern University, USA David Gal, University of Illinois at Chicago, USA EXTENDED ABSTRACT each experiment, we aimed to collect 300 participants to ensure a The endowment effect is a phenomenon in which sellers have sufficiently large cell sizes. For the endowment conditions, buyers a higher valuation of their goods than buyers (Kahneman, Knetsch, were asked to imagine that they are thinking about purchasing the and Thaler 1990, 1991).
    [Show full text]
  • Zicklin School of Business Baruch College, CUNY MKT 88800
    Zicklin School of Business Baruch College, CUNY MKT 88800: Consumer Behavior and Behavioral Decision Theory Professor Stephen Gould: Fall 2019 This course aims to develop your knowledge and research skills by considering a number of different perspectives and focusing them on consumer behavior and decision making. We start with readings on selected topics each week and enrich our understanding through experiential exercises, thought experiments and research proposals. This comprehensive approach reflects a mapping of research which might best be considered as locating points in researcher consciousness, whether or not you follow up in any particular domain mentioned here. It thus is designed to help you think out of the box, whether you want to take a huge leap of the imagination or more generally extend the work of some relevant topic you are interested in. It is impossible to read or even consider all important papers or topics. I have made a subjective selection based on what I see at the moment. There is some flexibility and if any of you have any thoughts about some topic to consider let me know. Learning Objectives 1. Students should be able as a result of this course to theorize about, design and run studies applying BDT. 2. All students whether they directly focus on BDT in their own research programs or not should be able to apply the theoretical and experimental design insights from this field to their own investigations of consumer behavior and other related disciplines. In that respect, they will come away with a deeper appreciation of decision making in terms of such central aspects as (1) conscious versus non-conscious effects, (2) intuitive versus counterintuitive findings and (3) how various BDT theories such as Prospect Theory and others are continually evolving, contesting and challenging more conventional economic and consumer research perspectives.
    [Show full text]
  • The Loss of Loss Aversion: Will It Loom Larger Than Its Gain?
    The Loss of Loss Aversion: Will It Loom Larger Than Its Gain? David Gal Derek D. Rucker University of Illinois at Chicago Northwestern University Accepted by Sharon Shavitt, Associate Editor Loss aversion, the principle that losses loom larger than gains, is among the most widely accepted ideas in the social sciences. The first part of this article introduces and discusses the construct of loss aversion. The sec- ond part of this article reviews evidence in support of loss aversion. The upshot of this review is that current evidence does not support that losses, on balance, tend to be any more impactful than gains. The third part of this article aims to address the question of why acceptance of loss aversion as a general principle remains per- vasive and persistent among social scientists, including consumer psychologists, despite evidence to the con- trary. This analysis aims to connect the persistence of a belief in loss aversion to more general ideas about belief acceptance and persistence in science. The final part of the article discusses how a more contextualized perspective of the relative impact of losses versus gains can open new areas of inquiry that are squarely in the domain of consumer psychology. Keywords Loss aversion; Sociology of science One of us polled approximately 80 people present we have encountered near unanimous support for for a conference session on consumer decision mak- the premise that losses loom larger than gains. ing at the 2016 Society for Judgment and Decision Although anecdotal, we view these examples as Making Conference in Boston. The question posed illustrations of the near universal acceptance among was simple: Which of the following do you believe? social scientists of loss aversion—the idea that losses loom larger than equivalent magnitude gains.
    [Show full text]
  • Gains, Losses, and Judges: Framing and the Judiciary Jeffrey J
    Notre Dame Law Review Volume 94 | Issue 2 Article 2 1-2019 Gains, Losses, and Judges: Framing and the Judiciary Jeffrey J. Rachlinski Cornell Law School Andrew J. Wistrich United States District Court for the Central District of California Follow this and additional works at: https://scholarship.law.nd.edu/ndlr Part of the Courts Commons, and the Judges Commons Recommended Citation 94 Notre Dame L. Rev. 521 (2019). This Article is brought to you for free and open access by the Notre Dame Law Review at NDLScholarship. It has been accepted for inclusion in Notre Dame Law Review by an authorized editor of NDLScholarship. For more information, please contact [email protected]. \\jciprod01\productn\N\NDL\94-2\NDL202.txt unknown Seq: 1 27-DEC-18 9:19 GAINS, LOSSES, AND JUDGES: FRAMING AND THE JUDICIARY Jeffrey J. Rachlinski* & Andrew J. Wistrich** Losses hurt more than foregone gains—an asymmetry that psychologists call “loss aver- sion.” Losses cause more regret than foregone gains, and people struggle harder to avoid losses than to obtain equivalent gains. Loss aversion produces a variety of anomalous behaviors: people’s preferences depend upon the initial reference point (reference-dependent choice); people are overly focused on maintaining the status quo (status quo bias); people attach more value to goods they own than to identical goods that they do not (endowment effect); and people take excessive risks to avoid sure losses (risk seeking in the face of losses). These phenomena are so pervasive that legal scholars have assumed that they influence the development of law. Although numerous studies reveal that framing influences how ordinary people think about their rights, a clear demonstration that judges decide cases differently when the underlying facts present gains as opposed to losses does not exist.
    [Show full text]
  • How Buyer Usage Intent Affects the Pricing of Used Goods
    Aaron R. Brough & Mathew S. Isaac Finding a Home for Products We Love: How Buyer Usage Intent ConsumersAffects often dispose of theused products Pricing by selling them in a ofsecondary Used market (e.g., classifiedGoods advertisements, Craigslist, eBay). When consumers must dispose of products to which they feel emotionally attached, they often expect to sell the product at a price in excess of its market value. However, the authors identify a condition in which product attachment can decrease rather than increase the minimum price sellers are willing to accept. Specifically, they propose that due to concern for how products are used following a transaction, strongly attached sellers may be more willing than weakly attached sellers to provide discounts to potential buyers whose usage intentions are deemed appropriate. Whereas prior research has focused primarily on one particular consequence of attachment, namely, the intensified reluctance of consumers to part with their possessions, this research identifies a novel consequence of attachment: a heightened sensitivity to the manner in which the product will be used following a transaction. Four empirical studies provide converging evidence that sellers’ product attachment determines the extent to which their minimum acceptable sales price is influenced by buyer usage intent. Keywords: product attachment, secondary markets, pricing, product disposition onsumers often dispose of used products by selling from the transaction. According to this logic, as the strength them in a secondary market (e.g., classified adver- of a seller’s attachment to an item increases, the item’s min- tisements, Craigslist, eBay). An important decision imum acceptable selling price should increase as well.
    [Show full text]