MANAGEMENT SCIENCE Articles in Advance, pp. 1–15 http://pubsonline.informs.org/journal/mnsc/ ISSN 0025-1909 (print), ISSN 1526-5501 (online)
Translated Attributes as Choice Architecture: Aligning Objectives and Choices Through Decision Signposts
Christoph Ungemach,a Adrian R. Camilleri,b Eric J. Johnson,c Richard P. Larrick,d Elke U. Webere a TUM School of Management, Technische Universität München, 80333 München, Germany; b RMIT University, Melbourne, Victoria 3000, Australia; c Columbia Business School, Columbia University, New York, New York 10027; d Fuqua School of Business, Duke University, Durham, North Carolina 27708; e Princeton University, Princeton, New Jersey 08544 Contact: [email protected] (CU); [email protected] (ARC); [email protected] (EJJ); [email protected] (RPL); [email protected] (EUW)
Received: February 2, 2015 Abstract. Every attribute can be expressed in multiple ways. For example, car fuel econ- Accepted: August 23, 2016 omy can be expressed as fuel efficiency (“miles per gallon”), fuel cost in dollars, or tons of Published Online in Articles in Advance: greenhouse gases emitted. Each expression, or “translation,” highlights a different aspect March 23, 2017 of the same attribute. We describe a new mechanism whereby translated attributes can https://doi.org/10.1287/mnsc.2016.2703 serve as decision “signposts” because they (1) activate otherwise dormant objectives, such as proenvironmental values and goals, and (2) direct the person toward the option that Copyright: © 2017 INFORMS best achieves the activated objective. Across three experiments, we provide evidence for the occurrence of such signpost effects as well as the underlying psychological mech- anism. We demonstrate that expressing an attribute such as fuel economy in terms of multiple translations can increase preference for the option that is better aligned with objectives congruent with this attribute (e.g., the more fuel-efficient car for those with pro- environmental attitudes), even when the new information is derivable from other known attributes. We discuss how using translated attributes appropriately can help align a per- son’s choices with their personal objectives.
History: Accepted by Yuval Rottenstreich, judgment and decision making. Funding: Financial support from the National Science Foundation [Grant SES 0951516] is gratefully acknowledged. The second author was supported by an Alcoa Foundation Fellowship (2787_2012) received from the American Australian Association. Supplemental Material: The online appendix is available at https://doi.org/10.1287/mnsc.2016.2703.
Keywords: behavioral decision making • behavioral economics • consumer behavior • choice architecture • theory • government • regulations • applications • marketing • segmentation • translated attributes • proenvironmental behavior
1. Introduction overwhelm a person. On the other, less information Choice options typically vary on multiple attributes. could deprive a person of important facts. For example, a car’s attributes include price, fuel econ- Little may be gained by presenting one translated omy, safety rating, and type of navigation system. attribute instead of another because the two trans- In turn, each attribute can have multiple translations, lated attributes are often perfectly correlated. From that is, different ways the attribute can be expressed. a strictly rational point of view, translated attributes For instance, a car’s fuel economy can be expressed are completely redundant if the translation equiva- in different ways. Figure1 shows the U.S. Environ- lence is known. However, the theoretical perspective of bounded rationality (Simon 1982) and supporting mental Protection Agency (EPA) fuel economy and empirical evidence suggest that people tend to con- environment label, which expresses fuel economy in struct their preferences (Lichtenstein and Slovic 2006; terms of miles travelled per gallon of fuel, the esti- Payne et al. 1988, 1993; Ungemach et al. 2011) using mated annual fuel cost (AFC), and a 1-to-10 green- information about choice options at face value (e.g., house gas rating (GGR), among others. These differ- Downloaded from informs.org by [128.112.72.171] on 19 May 2017, at 12:21 . For personal use only, all rights reserved. the concreteness principle, Slovic 1972; or What You ent expressions, which we term “translated attributes,” See Is All There Is [WYSIATI], Kahneman 2011). Bond are closely related to each other and highly corre- et al. (2008) have shown that people often overlook lated. Nevertheless, each translation also highlights key personal objectives when making choices because different aspects of the same attribute. A fundamental they possess a myopic mental representation of the decision faced by policy makers is to determine how choice. Assuming that consideration of personal objec- much information should be presented to people to tives is beneficial to effective decision making (Keeney help them make better decisions for themselves and 1992), these findings imply that people often end up for society. On the one hand, more information could with suboptimal decision outcomes that are not fully
1 Ungemach et al.: Translated Attributes as Choice Architecture 2 Management Science, Articles in Advance, pp. 1–15, © 2017 INFORMS
Figure 1. (Color online) The Current U.S. Environmental Protection Agency Fuel Economy and Environment Label for Gasoline Vehicles
aligned with personal objectives. Bond et al. (2008) global attribute, we identify and test two different pro- have suggested that recognition of important per- cesses by which translated attributes affect decisions. sonal objectives may be assisted through guides that Specifically, we distinguish the established effects of describe additional features of products such as con- noncompensatory heuristics such as counting superi- sumer reports. We propose that translated attributes ority across attributes and using the majority rule (e.g., play a similar role in improving choice: they allow Alba and Marmorstein 1987, Russo and Dosher 1983, people to recognize important personal objectives that Zhang et al. 2006), and our own novel explanation: would otherwise be overlooked. Therefore, our gen- activation of relevant objectives and direction toward eral hypothesis is that translated attributes have the achieving them through decision signposts. potential to influence preferences because they serve as decision “signposts” helping people first recognize 1.1. Translated Attributes as Decision Signposts and then pursue options congruent with their personal On a roadside, a signpost has two important fea- objectives. tures: First, it indicates the presence of a destination Previous literature has shown that partitioning a that might be of personal relevance, such as a nearby global attribute into components can increase the town. Second, it points out how to reach the destina- weight accorded to that global attribute (Dawes 1979, tion by providing the actual direction and distance Fischhoff et al. 1978, Weber et al. 1988). For exam- to travel. Similarly, translated attributes possess both ple, the global attribute “job security” can be split into features. First, translated attributes can produce acti- component attributes such as “stability of the firm” vation of personally relevant objectives. This implies and “personal job security.” Although related to par- that a translated attribute will have the most impact titioning, the notion of translated attributes has three on those who have objectives matching those aspects features that distinguish it from this earlier literature. highlighted by the translated attribute. Second, a deci- First, translated attributes are monotone transforma- sion signpost conveys direction toward achieving those tions of each other and highly correlated, whereas com- objectives by explicitly describing the degree to which
Downloaded from informs.org by [128.112.72.171] on 19 May 2017, at 12:21 . For personal use only, all rights reserved. ponents of a global attribute described in the attribute different options meet the person’s objectives. splitting literature may not be correlated at all. Sec- People have many objectives that can arise from dif- ond, translated attributes differ from derived attributes ferent sources, such as values and goals. Values are used in advertising, such as a car being described as stable dispositions that structure and guide specific “masculine,” because translated attributes all map onto beliefs, norms, and attitudes (Feather 1995, Rokeach actual physical properties of the object. Third, and 1973). Goals are motivational constructs directed to most importantly, whereas the attribute splitting lit- achieve a desirable end state (van Osselaer and erature demonstrates the phenomenon that the sum Janiszewski 2012). Goals direct movement that leads to of component attributes attracts more weight than the degrees of achievement allowing progress (and failure) Ungemach et al.: Translated Attributes as Choice Architecture Management Science, Articles in Advance, pp. 1–15, © 2017 INFORMS 3
to be gauged (Huang et al. 2012). Goals, such as loos- partitioning of options and attributes (Fox et al. 2005; ing 5 lbs over the summer, are typically more specific for reviews, see Johnson et al. 2012 and Camilleri and and temporary than values, such as living healthily. Larrick 2015). These interventions, sometimes referred Values can direct which goals are considered impor- to as “nudges,” often operate beneath conscious aware- tant, and prioritized objectives can direct attention to ness to help improve individual and social welfare congruent information, which in turn affects behav- (Smith et al. 2013, Thaler and Sunstein 2008). How- ior (Stern and Dietz 1994). However, Bond et al. (2008) ever, this lack of awareness exposes such interventions demonstrate that people often focus too narrowly and to the criticism that they manipulate individuals by forget many objectives that they consider to be valu- restricting their autonomy to act upon their own prefer- able, unless aided. ences (e.g., Hausman and Welsh 2010). As we demon- We argue that our proposed signpost effect is con- strate below, the presentation of translated attributes ceptually distinct from previous work on framing can be an effective and benevolent aspect of choice and priming. Traditional “framing effects” occur when architecture that does not restrict individuals’ auton- behavior changes in response to different representa- omy. Instead, it allows people to select options that are tions of information that is equivalent in basic struc- more consistent with their personal objectives. This is ture and final consequences. For example, Levin et al. also another important theoretical distinction between (1998) distinguish three types of framing effects, each signposts and counting effects (such as attribute split- relying on different cognitive mechanisms: risky choice ting effects and majority rule strategies). Whereas sim- framing, attribute framing, and goal framing. Each of ply steering people to an option that is superior on these framing categories relies on changes in valance: multiple positive (translated) attributes is potentially a risky choice framing contrasts options in terms of gain “trick,” guiding people to see what they care about and and loss; attribute framing contrasts object character- to act on this preference is helpful to the individual. istics positively and negatively; goal framing contrasts In summary, our novel contribution is the idea that positive consequences of engaging in a behavior with the presentation of translated attributes can be utilized negative consequences of not engaging in the behavior. selectively as decision signposts to help people match Our proposed translated attribute effect is distinct from options with their personal objectives. Specifically, we these framing effects because it does not rely on such predict that the effect of shifting preferences through “valence shifts.” Indeed, we would expect the same the provision of translated attributes will be strongest activation-and-direction effect regardless of positive or for those who have personal objectives congruent with negative valence. those highlighted by the translated attributes. When Finally, we argue that the effect of signposts is dis- a translation is distinct enough to activate an over- tinct from “bottom-up” priming effects, which find looked objective, a signpost effect is expected to occur that a goal (e.g., becoming educated) can be activated through the subliminal presentation of means to com- in addition to any simple counting heuristic effects, plete that goal (e.g., study; Shah and Kruglanski 2003). which are agnostic with regard to the type of trans- First, when a translated attribute acts as decision sign- lated attributes presented. Finally, we predict this sign- post, the objective is directly presented and compre- post effect to occur only when the presented attributes hended. Second, translated attributes, when acting as provide directional information, allowing the person to decision signposts, also provide directional informa- identify options that are aligned with activated per- tion about how to choose and act, which primes do not. sonal objectives. The rest of this paper is arranged as follows: In Exper- 1.2. Translated Attributes as Choice Architecture iment 1, we demonstrate how translated attributes can Because they act as decision signposts, translated at- affect preferences dependent on the congruency be- tributes represent a type of choice architecture inter- tween the translated attribute and a person’s values. vention. Choice architecture refers to the application In Experiment 2, we show that signpost effects can- of behavioral insights to understand the influence that not be explained by differences in perceived knowledge different ways of presenting information about choice about the relation between attributes provided by one
Downloaded from informs.org by [128.112.72.171] on 19 May 2017, at 12:21 . For personal use only, all rights reserved. options can have on decisions and behavior (Sunstein translated attribute versus another. In Experiment 3, we 2011, Thaler and Sunstein 2008, Johnson et al. 2012). show how translated attributes act as decision signposts Examples of application domains include personal by explicitly manipulating the activation and direction health (e.g., Kling et al. 2012), retirement savings (e.g., features of translated attributes. O’Donoghue and Rabin 1999), and the environment (e.g., Camilleri and Larrick 2014, Larrick and Soll 2008). Choice architecture builds on insights about the effect 2. Experiment 1—The Signpost Effect of defaults (Johnson and Goldstein 2003), the number The purpose of Experiment 1 was to test the value acti- of alternatives presented (Payne et al. 1993), and the vation mechanism proposed as part of the hypothesized Ungemach et al.: Translated Attributes as Choice Architecture 4 Management Science, Articles in Advance, pp. 1–15, © 2017 INFORMS
signpost effect. We chose to focus on the environmen- 1987, Russo and Dosher 1983, Zhang et al. 2006). Con- tal domain, specifically choices between cars that dif- gruent with our signpost effect hypothesis, we further fer in terms of their fuel economy, because it provides predicted that the effect of translated attributes would an acknowledged paradox of consumers appearing to be moderated, and be stronger for participants who select options that are not in their economic self-interest valued the environment. Specifically, we predicted that (National Highway Traffic Safety Administration 2010). more proenvironmental participants would be more We asked participants to choose between pairs of cars likely to choose the fuel-efficient car when the pre- where the global attributes were price and fuel econ- sented translated attribute was associated with the omy, which were arranged to trade off against one environmental impact of fuel economy (i.e., when pre- another. In line with our proposed translated attribute sented with greenhouse gas rating). This is because the framework, we used three highly correlated transla- environmental attribute was expected to activate pre- tions for the car fuel economy attribute: annual fuel cost, existing environmental values and highlight the oth- gallons (of gas consumed) per 100 miles, and green- erwise overlooked proenvironmental objective in the house gas rating. We assumed that annual fuel cost decision. However, this moderation was not expected was likely to activate financial objectives, that gallons to occur when the presented translated attribute was per 100 miles was likely to activate fuel consumption not associated with the environmental impact of fuel objectives, and that greenhouse gas rating was likely to economy (e.g., annual fuel cost). activate preexisting proenvironmental values. This lat- ter assumption was guided by the fact that greenhouse 2.1. Method gases have been identified as the most significant driver 2.1.1. Participants. Three hundred forty-one American of climate change (IPCC 2013) and the greenhouse effect participants (52% female; mean age 31.8; SD 10.1) (U.S. Environmental Protection Agency 2014). In addi- were recruited through Amazon’s Mechanical Turk tion, a significant proportion of sustainability-related (MTurk) and paid a flat fee for their participation. product claims are based on carbon emissions (Cohen 2.1.2. Materials. Choice Design. We designed a set of and Vandenbergh 2012), and consumers are familiar nine choice problems (see Table1). Cars were described with its usage. Two advantages of focusing on the in terms of price and either one or two different trans- activation of proenvironmental values were that we lated attributes of fuel economy. In the cases where (a) knew that such values varied in strength across there was one fuel economy attribute, half the partici- the population and (b) environmental attitude could pants were presented with “annual fuel cost” and the be assessed with a well-validated measure. Participants other half with “greenhouse gas rating.” In the cases were presented either one or two of these translated fuel where there were two fuel economy attributes, half the economy attributes. Our experimental design kept the participants were presented with “annual fuel cost” type of translation orthogonal to the number of trans- together with “greenhouse gas rating,” and the other lated attributes presented, which allowed us to distin- half of participants were presented with “annual fuel guish between the effect of counting heuristics and the cost” together with “gallons per 100 miles” (GPM). proposed signpost mechanism. Annual fuel cost, greenhouse gas rating, and gallons Based on past research, we predicted that when cars per 100 miles were highly correlated. Annual fuel cost were presented with more translated fuel economy was calculated assuming 15,000 miles driven annually attributes, participants would be more likely to pre- and $3.70 per gallon of gas (similar assumptions under- fer the more fuel-efficient car (Alba and Marmorstein lie the calculated values presented on the American
Table 1. Set of Nine Choice Problems Used in Experiments 1 and 3
Car A ($) Car B ($) Difference in total cost Choice problem Price Annual fuel costa Price Annual fuel costa over five years (car A B) ($) − 1 29,999 3,964 33,699 2,775 2,246
Downloaded from informs.org by [128.112.72.171] on 19 May 2017, at 12:21 . For personal use only, all rights reserved. 2 25,799 2,775 29,999 2,220 1,425 − 3 25,799 3,964 33,699 2,775 1,954 − 4 25,799 2,775 33,699 2,220 5,125 − 5 29,999 3,964 33,699 2,220 5,021 6 25,799 3,964 29,999 2,220 4,521 7 25,799 3,964 33,699 2,220 821 8 29,999 2,775 33,699 2,220 925 − 9 25,799 3,964 29,999 2,775 1,746
Notes. The lower price car is always car A. The ordering of the cars during the experiments was counterbalanced. aThe fuel cost assumes 15,000 miles driven annually for five years, costing $3.70 for gas and no discount rate. Ungemach et al.: Translated Attributes as Choice Architecture Management Science, Articles in Advance, pp. 1–15, © 2017 INFORMS 5
EPA label). Gallons per 100 miles was described as the subsequent analysis, leaving 320 participants. How- fuel efficiency of the car in terms of how many gallons ever, as described below, all conclusions remain un- of fuel were required to travel 100 miles. Greenhouse changed if we include these data in the analysis. gas rating was described as a 1-to-10 rating comparing 2.2.1. Activation of Environmental Values. To assess a car’s fuel economy and tailpipe carbon dioxide (CO2) whether our manipulation was successful in activat- emissions to those of all other new cars, where a rating ing environmental values, we checked the effect of of 10 was best (i.e., fewest CO2 emissions). The values presenting the greenhouse gas rating attribute on for the different attribute levels reflected typical ranges the self-rating of considering the environmental and encountered in actual car choices in a factorial design. cost aspects of the cars in participants’ decisions. As Environmental Values. Environmental values were expected, participants reported considering the envi- measured with the New Ecological Paradigm–Revised ronmental aspect to a greater extent when the GGR (NEP-R) scale (Dunlap et al. 2000), which is a standard was present (mean 2.95, SD 1.12) than when it was measure of attitudes toward sustainability. Participants absent (mean 1.81, SD 1.00, t 312.16 9.553, p < rated 15 statements (e.g., “Humans have the right to 0.0001). Conversely, in conditions( with) the− GGR rat- modify the natural environment to suit their needs”) ing present, the cost aspect was considered to a lesser on five-point scales ranging from “strongly disagree” extent (mean 3.78, SD 0.85) than in conditions with- to “strongly agree.” Scores on the NEP-R scale range out the GGR rating (mean 4.20, SD 0.75), t 312.94 from 15 to 75. Higher scores indicate stronger proenvi- 4.836, p < 0.0001). ( ) ronmental values. 2.2.2. Preferences. Figure2 shows the observed pro- 2.1.3. Design. We employed a 2 (number of fuel-effi- portions of fuel-efficient car choices in the four exper- ciency attributes: 1 vs. 2) 2 (environmental attribute: imental groups collapsed across choice sets. On aver- × present vs. absent) 9 (choice set) mixed design. The age, participants chose the fuel-efficient option 54% of × first two factors were between subjects and the third the time (SD 31%). In line with a counting expla- factor was within subjects. The main dependent vari- nation, participants made more fuel-efficient choices able was whether or not participants selected the fuel- when fuel economy was expressed via two translated efficient car. attributes (right pair of bars) than one (left pair of bars). To investigate the signpost effect, we examined the 2.1.4. Procedure. Participants first read an instruction screen in which they were told to assume they averaged relationship between the observed likelihood of choos- 15,000 miles of driving each year and that they would ing the environmental option across participants’ envi- ronmental attitudes as indicated by their NEP-R scores keep the car for five years before giving it away. Par- (see Figure3). As predicted, the probability of choosing ticipants were also shown a summary of the price and fuel-efficiency attribute definitions they would later be presented with. During the choice task, participants Figure 2. Proportion of Choices for the Fuel-Efficient saw two options in a table format with price and Option in Experiment 1 as a Function of the Number of fuel economy attributes (see Online Appendix A). The Fuel-Efficiency Attributes and Whether an Environmental choice screens also displayed the attribute definitions. Attribute Was Presented or Not Participants made a total of nine choices between 1.00 Environmental attribute: different pairs of cars. After these choices, participants Absent rated the extent to which they considered the environ- Present mental and the cost aspects of the cars, respectively, when making their choices. These responses were 0.75 made on five-point scales ranging from “not at all” to “exclusively.” Participants were then asked to judge how important a number of different car attributes 0.50 (e.g., price, car type, safety rating, miles per gallon (MPG)) would be to them if making a real car purchase, Downloaded from informs.org by [128.112.72.171] on 19 May 2017, at 12:21 . For personal use only, all rights reserved. on five-point scales ranging from “unimportant” to 0.25 “extremely important.” Finally, participants completed items relating to demographics, past driving behavior,
environmental attitudes (NEP-R scale), and an atten- Proportion choosing the fuel-efficient car tion check. 0
12 2.2. Results No. of fuel-efficiency attributes Twenty-one participants incorrectly answered the at- tention check question and were removed from the Note. Error bars are the standard error of the mean (SEM). Ungemach et al.: Translated Attributes as Choice Architecture 6 Management Science, Articles in Advance, pp. 1–15, © 2017 INFORMS
Figure 3. Probability of Choosing the Fuel-Efficient Car in independently influence people’s preferences. First, Experiment 1 Modeled as a Function of Environmental presenting more translated fuel economy attributes in- Values, Number of Fuel-Efficiency Attributes, and Whether creased the likelihood of choosing the more fuel-effi- an Environmental Attribute Was Presented or Not cient car, regardless of the type of attributes. Second, %NVIRONMENTAL ATTRIBUTE %NVIRONMENTAL ATTRIBUTE and in line with our hypothesized signpost effect, the ABSENT PRESENT presentation of an environmental translated attribute increased the likelihood of choosing the more fuel- efficient car, regardless of the number of total presented attributes. Importantly, the increase in fuel-efficient
choices was driven by those with higher proenviron- mental values and cannot be explained by a simple counting heuristic. Rather, it appears that the pres- ence of the environmental translated attribute acti- vated respondents’ preexisting but latent proenviron- mental value, and subsequently aligned choices with personal values. .O OF FUEL EFFICIENCY An alternative explanation for our observations is ATTRIBUTES that participants may have received different informa- 0ROBABILITY OF CHOOSING THE FUEL EFFICIENT CAR tion when presented with one attribute combination compared to another. Therefore, the purpose of Exper- n n n n n n iment 2 was to contrast our activation-and-direction %NVIRONMENTAL VALUE .%02 SCORE CENTERED account with this potential informational account.
3. Experiment 2—Effects of Information the fuel-efficient car increased with increasing NEP-R According to our value-activation-and-direction ac- scores when the GGR attribute was present (right count, translated attributes serve as decision-signposts: panel). However, this relationship was not observed in They activate a person’s preexisting objectives and then the conditions without the GGR attribute (left panel). help the person to identify which option best aligns To test that this effect was statistically significant, with their activated objective. According to the infor- we compared several nested multilevel logistic regres- mational account, a person might fail to realize that cer- sion models with selection of the fuel-efficient car as tain attributes are translations of one another and, as a the dependent variable. All models contained random result of this oversight, have a different knowledge base intercepts for participants and choice problems. For the with relation to one attribute combination compared to main hypotheses, we included simple fixed effects for another. Moreover, a person might gain different infor- the number of attributes presented, a dummy variable mation about the relation between attributes through- indicating the presence of the GGR attribute, and the out the experiment depending on the experimental two-way GGR NEP-R interaction to test the sign- present × manipulation they were assigned to. For example, par- post effect. The model confirmed that participants were ticipants presented with a greenhouse gas rating might more likely to select the fuel-efficient option when fuel find it easier to learn the relation between environmen- efficiency was expressed by two translated attributes tal impact and annual fuel cost compared to partici- compared to one (χ2 1 9.16, p < 0.01). In addi- ( ) pants presented with gallons per 100 miles and annual tion, and in line with our prediction, the relationship fuel cost. between environmental attitudes and the probability To rule out this informational account, we replicated of choosing the fuel-efficient car was moderated by Experiment 1 while manipulating whether knowledge the presence of the GGR attribute, as indicated by a about the relation between translated attributes was 2 significant GGRpresent NEP-R interaction (χ 1 12.2, measured before versus after the choice task. If the 1 × ( ) p < 0.001). Finally, a comparison with a model that informational account were true, we would expect that also included a number of attributes NEP-R inter- knowledge regarding the relation between translated
Downloaded from informs.org by [128.112.72.171] on 19 May 2017, at 12:21 . For personal use only, all rights reserved. × action showed that the relationship between environ- attributes would be different before versus after the mental attitudes and the probability of choosing the choice task, or as a function of which attributes were fuel-efficient car was not moderated by the number of presented during the choice task. attributes presented (i.e., number of attribute NEP-R interaction, χ2 1 0.62, p > 0.05). × 3.1. Methods ( ) 3.1.1. Participants. Seven hundred ninety-nine Ameri- 2.3. Discussion can participants (44% female; mean age 31; SD 11.2) The observations made in Experiment 1 illustrate that were recruited through MTurk and paid a flat fee for both the number of attributes and the type of attributes their participation. Ungemach et al.: Translated Attributes as Choice Architecture Management Science, Articles in Advance, pp. 1–15, © 2017 INFORMS 7
3.1.2. Design. The design was a simplified version of between AFC and GGR was 6.4 out of 10 (SD 2.4). Experiment 1. Specially, we used a 2 (translated at- The mean relatedness score between AFC and engine tribute: GPM vs. GGR) 2 (knowledge measure: before longevity was 4.2 out of 10 (SD 2.6). The mean relat- vs. after choice task) between-subjects× design. For each edness score between GGR and crash safety rating was car, participants were presented with price, AFC, and 2.1 out of 10 (SD 1.9). The mean relatedness score one of the translated attribute variables (i.e., GPM or between AFC and GGR was significantly higher than GGR). To limit opportunities to learn about the correla- the related scores between the other two comparisons tion between the translated attributes, participants were (both p’s < 0.001), suggesting that the relatedness mea- presented with a single choice scenario in this experi- sure was valid. ment (Problem 2 from Experiment 1; see Table1). We next examined whether participants’ response 3.1.3. Materials. We measured knowledge of the rela- to the relatedness between AFC and GGR varied as tion between AFC and GGR in two ways. First, we used a function of experimental group. An inspection of a general “relatedness” measure that asked partici- the means, which ranged between 6.2 and 6.6, sug- pants how related the two metrics were on a 10-point gested little variance between groups. An analysis of scale from “not at all related” to “completely related.” variance with translated attribute (GPM vs. GGR) and On this same page and using the same scale, we also knowledge measure timing (before vs. after choice asked how related AFC and engine longevity were, task) entered as independent variables and relatedness entered as the dependent variable revealed no effect and how related GGR and crash safety rating were (see Online Appendix B). These two additional questions of translated attribute (F 1, 760 1.54, p 0.21), no ( ) F measured comparisons with unrelated variables and effect of knowledge measure timing ( 1, 760 0.51, p ( ) were expected to produce very low relatedness scores, 0.48), and no interaction between these two vari- ables (F 1 760 0 03, p 0 84).2 Moreover, the distri- thereby allowing us to evaluate the validity of our relat- , . . bution of( responses) to the relatedness question was not edness scale. Second, we used directional questions significantly different between those who answered that presented the participant with a list of AFC val- the knowledge questions before versus after the choice ues ($3,800, $2,900, $2,150, $1,650) in random order, for task (two-sample Kolmogorov–Smirnov test, D which matching scores had to be identified within a Max 0.04, p 0.94). Analyses using the data collected from list of GGR values ranging from 1 to 10 (the answers the four directional questions produced similarly null were 2, 4, 6, and 8, respectively). This question allowed results (see the electronic companion). In summary, us to determine whether participants correctly iden- there was no evidence for a difference in knowledge tified the (negative) direction of the relation between regarding the relation between AFC and GGR as a AFC and GGR. function of which label was presented or whether the 3.1.4. Procedure. Participants for whom knowledge knowledge questions were asked before or after the was to be measured prior to choice were presented choice task. with the current U.S. fuel economy label (see Fig- 3.2.2. Choice. As can be seen in Figure4, the pro- ure1), together with definitions of AFC and GGR, portion of participants choosing the fuel-efficient car and answered the three relatedness questions. On the was higher when the environmental attribute GGR next page, participants answered the four directional was present compared to when it was absent (i.e., questions. They then completed the choice task, which when GPM was presented). Moreover, this difference was followed by two attention check questions. Finally, appears to hold regardless of when the knowledge we asked participants to complete the NEP-R scale measure was administered. To statistically confirm and demographic questions. Participants for whom this interpretation, we ran a logistical regression with knowledge was to be measured after choice had a translated attribute (GPM vs. GGR) and knowledge similar experience; however, the choice task was pre- measure timing (before vs. after choice task) entered sented first. as independent variables, and choice as the dependent variable. The analysis revealed a main effect of trans- 3.2. Results lated attribute (χ2(1, N 761 48.32, p < 0.001), no Thirty-eight participants incorrectly answered both Downloaded from informs.org by [128.112.72.171] on 19 May 2017, at 12:21 . For personal use only, all rights reserved. effect of knowledge measure timing) (χ2(1, N 761 attention check questions and were removed from the 1.36, p 0.24), and no interaction between these two) subsequent analysis, leaving 761 participants. How- variables (χ2(1, N 761 1.41, p 0.24).3 In other ever, as described below, the conclusions remain the words, participants were) significantly more likely to same even when these excluded data are included in prefer the efficient car when presented with AFC and the analysis. GGR compared to AFC and GPM, irrespective of the 3.2.1. Knowledge. We first contrasted the three relat- timing of the knowledge question. edness questions to lend support to the use of related- To demonstrate a signpost effect for Experiment 2, ness as a valid measure. The mean relatedness score we ran a second logistic regression, this time also Ungemach et al.: Translated Attributes as Choice Architecture 8 Management Science, Articles in Advance, pp. 1–15, © 2017 INFORMS
Figure 4. Proportion of Choices for the Fuel-Efficient Figure 5. Probability of Choosing the Fuel-Efficient Car in Option in Experiment 2 as a Function of the Timing of the Experiment 2 as a Function of Environmental Values and Knowledge Measure and Whether an Environmental Whether an Environmental Attribute Was Present or Not Attribute Was Absent or Present %NVIRONMENTAL ATTRIBUTE 1 Environmental attribute !BSENT Absent 0RESENT Present
0ROBABILITY OF CHOOSING THE FUEL EFFICIENT CAR Proportion choosing the fuel-efficient car
0 n n n Before After Knowledge question timing %NVIRONMENTAL VALUE .%0 2 SCORE CENTERED
and GGR did not differ before versus after participat- adding the mean-centered NEP-R scores as an indepen- ing in the choice task, and regardless of which trans- dent variable, which was also crossed with the other lated attribute was presented. In addition, we observed independent variables. Again, the analysis revealed an the signpost effect within a single choice trial, ruling effect of translated attribute (χ2(1, N 761) 48.14, out a learnt knowledge account. Moreover, the ten- p < 0.0001), no effect of knowledge measure timing dency to choose the efficient car was not determined by (χ2(1, N 761) 2.31, p 0.13), and no interaction the participants’ perceived relationship between AFC between these two variables (χ2(1, N 761) 1.55, p and GGR. Therefore, these observations lend further 0.21). Moreover, there was a significant effect of NEP-R support to our value-activation-and-direction account scores (χ2(1, N 761) 4.52, p 0.03). Importantly, and of the data: individuals possess a collection of knowl- as predicted, there was a significant interaction between edge and values, and different translated attributes translated attribute and NEP-R scores (χ2(1, N 761) can activate and direct otherwise dormant objectives, 15.01, p 0.0002),4 indicating that participants were sig- which only then impact upon choices. nificantly more likely to prefer the efficient car when presented with AFC and GGR compared to AFC and 4. Experiment 3—Boundary Conditions GPM, and this was especially true for those who had a for Signposts relatively high NEP-R score. This pattern is illustrated In our conceptual framework, the signpost effect oper- in Figure5. ates by the following two processes: (1) a translated Finally, there was no correlation between choice and attribute activates some latent objective of the person relatedness (Spearman’s ρ 0.01, p 0.73), which sug- (e.g., a value, goal, etc.), and (2) the translated attribute gests that choices were not influenced by the knowl- directs the people to the option that is most congru- edge that participants possessed regarding the relation ent with the activated objective. This conceptualization between AFC and GGR. predicts several conditions under which a translated attribute should not cause a signpost effect. First, the
Downloaded from informs.org by [128.112.72.171] on 19 May 2017, at 12:21 . For personal use only, all rights reserved. 3.3. Discussion effect should not occur if the objective associated with The observations made in Experiment 2 replicated the the translated attributes is already activated. Recall signpost effect found in Experiment 1: Participants that we expect that presenting the greenhouse gas tended to have a stronger preference for the fuel-effi- rating attribute will cause participants with preexist- cient car when presented with AFC and GGR com- ing proenvironmental values to weight environmental pared to AFC and GPM, especially for those with information more heavily during choice. However, we higher proenvironmental attitudes. Importantly, this would not expect this if, for some reason, the partic- effect cannot be explained by a knowledge account be- ipants were already thinking about how much they cause understanding of the relationship between AFC value the environment. Ungemach et al.: Translated Attributes as Choice Architecture Management Science, Articles in Advance, pp. 1–15, © 2017 INFORMS 9
The second process would not operate if the option existing values, as predicted by our own account, we most congruent with the activated objective were would expect the distribution of environmental atti- already known. This could be possible if participants tudes to be similar across experimental groups and were explicitly taught the relationship between at- stages of the experiment. tributes and, more importantly, the direction of the relationship such that they could independently make 4.1. Methods the translation. For example, participants who have 4.1.1. Participants. Six hundred six American partic- proenvironmental objectives and understand that a ipants (58% female; mean age 31.6; SD 10.8) were high annual fuel cost implies high greenhouse gas recruited through MTurk and paid a flat fee for their emissions could use the first attribute to infer the participation. second and thus act on their objectives in spite of 4.1.2. Design. We employed a 2 (translation: annual the incongruence between the presented translated fuel cost vs. greenhouse gas rating) 2 (tutorial: present attribute (i.e., annual fuel cost) and their activated vs. absent) 2 (order of NEP-R scale:× before choice vs. objectives (i.e., proenvironmental behavior). after choice)× mixed design. The main dependent vari- In Experiment 3, we tested the extent to which both able was whether or not the participant selected the of these mechanisms underlie the signpost effect using fuel-efficient car. the car choice paradigm introduced in Experiments 1 and 2. We activated participants’ environmental values 4.1.3. Materials and Procedure. Participants were ran- (or not) prior to choice by having them fill out an envi- domly assigned to one of the eight conditions and ronmental value questionnaire before (vs. after) choos- presented with the same nine car choices used in ing between the cars. In addition, we educated the Experiment 1. For each choice pair, participants viewed participants (or not) about the direction of the relation- the price of the car and one fuel-efficiency translation ship between the annual fuel cost and environmental (see Online Appendix C). Half of the participants were impact prior to the choice phase through a tutorial. presented with the annual fuel cost, and the other half We predicted that in situations where participants with the greenhouse gas rating. Half of the participants were not reminded of their environmental values completed the NEP-R scale before the choice task, and or not educated about the direction of the relation- the other half completed it after the choice task. In ship between annual fuel cost and the environmental addition, half of the participants watched a brief ani- impact, we would replicate the original signpost effect: mation explicitly describing the direction of the rela- participants’ likelihood of choosing the fuel-efficient tionship between the annual fuel cost and the green- car would be aligned with their environmental val- house gas emissions before the choice task and after the ues when presented with the greenhouse gas rating NEP-R scale (see Online Appendix D). To complete the attribute but not when presented with the annual fuel tutorial, participants had to correctly answer a question cost attribute. In contrast, we predicted that when par- regarding the positive relationship between the two ticipants were reminded of their environmental val- variables. After the nine choices, all participants had to ues or educated about the direction of the relation- answer two manipulation check questions to evaluate ship between annual fuel cost and the environmental whether they had understood the relationship between impact prior to choice, then the signpost effect would annual fuel cost and the greenhouse gas emissions of not be observed: participants’ likelihood of choosing the car. The first question asked participants to rate the fuel-efficient car would be aligned with their envi- how strong the relationship between the annual fuel ronmental values regardless of which attribute was cost and the greenhouse gas emissions of a car is on a presented. five-point scale (“unrelated” to “completely related”). Finally, the measurement of environmental attitudes The second question asked participants to select the before and after the presentation of the translated car with the fewest greenhouse gas emissions out of attributes as part of the design also allowed us to test an a set of four cars described only by their annual fuel alternative explanation for the signpost effect observed cost. Finally, participants provided basic demographic in Experiments 1 and 2, namely, that the translated information. As there were no attention check ques-
Downloaded from informs.org by [128.112.72.171] on 19 May 2017, at 12:21 . For personal use only, all rights reserved. attribute created new environmental values that the tions, the data from all 606 participants were used for participant originally did not possess. If our manip- the subsequent analysis. ulation of presenting environmental attribute transla- tions did indeed create new values, then we would 4.2. Results expect the distribution of environmental values to dif- 4.2.1. Manipulation Check. To assess whether our tu- fer between experimental groups and expect higher torial manipulation was successful in explaining the environmental attitude scores after the decision tasks relationship between annual fuel cost and the green- involving the greenhouse ratings. However, if environ- house gas emissions of a car, we analyzed the perceived mental attribute translations serve only as signposts for relationship strength between these attributes across Ungemach et al.: Translated Attributes as Choice Architecture 10 Management Science, Articles in Advance, pp. 1–15, © 2017 INFORMS
the tutorial conditions. As expected, participants who Figure 6. Percentage of Fuel-Efficient Car Choices in went through the tutorial reported a stronger rela- Experiment 3 as a Function of Environmental Values tionship between a car’s annual fuel cost and its (Centered NEP-R Scores), Type of Fuel-Efficiency Attribute, greenhouse gas emissions (mean 3.94, SD 0.86) Whether the NEP-R Scale Was Presented First or Last, and than participants who did not go through the tutorial Whether a Tutorial Was Presented or Not (mean 3.49, SD 0.84, t 601.6 6.47, p < 0.001). ( ) − .O TUTORIAL 4UTORIAL Participants who went through the tutorial were also more likely to correctly identify the car with the lowest
emissions (85%) than participants who did not (78%, .%0 2
χ (1, N 604) 10.52, p < 0.01). R
We also tested whether the tutorial affected par- SCALE FIRS ticipant’s environmental values by comparing NEP-R scores between conditions. We found no significant differences between NEP-R scores of participants who t went through the tutorial (mean 53.31, SD 9.73) and participants who did not (mean 53.92, SD 9.59, t 603.73 0.77, p 0.44). Similarly, there was no dif- ( )
ference between the NEP-R scores of participants who .%0 answered the NEP-R questions before (mean 53.64, R SD 9.41) and after the choice task (mean 53.60, SD 0ERCENTAGE OF EFFICIENT CHOICES SCALE LAST 9.91, t 602.37 0.05, p 0.963). Finally, there was no ( ) difference between the NEP-R scores of participants who had seen the greenhouse gas rating (mean 54.03, SD 9.61) and participants who had seen the annual fuel cost (mean 53.21, SD 9.70, t 603.99 1.04, ( ) − p 0.3). Thus, there was no evidence for the creation of n n n n n n environmental values as a result of our experimental %NVIRONMENTAL VALUE .%0 2 SCORE CENTERED
manipulations. &UEL