Judgment and Decision Making, Vol. 6, No. 5, July 2011, pp. 359–380 Recognition-based judgments and decisions: What we have learned (so far) Julian N. Marewski∗ Rüdiger F. Pohl† Oliver Vitouch‡ Abstract This special issue on recognition processes in inferential decision making represents an adversarial collaboration among the three guest editors. This introductory article to the special issue’s third and final part comes in three sections. In Section 1, we summarize the six papers that appear in this part. In Section 2, we give a wrap-up of the lessons learned. Specifically, we discuss (i) why studying the recognition heuristic has led to so much controversy, making it difficult to settle on mutually accepted empirically grounded assumptions, (ii) whether the development of the recognition heuristic and its theoretical descriptions could explain some of the past controversies and misconceptions, (iii) how additional cue knowledge about unrecognized objects could enter the decision process, (iv) why recognition heuristic theory should be complemented by a probabilistic model of strategy selection, and (v) how recognition information might be related to other information, especially when considering real-world applications. In Section 3, we present an outlook on the thorny but fruitful road to cumulative theory integration. Future research on recognition-based inferences should (i) con- verge on overcoming past controversies, taking an integrative approach to theory building, and considering theories and findings from neighboring fields (such as marketing science and artificial intelligence), (ii) build detailed computational process models of decision strategies, grounded in cognitive architectures, (iii) test existing models of such strategies competitively, (iv) design computational models of the mechanisms of strategy selection, and (v) effectively extend its scope to decision making in the wild, outside controlled laboratory situations. Keywords: adversarial collaboration, recognition heuristic, special issue. So much the worse for the facts! PhD thesis De orbitis planetarum (1801) being - Georg Wilhelm Friedrich Hegel (attrib.), not in line with the facts when confronted with the central theory of his Mind, not space, is science’s final frontier. In closing, the three of us want to express our gratitude to all the - John Horgan (1996, p. 159) contributing authors of this triple special issue, and especially to Judg- ment and Decision Making’s editor-in-chief, Jonathan Baron, for his [Vicky:] I’m not going to Oviedo. First off, I wise, patient, and fair guidance from start to finish. Without Jon’s ef- never heard of Oviedo. I don’t find him win- forts it would not have been possible to compile this special issue. We ning. Third, even if I wasn’t engaged and also want to thank the following colleagues for providing manuscript reviews, greatly contributing to the project’s overall success: C. Athena was free to have some kind of dalliance with Aktipis, Jonathan Baron, William H. Batchelder, Manel Baucells, Arndt a Spaniard, I wouldn’t pick this one. Bröder, Colin F. Camerer, Jason Dana, Clintin P. Davis-Stober, Michael - Woody Allen & Letty Aronson (2008) R. P. Dougherty, Edgar Erdfelder, Ido Erev, Wolfgang Gaissmaier, An- dreas Glöckner, Daniel G. Goldstein, Hauke Heekeren, Ralph Her- twig, Benjamin E. Hilbig, Ulrich Hoffrage, Robin M. Hogarth, Na- The compilation of this special issue on recognition- talia Karelaia, Konstantinos V. Katsikopoulos, Damian Läge, Rui Mata, based decisions represents an adversarial collaboration Ben R. Newell, Robert M. Nosofsky, Christopher Olivola, Henrik Ols- among the three guest editors. At the beginning of this son, Thorsten Pachur, Timothy J. Pleskac, Markus Raab, Sascha Serwe, editorial to Part III of the special issue, a comment is Thomas S. Wallsten, Warren Waren, Anders Winman, Gal Zauberman, and six more reviewers who remain anonymous to the guest editors. All warranted. The editorial consists of three sections, with reviewers are acknowledged in the journal’s annual reports. Rüdiger Pohl serving as the lead author for Section 1, Finally, a loving thank you is due to our families, for bearing a lot Oliver Vitouch for Section 2, and Julian Marewski for these years (2009–2011). Section 3. While we have commented on each other’s ∗Max Planck Institute for Human Development, Berlin, Germany. Julian Marewski is now at the University of Lausanne, Switzerland, sections and, where needed, striven to formulate a text Faculty of Business and Economics, Dept. of Organizational Behavior. that represents a compromise between our positions, in Address: Université de Lausanne, Quartier UNIL-Dorigny, Bâtiment some cases, we have not succeeded to achieve compro- Internef, 1015 Lausanne. Email: [email protected]. mises, and therefore have agreed to disagree. As a result, †University of Mannheim, Germany. Email: pohl@psychologie. uni-mannheim.de. the three sections are still firstly and foremostly written ‡University of Klagenfurt, Austria. Email: [email protected]. from the perspective of the respective lead author, who 359 Judgment and Decision Making, Vol. 6, No. 5, July 2011 What we have learned (so far) 360 takes full responsibility for the section’s text. We have de- Table 1: Topical categories of the special issue’s articles. cided to spare the readers from working their way through a myriad of footnotes, signalling our points of discord; Tests of the recognition heuristic and tests of theory ex- rather we challenge the so inclined to scent out the para- tensions graphs still smoldering. Ayton, Önkal, & McReynolds (2011) — Influence of con- flicting information 1 Introduction [Rüdiger F. Pohl] Erdfelder, Küpper-Tetzel, & Mattern (2011) — Recogni- tion memory states When we released our call for papers, we did not antici- Gaissmaier & Marewski (2011) — Use of recognition in pate such an overwhelming response. What was initially forecasting planned as one special issue turned into a three-part issue Gigerenzer & Goldstein (2011) — Clarification and ex- with eight articles in Vol. 5 (4), seven in Vol. 6 (1), and tension of the recognition heuristic six in Vol. 6 (5) of Judgment and Decision Making. Sev- Glöckner & Bröder (2011) — Strategy classification eral more submitted manuscripts were rejected or with- method drawn. Table 1 provides an overview of the published Herzog & Hertwig (2011) — Recognition of crowds in papers, not in the order in which they appeared, but in a forecasting topical order trying to sort them according to their main Hilbig, Scholl, & Pohl (2010) — Effort-reduction feature focus. Sorting papers into that order was easy for some, of using the recognition heuristic but more difficult for others that actually relate to more Hochman, Ayal, & Glöckner (2010) — Arousal in infor- than one topic. We nevertheless put all papers into one mation integration category each, in order to keep the overview simple. Hoffrage (2011) — Discovery and first test of the recog- Those articles from Table 1 that appeared in Parts I nition heuristic and II of the special issue were already introduced there Oeusoonthornwattana & Shanks (2010) — Recognition (Marewski, Pohl, & Vitouch, 2010, 2011). In the remain- in preference judgments der of this section, we describe the six new papers in Part III. The less-is-more effect Ayton et al. (2011) apply the recognition heuristic to Beaman, Smith, Frosch, & McCloy (2010) — Extension the study of forecasts (see also, e.g., Herzog & Hertwig, of the less-is-more effect to knowledge-driven infer- 2011; Pachur & Biele, 2007), specifically to the forecast- ences ing of soccer match results. Their first experiment (which Davis-Stober, Dana, & Budescu (2010) — Mathematical is a classic one, as it is already cited as an unpublished foundation of optimal one-reason decision strategies manuscript in Goldstein & Gigerenzer, 1999, 2002) com- Katsikopoulos (2010) — Conditions and methodological pares the forecasting behavior of British and Turkish stu- problems of finding the less-is-more effect dents on the results of British soccer matches. The results Smithson (2010) — Generalization of the less-is-more ef- showed that both samples predicted the outcomes almost fect to new conditions equally well, suggesting that the Turkish students who were less familiar with the British soccer teams could ex- Methodological challenges ploit their valid recognition knowledge to improve their Hilbig (2010a) — Measures of using the recognition predictions. After making their predictions, the Turkish heuristic students received the half-time scores and were asked to make new predictions. This manipulation leads to a sit- Tomlinson, Marewski, & Dougherty (2011) — Method- uation that deviates from what Goldstein and Gigerenzer ological challenges (e.g., 1999, 2002) considered the proper domain of the Comments and discussions recognition heuristic. Cue values are given—and not re- trieved from memory—and the half-time scores also pro- Goldstein & Gigerenzer (2011) — Fruitful avenues and vide information about unrecognized teams. Ayton et al. misunderstandings report that knowing the half-time score affected a sub- Hauser (2011) — Marketing science perspective stantial number of participants’ predictions, even in cases B. R. Newell (2011) — Status of the recognition heuristic where only one of the teams was recognized. Pachur (2011) — Measures and recognition processes In their second experiment, Ayton et al. (2011) asked Pohl (2011) — Summary of the debate surrounding the British students