Advancing Large-Scale Creativity Through Adaptive Inspirations And
Total Page:16
File Type:pdf, Size:1020Kb
View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by ASU Digital Repository Advancing Large-Scale Creativity through Adaptive Inspirations and Research in Context by Victor Augusto da Silva Girotto A Dissertation Presented in Partial Fulfillment of the Requirements for the Degree Doctor of Philosophy Approved December 2018 by the Graduate Supervisory Committee: Erin Walker, Co-Chair Winslow Burleson, Co-Chair Ross Maciejewski Sharon Hsiao Jeffrey Bigham ARIZONA STATE UNIVERSITY May 2019 ABSTRACT An old proverb claims that “two heads are better than one”. Crowdsourcing research and practice have taken this to heart, attempting to show that thousands of heads can be even better. This is not limited to leveraging a crowd’s knowledge, but also their creativity—the ability to generate something not only useful, but also novel. In practice, there are initiatives such as Free and Open Source Software communities developing innovative software. In research, the field of crowdsourced creativity, which attempts to design scalable support mechanisms, is blooming. However, both contexts still present many opportunities for advancement. In this dissertation, I seek to advance both the knowledge of limitations in current technologies used in practice as well as the mechanisms that can be used for large-scale support. The overall research question I explore is: “How can we support large-scale creative collaboration in distributed online communities?” I first advance existing support techniques by evaluating the impact of active support in brainstorming performance. Furthermore, I leverage existing theoretical models of individual idea generation as well as recommender system techniques to design CrowdMuse, a novel adaptive large-scale idea generation system. CrowdMuse models users in order to adapt itself to each individual. I evaluate the system’s efficacy through two large-scale studies. I also advance knowledge of current large-scale practices by examining common communication channels under the lens of Creativity Support Tools, yielding a list of creativity bottlenecks brought about by the affordances of these channels. Finally, I connect both ends of this dissertation by deploying CrowdMuse in an Open Source online i community for two weeks. I evaluate their usage of the system as well as its perceived benefits and issues compared to traditional communication tools. This dissertation makes the following contributions to the field of large-scale creativity: 1) the design and evaluation of a first-of-its-kind adaptive brainstorming system; 2) the evaluation of the effects of active inspirations compared to simple idea exposure; 3) the development and application of a set of creativity support design heuristics to uncover creativity bottlenecks; and 4) an exploration of large-scale brainstorming systems’ usefulness to online communities. ii ACKNOWLEDGMENTS I am forever in debt to both of my advisors, Winslow Burleson and Erin Walker, for their guidance, expertise, and patience throughout this long academic journey. Win opened the doors for me. Without his support, I would not have stayed at ASU to pursue my doctorate. It was also through his lectures and multidisciplinary work that I learned about the exciting field of creativity. Erin kept me moving. Without her precise feedback, my research would have crumbled. Many of the findings described here were only possible because she correctly encouraged me to persist at the analysis. I am also grateful to my committee members, Ross Maciejewski, Sharon Hsiao, and Jeffrey Bigham. I must also thank my colleagues at the 2 Sigma Learning lab, Nichola Lubold, Shang Wang, and Ishrat Ahmed, for kindly sharing their knowledge and time, as well as breaking my systems before study participants did. I must also thank Rachana Rao, Deniz Sonmez, Sameena Hossain, and John Frens for their help with data analysis and coding. Finally, I am grateful to Cecil Lozano and Kasia Muldner, who were strong positive influences during the early years of my doctorate. I would not be writing these words if it were not for my wife Miriam, who gave me the love and encouragement to persist after every failed experiment. I am also thankful for the support received from my family—my mother Claudia and stepfather Ira, my father Guilherme and stepmother Noemi, my brother Gustavo, and grandparents Eser, Leila, Adamor, and especially Eurides, my academic role-model. I must also thank Jadiel de Armas for his friendship and advices that made this doctorate possible. iii TABLE OF CONTENTS Page LIST OF TABLES ................................................................................................................. vii LIST OF FIGURES .............................................................................................................. viii CHAPTER 1 INTRODUCTION ................................................................................................... 1 Research Problem ........................................................................................ 6 Contributions ................................................................................................... 7 2 BACKGROUND WORK .................................................................................. 12 Creativity ................................................................................................... 12 Large-Scale Creativity ............................................................................... 28 Conclusion ..................................................................................................... 36 3 BOTTLENECKS IN CURRENT COMMUNICATION CHANNELS ............. 37 FOSS Communication Channels ............................................................... 39 CST Design Heuristics .................................................................................. 43 Method ........................................................................................................... 49 Results ........................................................................................................... 52 Discussion ...................................................................................................... 61 Limitations ..................................................................................................... 63 Conclusion ..................................................................................................... 65 4 IMPROVING INSPIRATION EFFECT THROUGH MICROTASKS ............. 67 The System ................................................................................................ 69 iv CHAPTER Page Metrics ........................................................................................................... 72 Experiment 1: Rating Task ........................................................................ 75 Experiment 2a & 2b: Similarity Choice Task ............................................ 78 Experiment 3: Comparison Across Task Types ......................................... 85 Discussion ...................................................................................................... 88 Conclusion ..................................................................................................... 93 5 CROWDMUSE: SUPPORTING BRAINSTORMING THROUGH MODELING AND ADAPTATION .................................................................... 95 The CrowdMuse System ........................................................................... 97 Study 1 .................................................................................................... 108 Study 2 .................................................................................................... 116 Revisiting the Categorization Scheme ..................................................... 119 Discussion .................................................................................................... 121 Limitations & Future Work ..................................................................... 123 Conclusion ................................................................................................... 126 6 DEPLOYING CROWDMUSE IN AN ONLINE COMMUNITY ................... 127 Deployment Community: FreeCAD ........................................................... 130 Method ......................................................................................................... 131 Results ......................................................................................................... 133 Discussion .................................................................................................... 144 Limitations ................................................................................................... 148 Conclusion ................................................................................................... 150 v CHAPTER Page 7 FINAL DISCUSSION ........................................................................................ 151 Discussion ....................................................................................................154 Limitations ...................................................................................................165 Future Work ............................................................................................166 Conclusion ...................................................................................................169 REFERENCES .....................................................................................................................170