OCTOBER 14-15, 2016 | MIT SAMBERG CONFERENCE CENTER, 50 MEMORIAL DRIVE CONFERENCE ON DIGITAL EXPERIMENTATION @CODECON Hosted by the MIT Initiative on the Digital Economy #CODECON16 Friday, October 14th 8:00am Registration, Breakfast, Opening Remarks (7th Floor) 9:00am Plenary Session 1 (7th Floor) Session Chair: Erik Brynjolfsson (MIT) Estimation and Evaluation of Optimal Policies. Susan Athey (Stanford University) Escaping from Government and Corporate Surveillance. Evidence from the MIT Digital Currency Experiment. Catherine Tucker (MIT) 10:10am Coffee Break (6th Floor) 10:30am Parallel Sessions (6th Floor) A: Education (DR 3+4) B: Methods I (DR 5) Session Chair: Catherine Tucker Session Chair: Susan Athey Big Bad Data: The Case of For-Profit College Ad- Multi-armed Contextual Bandits with Forests. Susan vertising. Avinash Gannamaneni (MIT), Avi Goldfarb Athey (Stanford University), Wenfei Du (Stanford Uni- (University of Toronto), and Catherine Tucker (MIT). versity), and Guido Imbens (Stanford University). Remedying Education with Personalized Learning: Efficient Discovery of Heterogeneous Treatment Evidence from Randomized Field Experiment in Effects in Randomized Experiments via Anomalous India. Anuj Kumar (University of Florida) and Amit Pattern Detection. Edward McFowland III (University Mehra (University of Texas Dallas). of Minnesota), Sriram Somanchi (University of Notre Dame), and Daniel B. Neill (Carnegie Mellon Universi- ty). Private vs. Public Ranking in Online Communities: A Concise Summarization of Heterogeneous Treatment Randomized Field Experiment on MOOCs. Xitong Li Effect Using Total Variation Regularized Regression. (HEC Paris) and Jiayin Zhang (Tsinghua University). Alex Deng (Microsoft), Pengchuan Zhang (California Institute of Technology), Shouyuan Chen (Microsoft), Jiannan Lu (Microsoft), and Dong Woo Kim (Micro- soft). Curiosity Killed the Cat, but Makes Crowdwork Two Stage: A Simple Framework for Finding CATEs. Better. Edith Law (University of Waterloo), Ming Yin George Berry (Facebook and Cornell University), Ana (Harvard University), Joslin Goh (University of Wa- Franco (Facebook and Stanford University), Alex- terloo), Kevin Chen (University of Waterloo), Michael ander Peysakhovich (Facebook), and Sean J. Taylor Terry (University of Waterloo), and Krzysztof Z. Gajos (Facebook). (Harvard University). Planning Prompts Increase Course Completion in Combining Observational and Experimental Data to MOOCs. Michael Yeomans (Harvard University) and Find Heterogeneous Treatment Effects. Alexander Justin Reich (MIT). Peysakhovich (Facebook) and Akos Lada (Facebook). 11:45am Lunch (7th Floor) OCTOBER 14-15, 2016 | MIT SAMBERG CONFERENCE CENTER, 50 MEMORIAL DRIVE CONFERENCE ON DIGITAL EXPERIMENTATION @CODECON #CODECON16 Friday, October 14th 12:45pm Plenary Session 2 (7th Floor) Session Chair: Sinan Aral (MIT) When Randomized Experiments are Plentiful. Dean Eckles (MIT) Insights from Behavioral Economics for Consumer Finance Markets. Antoinette Schoar (MIT) 2:00pm Coffee Break (6th Floor) 2:30pm Parallel Sessions (6th Floor) C: eCommerce (DR 3+4) D: Marketing I (DR 5) Session Chair: Antoinette Schoar Session Chair: Dean Eckles Measuring the Value of Recommendation Links on Omnichannel Marketing: Digital Field Experiments. Product Demand. Anuj Kumar (University of Florida) Xueming Luo (Temple University), Yuchi Zhang (Santa and Kartik Hosanagar (University of Pennsylvania). Clara University), and Fue Zeng (Wuhan University). Improving Online Retail Margins by Increasing Bridging the Gap: Connecting Large-scale Data from Search Frictions. Donald Ngwe (Harvard University) Digital Experimentation to the Physical World. Reka and Thales Teixeira (Harvard University). Daniel-Weiner (Dstillery), Claudia Perlich (Dstillery), and Ori Stitelman (Dstillery). Ecommerce Platforms and International Trade: A The Effect of Product Placement on Shopping Randomized Field Experiment on eBay. Xiang Hui Behavior at the Point of Purchase: Evidence from (MIT). Randomized Experiment Using Video Tracking in a Physical Book Store. Qiwei Han (Carnegie Mellon Uni- versity and Instituto Superior Tecnico), Pedro Ferreira (Carnegie Mellon University), and Joao Paulo Costeira (Instituto Superior Tecnico). The Effect of TV Content on Piracy: Evidence From The Online Display Ad Effectiveness Funnel & Car- a Household Level Randomized Experiment. Miguel ryover: A Meta-study of Predicted Ghost Ad Exper- Godinho de Matos (Catolica-Lisbon), Pedro Ferreira iments. Garrett Johnson (University of Rochester), (Carnegie Mellon University), and Michael D. Smith Randall A. Lewis (Netflix), and Elmar I. Nubbemeyer (Carnegie Mellon University). (Google). Freemium Pricing: A Stylized Framework and Evi- Saving “For Your Baby”: Framing and Priming in dence from a Large-scale Field Experiment. Julian Print-at-Home Coupons. Jura Liaukonyte (Cornell Runge (Humboldt University), Joerg Claussen (Lud- University), Matthew McGranaghan (Cornell Universi- wig-Maximilians-University), and Stefan Wagner (Eu- ty), and Kenneth Wilbur (UC San Diego). ropean School of Management and Technology). 3:45pm Coffee Break (7th Floor) 4:15pm Fireside Panel: The Tyranny of Algorithms? (7th Floor) 5:45pm Reception (7th Floor) 2 OCTOBER 14-15, 2016 | MIT SAMBERG CONFERENCE CENTER, 50 MEMORIAL DRIVE CONFERENCE ON DIGITAL EXPERIMENTATION @CODECON #CODECON16 Saturday, October 15th 8:30am Registration, Breakfast, Opening Remarks (7th Floor) 9:30am Plenary Session 3 (7th Floor) Session Chair: Sandy Pentland (MIT) Machine Learning, Causal Inference, and Estimating Heterogeneous Treatment Effects. Jas Sekhon (UC Berkeley) Machine Learning Choices. Johan Ugander (Stanford University) 10:30am Coffee Break (6th Floor) 10:45am Parallel Sessions (6th Floor) E: Social Networks (DR 3+4) F: Methods II (DR 5) Session Chair: Johan Ugander Session Chair: Jas Sekhon Referral Policies for Optimal Growth: a Randomized Split-door Criterion: Automatic Search for Natu- Experiment. Rodrigo Belo (Erasmus University) and ral Experiments. Amit Sharma (Microsoft), Jake M. Ting Li (Erasmus University). Hofman (Microsoft), and Duncan J. Watts (Microsoft). The Impact of Referral Coupons on Customer Behav- Bayesian Optimization for Large-scale Online Field ior and Firm Revenues: Evidence from Field Exper- Experiments. Eytan Bakshy (Facebook), Konstantin iments. Raghuram Iyengar (University of Pennsylva- Kashin (Facebook), and Benjamin Letham (Face- nia) and Young-Hoon Park (Cornell University). book). Altruism Pays! Towards Optimal Call-to-Action for Representativity and Networked Interference in Online Referral: A Randomized Field Experiment. Rural Field Experiments: A Large-scale RCT in Rural JaeHwuen Jung (University of Minnesota), Ravi Bapna Mexico. Alejandro Noriega (MIT) and Alex Pentland (University of Minnesota), Joseph M. Golden (Collage. (MIT). com), and Tianshu Sun (University of Southern Cali- fornia). What's a Hot-Vote Worth in Online Dating? Evidence Limiting Bias from Test-control Interference in On- from a Randomized Field Experiment. Ravi Bapna line Marketplace Experiments. Dave Holtz (MIT). (University of Minnesota), Jui Ramaprasad (McGill University), and Akhmed Umyarov (University of Min- nesota). Social Influence in Experience vs. Search Goods. Rebar: Predicting Outcomes to Reinforce Online Ex- Shan Huang (MIT), Sinan Aral (MIT), Yu Hu (MIT), and periments. Adam C. Sales (University of Texas), Neil T. Erik Brynjolfsson (MIT). Heffernan (Worcester Polytechnic Institute), and Ben B. Hansen (University of Michigan). 12:00pm Lunch and Poster Slam (7th Floor) 3 OCTOBER 14-15, 2016 | MIT SAMBERG CONFERENCE CENTER, 50 MEMORIAL DRIVE CONFERENCE ON DIGITAL EXPERIMENTATION @CODECON #CODECON16 Saturday, October 15th 1:30pm Parallel Sessions (6th Floor) G: Engagement & UGC (DR 3+4) H: Observational Methods & Natural Experiments (DR 5) Session Chair: Ron Kohavi Session Chair: Edo Airoldi Stimulating User-generated Content via Perfor- The Cost of Solidarity: A Quasi Experiment on the mance Feedback: A Randomized Mobile Field Exper- Effect of Joining a Strike on Community Participa- iment. Yili (Kevin) Hong (Arizona State University), tion in the 2015 reddit Blackout. J. Nathan Matias Bin Gu (Arizona State University), Gordon Burtch (MIT). (University of Minnesota), Ni Huang (Temple Universi- ty), and Chen Liang (Arizona State University). The Dark Side of User Participation - The Effect of Necessary and Probably Sufficient Test for Instru- Calls to Action on Trust and Information Revelation. mental Variables. Amit Sharma (Microsoft). Naama Ilany-Tzur (Tel Aviv University), Lior Zalman- son (NYU), and Gal Oestreicher-Singer (Tel Aviv University). Fostering Public Good Contributions with Symbolic Controlling for Latent Homophily in Social Networks Awards: A Large-scale Field Experiment at Wikipe- through Inferring Latent Locations. Cosma Rohilla dia. Jana Gallus (UCLA). Shalizi (Carnegie Mellon University and the Santa Fe Institute) and Edward McFowland III (University of Minnesota). More Than the Sum of Their Parts: Testing Multiple The Welfare Impact of Consumer Reviews: A Case Modes of Contact in a Twitter Field Experiment. Study of the Hotel Industry. Gregory Lewis (Microsoft Kevin Collins (Analyst Institute), Alexander Coppock and NBER) and Georgios Zervas (Boston University). (Yale University), and Andrew Guess (NYU). Modeling User Engagement in Mobile Content Social Media and Political Donations: Evidence from Consumption with Tapstream Data and Field Exper- Twitter. Maria Petrova (Universitat Pompeu