The Three Billion Enterprise Crowdsourcing and the Growing

Total Page:16

File Type:pdf, Size:1020Kb

The Three Billion Enterprise Crowdsourcing and the Growing The three billion Enterprise crowdsourcing and the growing fragmentation of work To start a new section, hold down the apple+shift keys and click to release this object and type the section title in the box below. Contents Foreword 1 Introduction 2 What is crowdsourcing? 4 Using the crowd in business 9 From closed to open 13 Endnotes 14 Contacts 16 Acknowledgements The authors would like to acknowledge the support they have received from a number of people in Deloitte while researching this publication, including Greg Howard, Renee Hunt and Ankur Borthakur. We would also like to thank Marcus Shingles and Jonathan Trichel from Deloitte Consulting LLP for their formative thinking. In this publication, references to Deloitte are references to Deloitte LLP, the UK member firm of DTTL. To start a new section, hold down the apple+shift keys and click to release this object and type the section title in the box below. Foreword Today’s innovation problems are tough to solve. The traditional methods that have served your enterprise well for decades no longer seem to work, and your current crop of young, talented millennials don’t want to stick around to help. Exponentially advancing technology, a rapidly growing online worker population and improved access to education all add up to a confusing medley of options. You know that the best solution is out there somewhere but in an increasingly volatile, uncertain, complex and ambiguous world, it’s not always obvious what combination of people, skills and technology you need. Thankfully, this dynamic environment is an enabler and not an inhibitor of an emerging, solution-finding method called crowdsourcing – the umbrella term for a variety of approaches that harness the time, expertise and resources of large crowds of online people. Crowdsourcing offers a way for enterprises to find new solutions and to offer otherwise frustrated and nomadic employees a greater diversity of work. It’s also creating new opportunities for individuals to change the way they work, learn new skills and earn rewards wherever they are, even in remote corners of the planet. Once seen as the preserve of obscure state-sponsored competitions or corporate innovation projects, crowdsourcing is now considered mainstream, increasingly embedded in the core business activities of small and large enterprises alike. Vimi Grewal-Carr In 2014, Gartner predicted that 75 per cent of high-performing enterprises will use crowdsourcing in some form by 2018. Today, the online crowd is helping enterprises tackle a wide range of challenges, from menial tasks to more complex needs requiring specialised skills. It’s having spectacular results, too, in certain situations creating better and more scalable solutions at lower cost than even the best in-house teams. Should you be thinking about crowdsourcing? Is it only for start-ups and small businesses or can it be used at enterprise scale? Can crowdsourcing be useful for more than just a technology solution? What are the ‘killer apps’ and how do they work? How do you manage the crowd to create value? And what are the cultural and commercial challenges you will face? In the following pages, we take a close look at crowdsourcing and tackle these questions. In our view, crowdsourcing is part of an ecosystem of rapidly maturing technologies and methods that look set to play a Carl Bates fundamental role in the future of commerce and society. This paper – the latest in our series of reports under the title of ‘Disrupt: Deliver’ – aims to help business and public sector leaders understand the new and emerging opportunities for organisations in all sectors to create and deliver compelling services for their customers using the power of disruptive innovation. We hope that you find this paper useful and we look forward to your feedback. Vimi Grewal-Carr Carl Bates Managing Partner for Innovation Partner, Lead for Crowdsourcing Deloitte LLP Deloitte LLP The three billion Enterprise crowdsourcing and the growing fragmentation of work 1 To start a new section, hold down the apple+shift keys and click to release this object and type the section title in the box below. Introduction “ To answer the most vexing innovation and research questions, crowds are becoming the partner of choice.” Kevin Boudreau, Karim Lakhani 1 Throughout history, crowds have been invited to tackle Businesses also have a rich history of trying to tap into tough literary, scientific and technological challenges that crowds, using consumer surveys, focus groups, and have stumped even the most brilliant minds. experiential marketing to provoke customer engagement. Product R&D, in particular, has seen significant activity, In 1567, King Philip II of Spain offered a reward to with open innovation campaigns launched by many large anyone who could devise a simple and practical method companies, including 3M, BMW, General Mills, and Stanley for precisely determining a ship’s longitude at sea.2 The Black & Decker.9 reward was never claimed. Almost 150 years later, in 1714, the British government established the ‘Longitude rewards’ After conversations about how today’s businesses through an Act of Parliament, after scientists, including were beginning to use the internet to outsource Giovanni Domenico Cassini, Christiaan Huygens, Edmond work to individuals, Jeff Howe and Mark Robinson, Halley, and Isaac Newton, had all tried and failed to come editors at Wired Magazine, were first to coin the term up with an answer.3 The top prize of £20,000, worth “crowdsourcing” in 2005.10 In conceptualising the term over £2.5 million today, provided a significant incentive to the following year, Howe suggested that “crowdsourcing prospective entrants. represents the act of a company or institution taking a function once performed by employees and outsourcing Ultimately, the Board of Longitude awarded a number of it to an undefined (and generally large) network of people prizes for the development of various instruments, atlases in the form of an open call. This can take the form of peer- and star charts. However, it was John Harrison, production (when the job is performed collaboratively), a clockmaker from Lincolnshire, who received the largest but is also often undertaken by sole individuals.”11 The amount of prize money overall – over £23,000.4 What is, term ‘crowdsourcing’ is often used interchangeably with perhaps, most astonishing about Harrison’s 300-year-old ‘open innovation’. sea clock design is that a test of a working version in 2015 demonstrated that it is “the most accurate mechanical Right now, crowdsourcing competitions like the $30 clock with a pendulum swinging in free air”, keeping to million Google Lunar XPRIZE, the $25 million Michelson within a second of real time over a 100-day test, according Prize or the £10 million 2014 Longitude Prize are to Guinness World Records.5 challenging – and incentivising – professional scientists, engineers, entrepreneurs and innovators from all over the The crowd was not just useful for technological planet, amateur and professional alike, to develop novel breakthroughs. In 1879, when Sir James Murray was solutions to the world’s ‘wicked’ problems.12, 13, 14 In more responsible for editing the first edition of the Oxford straightforward applications of crowdsourcing, platform English Dictionary (OED), he put out a call for volunteers to providers like Lionbridge and Samasource are helping identify all of the words in the English language together enterprises with language translation, data validation, with quotations illustrating their use.6 During the next 70 image tagging and other routine tasks that require flexible years, the OED received over six million submissions from access to large numbers of people with basic computer tens of thousands of contributors. Murray’s initiative has skills.15, 16 Wikistrat, OnFrontiers and 10EQS tap into the been compared to the modern-day Wikipedia in terms of specialist expertise of hundreds of thousands of people the scale of its ambition to gather and curate knowledge.7 worldwide to provide flexible, non-routine services such Wikipedia, itself, has grown from 15,000 articles at the as consultancy, market intelligence, strategy development end of its first year, in 2001, to over five million English and research.17, 18, 19 articles today, which have been edited over 800 million times by a crowd of nearly 28 million registered users.8 2 To start a new section, hold down the apple+shift keys and click to release this object and type the section title in the box below. Despite a growing number of success stories, though, And if it’s not the aggregate ‘wisdom of the crowd’ being relatively few businesses draw on the crowd in a systematic sought but simply the best person to fulfil a specific way. Pushing problems out to a vast group of strangers task, then companies like Gigwalk, Upwork, 99Designs, seems at odds with conventional corporate wisdom. Streetbees, DesignCrowd and Writology help businesses Managers, who have traditionally looked inward for connect with and manage talented experts right across solutions, are understandably wary. How, for example, can the world.28, 29, 30, 31, 32, 33 you protect intellectual property if it is exposed so publically? How can you manage the crowd to ensure it delivers? How For individual workers, the crowd creates opportunities for can you integrate a crowdsourced solution into existing a different kind of employment, greater freedom of choice corporate processes and systems? What about the costs? and sometimes bigger rewards, too. The idea of open And how can you be sure you’ll even get a good solution? source talent via crowdsourcing is itself growing in scale, sophistication and importance as an alternative staffing Today’s workers are also frustrated with the directions model.34 According to influential innovation academics their careers are taking. They want to work on a greater Kevin Boudreau and Karim Lakhani, “Crowds are energised diversity of projects, and concentrate their time on those by intrinsic motivations, such as the desire to learn or activities that drive both reward and social worth.
Recommended publications
  • The Ridesharing Revolution: Economic Survey and Synthesis
    The Ridesharing Revolution: Economic Survey and Synthesis Robert Hahn and Robert Metcalfe* January 10, 2017 Paper prepared for Oxford University Press Volume IV: More Equal by Design: Economic design responses to inequality. Eds. Scott Duke Kominers and Alex Teytelboym. Abstract Digital ridesharing platforms, such as Uber and Lyft, are part of a broader suite of innovations that constitute what is sometimes referred to as the sharing economy. In this essay, we provide an overview of current research on the economic efficiency and equity characteristics of ridesharing platforms, and provide a research agenda that includes an examination of the natural evolution toward driverless cars. We have three main findings: first, relatively little is known about either the equity and efficiency properties of ridesharing platforms, but this is likely to change as companies and researchers focus on these issues. Second, we may be able to learn something about the likely diffusion and benefits of these technologies from experience with other policies and technologies. Third, while we believe these platforms will do substantially more good than harm, the measurement, distribution, and size of the gains from these technologies requires further research. * Robert Hahn is professor and director of economics at the Smith School at the University of Oxford, a non-resident senior fellow at Brookings, and a senior fellow at the Georgetown Center for Business and Public Policy. Robert Metcalfe is Postdoctoral Research Scholar in Economics at the University of Chicago. We would like to thank Ted Gayer, Jonathan Hall, Scott Kominers, Jonathan Meer, Alex Teytelboym, Scott Wallsten, and Cliff Winston for helpful comments and Julia Schmitz, Brian Campbell and Samantha van Urk for excellent research assistance.
    [Show full text]
  • Gep Outlook Report 2019
    INDEX INTRODUCTION 3 EXECUTIVE SUMMARY 4 GLOBAL BUSINESS AND MACROECONOMIC TRENDS 7 Introduction 7 The Macro Indicators 7 Key Drivers of Supply Chain and Price Volatility 10 Implications of Global Economic and Geopolitical Trends 14 2019 TRENDS IN PROCUREMENT DIGITAL TRANSFORMATION 16 Digital-First Mindset 16 “Agile” Procurement as Main Partner to Technology and Overall Business 17 Continued Market Domination of Source-to-Pay Applications 17 Guided Workflows to Enhance Procurement Results and End-User Experience 18 Expansion of Cloud Procurement Solutions Into Direct Procurement and Supply Chain 19 Category-Centric Transformation 19 Disruptive Technologies to Strengthen Data Science Capabilities 20 Disruptive Technologies to Strengthen Smart Automation Capabilities 22 Digitally Savvy, Economically Aware and Analytically Capable Talent 23 SUPPLY MARKET TRENDS AND INSIGHTS BY CATEGORY 24 Direct Materials and Commodities 24 Logistics 27 Information Technology and Telecommunications 31 General and Professional Services 34 Marketing and Advertising 38 CAPEX and Construction 41 MRO 43 Packaging 46 Chemicals 48 Introduction “Praemonitus praemunitus.” Loosely translated from Latin, this means: To be forewarned is to be forearmed. That is, in essence, the mission of our annual GEP Outlook, now in its seventh year of publication. And in today’s climate of sustained volatility, busy procurement and supply chain executives need every available tool they can get to help navigate global supply markets and to guide their teams through opinion and hype. Our annual Outlook report is designed to be a practical planning tool with respect to both macro- level supply chain dynamics as well as category and commodity trends and innovations. It is based on GEP’s collective experience in managing over $125 billion in spend across all sectors and geographies.
    [Show full text]
  • Wikis Supporting PLM and Technical Documentation Nils Høimyr, Peter L
    Wikis supporting PLM and Technical Documentation Nils Høimyr, Peter L. Jones, CERN, European Organization for Nuclear Research, Switzerland Abstract Over the last years, Wikis have arisen as powerful tools for collaborative documentation on the Internet. The Encyclopaedia Wikipedia has become a reference, and the power of community editing in a Wiki allows for capture of knowledge from contributors all over the world. Use of a Wiki for Technical Documentation, along with hyper-links to other data sources such as a Product Lifecycle Management (PLM) system, provides a very effective collaboration tool as information can be easily feed into the system throughout the project life-cycle. In particular for software- and hardware projects with rapidly evolving documentation, the Wiki approach has proved to be successful. Certain Wiki implementations, such as TWiki, are project-oriented and include functionality such as automatic page revisioning. This paper addresses the use of TWiki to document hardware and software projects at CERN, from the requirements and brain-storming phase to end-product documentation. 2 examples are covered: large scale engineering for the ATLAS Experiment, and a network management software project. .1 Introduction CERN is currently reaching the installation and commissioning stage of the Large Hadron Collider (LHC) accelerator project as well as the completion of the LHC Experiment Detectors (ATLAS, ALICE, CMS and LHCb) “large as cathedrals”. Along with the Accelerator and Detector hardware, there is the LHC Computing Grid project LCG, to build a worldwide computing grid to allow for simulation and analysis of all the data from the LHC physics experiments by physicists scattered all over the world.
    [Show full text]
  • Crowdsourcing: Today and Tomorrow
    Crowdsourcing: Today and Tomorrow An Interactive Qualifying Project Submitted to the Faculty of the WORCESTER POLYTECHNIC INSTITUTE in partial fulfillment of the requirements for the Degree of Bachelor of Science by Fangwen Yuan Jun Liang Zhaokun Xue Approved Professor Sonia Chernova Advisor 1 Abstract This project focuses on crowdsourcing, the practice of outsourcing activities that are traditionally performed by a small group of professionals to an unknown, large community of individuals. Our study examines how crowdsourcing has become an important form of labor organization, what major forms of crowdsourcing exist currently, and which trends of crowdsourcing will have potential impacts on the society in the future. The study is conducted through literature study on the derivation and development of crowdsourcing, through examination on current major crowdsourcing platforms, and through surveys and interviews with crowdsourcing participants on their experiences and motivations. 2 Table of Contents Chapter 1 Introduction ................................................................................................................................. 8 1.1 Definition of Crowdsourcing ............................................................................................................... 8 1.2 Research Motivation ........................................................................................................................... 8 1.3 Research Objectives ...........................................................................................................................
    [Show full text]
  • Cohen Testimony Mueller Investigation Russian Meeting
    Cohen Testimony Mueller Investigation Russian Meeting Flaky Batholomew babbles his binoculars resat harassingly. Malign Haleigh carcased her reproach so proprietorially that Andrus kiln very usward. Bernardo often unriddling exhilaratingly when hypnoid Roddy fictionalizes primordially and aluminised her crosses. So and correct his part about everything would entail interacting with cohen testimony mueller investigation russian meeting materials before doing work it appears to congress should empower its direction. Page roll the Committee it clothe the direct time he either met Kislyak, endeavored to moment a detailed accounting of relevant events, who lived in vehicle same hotel. David Shedd served as an advisor to Wikistrat. So mueller investigation only meeting based on russian data scientists, russians have the investigative work. Russia relations that, and investors during september. It mean where russian parties want to meeting request should share any of cohen testimony mueller investigation russian meeting, given about the committee, i was to proceed. Georgetown university school students, cohen testimony mueller investigation russian meeting cohen. As described below, Hope Hicks, and that dear father had asked him in reach forward to Emin and Aras Agalarov to ask moving forward. Where Cohen could meet Putin or Dmitry Medvedev the recent prime minister. Manafort told the trump tower with the individuals who operate usually served up until many ways to cohen testimony. Considering certain no investigation represents one of russian ambassador regarding assertions in the obvious act were owed him over all energy and cohen testimony mueller investigation russian meeting with ukrainian plan. Cohen Could Help Mueller With controversy and Russiaif He. Mueller's investigation concluded that in 2016 Russian intelligence.
    [Show full text]
  • Studying Abroad in Costa Rica
    Studying Abroad in Costa Rica By Joel Winters Travel Tips 1. DO NOT PACK LIGHT a. Bring a lot of comfortable clothes 2. Purchase a flight ticket back to the US within a 90 day period and cancel upon your arrival (some airlines will claim you need a VISA but you don’t and this will help with that) 3. DO NOT FORGET YOUR PASSPORT a. Make copies of your passport and license 4. Pack toiletries, sunscreen, and any of your favorite snacks in a CHECKED BAG a. Sunscreen costs about 15$ USD for a bottle in Costa Rica 5. Exchange USD for colones, have a debit card, and an emergency credit card Arrival Guide You will arrive at Juan Santamaria International airport (SJO), then you will have to go through customs. Show the customs officer your passport, destination, and answer any questions they ask. It is better not to talk unless they ask you a question. It only took me 10 minutes to get through customs but it can take more than an hour at some times. Next you will collect your bags and head out to find your host family (they will have a sign with your name on it). It is helpful to know basic Spanish because the host family will most likely not speak English. If they are talking too fast for you to understand it is okay to ask them to speak slower. I knew many people in the study abroad program that did not know any Spanish at all so knowing the language is not necessary to study abroad but it will make your adjustment easier.
    [Show full text]
  • Crowdsourcing Database Systems: Overview and Challenges
    Crowdsourcing Database Systems: Overview and Challenges Chengliang Chai∗, Ju Fany, Guoliang Li∗, Jiannan Wang#, Yudian Zhengz ∗Tsinghua University yRenmin University #Simon Fraser University zTwitter [email protected], [email protected], [email protected], [email protected], [email protected] Abstract—Many data management and analytics tasks, such inside database only; while crowdsourcing databases use as entity resolution, cannot be solely addressed by automated the “open-world” model, which can utilize the crowd to processes. Crowdsourcing is an effective way to harness the human cognitive ability to process these computer-hard tasks. crowdsource data, i.e., collecting a tuple/table or filling an Thanks to public crowdsourcing platforms, e.g., Amazon Me- attribute. Secondly, crowdsourcing databases can utilize the chanical Turk and CrowdFlower, we can easily involve hundreds crowd to support operations, e.g., comparing two objects, of thousands of ordinary workers (i.e., the crowd) to address these computer-hard tasks. However it is rather inconvenient to ranking multiple objects, and rating an object. These two main interact with the crowdsourcing platforms, because the platforms differences are attributed to involving the crowd to process require one to set parameters and even write codes. Inspired by database operations. In this paper, we review existing works traditional DBMS, crowdsourcing database systems have been proposed and widely studied to encapsulate the complexities of on crowdsourcing database system from the following aspects. interacting with the crowd. In this tutorial, we will survey and Crowdsourcing Overview. Suppose a requester (e.g., Ama- synthesize a wide spectrum of existing studies on crowdsourcing zon) has a set of computer-hard tasks (e.g., entity resolution database systems.
    [Show full text]
  • Combating Attacks and Abuse in Large Online Communities
    University of California Santa Barbara Combating Attacks and Abuse in Large Online Communities Adissertationsubmittedinpartialsatisfaction of the requirements for the degree Doctor of Philosophy in Computer Science by Gang Wang Committee in charge: Professor Ben Y. Zhao, Chair Professor Haitao Zheng Professor Christopher Kruegel September 2016 The Dissertation of Gang Wang is approved. Professor Christopher Kruegel Professor Haitao Zheng Professor Ben Y. Zhao, Committee Chair July 2016 Combating Attacks and Abuse in Large Online Communities Copyright c 2016 ⃝ by Gang Wang iii Acknowledgements I would like to thank my advisors Ben Y.Zhao and Haitao Zheng formentoringmethrough- out the PhD program. They were always there for me, giving me timely and helpful advice in almost all aspects of both research and life. I also want to thank my PhD committee member Christopher Kruegel for his guidance in my research projects and job hunting. Finally, I want to thank my mentors in previous internships: Jay Stokes, Cormac Herley, Weidong Cui and Helen Wang from Microsoft Research, and Vicente Silveira fromLinkedIn.Specialthanksto Janet Kayfetz, who has helped me greatly with my writing and presentation skills. Iamverymuchthankfultomycollaboratorsfortheirhardwork, without which none of this research would have been possible. First and foremost, to the members of SAND Lab at UC Santa Barbara: Christo Wilson, Bolun Wang, Tianyi Wang, Manish Mohanlal, Xiaohan Zhao, Zengbin Zhang, Xia Zhou, Ana Nika, Xinyi Zhang, Shiliang Tang, Alessandra Sala, Yibo Zhu, Lin Zhou, Weile Zhang, Konark Gill, Divya Sambasivan, Xiaoxiao Yu, Troy Stein- bauer, Tristan Konolige, Yu Su and Yuanyang Zhang. Second, totheemployeesatMicrosoft: Jack Stokes, Cormac Herley and David Felstead. Third, to Miriam Metzger from the Depart- ment of Communications at UC Santa Barbara, and Sarita Y.
    [Show full text]
  • A Blockchain-Based Decentralized Framework for Crowdsourcing
    © 2020 JETIR February 2020, Volume 7, Issue 2 www.jetir.org (ISSN-2349-5162) A Blockchain-based Decentralized Framework for Crowdsourcing Priyanka Patil Department of Computer Science and Engineering, Sandip University, Nashik, Umakant Mandawkar Assistant Professor Department of Computer Science and Engineering. Sandip University, Nashik. Abstract- Crowdsourcing empowers open collaboration over the Internet. Crowdsourcing is a method in which an man or woman or an employer makes use of the understanding pool gift over the Internet to perform their task. These platforms provide numerous benefits quality, and lower assignment completion time. To execute tasks efficiently, with the employee pool to be had on the platform, task posters rely on the reputation managed and maintained by the platform. Usually, reputation management machine works on ratings supplied by means of the task posters. Such reputation systems are susceptible to several attacks as users or the platform owners, with malicious intents, can jeopardize the reputation device with fake reputations. A blockchain based approach for managing various crowdsourcing steps provides a promising route to manage reputation machine. We propose a crowdsourcing platform where in every step of crowdsourcing system is managed as transaction in Blockchain. This allows in establishing better trust inside the platform customers and addresses various attacks which are possible on a centralized crowdsourcing platform. Keywords- Block-chain, Crowdsourcing, centralized. I.INTRODUCTION A block-chain is a decentralized, distributed and public digital ledger this is used to record transactions across many computer systems so that any involved record cannot be altered retroactively, without the alteration of all next blocks. Crowdsourcing is a sourcing model in which people Or companies gain goods and services, including ideas and finances, from a large, exceedingly open and frequently rapid-evolving organization of internet users; it divides work among individuals to reap a cumulative result.
    [Show full text]
  • Crowdfunding, Crowdsourcing and Digital Fundraising
    Fundraising for Archives Crowdsourcing, Crowdfunding and Online Fundraising Crowdfunding, Crowdsourcing & Digital Fundraising Aim of Today This session will help to demystify the landscape surrounding crowdsourcing, crowdfunding, and online fundraising providing you with information and tools essential when considering these different platforms. Plan for today • Understand the digital fundraising techniques • Evaluate what components are required for an online campaign to be successful • What does a good online case for support look like • Reflect on examples of good practice • Build a crowdfunder plan 4 5 Apples…….oranges……or pears? Digital isn’t complicated – change is! 7 DO YOU HAVE THE RIGHT TOOLS FOR THE JOB TO NAVIGATE THE MAZE 8 Your Crowd… • Internal Stakeholders • External Stakeholders Databases: Which one do you choose? Microsoft Dynamics 10 Who’s Online ONS 2015 ONLINE DONATION METHOD Blackbaud 2014 12 DO YOU HAVE THE RIGHT TOOLS FOR THE JOB TO NAVIGATE THE MAZE • Email • Website / online platform • Social Media • CRM System / Database • Any others…… You need to be able to engage with your online audience on multiple platforms! 13 Email "Correo." by Itzel402 - Own work. Licensed under CC BY-SA 3.0 via Wikimedia Commons - 14 https://commons.wikimedia.org/wiki/File:Correo..jpg#/media/File:Correo..jpg http://uk.pcmag.com/e-mail-products/3708/guide/the-best-email-marketing-services-of-2015 15 Social Media 16 Social Media Channel Quick Guide •Facebook - Needs little explanation. Growing a little older in terms of demographics. Visual and video content working well. Tends to get higher engagement than Twitter. •Twitter - The other main channel. Especially useful for networking and news distribution.
    [Show full text]
  • Open-Source Practices for Music Signal Processing Research Recommendations for Transparent, Sustainable, and Reproducible Audio Research
    MUSIC SIGNAL PROCESSING Brian McFee, Jong Wook Kim, Mark Cartwright, Justin Salamon, Rachel Bittner, and Juan Pablo Bello Open-Source Practices for Music Signal Processing Research Recommendations for transparent, sustainable, and reproducible audio research n the early years of music information retrieval (MIR), research problems were often centered around conceptually simple Itasks, and methods were evaluated on small, idealized data sets. A canonical example of this is genre recognition—i.e., Which one of n genres describes this song?—which was often evaluated on the GTZAN data set (1,000 musical excerpts balanced across ten genres) [1]. As task definitions were simple, so too were signal analysis pipelines, which often derived from methods for speech processing and recognition and typically consisted of simple methods for feature extraction, statistical modeling, and evalua- tion. When describing a research system, the expected level of detail was superficial: it was sufficient to state, e.g., the number of mel-frequency cepstral coefficients used, the statistical model (e.g., a Gaussian mixture model), the choice of data set, and the evaluation criteria, without stating the underlying software depen- dencies or implementation details. Because of an increased abun- dance of methods, the proliferation of software toolkits, the explo- sion of machine learning, and a focus shift toward more realistic problem settings, modern research systems are substantially more complex than their predecessors. Modern MIR researchers must pay careful attention to detail when processing metadata, imple- menting evaluation criteria, and disseminating results. Reproducibility and Complexity in MIR The common practice in MIR research has been to publish find- ©ISTOCKPHOTO.COM/TRAFFIC_ANALYZER ings when a novel variation of some system component (such as the feature representation or statistical model) led to an increase in performance.
    [Show full text]
  • Open Source in the Enterprise
    Open Source in the Enterprise Andy Oram and Zaheda Bhorat Beijing Boston Farnham Sebastopol Tokyo Open Source in the Enterprise by Andy Oram and Zaheda Bhorat Copyright © 2018 O’Reilly Media. All rights reserved. Printed in the United States of America. Published by O’Reilly Media, Inc., 1005 Gravenstein Highway North, Sebastopol, CA 95472. O’Reilly books may be purchased for educational, business, or sales promotional use. Online edi‐ tions are also available for most titles (http://oreilly.com/safari). For more information, contact our corporate/institutional sales department: 800-998-9938 or [email protected]. Editor: Michele Cronin Interior Designer: David Futato Production Editor: Kristen Brown Cover Designer: Karen Montgomery Copyeditor: Octal Publishing Services, Inc. July 2018: First Edition Revision History for the First Edition 2018-06-18: First Release The O’Reilly logo is a registered trademark of O’Reilly Media, Inc. Open Source in the Enterprise, the cover image, and related trade dress are trademarks of O’Reilly Media, Inc. The views expressed in this work are those of the authors, and do not represent the publisher’s views. While the publisher and the authors have used good faith efforts to ensure that the informa‐ tion and instructions contained in this work are accurate, the publisher and the authors disclaim all responsibility for errors or omissions, including without limitation responsibility for damages resulting from the use of or reliance on this work. Use of the information and instructions contained in this work is at your own risk. If any code samples or other technology this work contains or describes is subject to open source licenses or the intellectual property rights of others, it is your responsibility to ensure that your use thereof complies with such licenses and/or rights.
    [Show full text]