DOCSLIB.ORG

Qualitative Data Sharing and Re-Use for Socio-Environmental Systems Research: a Synthesis of Opportunities, Challenges, Resources and Approaches

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Qualitative Data Sharing and Re-Use for Socio-Environmental Systems Research: a Synthesis of Opportunities, Challenges, Resources and Approaches Qualitative data sharing and re-use for socio-environmental systems research: A synthesis of opportunities, challenges, resources and approaches SESYNC WHITE PAPER Lead authors: Kristal Jones and Steven M. Alexander National Socio-Environmental Synthesis Center Lead authors: Kristal Jones (SESYNC) and Steven M. Alexander (Science Advisor, Canadian Department of Fisheries and Oceans) Contributing authors (in alphabetical order): Nathan Bennett (University of British Columbia and Stanford University), Libby Bishop (UK Data Service and UK Data Archive - University of Essex), Amber Budden (DataONE), Michael Cox (Dartmouth University), Mercè Crosas (Harvard University), Eddie Game (The Nature Conservancy), Janis Geary (University of Alberta), Charlie Hahn (University of Washington), Dean Hardy (SESYNC), Jay Johnson (University of Kansas), Sebastian Karcher (Qualitative Data Repository), Matt LaFevor (University of Alabama), Nicole Motzer (SESYNC), Patricia Pinto da Silva (NOAA), Jeremy Pittman (University of Waterloo), Heather Randell (SESYNC), Julie Silva (University of Maryland), Joseph Smith (University of Maryland), Mike Smorul (Nava Public Benefit Corporation, formerly at SESYNC), Carly Strasser (Collaborative Knowledge Foundation), Colleen Strawhacker (National Snow & Ice Data Center), Andrew Stuhl (Bucknell University), Nicholas Weber (University of Washington), Deborah Winslow (National Science Foundation) This white paper present a summary and extension of discussions that occurred during a workshop supported by the National Socio-Environmental Synthesis Center (SESYNC) and held at the SESYNC offices in Annapolis, MD on February 28-March 2, 2017. All contributing authors listed below were workshop participants, and so contributed to the discussion that informed and/or writing of the white paper. The National Socio-Environmental Synthesis Center (SESYNC) is supported under funding received from the National Science Foundation DBI-1052875. The opinions, ideas and positions presented in this paper are the authors’ alone, and do not reflect the opinions, ideas or positions of the National Socio-Environmental Synthesis Center, the University of Maryland or the National Science Foundation. Citation: Jones, K., Alexander, S.M., et al. (2018). Qualitative data sharing and re-use for socio-environmental systems research: A synthesis of opportunities, challenges, resources and approaches. SESYNC White Paper. DOI:10.13016/M2WH2DG59. Permanent url: http://hdl.handle.net/1903/20257 EXECUTIVE SUMMARY Researchers in many disciplines, both social and natural sciences, have a long history of collecting and analyzing qualitative data to answer questions that have many dimensions, to interpret other research findings, and to characterize processes that are not easily quantified. Qualitative data is increasingly being used in socio-environmental systems research and related interdisciplinary efforts to address complex sustainability challenges. There are many scientific, descriptive and material benefits to be gained from sharing and re-using qualitative data, some of which reflect the broader push toward open science, and some of which are unique to qualitative research traditions. However, although open data availability is increasingly becoming an expectation in many fields and methodological approaches that work on socio- environmental topics, there remain many challenges associated the sharing and re-use of qualitative data in particular. This white paper discusses opportunities, challenges, resources and approaches for qualitative data sharing and re-use for socio-environmental research. The content and findings of the paper are a synthesis and extension of discussions that began during a workshop funded by the National Socio- Environmental Synthesis Center (SESYNC) and held at the Center Feb. 28-March 2, 2017. The structure of the paper reflects the starting point for the workshop, which focused on opportunities, challenges and resources for qualitative data sharing, and presents as well the workshop outputs focused on developing a novel approach to qualitative data sharing considerations and creating recommendations for how a variety of actors can further support and facilitate qualitative data sharing and re-use. The white paper is organized into five sections to address the following objectives: (1) Define qualitative data and discuss the benefits of sharing it along with its role in socio-environmental synthesis; (2) Review the practical, epistemological, and ethical challenges regarding sharing such data; (3) Identify the landscape of resources available for sharing qualitative data including repositories and communities of practice (4) Develop a novel framework for identifying levels of processing and access to qualitative data; and (5) Suggest roles and responsibilities for key actors in the research ecosystem that can improve the longevity and use of qualitative data in the future. ii TABLE OF CONTENTS Executive Summary ......................................................................................................................... ii Table of Contents ............................................................................................................................ iii List of Tables and Boxes .................................................................................................................. iv Introduction ....................................................................................................................................1 Background ....................................................................................................................................2 What is qualitative data? ............................................................................................................ 2 Why share qualitative data? ........................................................................................................ 2 Scientific benefits .................................................................................................................. 2 Descriptive benefits............................................................................................................... 3 Material benefits .................................................................................................................. 4 What role does qualitative data play in socio-environmental synthesis? .......................................... 5 Challenges for qualitative data sharing and re-use .............................................................................8 Practical challenges for qualitative data sharing and re-use ........................................................... 8 Epistemological and ethical challenges for qualitative data sharing .............................................. 10 Epistemological challenges ................................................................................................. 10 Ethical challenges .............................................................................................................. 12 Landscape of resources for qualitative data sharing and re-use ........................................................14 Repositories ............................................................................................................................. 14 Technical resources ................................................................................................................. 15 Networks and communities of practice ....................................................................................... 17 Levels of processing and access for qualitative data sharing and re-use .............................................18 Levels of processing ................................................................................................................ 18 Levels of access ...................................................................................................................... 19 A framework for levels of processing and access for qualitative data ............................................ 19 Roles and recommendations for actors in qualitative data sharing and re-use ....................................24 Researchers ............................................................................................................................. 25 Recommendations for researchers ............................................................................................. 25 Research institutions ................................................................................................................. 26 Data repositories and open science organizations....................................................................... 27 Recommendations for data repositories and cyberinfrastructure organizations ............................... 27 Journals and publishers ............................................................................................................ 28 Research funders ..................................................................................................................... 29 References ....................................................................................................................................30 iii List of Tables and Boxes Table 1: FAIR principles and definitions ....................................................................................... 9 Table 2: Definitions of levels of processing for qualitative data ....................................................
Load more

Recommended publications
  • Getting Started Guide Version 2.4 (November 2020) 1
    Quirkos Getting started guide Version 2.4 (November 2020) 1 Contents Introduction p2 Installation p3 Your first project p4 Button by button guide p6 Step-by-step guide p7 Exports and reports p12 Tips and Tricks p13 Next Steps p14 2 Introduction Quirkos is a simple and visual tool to help with the qualitative analysis of text data. It is identical on Windows, Mac and Linux, so this guide applies to all platforms. Here are a few things to bear in mind as you learn Quirkos for the first time: Quirkos can store your projects in our secure cloud server, or in one project file on your computer. Everything is in one file for easy backup and sharing. Quirkos saves your work as you go, so there is no manual save button, but no risk of losing your work. Add your data to the project from txt, rtf, csv, Word (docx) or PDF files, or copy and paste from any other source. Describe your sources in any way with the source properties, such as age or gender, or type of source and comments. Your themes or topics are shown as bubbles on the left side of the screen. As you drag and drop sections of text to them they will grow. Drag and drop text onto the Memos column to add a note and record your thoughts and observations At any stage of your coding, you can create many different types of exports: detailed reports, coded transcripts for Word, or spreadsheets for statistical analysis. 3 Installation You can download the full version of Quirkos from our website, or from one of our USB sticks.
    [Show full text]
  • Current Issues in Qualitative Data Analysis Software (QDAS): a User and Developer Perspective
    The Qualitative Report Volume 23 Number 13 Article 5 3-6-2018 Current Issues in Qualitative Data Analysis Software (QDAS): A User and Developer Perspective Jeanine C. Evers Erasmus University of Rotterdam, [email protected] Follow this and additional works at: https://nsuworks.nova.edu/tqr Part of the Law Commons, Quantitative, Qualitative, Comparative, and Historical Methodologies Commons, and the Social Statistics Commons Recommended APA Citation Evers, J. C. (2018). Current Issues in Qualitative Data Analysis Software (QDAS): A User and Developer Perspective. The Qualitative Report, 23(13), 61-73. https://doi.org/10.46743/2160-3715/2018.3205 This Article is brought to you for free and open access by the The Qualitative Report at NSUWorks. It has been accepted for inclusion in The Qualitative Report by an authorized administrator of NSUWorks. For more information, please contact [email protected]. Current Issues in Qualitative Data Analysis Software (QDAS): A User and Developer Perspective Abstract This paper describes recent issues and developments in Qualitative Data Analysis Software (QDAS) as presented in the opening plenary at the KWALON 2016 conference. From a user perspective, it reflects current features and functionality, including the use of artificial intelligence and machine learning; implications of the cloud; user friendliness; the role of digital archives; and the development of a common exchange format. This user perspective is complemented with the views of software developers who took part in the “Rotterdam Exchange Format Initiative,” an outcome of the conference. Keywords Qualitative Data Analysis Software, QDAS, Artificial Intelligence, Machine Learning, TLA AS.ti, Cassandre, Dedoose, f4analyse, MAXQDA, NVivo, QDA Miner, Quirkos, Transana, Exchange format, Interoperability, Qualitative Data Analysis, Learning Curve QDAS, Textual Data Mining, Cloud services.
    [Show full text]
  • The Value of CAQDAS for Systematising Literature Reviews
    BY DR. CHRISTINA SILVER, [email protected] RESEARCH FELLOW, UNIVERSITY OF SURREY The value of CAQDAS for systematising literature reviews Software designed to facilitate qualitative and mixed methods research is collectively known as CAQDAS Undertaking a literature review is similar to con- (Computer Assisted Qualitative Data AnalysiS). ducting a qualitative data analysis (QDA) in terms Available since the 1980s it provides tools designed of the analytic activities involved (Table 2.). Specific to support a range of analytic activities across disci- analytic requirements should drive the way tools are plines and sectors. Using references from bibliographic used rather than the availability of product features software (e.g. Endnote, Zotero, Mendeley) enables systematic literature reviewing, integrated with data Table 2. analysis. This article outlines some possibilities, high- Analytic activities supported by CAQDAS lighting considerations in planning a literature review for librarians and others. Integration revy revy • Bring together all relevant material into one “workspace” • Quantify qualitative data / qualify quantitative data 01 2016 01 What CAQDAS packages “do”? Organisation The acronym “CAQDAS” is misleading because • Manage facts about data (metadata, socio-demo- these programs do not “do” analysis; users remain in graphics etc.) control of and responsible for everything. It’s there- • Represent ideas that form the basis of analysis fore better to think of them as project management tools. Harnessing CAQDAS powerfully involves their Exploration use from start to finish, whether for an academic • Familiarise with data study, service evaluation, public consultation, liter- • Access and mark inherent structure ature review, or anything else. Each program has a suite of features, too many to list here.
    [Show full text]
  • The Quest for Collaborative Ministry in the Church in Wales
    The quest for collaborative ministry: an investigation into an elusive practice in the Church in Wales Item Type Thesis or dissertation Authors Adams, Stephen, A. Citation Adams, S, P. (2019). The quest for collaborative ministry: an investigation into an elusive practice in the Church in Wales (Doctoral dissertation). University of Chester, UK. Publisher University of Chester Rights Attribution-NonCommercial-NoDerivatives 4.0 International Download date 30/09/2021 15:35:27 Item License http://creativecommons.org/licenses/by-nc-nd/4.0/ Link to Item http://hdl.handle.net/10034/623501 The quest for collaborative ministry: an investigation into an elusive practice in the Church in Wales Thesis submitted in accordance with the requirements of the University of Chester for the degree of Doctor of Professional Studies in Practical Theology by Stephen Paul Adams July 2019 2 “The material being presented for examination is my own work and has not been submitted for an award of this or another HEI except in minor particulars which are explicitly noted in the body of the thesis. Where research pertaining to the thesis was undertaken collaboratively, the nature and extent of my individual contribution has been made explicit.” 30th July 2019 3 Contents Table of Figures ........................................................................................................ 7 Acknowledgements .................................................................................................. 8 Abstract ..................................................................................................................
    [Show full text]
  • Quirkos 2.1: Distinguishing Features and Functions
    Software Reviews: Quirkos 2.1 Quirkos 2.1: Distinguishing features and functions This document is intended to be read in conjunction with the ‘Choosing a CAQDAS Package Working Paper’ which provides a more general commentary of common CAQDAS functionality. This document does not provide an exhaustive account of all the features and functions provided by Quirkos but is designed to highlight some of its distinguishing elements. The Comment section at the end details our opinions on certain aspects of functionality and usability. See also Silver & Lewins (2014) Using Software in Qualitative Research: A Step-by-Step Guide, Sage Publications and software developer website. This document reviews Quirkos version 2.1. Many thanks to Daniel Turner for reviewing this document for accuracy. Background http://www.quirkos.com/ Quirkos was developed by Daniel Turner and colleagues in response to what they saw as frustrations with existing CAQDAS packages ■ The company Quirkos was founded in 2013 and the public release of the first version of the software was in October 2014 ■ Developmental impetus was framed by a desire to design tools that open up qualitative analysis to everyone. The aim of Quirkos therefore is to provide software that is accessible to those without extensive research experience, as well as those working within professional research contexts, that is easy to use and that works across platforms ■ The pricing structure for Quirkos is considerably lower than most other CAQDAS packages ■ Quirkos works on Windows, Mac and Linux platforms ■ Quirkos runs on a local installation of the software ■ Future development will include a collaborative cloud version enabling team-members to work concurrently on the same Quirkos project.
    [Show full text]
  • A Meta Synthesis of Content Analysis Approaches
    American Journal of Educational Research, 2018, Vol. 6, No. 6, 632-637 Available online at http://pubs.sciepub.com/education/6/6/8 ©Science and Education Publishing DOI:10.12691/education-6-6-8 A Meta Synthesis of Content Analysis Approaches G. Manimozhi, P. Srinivasan* Department of Education, Central University of Tamil Nadu, Thiruvarur, India *Corresponding author: [email protected] Abstract The present analyzing is an attempt to Meta synthesis of content analysis method. The content analysis method was collected by the journals like as “The qualitative Report, Google Scholar and JSTOR”. The sample consists of literature reviews based on content analysis method. Every reviews detail was noted. The reviews responses were in a synthesis. The synthesis refers information about content analysis method. Therefore the investigators categorized the content analysis method reviews. A synthesis of content analysis method review is formed in conclusion and finalizing the common approach of content analysis. Keywords: content analysis, approach of content analysis, meta-synthesis Cite This Article: G. Manimozhi, and P. Srinivasan, “A Meta Synthesis of Content Analysis Approaches.” American Journal of Educational Research, vol. 6, no. 6 (2018): 632-637. doi: 10.12691/education-6-6-8. occurrence of identified terms (word counts), by the mid- 1950's researchers were already starting to consider the 1. Introduction need for more sophisticated methods of analysis, focusing on concepts rather than simply words, and on semantic Systematic reviewing and meta-analysis of the quantitative relationships rather than just presence [18]. research indication has extended from the health disciplines At the same time as both conduct still continue into other disciplines.
    [Show full text]
  • NNT : 2017SACLC077 Interfaces : Approches Interdisciplinaires
    NNT : 2017SACLC077 THESE DE DOCTORAT DE L’UNIVERSITE PARIS-SACLAY PREPAREE A L’ECOLE CENTRALESUPELEC ECOLE DOCTORALE N° 573 Interfaces : approches interdisciplinaires / fondements, applications et innovation Spécialité de doctorat : Sciences et technologies industrielles Par Mme Sonia Ben Hamida Innovate by Designing for Value – Towards a Design-to-Value Methodology in Early Design Stages Thèse présentée et soutenue à l’école CentraleSupélec, université Paris-Saclay, le 14/12/2017 : Composition du Jury : Mme Claudia Eckert, Professeur en Conception, Open University, Présidente M. Olivier de Weck, Professeur d’Aéronautique, d’Astronautique et d’Ingénierie Système, MIT, Rapporteur M. Benoît Eynard, Directeur Innovation & Partenariats et de l'Institut de Mécatronique, UTC, Rapporteur M. Yves Pigneur, Professeur en Business Model, Design et Innovation, HEC UNIL, Examinateur M. Bernard Yannou, Directeur du Laboratoire de Génie Industriel, CentraleSupélec, Examinateur M. Alain Huet, Chef du service Architecture de Systèmes Complexes, ArianeGroup, Examinateur M. Jean-Claude Bocquet, Professeur en Conception, CentraleSupélec, Directeur de thèse Mme Marija Jankovic, Maître de Conférences en Conception, CentraleSupélec, Co-directrice de thèse Acknowledgments I am reaching the end of this exciting, inspiring, and unforgettable journey which was only possible thanks to the wonderful people who accompanied me along the way. I would like to take the opportunity to express my sincerest gratitude to my academic advisors Prof. Dr. Marija Jankovic and Prof. Dr. Jean-Claude Bocquet for the time they spent with me to frame and shape this research project as well as for the guidance and continuous encouragement throughout the years, and to my colleagues at Airbus Safran Launchers for the feedback and inspiration they gave me.
    [Show full text]
  • Note Caqdas | Cmw
    NOTE CAQDAS | CMW NOTE D’AIDE A LA DECISION EN VUE D’ÉQUIPER LE CMW DE CAQDAS1 POUR L’ANALYSE QUALITATIVE Thibaut Rioufreyt (MCF en science politique, Université Lyon 2 / Triangle)2 A la demande et en collaboration avec Muriel Pommier (IE en sociologie, ENS de Lyon / CMW) 03/11/2020 1 Computer Assisted Qualitative Data Analysis : Logiciel d’aide à l’analyse qualitative 2 NOTE CAQDAS | CMW INTRODUCTION Cette note vise à présenter les différentes options techniques et financières disponibles en vue d’équiper le Centre Max Weber en logiciels d’aide à l’analyse qualitative de type CAQDAS (Computer Assisted Qualitative Data Analysis). Sa rédaction s’inscrit dans une démarche engagée depuis fin 2018 par Muriel Pommier afin de recenser les besoins des doctorant.e.s, ingénieur.e.s, chercheur.se.s et enseignant.e.s-chercheur.se.s du Centre Max Weber en matière d’analyse qualitative et de trouver comment y répondre. La consultation par voie de questionnaire (2019) montre que plus d'une trentaine de membres du CMW affirment l’intention d'utiliser un outil d’aide à l’analyse qualitative pour leur activité de recherche, à la condition d'être formé.e.s à un logiciel en raison de la complexité technique perçue de ce type d'outil3. Par la suite, une formation interne au CMW intitulée « Les logiciels d’aide à l’analyse qualitative (CAQDAS). Prise en main et réflexivité méthodologique. Découvrir et s’initier aux logiciels d’aide à l’analyse qualitative » (d’une durée de 6 heures) assurée par Thibaut Rioufreyt a été organisée le 23 septembre 20204.
    [Show full text]
  • Laadullisen Aineiston Analyysiohjelmistot: Atlas.Ti
    LAADULLISEN AINEISTON ANALYYSIOHJELMISTOT: ATLAS.TI Sanna Herkama & Anne Laajalahti Metodifestivaalit, Tampere 27.8.2019 SANNA HERKAMA ANNE LAAJALAHTI Erikoistutkija, FT Koulutus- ja kehittämisjohtaja, FT INVEST-tutkimushanke, www.invest.utu.fi Infor, www.infor.fi Psykologian ja logopedian laitos Prologos ry, puheenjohtaja Turun yliopisto Mevi ry, varapuheenjohtaja ProCom ry, Tiede- ja teoriajaos, puheenjohtaja TOPICS & Laajalahti 2019 Herkama • Technologies in qualitative analysis • What can you and can’t do with ATLAS.ti? • ATLAS.ti in practice Laajalahti, A. & Herkama, S. (2018). Laadullinen analyysi ATLAS.ti-ohjelmistolla. • Utilising ATLAS.ti – pitfalls and benefits In R. Valli (Ed.), Ikkunoita • Closing remarks tutkimusmetodeihin 2. 5th edition. Jyväskylä: PS-kustannus, 106–133. TECHNOLOGIES SHAPE OUR THINKING Medium is the 1 Conducting research has always been intertwined with the usage of message! various aids, tools, and technologies. Also, various software have assisted ~ Marshall McLuhan researchers for long. 2 Even such choices as the utilisation of A4 paper size (Järpvall 2016) and PowerPoint slides (Adams 2006) guide the way we process information, i.e. how we produce, reproduce, use, and share information! Herkama & Laajalahti 2019 TRADITIONAL OR COMPUTER ASSISTED Computer ANALYSIS? Assisted/Aided Qualitative 1 Traditional analysis: Should I go for a traditional way of analysing Data research material? Paper prints and coloring, copy-paste procedures, Analysis hanging papers on the wall, post-it tags etc.? Software 2 Computer assisted analysis: Should I use Computer Assisted/Aided Qualitative Data Analysis Software (CAQDAS)? Storing data in one place, checking up things quickly, handling text and audiovisual material parallel, creating summaries in seconds… Herkama & Laajalahti 2019 CAQDAS – RESTRICTING OR EXPANDING THINKING? 1 Technologies shape our thinking – whether we want it or not (Laajalahti & Herkama 2018).
    [Show full text]
  • Diaporama Conf CAQDAS 201
    Que permet de faire un CAQDAS ? Stéphanie Abrial & Thibaut Rioufreyt (CNRS-Pacte) (Labex Comod/Triangle) Contacts : [email protected] - [email protected] ANF Quali-SHS, Mardi 8 octobre 2019 -Oléron Recherche en sciences sociales et CAQDAS ● Fin des années 1980, recherche quali anglo-saxonne : Contexte d’apparition des logiciels CAQDAS (Kelle, 1995) ● CAQDAS : Computer-assisted qualitative data analysis software (Finding, Lee, 1991) ● Des outils d’aide à l’analyse plutôt que des outils d’analyse ● Grounded Theory 2 13 Programme LaLa Grounded Grounded Theory Theory Données QUALI Nvivo10 Données & Corpus Codage & Codes Caractéristiques Requêtes Apparaît aux USA Principe Méthodologie à la fin des années 1960 • « Au lieu de « forcer » • Préciser l’objet de des théories « sur » les recherche, formuler des données empiriques pour hypothèses mais… pas de • Enraciner l’analyse dans les interpréter, le cadre théorique a priori. les données de terrain. chercheur s’ouvre à l’émergence d’éléments • S’inscrire dans une • En réaction aux de théorisation ou de démarche inductive de approches déductives. concepts qui sont va-et-vient entre le suggérés par les données terrain et l’analyse. • Glaser & Strauss : The de terrain et ce, tout au Discovery of Grounded long de la démarche analytique. » • Ne pas présupposer par Theory, 1967. avance des catégories 4 1 (Guillemette , 2006). 0 2 d’analyse. L - A I R B A e i n a h p é t S © 3 Apports des CAQDAS Données qualitatives : textes, images, sons, web, vidéos, tableaux... ● CORPUS → Construire un projet et gérer des sources de nature différente. « Création par le logiciel d’une structure « réceptacle » des données propres à un projet qui héberge à la fois les données brutes et l’ensemble des fichiers résultat » (Brugidou, Leroux, 2005) ● CODAGE → Condenser, décontextualiser, découper les données en unités d’analyse.
    [Show full text]
  • Student Learning on Faculty-Led Study Abroad: a Qualitative Study of Stakeholder Views
    CORE Metadata, citation and similar papers at core.ac.uk Provided by University of Minnesota Digital Conservancy Student Learning on Faculty-Led Study Abroad: A Qualitative Study of Stakeholder Views A Dissertation SUBMITTED TO THE FACULTY OF THE UNIVERSITY OF MINNESOTA BY Mary H. Schlarb IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR THE DEGREE OF DOCTOR OF PHILOSOPHY Advisor: Deanne L. Magnusson, Ph.D. May 2019 Copyright by Mary H. Schlarb 2019 Acknowledgements Throughout the doctoral program and dissertation project, many people have supported and guided me. I would first like to thank Dr. Deanne Magnusson for the unparalleled level of guidance and support she provided me throughout this learning process. She models the student-centered, authentic teaching this study addresses, and her guidance at all stages of this project has been both constructively critical and essential to my progress. She knew when to challenge me rigorously, both in my thinking and my progress, and when to provide encouragement. It has been such a pleasure to collaborate with her on this project. I am also deeply grateful to Dr. Michael Paige for his mentoring in the earlier stages of this project as my initial advisor. He challenged me intellectually, shaped my thinking on study design and direction, and encouraged me with his exuberant support. His scholarship was a guidepost for me throughout this study, and I am inspired to continue that work as a professional and a researcher. With his passing, we have lost a tremendously thoughtful and engaging intercultural educator who contributed so much to our understanding of intercultural learning and internationalization.
    [Show full text]
  • Ease on Down the Code: Complex Collaborative Qualitative Coding Simplified with ‘Code Wizard’
    Ease on Down the Code: Complex Collaborative Qualitative Coding Simplified with ‘Code Wizard’ ABBAS GANJI, University of Washington, USA MANIA ORAND, Institute for Research in Fundamental Sciences (IPM) & University of Washington, USA DAVID W. MCDONALD, University of Washington, USA This paper describes the design and development of a preliminary qualitative coding tool as well as a method to improve the process of achieving inter-coder reliability (ICR) in small teams. Software applications that support qualitative coding do not sufficiently assist collaboration among coders and overlook some fundamental issues related to ICR. We propose a new dimension of collaborative coding called “coders’ certainty” and demonstrate its ability to illustrate valuable code disagreements that are missing from existing approaches. Through a case study, we describe the utility of our tool, Code Wizard, and how it helped a group of researchers effectively collaborate to code naturalistic observation data. We report the valuable lessons we learned from the development of our tool and method: (1) identifying coders’ certainty constitutes an important part of determining the quality of data analysis and facilitates identifying overlapping and ambiguous codes, (2) making the details of coding process visible helps streamline the coding process and leads to a sense of ownership of the research results, and (3) there is valuable information hidden in coding disagreements that can be leveraged for improving the process of data analysis. CCS Concepts: • Human-centered computing → Collaborative and social computing theory, 132 concepts and paradigms KEYWORDS Qualitative coding, collaborative coding, qualitative coding software application, qualitative code disagreements ACM Reference format: Abbas Ganji, Mania Orand, David W.
    [Show full text]