Automatically Generating Reading Lists

Total Page:16

File Type:pdf, Size:1020Kb

Automatically Generating Reading Lists UCAM-CL-TR-848 Technical Report ISSN 1476-2986 Number 848 Computer Laboratory Automatically generating reading lists James G. Jardine February 2014 15 JJ Thomson Avenue Cambridge CB3 0FD United Kingdom phone +44 1223 763500 http://www.cl.cam.ac.uk/ c 2014 James G. Jardine This technical report is based on a dissertation submitted August 2013 by the author for the degree of Doctor of Philosophy to the University of Cambridge, Robinson College. Technical reports published by the University of Cambridge Computer Laboratory are freely available via the Internet: http://www.cl.cam.ac.uk/techreports/ ISSN 1476-2986 Abstract | 3 Abstract This thesis addresses the task of automatically generating reading lists for novices in a scientific field. Reading lists help novices to get up to speed in a new field by providing an expert-directed list of papers to read. Without reading lists, novices must resort to ad- hoc exploratory scientific search, which is an inefficient use of time and poses a danger that they might use biased or incorrect material as the foundation for their early learning. The contributions of this thesis are fourfold. The first contribution is the ThemedPageRank (TPR) algorithm for automatically generating reading lists. It combines Latent Topic Models with Personalised PageRank and Age Adjustment in a novel way to generate reading lists that are of better quality than those generated by state- of-the-art search engines. TPR is also used in this thesis to reconstruct the bibliography for scientific papers. Although not designed specifically for this task, TPR significantly outperforms a state-of-the-art system purpose-built for the task. The second contribution is a gold-standard collection of reading lists against which TPR is evaluated, and against which future algorithms can be evaluated. The eight reading lists in the gold-standard were produced by experts recruited from two universities in the United Kingdom. The third contribution is the Citation Substitution Coefficient (CSC), an evaluation metric for evaluating the quality of reading lists. CSC is better suited to this task than standard IR metrics such as precision, recall, F-score and mean average precision because it gives partial credit to recommended papers that are close to gold-standard papers in the citation graph. This partial credit results in scores that have more granularity than those of the standard IR metrics, allowing the subtle differences in the performance of recommendation algorithms to be detected. The final contribution is a light-weight algorithm for Automatic Term Recognition (ATR). As will be seen, technical terms play an important role in the TPR algorithm. This light-weight algorithm extracts technical terms from the titles of documents without the need for the complex apparatus required by most state-of-the-art ATR algorithms. It is also capable of extracting very long technical terms, unlike many other ATR algorithms. Four experiments are presented in this thesis. The first experiment evaluates TPR against state-of-the-art search engines in the task of automatically generating reading lists that are comparable to expert-generated gold-standards. The second experiment compares the performance of TPR against a purpose-built state-of-the-art system in the task of automatically reconstructing the reference lists of scientific papers. The third experiment involves a user study to explore the ability of novices to build their own reading lists using two fundamental components of TPR: automatic technical term recognition and topic modelling. A system exposing only these components is compared against a state- of-the-art scientific search engine. The final experiment is a user study that evaluates the technical terms discovered by the ATR algorithm and the latent topics generated by TPR. The study enlists thousands of users of Qiqqa, research management software independently written by the author of this thesis. Abstract | 4 Acknowledgements | 5 Acknowledgements I would like to thank my supervisor, Dr. Simone Teufel, for allowing me the room to develop my ideas independently from germination to conclusion, and for dedicating so much time to guiding me through the writing-up process. I thank her for the many interesting and thought-provoking discussions we had throughout my graduate studies, both in Cambridge and in Edinburgh. I am grateful to the Computer Laboratory at the University of Cambridge for their generous Premium Research Studentship Scholarship. Many thanks are due to Stephen Clark and Ted Briscoe for their continued and inspiring work at the Computer Laboratory. I am also grateful to Nicholas Smit, my accomplice back in London, and the hard-working committee members of Cambridge University Entrepreneurs and the Cambridge University Technology and Enterprise Club for their inspiration and support in turning Qiqqa into world-class research software. I will never forget my fellow Robinsonians who made the journey back to university so memorable, especially James Phillips, Ross Tokola, Andre Schwagmann, Ji-yoon An, Viktoria Moltz, Michael Freeman and Marcin Geniusz. Reaching further afield of College, University would not have been the same without the amazing presences of Stuart Barton, Anthony Knobel, Spike Jackson, Stuart Moulder and Wenduan Xu. I am eternally grateful to Maïa Renchon for her loving companionship and support through some remarkably awesome and trying times, to my mother, Marilyn Jardine, for inspiring me to study forever, and to my father, Frank Jardine, for introducing me to my first “thinking machine”. Acknowledgements | 6 Table of Contents | 7 Table of Contents Abstract............................................................................................................................. 3 Acknowledgements .......................................................................................................... 5 Table of Contents ............................................................................................................. 7 Table of Figures .............................................................................................................. 11 Table of Tables ............................................................................................................... 13 Chapter 1. Introduction .............................................................................................. 15 Chapter 2. Related work ............................................................................................. 21 2.1 Information Retrieval ....................................................................................... 21 2.2 Latent Topic Models ........................................................................................ 24 2.2.1 Latent Semantic Analysis ......................................................................... 27 2.2.2 Latent Dirichlet Allocation ....................................................................... 28 2.2.3 Non-Negative Matrix Factorisation (NMF) ............................................. 30 2.2.4 Advanced Topic Modelling ...................................................................... 30 2.3 Models of Authority......................................................................................... 32 2.3.1 Citation Indexes ........................................................................................ 32 2.3.2 Bibliometrics: Impact Factor, Citation Count and H-Index ..................... 34 2.3.3 PageRank .................................................................................................. 34 2.3.4 Personalised PageRank ............................................................................. 36 2.3.5 HITS ......................................................................................................... 41 2.3.6 Combining Topics and Authority ............................................................. 42 2.3.7 Expertise Retrieval ................................................................................... 45 2.4 Generating Reading Lists................................................................................. 45 2.4.1 Ad-hoc Retrieval ...................................................................................... 45 2.4.2 Example-based Retrieval .......................................................................... 46 2.4.3 Identifying Core Papers and Automatically Generating Reviews ............ 46 2.4.4 History of Ideas and Complementary Literature ...................................... 47 2.4.5 Collaborative Filtering.............................................................................. 48 2.4.6 Playlist Generation ................................................................................... 49 2.4.7 Reference List Reintroduction .................................................................. 49 Table of Contents | 8 2.5 Evaluation Metrics for Evaluating Lists of Papers .......................................... 51 2.5.1 Precision, Recall and F-score ................................................................... 51 2.5.2 Mean Average Precision (MAP) .............................................................. 52 2.5.3 Relative co-cited probability (RCP) ......................................................... 53 2.5.4 Diversity ................................................................................................... 54 Chapter 3. Contributions of this Thesis.....................................................................
Recommended publications
  • Mendeley Mendeley Is a Reference and Citation Manager Available for Free up to 2 GB of Web Storage (More Storage Is Available for $55 Per Year)
    Mendeley Mendeley is a reference and citation manager available for free up to 2 GB of web storage (more storage is available for $55 per year). Mendeley is available as a desktop app, mobile app, as well as online. An MS Word extension allows users to connect to and cite their references while writing. Mendeley allows users to add resources in three ways. First, one may upload a PDF to Mendeley. Mendeley stores the PDF and allows the user to comment on and write notes in the PDF. Users may also enter sources manually, in cases where no PDF is present. For this entry approach, a few templates are available for the most common resource types. Users may also use the web extension to download source information from the web. Once sources have been entered, users can then then organize their sources in a variety of ways. The most prevalent use is through folders, which allow users to categorize sources by topic or project. However, users can also create tags for their files and sources so that they can search for keywords or topics that are important to them. Points in favor: • In-app PDF reader with commentary ability Points against: • Surprising lack of resource templates and information fields (e.g. no template for a conference paper or a book with translator). • MS Word extension has bugs that cause it to crash. Screenshots: Microsoft Word Citation Generator Although we tested Microsoft Word primarily as a writing app, the program includes a citation generator which was tested for facility and accuracy alongside the other reference management apps.1 Like other apps, MS Word has templates for common and uncommon resource types, including book, journal, and sound recording.
    [Show full text]
  • Field Guide to Software for Nonprofit Immigration Advocates, Organizers, and Service Providers
    THE FIELD GUIDE TO SOFTWARE FOR NONPROFIT IMMIGRATION ADVOCATES, ORGANIZERS, AND SERVICE PROVIDERS By the Immigration Advocates Network and Idealware THE FIELD GUIDE TO SOFTWARE FOR NONPROFIT IMMIGRATION ADVOCATES, ORGANIZERS, AND SERVICE PROVIDERS By the Immigration Advocates Network and Idealware THE FIELD GUIDE TO SOFTWARE FOREWORD Welcome, The Field Guide to Software is a joint effort between the Immigration Advocates Network and Idealware. Through straightforward overviews, it helps pinpoint the types of software that might be useful for the needs of nonprofit immigration advocates, organizers, and service providers and provides user- friendly summaries to demystify the possible options. It covers tried-and-true and emerging tools and technolgies, and best practices and specific aspects of nonprofit software. There’s also a section to guide you through the sometimes daunting process of choosing and implementing software. We know you have your hands full and don’t always have time to keep up with the latest information about the software that can help your organization. That’s where this guide can help. Thank you for all you do to make the world a better place. We hope this Field Guide will help you do it all just a little more easily. Matthew Burnett Karen Graham Director, Executive Director, Immigration Advocates Network Idealware iii THE FIELD GUIDE TO SOFTWARE TABLE OF CONTENTS TABLE 1. Introduction 7 • Understanding What You Need 8 • Every Organization Needs 10 2. Case Studies: Putting Tools to Use 13 • Using Technology to Expand Legal Services: Ayuda Delaware 14 • A Holistic Approach to Serving Immigrants: Benevolent Charities of Oklahoma 17 • Giving Voice to Immigrants: Idaho Coalition for Immigrants and Refugees 20 3.
    [Show full text]
  • Techmatters: "Qiqqa" Than You Can Say Reference Management: a Tool To
    LOEX Quarterly Volume 40 TechMatters: “Qiqqa” than you can say Reference Management: A Tool to Organize the Research Process Krista Graham, Georgia State University Perhaps you are a Mendeley user searching for an alternate Getting Qiqqa reference management tool given the news about that tool’s In order to use Qiqqa you do need to download and in- purchase by Elsevier (http://blog.mendeley.com/start-up- stall a copy of the free software application, which is cur- life/team-mendeley-is-joining-elsevier/)? Or maybe you are rently only available for the Windows and Android plat- a current EndNote user searching for an alternative with a forms. Although you can test drive the application without gentler learning curve? Or possibly you are a happy Zotero logging in, you will need to create a free account (http:// user in need of a few additional features, such as the ability www.qiqqa.com/Account/Register) if you want to maintain to perform OCR on PDF images? Or you might just be a multiple “libraries” of information and share them with col- newcomer to the world of reference management software leagues and/or friends. looking for a usable tool to use yourself or recommend to students? Whatever the case, if you are in the market for a Collect and Organize new tool to organize, manage, and work with your collec- tion of research sources, you may want to take a look at The first stage in the research process generally in- Qiqqa (think “quicker”, but with a British accent). volves identifying and collecting what can quickly become a large number of articles on a selected topic.
    [Show full text]
  • 2017-Networkthousand
    1 Annotated Bibliography, and Summaries I. Annotating Text II. Annotating Media III. Annotation Theory and Practice IV. Group Dynamics and Social Annotation V. Bibliographic Reference/Metadata/Tagging Note to Reader: The categories of this bibliography have been separated into ‘Tools’ and ‘Articles’ for ease of reading. Cross-posted entries have been marked with an asterisk (*) after their first appearance. Category I: Annotating Text This category provides an environmental scan of the current state of text-based annotation practices and the foundational tools in the discipline. Many of the publications focus on situating annotation in the field of digital humanities by drafting definitions for annotation practice; specifying a general annotation framework for commentary across mediums; or brainstorming platforms that would better support user interaction with objects and with each other. Authors remark that the evolution of scholarship brought about by interactive Web 2.0 practices shifted the focus from learner-content interaction to learner-learner interaction, and that this behavioural shift necessitates a redesign of tools (Agosti et al. 2005; Gao 2013). It is widely acknowledged that annotation practices are beneficial for learning, archiving, clarifying, sharing, and expanding; current Web architecture, however, struggles to facilitate these advantages (Agosti et al. 2012; Bottoni 2003; Farzan et al. 2008). Several publications introduce tools that bridge the gap between tool design and user needs, specifically AnnotatEd and CommentPress (Farzan et al. 2008; Fitzpatrick 2007). These tools, along with alternative platforms that gamify annotation, allow for interactive reading and support user engagement with resources in a customizable way. The tools treat documents as mutable objects that can be tagged, highlighted, and underlined.
    [Show full text]
  • Análisis Comparativo De Los Gestores Bibliográficos Sociales Zotero, Docear Y Mendeley: Características Y Prestaciones
    Análisis comparativo de los gestores bibliográficos sociales Zotero, Docear y Mendeley: características y prestaciones. Comparative analysis of social bibliographic management software Zotero , Docear and Mendeley: fea- tures and benefits. Montserrat López Carreño Universidad de [email protected] Resumen Abstract Se realiza una aproximación al origen y evolu- A comparative analysis between the free biblio- ción de la gestión bibliográfica personal, esta- graphic reference management software. These bleciendo una cronología de la aparición de los bibliographic reference managers offer to the gestores bibliográficos más populares, resaltan- users the ability to retrieve, store, edit and dis- do sus características y evidenciando su utilidad seminate bibliographic information. An approach en el ámbito académico-científico. Para ello, hay is made to the origin and evolution of these sys- que tratar de analizar conceptos y procesos di- tems, establishing a chronology since the ap- rectamente relacionados con los gestores bi- pearance of the most popular bibliographic bliográficos personales, productos objeto de management software, highlighting their fea- estudio, tales como fuentes de información bi- tures and usefulness in academic research. We bliográfica y la normalización bibliográfica y, have analyzed concepts and processes directly fundamentalmente del ámbito científico, donde related to personal bibliographic management son productos esenciales en la formalización de applications under study, such as the sources of la su producción para su posterior difusión. Para bibliographic information and the set of biblio- ello se realiza un análisis comparativo entre los graphic standards employed by them, essential gestores de referencia bibliográficos gratuitos aspects of the scientific field, where these prod- Zotero, Docear y Mendeley, habiendo consegui- ucts have a great importance in the formalization do identificar algunas diferencias significativas of the scientific production for later broadcast .
    [Show full text]
  • Qiqqa : Aide-Me Moire
    Qiqqa : Aide-me moire 1. Menu Home ......................................................................................................................................... 2 1.1. Différentes bibliothèques ............................................................................................................. 2 1.2. Vidéo/Tutoriel .............................................................................................................................. 2 1.3. Nouveautés .................................................................................................................................. 3 1.4. Lancement .................................................................................................................................... 3 2. Gestion des Bibliothèques ................................................................................................................... 3 2.1. Interface principale ...................................................................................................................... 3 2.2. Importation .................................................................................................................................. 3 2.3. Méta données .............................................................................................................................. 4 2.4. Recherches dans la librairie .......................................................................................................... 4 2.5. Annotations .................................................................................................................................
    [Show full text]
  • Revista Eletrônica Atoz: Novas Práticas Em Informação E Conhecimento
    UFPR/SCSA/Grupo de Pesquisa “Metodologias em Gestão da Informação” Revista eletrônica AtoZ: novas práticas em informação e conhecimento MSc Eduardo Michelotti Bettoni1 Marcelo Batista de Carvalho Profa. Dra. Patricia Zeni Marchiori GERAÇÃO DE INDICADORES PARA PERIÓDICOS CIENTÍFICOS: UM ESTUDO NA ATOZ Apêndice do Relatório final referente ao Edital de Apoio à Editoração e Publicação de Periódicos Científicos - 2016 (UFPR/PRPPG/SIBI) Curitiba 2016 1 Email para contato com os autores: [email protected] RESUMO Projeto aprovado no Edital de apoio à editoração de periódicos científicos (PRPPG/UFPR - 2016), para aplicação do recurso nas atividades do periódico AtoZ: Novas práticas em informação e conhecimento (PPGCGTI/UFPR). Objetivou constituir uma base de referências dos trabalhos publicados e planejar indicadores de desempenho da revista. Verificou-se que não somente o corpus de referências mas também a conversão dos metadados da revista em indicadores podem servir como orientação para melhores tomadas de decisão no processo editorial em vista dos critérios postulados pelas agências indexadoras. Por sua vez, a análise da base constituída também permite um melhor entendimento sobre as relações entre o periódico e seus pares, além de dar suporte à um processo de editoração mais assertivo com o uso do formato BibTeX. Palavras-chave: Periódico. Bibliometria. Análise de Produção Científica. SUMÁRIO 1 INTRODUÇÃO.................................................................................................4 2 BASE DE REFERÊNCIAS - A BASE BIB
    [Show full text]
  • Successful Talent Management Strategies Business Leaders Use to Improve Succession Planning
    Walden University ScholarWorks Walden Dissertations and Doctoral Studies Walden Dissertations and Doctoral Studies Collection 2020 Successful Talent Management Strategies Business Leaders Use to Improve Succession Planning Louai Damer Walden University Follow this and additional works at: https://scholarworks.waldenu.edu/dissertations Part of the Business Commons This Dissertation is brought to you for free and open access by the Walden Dissertations and Doctoral Studies Collection at ScholarWorks. It has been accepted for inclusion in Walden Dissertations and Doctoral Studies by an authorized administrator of ScholarWorks. For more information, please contact [email protected]. Walden University College of Management and Technology This is to certify that the doctoral study by Louai Damer has been found to be complete and satisfactory in all respects, and that any and all revisions required by the review committee have been made. Review Committee Dr. Brandon Simmons, Committee Chairperson, Doctor of Business Administration Faculty Dr. James Glenn, Committee Member, Doctor of Business Administration Faculty Dr. Diane Dusick, University Reviewer, Doctor of Business Administration Faculty Chief Academic Officer and Provost Sue Subocz, Ph.D. Walden University 2020 Abstract Successful Talent Management Strategies Business Leaders Use to Improve Succession Planning by Louai Damer MBA, University of Leicester, 2014 BSe Engineering, University of Jordan, 1999 Doctoral Study Submitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Business Administration Walden University August 2020 Abstract Surveys on organizational training and development expenditures in the United States showed a total spend of $83 billion in 2019; however, 40% of new leaders still fail in the first 18 months.
    [Show full text]
  • NNT : 2017SACLC077 Interfaces : Approches Interdisciplinaires
    NNT : 2017SACLC077 THESE DE DOCTORAT DE L’UNIVERSITE PARIS-SACLAY PREPAREE A L’ECOLE CENTRALESUPELEC ECOLE DOCTORALE N° 573 Interfaces : approches interdisciplinaires / fondements, applications et innovation Spécialité de doctorat : Sciences et technologies industrielles Par Mme Sonia Ben Hamida Innovate by Designing for Value – Towards a Design-to-Value Methodology in Early Design Stages Thèse présentée et soutenue à l’école CentraleSupélec, université Paris-Saclay, le 14/12/2017 : Composition du Jury : Mme Claudia Eckert, Professeur en Conception, Open University, Présidente M. Olivier de Weck, Professeur d’Aéronautique, d’Astronautique et d’Ingénierie Système, MIT, Rapporteur M. Benoît Eynard, Directeur Innovation & Partenariats et de l'Institut de Mécatronique, UTC, Rapporteur M. Yves Pigneur, Professeur en Business Model, Design et Innovation, HEC UNIL, Examinateur M. Bernard Yannou, Directeur du Laboratoire de Génie Industriel, CentraleSupélec, Examinateur M. Alain Huet, Chef du service Architecture de Systèmes Complexes, ArianeGroup, Examinateur M. Jean-Claude Bocquet, Professeur en Conception, CentraleSupélec, Directeur de thèse Mme Marija Jankovic, Maître de Conférences en Conception, CentraleSupélec, Co-directrice de thèse Acknowledgments I am reaching the end of this exciting, inspiring, and unforgettable journey which was only possible thanks to the wonderful people who accompanied me along the way. I would like to take the opportunity to express my sincerest gratitude to my academic advisors Prof. Dr. Marija Jankovic and Prof. Dr. Jean-Claude Bocquet for the time they spent with me to frame and shape this research project as well as for the guidance and continuous encouragement throughout the years, and to my colleagues at Airbus Safran Launchers for the feedback and inspiration they gave me.
    [Show full text]
  • OSINT Handbook September 2020
    OPEN SOURCE INTELLIGENCE TOOLS AND RESOURCES HANDBOOK 2020 OPEN SOURCE INTELLIGENCE TOOLS AND RESOURCES HANDBOOK 2020 Aleksandra Bielska Noa Rebecca Kurz, Yves Baumgartner, Vytenis Benetis 2 Foreword I am delighted to share with you the 2020 edition of the OSINT Tools and Resources Handbook. Once again, the Handbook has been revised and updated to reflect the evolution of this discipline, and the many strategic, operational and technical challenges OSINT practitioners have to grapple with. Given the speed of change on the web, some might question the wisdom of pulling together such a resource. What’s wrong with the Top 10 tools, or the Top 100? There are only so many resources one can bookmark after all. Such arguments are not without merit. My fear, however, is that they are also shortsighted. I offer four reasons why. To begin, a shortlist betrays the widening spectrum of OSINT practice. Whereas OSINT was once the preserve of analysts working in national security, it now embraces a growing class of professionals in fields as diverse as journalism, cybersecurity, investment research, crisis management and human rights. A limited toolkit can never satisfy all of these constituencies. Second, a good OSINT practitioner is someone who is comfortable working with different tools, sources and collection strategies. The temptation toward narrow specialisation in OSINT is one that has to be resisted. Why? Because no research task is ever as tidy as the customer’s requirements are likely to suggest. Third, is the inevitable realisation that good tool awareness is equivalent to good source awareness. Indeed, the right tool can determine whether you harvest the right information.
    [Show full text]
  • Laadullisen Aineiston Analyysiohjelmistot: Atlas.Ti
    LAADULLISEN AINEISTON ANALYYSIOHJELMISTOT: ATLAS.TI Sanna Herkama & Anne Laajalahti Metodifestivaalit, Tampere 27.8.2019 SANNA HERKAMA ANNE LAAJALAHTI Erikoistutkija, FT Koulutus- ja kehittämisjohtaja, FT INVEST-tutkimushanke, www.invest.utu.fi Infor, www.infor.fi Psykologian ja logopedian laitos Prologos ry, puheenjohtaja Turun yliopisto Mevi ry, varapuheenjohtaja ProCom ry, Tiede- ja teoriajaos, puheenjohtaja TOPICS & Laajalahti 2019 Herkama • Technologies in qualitative analysis • What can you and can’t do with ATLAS.ti? • ATLAS.ti in practice Laajalahti, A. & Herkama, S. (2018). Laadullinen analyysi ATLAS.ti-ohjelmistolla. • Utilising ATLAS.ti – pitfalls and benefits In R. Valli (Ed.), Ikkunoita • Closing remarks tutkimusmetodeihin 2. 5th edition. Jyväskylä: PS-kustannus, 106–133. TECHNOLOGIES SHAPE OUR THINKING Medium is the 1 Conducting research has always been intertwined with the usage of message! various aids, tools, and technologies. Also, various software have assisted ~ Marshall McLuhan researchers for long. 2 Even such choices as the utilisation of A4 paper size (Järpvall 2016) and PowerPoint slides (Adams 2006) guide the way we process information, i.e. how we produce, reproduce, use, and share information! Herkama & Laajalahti 2019 TRADITIONAL OR COMPUTER ASSISTED Computer ANALYSIS? Assisted/Aided Qualitative 1 Traditional analysis: Should I go for a traditional way of analysing Data research material? Paper prints and coloring, copy-paste procedures, Analysis hanging papers on the wall, post-it tags etc.? Software 2 Computer assisted analysis: Should I use Computer Assisted/Aided Qualitative Data Analysis Software (CAQDAS)? Storing data in one place, checking up things quickly, handling text and audiovisual material parallel, creating summaries in seconds… Herkama & Laajalahti 2019 CAQDAS – RESTRICTING OR EXPANDING THINKING? 1 Technologies shape our thinking – whether we want it or not (Laajalahti & Herkama 2018).
    [Show full text]
  • A Potential Academic Writing Workflow
    A Potential Academic Writing Workflow * For My New Academic Writing Projects, Given What’s Available as of April 16, 2014 * theblossomingfledglingresearcher.wordpress.com, Last Updated April 16, 2014 NOTE: The softwares‘ web links are provided in the bottom-right text box below. (Please click the link to explore.) Research Project PDF Storage for Background Identification and Management and Personal Initial PDF Storage: Organized Reading: Dedicated Sequestering of Only Those Mgmt: Liquid Planner (free Computer File System --> "Background Reading" Library PDFs and other Sources That I educ. subscription) . or Mendeley or Qiqqa (for future in Mendeley or Qiqqa Will Actually CITE: A "To Be ColWiz + something like Open deep searches for re-finding (I have settled upon Mendeley, but Cited" Library in Mendeley or Project to Use as a Reverse "can't quite remember" PDFs) please see links to Qiqqa videos Qiqqa Calendar below if interested.) Quote-excerpting and Interactive Hone the Paper Outline (i.e. Sketch-write thePaper, Either Reading to Classify Sources Note-taking, Toggled w/ Render the Outline a Writing in Idea Mason--an INCREDIBLE into "Bins" (i.e., Tag by Emergent Outlining: In Citavi. Road Map, or "Story Tree"): In environment in which to Section/Topic in My Paper (EXTRA: Later, To Increase Scrivener, Idea Mason, Citavi, outline, sketch, and zeroeth Wherein I'll Be Citing the Command of This Content, Make or a Mind Map Tool such as draft--or in Scrivener, a New Source): Mendeley or Qiqqa Concept Maps of It. Can You? FreeMind as Embedded in Mind Map File, or in MS More and More from Memory?) Docear.
    [Show full text]