Neural Transfer Learning for Natural Language Processing

Total Page:16

File Type:pdf, Size:1020Kb

Neural Transfer Learning for Natural Language Processing NATIONAL UNIVERSITY OF IRELAND, GALWAY Neural Transfer Learning for Natural Language Processing by Sebastian Ruder A thesis submitted in partial fulfillment for the degree of Doctor of Philosophy in the College of Engineering and Informatics School of Engineering and Informatics Supervisors: John G. Breslin, Parsa Ghaffari February, 2019 Contents Declaration of Authorship vi Abstract viii Acknowledgements ix List of Figures x List of Tables xii Abbreviations xiv Notation xvi 1 Introduction 1 1.1 Motivation . .1 1.2 Research objectives . .3 1.3 Contributions . .4 1.4 Thesis outline . .6 1.5 Publications . .7 2 Background 10 2.1 Probability and information theory . 10 2.1.1 Probability basics . 10 2.1.2 Distributions . 15 2.1.3 Information theory . 16 2.2 Machine learning . 18 2.2.1 Maximum likelihood estimation . 19 2.2.2 Linear regression . 21 2.2.3 Gradient descent . 24 2.2.4 Generalization . 25 2.2.5 Regularization . 28 2.3 Neural networks . 30 2.3.1 Layers and models . 32 2.3.2 Back-propagation . 35 i Contents ii 2.4 Natural language processing . 37 2.5 Conclusions . 41 3 Transfer Learning 42 3.1 Introduction . 42 3.1.1 Definition . 44 3.1.2 Scenarios . 44 3.1.3 Taxonomy . 45 3.2 Multi-task learning . 47 3.2.1 Introduction . 47 3.2.2 Motivation . 47 3.2.3 Two methods for MTL in neural networks . 48 3.2.4 Why does MTL work? . 49 3.2.5 MTL in non-neural models . 50 3.2.5.1 Block-sparse regularization . 51 3.2.5.2 Learning task relationships . 52 3.2.6 Auxiliary tasks . 55 3.2.6.1 Common types of auxiliary tasks . 57 3.2.6.2 Related tasks used in NLP . 60 3.2.7 Summary . 62 3.3 Sequential transfer learning . 63 3.3.1 Introduction . 63 Sequential transfer learning stages . 64 3.3.2 Pretraining . 65 3.3.2.1 Distantly supervised pretraining . 66 3.3.2.2 Supervised pretraining . 67 3.3.2.3 Unsupervised pretraining . 67 3.3.2.4 Multi-task pretraining . 76 3.3.2.5 Architectures . 76 3.3.3 Adaptation . 77 3.3.3.1 Fine-tuning settings . 78 3.3.3.2 A framework for adaptation . 79 3.3.4 Lifelong learning . 80 3.3.5 Evaluation scenarios . 85 3.3.6 Summary . 85 3.4 Domain adaptation . 86 3.4.1 Introduction . 86 3.4.2 Representation approaches . 87 3.4.2.1 Distribution similarity approaches . 87 3.4.2.2 Latent feature learning . 90 3.4.3 Weighting and selecting data . 93 3.4.3.1 Instance weighting . 94 3.4.3.2 Instance selection . 95 3.4.4 Self-labelling approaches . 96 3.4.4.1 Self-training . 97 3.4.4.2 Multi-view training . 97 3.4.5 Multi-source domain adaptation . 99 Contents iii 3.4.6 Summary . 100 3.5 Cross-lingual learning . 100 3.5.1 Introduction . 101 3.5.2 Notation and terminology . 102 3.5.3 A typology for cross-lingual word embedding models . 104 3.5.4 Word-level alignment models . 106 3.5.4.1 Word alignment methods with parallel data . 106 3.5.4.2 Word alignment methods with comparable data . 115 3.5.5 Sentence-level alignment models . 116 3.5.5.1 Sentence alignment methods with parallel data . 117 3.5.5.2 Sentence alignment methods with comparable data . 123 3.5.6 Document-level alignment models . 123 3.5.6.1 Document alignment methods with comparable data . 124 3.5.7 Evaluation . 126 3.5.8 Summary . 128 3.6 Conclusions . 129 4 Selecting Data for Domain Adaptation 130 4.1 Learning to Select Data for Transfer Learning With Bayesian Optimization131 4.1.1 Introduction . 131 4.1.2 Data selection model . 132 4.1.2.1 Bayesian Optimization for data selection . 133 4.1.2.2 Features . 133 4.1.3 Experiments . 135 4.1.4 Results . 137 4.1.5 Related work . 143 4.1.6 Summary . 144 4.2 Strong Baselines for Neural Semi-supervised Learning under Domain Shift 145 4.2.1 Introduction . 145 4.2.2 Neural bootstrapping methods . 146 4.2.2.1 Self-training . 147 4.2.2.2 Tri-training . 148 4.2.2.3 Multi-task tri-training . 149 4.2.3 Experiments . 152 4.2.3.1 POS tagging . 152 4.2.3.2 Sentiment analysis . 153 4.2.3.3 Baselines . 153 4.2.3.4 Results . 153 4.2.4 Related work . 158 4.2.5 Summary . 159 4.3 Conclusions . 159 5 Unsupervised and Weakly Supervised Cross-lingual Learning 160 5.1 The Limitations of Unsupervised Bilingual Dictionary Induction . 161 5.1.1 Introduction . 161 5.1.2 How similar are embeddings across languages? . 162 5.1.3 Unsupervised cross-lingual learning . 164 Contents iv 5.1.3.1 Learning scenarios . 164 5.1.3.2 Summary of Conneau et al. [2018a] . 165 5.1.3.3 A simple supervised method . 166 5.1.4 Experiments . 167 5.1.4.1 Experimental setup . 167 5.1.4.2 Impact of language similarity . 167 5.1.4.3 Impact of domain differences . 169 5.1.4.4 Impact of hyper-parameters . 171 5.1.4.5 Impact of dimensionality . 172 5.1.4.6 Impact of evaluation procedure . 173 5.1.4.7 Evaluating eigenvector similarity . 174 5.1.5 Related work . 174 5.1.6 Summary . 175 5.2 A Discriminative Latent-Variable Model for Bilingual Lexicon Induction . 176 5.2.1 Introduction . 176 5.2.1.1 Graph-theoretic formulation . 177 5.2.1.2 Word embeddings . 178 5.2.2 A latent-variable model . 178 5.2.3 Parameter estimation . 181 5.2.3.1 Viterbi E-Step . ..
Recommended publications
  • What the Neurocognitive Study of Inner Language Reveals About Our Inner Space Hélène Loevenbruck
    What the neurocognitive study of inner language reveals about our inner space Hélène Loevenbruck To cite this version: Hélène Loevenbruck. What the neurocognitive study of inner language reveals about our inner space. Epistémocritique, épistémocritique : littérature et savoirs, 2018, Langage intérieur - Espaces intérieurs / Inner Speech - Inner Space, 18. hal-02039667 HAL Id: hal-02039667 https://hal.archives-ouvertes.fr/hal-02039667 Submitted on 20 Sep 2019 HAL is a multi-disciplinary open access L’archive ouverte pluridisciplinaire HAL, est archive for the deposit and dissemination of sci- destinée au dépôt et à la diffusion de documents entific research documents, whether they are pub- scientifiques de niveau recherche, publiés ou non, lished or not. The documents may come from émanant des établissements d’enseignement et de teaching and research institutions in France or recherche français ou étrangers, des laboratoires abroad, or from public or private research centers. publics ou privés. Preliminary version produced by the author. In Lœvenbruck H. (2008). Épistémocritique, n° 18 : Langage intérieur - Espaces intérieurs / Inner Speech - Inner Space, Stéphanie Smadja, Pierre-Louis Patoine (eds.) [http://epistemocritique.org/what-the-neurocognitive- study-of-inner-language-reveals-about-our-inner-space/] - hal-02039667 What the neurocognitive study of inner language reveals about our inner space Hélène Lœvenbruck Université Grenoble Alpes, CNRS, Laboratoire de Psychologie et NeuroCognition (LPNC), UMR 5105, 38000, Grenoble France Abstract Our inner space is furnished, and sometimes even stuffed, with verbal material. The nature of inner language has long been under the careful scrutiny of scholars, philosophers and writers, through the practice of introspection. The use of recent experimental methods in the field of cognitive neuroscience provides a new window of insight into the format, properties, qualities and mechanisms of inner language.
    [Show full text]
  • CNS 2014 Program
    Cognitive Neuroscience Society 21st Annual Meeting, April 5-8, 2014 Marriott Copley Place Hotel, Boston, Massachusetts 2014 Annual Meeting Program Contents 2014 Committees & Staff . 2 Schedule Overview . 3 . Keynotes . 5 2014 George A . Miller Awardee . 6. Distinguished Career Contributions Awardee . 7 . Young Investigator Awardees . 8 . General Information . 10 Exhibitors . 13 . Invited-Symposium Sessions . 14 Mini-Symposium Sessions . 18 Poster Schedule . 32. Poster Session A . 33 Poster Session B . 66 Poster Session C . 98 Poster Session D . 130 Poster Session E . 163 Poster Session F . 195 . Poster Session G . 227 Poster Topic Index . 259. Author Index . 261 . Boston Marriott Copley Place Floorplan . 272. A Supplement of the Journal of Cognitive Neuroscience Cognitive Neuroscience Society c/o Center for the Mind and Brain 267 Cousteau Place, Davis, CA 95616 ISSN 1096-8857 © CNS www.cogneurosociety.org 2014 Committees & Staff Governing Board Mini-Symposium Committee Roberto Cabeza, Ph.D., Duke University David Badre, Ph.D., Brown University (Chair) Marta Kutas, Ph.D., University of California, San Diego Adam Aron, Ph.D., University of California, San Diego Helen Neville, Ph.D., University of Oregon Lila Davachi, Ph.D., New York University Daniel Schacter, Ph.D., Harvard University Elizabeth Kensinger, Ph.D., Boston College Michael S. Gazzaniga, Ph.D., University of California, Gina Kuperberg, Ph.D., Harvard University Santa Barbara (ex officio) Thad Polk, Ph.D., University of Michigan George R. Mangun, Ph.D., University of California,
    [Show full text]
  • Review on Parse Tree Generation in Natural Language Processing
    International Journal of Application or Innovation in Engineering & Management (IJAIEM) Web Site: www.ijaiem.org Email: [email protected], [email protected] ISSN 2319 - 4847 Special Issue for National Conference On Recent Advances in Technology and Management for Integrated Growth 2013 (RATMIG 2013) Review on Parse Tree Generation in Natural Language Processing Manoj K. Vairalkar1 1 Assistant Professor, Department of Information Technology, Gurunanak Institute of Engineering & Technology Nagpur University, Maharashtra, India [email protected] ABSTRACT Natural Language Processing is a field of computer science concerned with the interactions between computers and human languagesThe syntax and semantics plays very important role in Natural Language Processing. Processing natural language such as English has always been one of the central research issues of artificial intelligence. The concept of parsing is very important. In this, the sentence gets parsed into Noun Phrase and Verb phrase modules. If there are further decomposition then these modules further gets divided. In this way, it helps to learn the meaning of word. Keywords:Parse tree, Parser, syntax, semantics etc 1.Introduction The ultimate objective of natural language processing is to allow people to communicate with computers in much the same way they communicate with each other. Natural language processing removes one of the key obstacles that keep some people from using computers. More specifically, natural language processing facilitates access to a database or a knowledge base, provides a friendly user interface, facilitates language translation and conversion, and increases user productivity by supporting English-like input. To parse a sentence, first upon the syntax and semantics of the sentence comes into consideration.
    [Show full text]
  • Building a Treebank for French
    Building a treebank for French £ £¥ Anne Abeillé£ , Lionel Clément , Alexandra Kinyon ¥ £ TALaNa, Université Paris 7 University of Pennsylvania 75251 Paris cedex 05 Philadelphia FRANCE USA abeille, clement, [email protected] Abstract Very few gold standard annotated corpora are currently available for French. We present an ongoing project to build a reference treebank for French starting with a tagged newspaper corpus of 1 Million words (Abeillé et al., 1998), (Abeillé and Clément, 1999). Similarly to the Penn TreeBank (Marcus et al., 1993), we distinguish an automatic parsing phase followed by a second phase of systematic manual validation and correction. Similarly to the Prague treebank (Hajicova et al., 1998), we rely on several types of morphosyntactic and syntactic annotations for which we define extensive guidelines. Our goal is to provide a theory neutral, surface oriented, error free treebank for French. Similarly to the Negra project (Brants et al., 1999), we annotate both constituents and functional relations. 1. The tagged corpus pronoun (= him ) or a weak clitic pronoun (= to him or to As reported in (Abeillé and Clément, 1999), we present her), plus can either be a negative adverb (= not any more) the general methodology, the automatic tagging phase, the or a simple adverb (= more). Inflectional morphology also human validation phase and the final state of the tagged has to be annotated since morphological endings are impor- corpus. tant for gathering constituants (based on agreement marks) and also because lots of forms in French are ambiguous 1.1. Methodology with respect to mode, person, number or gender. For exam- 1.1.1.
    [Show full text]
  • Sentiment Analysis for Multilingual Corpora
    Sentiment Analysis for Multilingual Corpora Svitlana Galeshchuk Julien Jourdan Ju Qiu Governance Analytics, PSL Research University / Governance Analytics, PSL Research University / University Paris Dauphine PSL Research University / University Paris Dauphine Place du Marechal University Paris Dauphine Place du Marechal de Lattre de Tassigny, Place du Marechal de Lattre de Tassigny, 75016 Paris, France de Lattre de Tassigny, 75016 Paris, France [email protected] 75016 Paris, France [email protected] [email protected] Abstract for different languages without polarity dictionar- ies using relatively small datasets. The paper presents a generic approach to the supervised sentiment analysis of social media We address the challenges for sentiment analy- content in foreign languages. The method pro- sis in Slavic languages by using the averaged vec- poses translating documents from the origi- tors for each word in a document translated in nal language to English with Google’s Neural English. The vectors derive from the Word2Vec Translation Model. The resulted texts are then model pre-trained on Google news. converted to vectors by averaging the vectorial Researchers tend to use the language-specific representation of words derived from a pre- pre-trained Word2Vec models (e.g., Word2Vec trained Word2Vec English model. Testing the approach with several machine learning meth- model pre-trained on Wikipedia corpus in Greek, ods on Polish, Slovenian and Croatian Twitter Swedish, etc.). On the contrary, we propose ben- corpora returns up to 86 % of classification ac- efiting from Google’s Neural Translation Model curacy on the out-of-sample data. translating the texts from other languages to En- glish.
    [Show full text]
  • Talking to Computers in Natural Language
    feature Talking to Computers in Natural Language Natural language understanding is as old as computing itself, but recent advances in machine learning and the rising demand of natural-language interfaces make it a promising time to once again tackle the long-standing challenge. By Percy Liang DOI: 10.1145/2659831 s you read this sentence, the words on the page are somehow absorbed into your brain and transformed into concepts, which then enter into a rich network of previously-acquired concepts. This process of language understanding has so far been the sole privilege of humans. But the universality of computation, Aas formalized by Alan Turing in the early 1930s—which states that any computation could be done on a Turing machine—offers a tantalizing possibility that a computer could understand language as well. Later, Turing went on in his seminal 1950 article, “Computing Machinery and Intelligence,” to propose the now-famous Turing test—a bold and speculative method to evaluate cial intelligence at the time. Daniel Bo- Figure 1). SHRDLU could both answer whether a computer actually under- brow built a system for his Ph.D. thesis questions and execute actions, for ex- stands language (or more broadly, is at MIT to solve algebra word problems ample: “Find a block that is taller than “intelligent”). While this test has led to found in high-school algebra books, the one you are holding and put it into the development of amusing chatbots for example: “If the number of custom- the box.” In this case, SHRDLU would that attempt to fool human judges by ers Tom gets is twice the square of 20% first have to understand that the blue engaging in light-hearted banter, the of the number of advertisements he runs, block is the referent and then perform grand challenge of developing serious and the number of advertisements is 45, the action by moving the small green programs that can truly understand then what is the numbers of customers block out of the way and then lifting the language in useful ways remains wide Tom gets?” [1].
    [Show full text]
  • Revealing the Language of Thought Brent Silby 1
    Revealing the Language of Thought Brent Silby 1 Revealing the Language of Thought An e-book by BRENT SILBY This paper was produced at the Department of Philosophy, University of Canterbury, New Zealand Copyright © Brent Silby 2000 Revealing the Language of Thought Brent Silby 2 Contents Abstract Chapter 1: Introduction Chapter 2: Thinking Sentences 1. Preliminary Thoughts 2. The Language of Thought Hypothesis 3. The Map Alternative 4. Problems with Mentalese Chapter 3: Installing New Technology: Natural Language and the Mind 1. Introduction 2. Language... what's it for? 3. Natural Language as the Language of Thought 4. What can we make of the evidence? Chapter 4: The Last Stand... Don't Replace The Old Code Yet 1. The Fight for Mentalese 2. Pinker's Resistance 3. Pinker's Continued Resistance 4. A Concluding Thought about Thought Chapter 5: A Direction for Future Thought 1. The Review 2. The Conclusion 3. Expanding the mind beyond the confines of the biological brain References / Acknowledgments Revealing the Language of Thought Brent Silby 3 Abstract Language of thought theories fall primarily into two views. The first view sees the language of thought as an innate language known as mentalese, which is hypothesized to operate at a level below conscious awareness while at the same time operating at a higher level than the neural events in the brain. The second view supposes that the language of thought is not innate. Rather, the language of thought is natural language. So, as an English speaker, my language of thought would be English. My goal is to defend the second view.
    [Show full text]
  • Natural Language Processing (NLP) for Requirements Engineering: a Systematic Mapping Study
    Natural Language Processing (NLP) for Requirements Engineering: A Systematic Mapping Study Liping Zhao† Department of Computer Science, The University of Manchester, Manchester, United Kingdom, [email protected] Waad Alhoshan Department of Computer Science, The University of Manchester, Manchester, United Kingdom, [email protected] Alessio Ferrari Consiglio Nazionale delle Ricerche, Istituto di Scienza e Tecnologie dell'Informazione "A. Faedo" (CNR-ISTI), Pisa, Italy, [email protected] Keletso J. Letsholo Faculty of Computer Information Science, Higher Colleges of Technology, Abu Dhabi, United Arab Emirates, [email protected] Muideen A. Ajagbe Department of Computer Science, The University of Manchester, Manchester, United Kingdom, [email protected] Erol-Valeriu Chioasca Exgence Ltd., CORE, Manchester, United Kingdom, [email protected] Riza T. Batista-Navarro Department of Computer Science, The University of Manchester, Manchester, United Kingdom, [email protected] † Corresponding author. Context: NLP4RE – Natural language processing (NLP) supported requirements engineering (RE) – is an area of research and development that seeks to apply NLP techniques, tools and resources to a variety of requirements documents or artifacts to support a range of linguistic analysis tasks performed at various RE phases. Such tasks include detecting language issues, identifying key domain concepts and establishing traceability links between requirements. Objective: This article surveys the landscape of NLP4RE research to understand the state of the art and identify open problems. Method: The systematic mapping study approach is used to conduct this survey, which identified 404 relevant primary studies and reviewed them according to five research questions, cutting across five aspects of NLP4RE research, concerning the state of the literature, the state of empirical research, the research focus, the state of the practice, and the NLP technologies used.
    [Show full text]
  • Detecting Politeness in Natural Language by Michael Yeomans, Alejandro Kantor, Dustin Tingley
    CONTRIBUTED RESEARCH ARTICLES 489 The politeness Package: Detecting Politeness in Natural Language by Michael Yeomans, Alejandro Kantor, Dustin Tingley Abstract This package provides tools to extract politeness markers in English natural language. It also allows researchers to easily visualize and quantify politeness between groups of documents. This package combines and extends prior research on the linguistic markers of politeness (Brown and Levinson, 1987; Danescu-Niculescu-Mizil et al., 2013; Voigt et al., 2017). We demonstrate two applications for detecting politeness in natural language during consequential social interactions— distributive negotiations, and speed dating. Introduction Politeness is a universal dimension of human communication (Goffman, 1967; Lakoff, 1973; Brown and Levinson, 1987). In practically all settings, a speaker can choose to be more or less polite to their audience, and this can have consequences for the speakers’ social goals. Politeness is encoded in a discrete and rich set of linguistic markers that modify the information content of an utterance. Sometimes politeness is an act of commission (for example, saying “please” and “thank you”) <and sometimes it is an act of omission (for example, declining to be contradictory). Furthermore, the mapping of politeness markers often varies by culture, by context (work vs. family vs. friends), by a speaker’s characteristics (male vs. female), or the goals (buyer vs. seller). Many branches of social science might be interested in how (and when) people express politeness to one another, as one mechanism by which social co-ordination is achieved. The politeness package is designed to make it easier to detect politeness in English natural language, by quantifying relevant characteristics of polite speech, and comparing them to other data about the speaker.
    [Show full text]
  • Text-Based Relation Extraction from the Web”
    ΤΜΗΜΑ ΠΛΗΡΟΦΟΡΙΚΗΣ ΜΕΤΑΠΤΥΧΙΑΚΟ ΔΙΠΛΩΜΑ ΕΙΔΙΚΕΥΣΗΣ (MSc) στα ΠΛΗΡΟΦΟΡΙΑΚΑ ΣΥΣΤΗΜΑΤΑ ΔΙΠΛΩΜΑΤΙKH ΕΡΓΑΣΙΑ “Εξαγωγή Σχέσεων από Κείμενα του Παγκόσμιου Ιστού” Τσιμπίδη Δωροθέα-Κωνσταντίνα M315009 ΑΘΗΝΑ, ΦΕΒΡΟΥΑΡΙΟΣ 2017 MASTER THESIS “Text-based Relation Extraction from the Web” Tsimpidi Dorothea-Konstantina SUPERVISORS: Anastasia Krithara, Research Associate, NCSR “Demokritos” Ion Androutsopoulos, Associate Professor, AUEB February 2017 Text-based Relation Extraction from the Web ACKNOWLEDGMENTS I would first like to thank my thesis advisor Anastasia Krithara for the constant guidance that she offered me and for allowing me to grow as a research scientist in the area of Information Extraction. I would also like to thank the AUEB Natural Language Processing Group and especially professor Ion Androutsopoulos for the valuable feedback every time it was needed. D. – K. Tsimpidi 4 Text-based Relation Extraction from the Web TABLE OF CONTENTS LIST OF TABLES……………………………………..………………………………………6 LIST OF FIGURES……………………………………………………………………………7 1. Introduction……………………………………………………………………………...8 2. State of the Art………………………………………………………………………….9 2.1 Traditional Relation Extraction………………………………………...……………9 2.2 Open Relation Extraction………………………….……………………...………….9 2.2.1 Existing Approaches………………………………………………………...10 2.2.2 Open Relation Extraction and Conditional Random Fields……………..15 2.3 Problem Statement…………………………………………………………………..16 3. Methodology……………………………………………………………………………18 3.1 Rule-based System…………………………………………………………………..18 3.1.1 Rules identifying Named Entities…………………………………………26
    [Show full text]
  • Natural Language Processing
    Natural Language Processing Liz Liddy (lead), Eduard Hovy, Jimmy Lin, John Prager, Dragomir Radev, Lucy Vanderwende, Ralph Weischedel This report is one of five reports that were based on the MINDS workshops, led by Donna Harman (NIST) and sponsored by Heather McCallum-Bayliss of the Disruptive Technology Office of the Office of the Director of National Intelligence's Office of Science and Technology (ODNI/ADDNI/S&T/DTO). To find the rest of the reports, and an executive overview, please see http://www.itl.nist.gov/iaui/894.02/minds.html. Historic Paradigm Shifts or Shift-Enablers A series of discoveries and developments over the past years has resulted in major shifts in the discipline of Natural Language Processing. Some have been more influential than others, but each is recognizable today as having had major impact, although this might not have been seen at the time. Some have been shift-enablers, rather than actual shifts in methods or approaches, but these have caused as major a change in how the discipline accomplishes its work. Very early on in the emergence of the field of NLP, there were demonstrations that NLP could develop operational systems with real levels of linguistic processing, in truly end-to-end (although toy) systems. These included SHRDLU by Winograd (1971) and LUNAR by Woods (1970). Each could accomplish a specific task — manipulating blocks in the blocks world or answering questions about samples from the moon. They were able to accomplish their limited goals because they included all the levels of language processing in their interactions with humans, including morphological, lexical, syntactic, semantic, discourse and pragmatic.
    [Show full text]
  • “Linguistic Analysis” As a Misnomer, Or, Why Linguistics Is in a State of Permanent Crisis
    Alexander Kravchenko Russia, Baikal National University of Economics and Law, Irkutsk “Linguistic Analysis” as a Misnomer, or, Why Linguistics is in a State of Permanent Crisis Key words: methodology, written-language bias, biology of language, consensual domain, language function Ключевые слова: методология, письменноязыковая предвзятость, биология языка, консенсуальная область, функция языка Аннотация Показывается ошибочность общепринятого понятия лингвистического анализа как анализа естественного языка. Следствием соссюровского структурализма и фило- софии объективного реализма является взгляд на язык как на вещь (код) – систему знаков, используемых как инструмент для коммуникации, под которой понимается обмен информацией. При таком подходе анализ в традиционной лингвистике пред- ставляет собой анализ вещей – письменных слов, предложений, текстов; все они являются культурными артефактами и не принадлежат сфере естественного языка как видоспецифичного социального поведения, биологическая функция которого состоит в ориентировании себя и других в когнитивной области взаимодействий. До тех пор, пока наукой не будет отвергнута кодовая модель языка, лингвистический анализ будет продолжать обслуживать языковой миф, удерживая лингвистику в со- стоянии перманентного кризиса. 1. Th e problem with linguistics as a science There is a growing feeling of uneasiness in the global community of linguists about the current state of linguistics as a science. Despite a lot of academic activity in the fi eld, and massive research refl ected in the ever growing number of publications related to the study of the various aspects of language, there hasn’t been a major breakthrough in the explorations of language as a unique endowment of humans. 26 Alexander Kravchenko Numerous competing theoretical frameworks and approaches in linguistic re- search continue to obscure the obvious truth that there is very little understanding of language as a phenomenon which sets humans apart from all other known biological species.
    [Show full text]