DOCSLIB.ORG

ERICA: Improving Entity and Relation Understanding for Pre-Trained Language Models Via Contrastive Learning

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
ERICA: Improving Entity and Relation Understanding for Pre-Trained Language Models Via Contrastive Learning ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning Yujia Qin♣♠♦, Yankai Lin}, Ryuichi Takanobu|}, Zhiyuan Liu♣∗, Peng Li}, Heng Ji♠∗, Minlie Huang|, Maosong Sun|, Jie Zhou} |Department of Computer Science and Technology, Tsinghua University, Beijing, China ♠University of Illinois at Urbana-Champaign }Pattern Recognition Center, WeChat AI, Tencent Inc. [email protected] Abstract Culiacán [1] Culiacán is a city in northwestern Mexico. [2] Culiacán is Pre-trained Language Models (PLMs) have the capital of the state of Sinaloa. [3] Culiacán is also the seat of Culiacán Municipality. [4] It had an urban population of shown superior performance on various down- 785,800 in 2015 while 905,660 lived in the entire municipality. stream Natural Language Processing (NLP) [5] While Culiacán Municipality has a total area of 4,758 k!!, tasks. However, conventional pre-training ob- Culiacán itself is considerably smaller, measuring only. [6] Culiacán is a rail junction and is located on the Panamerican jectives do not explicitly model relational facts Highway that runs south to Guadalajara and Mexico City. [7] in text, which are crucial for textual under- Culiacán is connected to the north with Los Mochis, and to the standing. To address this issue, we propose a south with Mazatlán, Tepic. novel contrastive learning framework ERICA Q: where is Guadalajara? A: Mexico. locate on to obtain a deep understanding of the entities Culiacán Panamerican Highway and their relations in text. Specifically, we de- Culiacán Municipality Los Mochis south to city of Mexico City fine two novel pre-training tasks to better un- Sinaloa derstand entities and relations: (1) the entity Mexico Guadalajara discrimination task to distinguish which tail entity can be inferred by the given head en- Figure 1: An example for a document “Culiacán”, in tity and relation; (2) the relation discrimination which all entities are underlined. We show entities and task to distinguish whether two relations are their relations as a relational graph, and highlight the close or not semantically, which involves com- important entities and relations to find out “where is plex relational reasoning. Experimental results Guadalajara”. demonstrate that ERICA can improve typical PLMs (BERT and RoBERTa) on several lan- guage understanding tasks, including relation extraction, entity typing and question answer- However, conventional pre-training objectives ing, especially under low-resource settings.1 do not explicitly model relational facts, which fre- quently distribute in text and are crucial for under- 1 Introduction standing the whole text. To address this issue, some Pre-trained Language Models (PLMs) (Devlin recent studies attempt to improve PLMs to better et al., 2018; Yang et al., 2019; Liu et al., 2019) have understand relations between entities (Soares et al., shown superior performance on various Natural 2019; Peng et al., 2020). However, they mainly Language Processing (NLP) tasks such as text clas- focus on within-sentence relations in isolation, ig- sification (Wang et al., 2018), named entity recog- noring the understanding of entities, and the inter- nition (Sang and De Meulder, 2003), and question actions among multiple entities at document level, answering (Talmor and Berant, 2019). Benefiting whose relation understanding involves complex rea- from designing various effective self-supervised soning patterns. According to the statistics on a learning objectives, such as masked language mod- human-annotated corpus sampled from Wikipedia eling (Devlin et al., 2018), PLMs can effectively documents by Yao et al.(2019), at least 40.7% re- capture the syntax and semantics in text to gener- lational facts require to be extracted from multiple ate informative language representations for down- sentences. Specifically, we show an example in Fig- stream NLP tasks. ure1, to understand that “Guadalajara is located in Mexico”, we need to consider the following clues ∗Corresponding author. 1Our code and data are publicly available at https:// jointly: (i) “Mexico” is the country of “Culiacán” github.com/thunlp/ERICA. from sentence 1; (ii) “Culiacán” is a rail junction lo- 3350 Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, pages 3350–3363 August 1–6, 2021. ©2021 Association for Computational Linguistics cated on “Panamerican Highway” from sentence 6; BERT (Devlin et al., 2018) and XLNet (Yang et al., (iii) “Panamerican Highway” connects to “Guadala- 2019) based on deep Transformer (Vaswani et al., jara” from sentence 6. From the example, we can 2017) architecture demonstrate their superiority in see that there are two main challenges to capture various downstream NLP tasks. Since then, nu- the in-text relational facts: merous PLM extensions have been proposed to 1. To understand an entity, we should consider further explore the impacts of various model ar- its relations to other entities comprehensively. In chitectures (Song et al., 2019; Raffel et al., 2020), the example, the entity “Culiacán”, occurring in larger model size (Raffel et al., 2020; Lan et al., sentence 1, 2, 3, 5, 6 and 7, plays an important 2020; Fedus et al., 2021), more pre-training cor- role in finding out the answer. To understand “Culi- pora (Liu et al., 2019), etc., to obtain better general acán”, we should consider all its connected entities language understanding ability. Although achiev- and diverse relations among them. ing great success, these PLMs usually regard words 2. To understand a relation, we should consider as basic units in textual understanding, ignoring the the complex reasoning patterns in text. For exam- informative entities and their relations, which are ple, to understand the complex inference chain in crucial for understanding the whole text. the example, we need to perform multi-hop reason- To improve the entity and relation understand- ing, i.e., inferring that “Panamerican Highway” is ing of PLMs, a typical line of work is knowledge- located in “Mexico” through the first two clues. guided PLM, which incorporates external knowl- In this paper, we propose ERICA, a novel frame- edge such as Knowledge Graphs (KGs) into PLMs work to improve PLMs’ capability of Entity and to enhance the entity and relation understanding. RelatIon understanding via ContrAstive learning, Some enforce PLMs to memorize information aiming to better capture in-text relational facts by about real-world entities and propose novel pre- considering the interactions among entities and re- training objectives (Xiong et al., 2019; Wang et al., lations comprehensively. Specifically, we define 2019; Sun et al., 2020; Yamada et al., 2020). Oth- two novel pre-training tasks: (1) the entity discrim- ers modify the internal structures of PLMs to fuse ination task to distinguish which tail entity can both textual and KG’s information (Zhang et al., be inferred by the given head entity and relation. 2019; Peters et al., 2019; Wang et al., 2020; He It improves the understanding of each entity via et al., 2020). Although knowledge-guided PLMs considering its relations to other entities in text; introduce extra factual knowledge in KGs, these (2) the relation discrimination task to distinguish methods ignore the intrinsic relational facts in text, whether two relations are close or not semantically. making it hard to understand out-of-KG entities or Through constructing entity pairs with document- knowledge in downstream tasks, let alone the errors level distant supervision, it takes complex relational and incompleteness of KGs. This verifies the ne- reasoning chains into consideration in an implicit cessity of teaching PLMs to understand relational way and thus improves relation understanding. facts from contexts. We conduct experiments on a suite of language understanding tasks, including relation extraction, Another line of work is to directly model entities entity typing and question answering. The experi- or relations in text in pre-training stage to break mental results show that ERICA improves the per- the limitations of individual token representations. formance of typical PLMs (BERT and RoBERTa) Some focus on obtaining better span representa- and outperforms baselines, especially under low- tions, including entity mentions, via span-based resource settings, which demonstrates that ERICA pre-training (Sun et al., 2019; Joshi et al., 2020; effectively improves PLMs’ entity and relation un- Kong et al., 2020; Ye et al., 2020). Others learn derstanding and captures the in-text relational facts. to extract relation-aware semantics from text by comparing the sentences that share the same entity 2 Related Work pair or distantly supervised relation in KGs (Soares et al., 2019; Peng et al., 2020). However, these Dai and Le(2015) and Howard and Ruder(2018) methods only consider either individual entities or propose to pre-train universal language representa- within-sentence relations, which limits the perfor- tions on unlabeled text, and perform task-specific mance in dealing with multiple entities and rela- fine-tuning. With the advance of computing power, tions at document level. In contrast, our ERICA PLMs such as OpenAI GPT (Radford et al., 2018), considers the interactions among multiple entities 3351 fh1; h2; :::; hjdijg, then we apply mean pooling op- eration over the consecutive tokens that mention eij to obtain local entity representations. Note eij may appear multiple times in di, the k-th occurrence of k eij, which contains the tokens from index nstart to k nend, is represented as: k m = MeanPool(h k ; :::; h k ): (1) eij nstart nend To aggregate all information about eij, we aver- Figure 2: An example of Entity Discrimination task. age2 all representations of each occurrence mk For an entity pair with its distantly supervised relation eij as the global entity representation e . Follow- in text, the ED task requires the ground-truth tail entity ij to be closer to the head entity than other entities. ing Soares et al.(2019), we concatenate the final representations of two entities eij1 and eij2 as their ri = [e ; e ] relation representation, i.e., j1j2 ij1 ij2 .
Load more

Recommended publications
  • 2Nd International Symposium on Application of Materials Science and Energy Materials
    2nd International Symposium on Application of Materials Science and Energy Materials (SAMSE 2018) IOP Conference Series: Materials Science and Engineering Volume 490 Shanghai, China 17 – 18 December 2018 Part 1 of 3 ISBN: 978-1-5108-8560-8 ISSN: 1757-8981 Printed from e-media with permission by: Curran Associates, Inc. 57 Morehouse Lane Red Hook, NY 12571 Some format issues inherent in the e-media version may also appear in this print version. This work is licensed under a Creative Commons Attribution 3.0 International Licence. Licence details: http://creativecommons.org/licenses/by/3.0/. No changes have been made to the content of these proceedings. There may be changes to pagination and minor adjustments for aesthetics. Printed by Curran Associates, Inc. (2019) For permission requests, please contact the Institute of Physics at the address below. Institute of Physics Dirac House, Temple Back Bristol BS1 6BE UK Phone: 44 1 17 929 7481 Fax: 44 1 17 920 0979 [email protected] Additional copies of this publication are available from: Curran Associates, Inc. 57 Morehouse Lane Red Hook, NY 12571 USA Phone: 845-758-0400 Fax: 845-758-2633 Email: [email protected] Web: www.proceedings.com TABLE OF CONTENTS PART 1 CHAPTER 1 – MATERIALS SCIENCE IMPROVING DURABILITY OF WOOD-MIXED WASTE PLASTIC COMPOSITES WITH COMPATIBILIZERS ...........................................................................................................................................................1 Ossi Martikka, Timo Kärki, Ari Puurtinen FRACTURE FAILURE
    [Show full text]
  • Four Sichuan Buddhist Steles and the Beginnings of Pure Land Imagery in China Author(S): Dorothy C
    Four Sichuan Buddhist Steles and the Beginnings of Pure Land Imagery in China Author(s): Dorothy C. Wong Source: Archives of Asian Art, Vol. 51 (1998/1999), pp. 56-79 Published by: University of Hawai'i Press for the Asia Society Stable URL: http://www.jstor.org/stable/20111283 . Accessed: 22/11/2013 13:42 Your use of the JSTOR archive indicates your acceptance of the Terms & Conditions of Use, available at . http://www.jstor.org/page/info/about/policies/terms.jsp . JSTOR is a not-for-profit service that helps scholars, researchers, and students discover, use, and build upon a wide range of content in a trusted digital archive. We use information technology and tools to increase productivity and facilitate new forms of scholarship. For more information about JSTOR, please contact [email protected]. University of Hawai'i Press and Asia Society are collaborating with JSTOR to digitize, preserve and extend access to Archives of Asian Art. http://www.jstor.org This content downloaded from 128.143.172.192 on Fri, 22 Nov 2013 13:42:46 PM All use subject to JSTOR Terms and Conditions Four Sichuan Buddhist Steles and the Beginnings of Pure Land Imagery in China Dorothy C.Wong University of Virginia 1 he Northern and Southern Dynasties (386?589) iswell thriving economic and cultural center since Han times, a recognized as period of significant developments in but compared with Nanjing and Luoyang, capital cities Chinese art history. Idioms and artistic conventions estab where ritual art in the service of a state ideology remained lished in Han-dynasty (202 BCE?220 CE) art continued, an imperative, Sichuan always allowed artists a much while the acceptance of Buddhism and Buddhist art forms greater degree of freedom.
    [Show full text]
  • Document-Level Relation Extraction with Dual-Tier Heterogeneous Graph
    Document-level Relation Extraction with Dual-tier Heterogeneous Graph Zhenyu Zhang, Bowen Yu, Xiaobo Shu, Tingwen Liu,∗ Hengzhu Tang, Yubin Wang and Li Guo Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China fzhangzhenyu1996,yubowen,shuxiaobo,[email protected] ftanghengzhu,wangyubin,[email protected] Abstract Document-level relation extraction (RE) poses new challenges over its sentence-level counterpart since it requires an adequate comprehension of the whole document and the multi-hop reasoning ability across multiple sentences to reach the final result. In this paper, we propose a novel graph- based model with Dual-tier Heterogeneous Graph (DHG) for document-level RE. In particular, DHG is composed of a structure modeling layer followed by a relation reasoning layer. The major advantage is that it is capable of not only capturing both the sequential and structural information of documents but also mixing them together to benefit for multi-hop reasoning and final decision- making. Furthermore, we employ Graph Neural Networks (GNNs) based message propagation strategy to accumulate information on DHG. Experimental results demonstrate that the proposed method achieves state-of-the-art performance on two widely used datasets, and further analyses suggest that all the modules in our model are indispensable for document-level RE. 1 Introduction Relation extraction (RE), which aims to identify relational facts between entities from plain text, is one of the most fundamental tasks in information extraction (IE) and natural language processing (NLP). Existing methods usually focus on extracting relations from a single sentence (i.e., sentence-level RE) (Soares et al., 2019; Yu et al., 2019; Zhang et al., 2020a).
    [Show full text]
  • 2021.Acl-Long.0.Pdf
    ACL-IJCNLP 2021 The 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing Proceedings of the Conference, Vol. 1 (Long Papers) August 1 - 6, 2021 Diamond Sponsors Platinum Sponsors Gold Sponsors ii Silver Sponsors Bronze Sponsors ©2021 The Association for Computational Linguistics Order copies of this and other ACL proceedings from: Association for Computational Linguistics (ACL) 209 N. Eighth Street Stroudsburg, PA 18360 USA Tel: +1-570-476-8006 Fax: +1-570-476-0860 [email protected] ISBN 978-1-954085-52-7 (Volume 1) iii Message from the General Chair I am delighted to welcome you to the Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021)! We are very grateful for many people. Fei Xia, Wenjie Li (Maggie) and Roberto Navigli, as the Program Chairs, have admirably guided the work of main conference organization and management. The calm and experienced Priscilla Rasmussen has done a lot of work for the signing of contracts with virtual platform company, Underline.io, calculation of registration fees and managing the entire registration process, and communication with sponsors and exhibitors. The amazing 68-person organizing committee, who all contributed so much to make the conference successful: Local Chairs (Priscilla Rasmussen, Thepchai Supnithi, Thanaruk Theeramunkong), Tutorial Chairs (David Chiang, Min Zhang), Workshop Chairs (Kentaro Inui, Michael Strube), Student Research Workshop Chairs (Jad Kabbara, Haitao Lin, Amandalynne Paullada, Jannis Vamvas), Faculty Advisors to the Student Workshop (Jing Jiang, Rico Sennrich, Derek F.
    [Show full text]
  • Chinese Physics B
    Chinese Physics B Volume 30 Number 4 April 2021 TOPICAL REVIEW | Machine learning in statistical physics 040202 Restricted Boltzmann machine: Recent advances and mean-field theory Aur´elienDecelle and Cyril Furtlehner SPECIAL TOPIC | Machine learning in statistical physics 048702 Relationship between manifold smoothness and adversarial vulnerability in deep learning with local errors Zijian Jiang, Jianwen Zhou and Haiping Huang TOPICAL REVIEW | Quantum computation and quantum simulation 048201 Quantum simulations with nuclear magnetic resonance system Chudan Qiu, Xinfang Nie and Dawei Lu SPECIAL TOPIC | Quantum computation and quantum simulation 040303 Realization of arbitrary two-qubit quantum gates based on chiral Majorana fermions Qing Yan and Qing-Feng Sun 040304 Taking tomographic measurements for photonic qubits 88 ns before they are created Zhibo Hou, Qi Yin, Chao Zhang, Han-Sen Zhong, Guo-Yong Xiang, Chuan-Feng Li, Guang-Can Guo, Geoff J. Pryde and Anthony Laing 040305 Efficient self-testing system for quantum computations based on permutations Shuquan Ma, Changhua Zhu, Min Nie and Dongxiao Quan 040306 Quantum annealing for semi-supervised learning Yu-Lin Zheng, Wen Zhang, Cheng Zhou and Wei Geng 044212 Realization of adiabatic and diabatic CZ gates in superconducting qubits coupled with a tunable coupler Huikai Xu, Weiyang Liu, Zhiyuan Li, Jiaxiu Han, Jingning Zhang, Kehuan Linghu, Yongchao Li, Mo Chen, Zhen Yang, Junhua Wang, Teng Ma, Guangming Xue, Yirong Jin and Haifeng Yu 044214 Speeding up generation of photon Fock state
    [Show full text]
  • Download Article
    Advances in Social Science, Education and Humanities Research, volume 310 3rd International Conference on Culture, Education and Economic Development of Modern Society (ICCESE 2019) The Forms and Features of Bashu Dances Shown on Carved Stone in Han Dynasty* Ling Zhao School of Music China West Normal University Nanchong, China 637000 Abstract—The dance image on carved stones of Bashu area enjoyment. It doesn't emphasize on techniques and is in Han Dynasty reflects the scene of majority of social music featured by spontaneous and random; second, it has certain and dance activities in Bashu area of Han Dynasty and is innovative and aesthetic significance. “Self dancing” and mainly in small and medium structure. There are two types of “invited dancing” are two common forms of performance of performance. One of them is self-entertainment dance for the this dance. purpose of own enjoyment and is commonly in two forms such as "self-dancing" and "invited dancing"; the other one of them A. Self Dancing is entertaining dance for the purpose of entertaining others and includes solo dance, couple dance, group dance, etc. Due to During Han Dynasty, this form of dance was very the unique geographical location of the Bashu area, style of the popular in all levels from the royal families to the folk dance images varies and presents a strong cultural style of Chu merchants. This form of dance is a dance played State. spontaneously when a party or feast reaches its climax. Self dancing is not a performance dance, having not that high Keywords—Bashu carved stone; self-entertainment dance; requirement for dance skills.
    [Show full text]
  • Osteoinductive Bone Substitutes Liu, T
    VU Research Portal Osteoinductive bone substitutes Liu, T. 2013 document version Publisher's PDF, also known as Version of record Link to publication in VU Research Portal citation for published version (APA) Liu, T. (2013). Osteoinductive bone substitutes. General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights. • Users may download and print one copy of any publication from the public portal for the purpose of private study or research. • You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal ? Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. E-mail address: [email protected] Download date: 10. Oct. 2021 Osteoinductive Bone Substitutes Tie Liu The following institutions generously funded printing of this thesis: Academic Centre for Dentistry Amsterdam VU University Amsterdam Tie Liu Osteoinductive bone substitutes Thesis Amsterdam – With ref. – With Summary in Dutch ISBN: 978-90-5383014-7 Copyright © 2013 by Tie Liu. All Rights Reserved. No part of this book may be reproduced, stored in a retrievable system, or transmitted in any form or by any means, mechanical, photo-copying, recording or otherwise, without the prior written permission of the holder of copyright.
    [Show full text]
  • Newsletter Summer 2016 Issue
    新 西 籣 東 增 會 館 THE TUNG JUNG ASSOCIATION OF NZ INC PO Box 9058, Wellington, New Zealand www.tungjung.org.nz Newsletter Summer 2016 issue ______ ——— The Tung Jung Association of New Zealand Committee 2016—2017 President Gordon Wu 388 3560 Membership Kaye Wong 388 8060 Vice President Peter Moon 389 8819 499 8082 Secretaries- English Eugenie McCabe 475 7707 Property Alex Chang 0278110551 Chinese Kevin Zeng 021 669628 Sam Kwok 388 3560 Treasurer Robert Ting 478 6253 Newsletter Gordon Wu 389 8819 Assistant treasurer Virginia Ng 232 9971 Peter Moon 388 3560 Social Peter Wong 388 5828 Website Gordon Wu 389 8819 Andrina Chang 499 8032 Peter Moon Peter Moon 389 8819 388 3560 Valerie Ting 565 4421 Public Gordon Wu relations Please visit our website at http://www.tungjung.org.nz 1 President’s report……… The last three months has gone by so quickly and Christmas is almost here so we all can have a quiet time after a hectic year. Since the last newsletter, we have had the annual general meeting and three committee stalwarts have decided to retire. There has been a re-shuffle of the committee, and whereas I am still president, Peter Moon is now vice-president. Taking over the secretarial duties is Eugenie McCabe, who recently joined us and Alex Chang and Sam Kwok have taken over the property management. The Moon Festival dinner at the Dragon’s Restaurant was well attended though numbers were slightly down from last year probably due to the fact that other organisations all had their celebrations on the same day.
    [Show full text]
  • The Later Tang Reign of Emperor Mingzong
    From Warhorses to Ploughshares The Later Tang Reign of Emperor Mingzong Richard L. Davis Hong Kong University Press The University of Hong Kong Pokfulam Road Hong Kong www.hkupress.org © 2014 Hong Kong University Press ISBN 978-988-8208-10-4 (Hardback) All rights reserved. No portion of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any infor- mation storage or retrieval system, without prior permission in writing from the publisher. British Library Cataloguing-in-Publication Data A catalogue record for this book is available from the British Library. 10 9 8 7 6 5 4 3 2 1 Printed and bound by Paramount Printing Co., Ltd., Hong Kong, China Contents Acknowledgments ix Preface xi Chart 1: Ancestry of Li Siyuan xvi Map 1: Map of Later Tang, ca. 926 xiv Chapter 1: People and Places 1 The conI 1 The Shatuo People 6 The Life and Legacy of Li Keyong 11 Imperial Women 15 Sons 18 Surrogate Sons 21 The upremeS Sibling Rivalry 24 Cast of Political Characters 26 Chapter 2: Royal Passage 33 The Slow Climb 33 The bortedA Reign of Zhuangzong 39 Unruly Guards and Bodyguards 42 The epidT Regent 49 Chapter 3: Political Events: The Tiancheng Reign, 926–930 63 Chapter 4: Political Events: The Changxing Reign, 930–933 89 Chapter 5: Institutions, Reforms, and Political Culture 121 Governing Officials 121 Law and Order 126 Campaign against Corruption 131 Historical Practices and Projects 134 Culture 137 Education and Examinations 140 From Finances to Technology 147 viii Contents Chapter 6: Volatile Periphery 155 The Shatuo-Kitan Rivalry 155 Nanping 162 Sichuan in Revolt 164 Epilogue 177 The bortedA Rule of Li Conghou (r.
    [Show full text]
  • (IJABE) Table of Contents
    International Journal of Agricultural and Biological Engineering (IJABE) Open Access at https://www.ijabe.org Table of Contents Volume 14, Number 2, March, 2021 Overview Articles (OA) Wind pressure acting on greenhouses: A review ············· Cong Wang, Bo Nan, Tieliang Wang, Yikui Bai, Yuqing Li (1) Applied Science, Engineering and Technology (ASET) Establishment and verification of prediction models for evaluating the physical and chemical properties of soilless substrates ·································· Binbin Gong, Ning Wang, Tiejun Zhang, Shao Li, Xiaolei Wu, Jing Tian, et al. (9) Photoreceptive reaction spectrum effect and phototactic activity intensity of locusts’ visual display characteristics stimulated by spectral light ············ Qihang Liu, Yueli Jiang, Jin Miao, Zhongjun Gong, Tong Li, Yun Duan, et al. (19) Animal, Plant and Facility System (APFS) CFD simulation and experiment on the flow field of air-assisted ultra-low-volume sprayers in facilities ············································· Xinyu Lu, Yan Gong, Dejiang Liu, Guo Wang, Xiao Chen, Xiao Zhang, et al. (26) Determination of amount of irrigation and nitrogen for comprehensive growth of greenhouse cucumber based on multi-level fuzzy evaluation ·················· Zhihao He, Tingting Hong, Zelin Cai, Zhi Yang, Manning Li, Zhi Zhang (35) Short-term feeding behaviour sound classification method for sheep using LSTM networks ························· Guanghui Duan, Shengfu Zhang, Mingzhou Lu, Cedric Okinda, Mingxia Shen, Tomas Norton (43) Power and Machinery
    [Show full text]
  • War, Politics and Society Inearly Modern China, 900-1795
    War, Politics and Society in Early Modern China, 900–1795 In this new take on China’s early modern history, Peter Lorge presents a fresh overview of the repeated recreation of the Chinese empire through military force. Emphasizing the relationship between the military and politics, and China’s power as an empire, Lorge argues that the strength of the territorial claims and political impact of each dynasty were determined primarily by their military capacity rather than by their cultural characteristics. Using a chronological narrative, War, Politics and Society in Early Modern China, 900–1795 breaks free of the dynastic boundaries that shape much scholarship in this area, focusing instead on the growing power of local elites. This power eventually led to a system of loose central control – to the sacrifice of real, centralized power over local affairs. Ideal for students of military and Asian studies, War, Politics and Society in Early Modern China, 900–1795 is essential reading for anyone interested in the military history of China. Peter Lorge is Senior Lecturer in Chinese History and Film at Vanderbilt University. WARFARE AND HISTORY Series Editor: Jeremy Black Professor of History, University of Exeter AIR POWER IN THE AGE OF TOTAL WAR MODERN CHINESE WARFARE, 1795–1989 John Buckley Bruce A. Elleman THE ARMIES OF THE CALIPHS: MODERN INSURGENCIES AND MILITARY AND SOCIETY IN THE COUNTER-INSURGENCIES: GUERRILLAS EARLY ISLAMIC STATE AND THEIR OPPONENTS SINCE 1750 Hugh Kennedy Ian F.W. Beckett THE BALKAN WARS, 1912–1913: PRELUDE MUGHAL WARFARE: IMPERIAL FRONTIERS TO THE FIRST WORLD WAR AND HIGHROADS TO EMPIRE 1500–1700 Richard C.
    [Show full text]
  • Social Recommendation in Heterogeneous Evolving Relation Network
    Social Recommendation in Heterogeneous Evolving Relation Network Bo Jiang 1, Zhigang Lu 1,2, Yuling Liu 1,2, Ning Li1, Zelin Cui1 1 Institute of Information Engineering, Chinese Academy of Sciences, Beijing, China 2 School of Cyber Security, University of Chinese Academy of Sciences, Beijing, China fjiangbo,luzhigang,liuyuling,[email protected] Abstract. The appearance and growth of social networking brings an exponential growth of information. One of the main solutions proposed for this information overload problem are recommender systems, which provide personalized results. Most existing social recommendation ap- proaches consider relation information to improve recommendation per- formance in the static context. However, relations are likely to evolve over time in the dynamic network. Therefore, temporal information is an essential ingredient to making social recommendation. In this paper, we propose a novel social recommendation model based on evolving re- lation network, named SoERec. The learned evolving relation network is a heterogeneous information network, where the strength of relation between users is a sum of the influence of all historical events. We in- corporate temporally evolving relations into the recommendation algo- rithm. We empirically evaluate the proposed method on two widely-used datasets. Experimental results show that the proposed model outper- forms the state-of-the-art social recommendation methods. Keywords: Social recommendation · Dynamic evolving · Relation net- work · Network embedding. 1 Introduction The last decades have witnessed the booming of social networking such as Twit- ter and Facebook. User-generated content such as text, images, and videos has been posted by users on these platforms. Social users is suffering from informa- tion overload.
    [Show full text]