Distributional Semantic Models Part 1: Introduction

Distributional Semantic Models Part 1: Introduction

Distributional Semantic Models Part 1: Introduction Stefan Evert1 with Alessandro Lenci2, Marco Baroni3 and Gabriella Lapesa4 1Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany 2University of Pisa, Italy 3University of Trento, Italy 4University of Stuttgart, Germany http://wordspace.collocations.de/doku.php/course:start isa pet Copyright © 2009–2016 Evert, Lenci, Baroni & Lapesa | Licensed under CC-by-sa version 3.0 cat isa dog © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 1 / 44 Outline Outline Introduction The distributional hypothesis Distributional semantic models Three famous examples Getting practical Software and further information R as a (toy) laboratory © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 2 / 44 Introduction The distributional hypothesis Outline Introduction The distributional hypothesis Distributional semantic models Three famous examples Getting practical Software and further information R as a (toy) laboratory © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 3 / 44 + meaning = use = distribution in language + distribution = collocations = habitual word combinations + semantic distance Introduction The distributional hypothesis Meaning & distribution I “Die Bedeutung eines Wortes liegt in seinem Gebrauch.” — Ludwig Wittgenstein I “You shall know a word by the company it keeps!” — J. R. Firth (1957) I Distributional hypothesis: difference of meaning correlates with difference of distribution (Zellig Harris 1954) I “What people know when they say that they know a word is not how to recite its dictionary definition – they know how to use it [. ] in everyday discourse.” (Miller 1986) © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 4 / 44 + distribution = collocations = habitual word combinations + semantic distance Introduction The distributional hypothesis Meaning & distribution I “Die Bedeutung eines Wortes liegt in seinem Gebrauch.” — Ludwig Wittgenstein + meaning = use = distribution in language I “You shall know a word by the company it keeps!” — J. R. Firth (1957) I Distributional hypothesis: difference of meaning correlates with difference of distribution (Zellig Harris 1954) I “What people know when they say that they know a word is not how to recite its dictionary definition – they know how to use it [. ] in everyday discourse.” (Miller 1986) © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 4 / 44 + semantic distance Introduction The distributional hypothesis Meaning & distribution I “Die Bedeutung eines Wortes liegt in seinem Gebrauch.” — Ludwig Wittgenstein + meaning = use = distribution in language I “You shall know a word by the company it keeps!” — J. R. Firth (1957) + distribution = collocations = habitual word combinations I Distributional hypothesis: difference of meaning correlates with difference of distribution (Zellig Harris 1954) I “What people know when they say that they know a word is not how to recite its dictionary definition – they know how to use it [. ] in everyday discourse.” (Miller 1986) © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 4 / 44 Introduction The distributional hypothesis Meaning & distribution I “Die Bedeutung eines Wortes liegt in seinem Gebrauch.” — Ludwig Wittgenstein + meaning = use = distribution in language I “You shall know a word by the company it keeps!” — J. R. Firth (1957) + distribution = collocations = habitual word combinations I Distributional hypothesis: difference of meaning correlates with difference of distribution (Zellig Harris 1954) + semantic distance I “What people know when they say that they know a word is not how to recite its dictionary definition – they know how to use it [. ] in everyday discourse.” (Miller 1986) © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 4 / 44 I He handed her her glass of bardiwac. I Beef dishes are made to complement the bardiwacs. I Nigel staggered to his feet, face flushed from too much bardiwac. I Malbec, one of the lesser-known bardiwac grapes, responds well to Australia’s sunshine. I I dined off bread and cheese and this excellent bardiwac. I The drinks were delicious: blood-red bardiwac as well as light, sweet Rhenish. + bardiwac is a heavy red alcoholic beverage made from grapes The examples above are handpicked and edited, of course. But in a corpus like the BNC, you will find at least as much relevant information. Introduction The distributional hypothesis What is the meaning of “bardiwac”? © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 5 / 44 I Beef dishes are made to complement the bardiwacs. I Nigel staggered to his feet, face flushed from too much bardiwac. I Malbec, one of the lesser-known bardiwac grapes, responds well to Australia’s sunshine. I I dined off bread and cheese and this excellent bardiwac. I The drinks were delicious: blood-red bardiwac as well as light, sweet Rhenish. + bardiwac is a heavy red alcoholic beverage made from grapes The examples above are handpicked and edited, of course. But in a corpus like the BNC, you will find at least as much relevant information. Introduction The distributional hypothesis What is the meaning of “bardiwac”? I He handed her her glass of bardiwac. © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 5 / 44 I Nigel staggered to his feet, face flushed from too much bardiwac. I Malbec, one of the lesser-known bardiwac grapes, responds well to Australia’s sunshine. I I dined off bread and cheese and this excellent bardiwac. I The drinks were delicious: blood-red bardiwac as well as light, sweet Rhenish. + bardiwac is a heavy red alcoholic beverage made from grapes The examples above are handpicked and edited, of course. But in a corpus like the BNC, you will find at least as much relevant information. Introduction The distributional hypothesis What is the meaning of “bardiwac”? I He handed her her glass of bardiwac. I Beef dishes are made to complement the bardiwacs. © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 5 / 44 I Malbec, one of the lesser-known bardiwac grapes, responds well to Australia’s sunshine. I I dined off bread and cheese and this excellent bardiwac. I The drinks were delicious: blood-red bardiwac as well as light, sweet Rhenish. + bardiwac is a heavy red alcoholic beverage made from grapes The examples above are handpicked and edited, of course. But in a corpus like the BNC, you will find at least as much relevant information. Introduction The distributional hypothesis What is the meaning of “bardiwac”? I He handed her her glass of bardiwac. I Beef dishes are made to complement the bardiwacs. I Nigel staggered to his feet, face flushed from too much bardiwac. © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 5 / 44 I I dined off bread and cheese and this excellent bardiwac. I The drinks were delicious: blood-red bardiwac as well as light, sweet Rhenish. + bardiwac is a heavy red alcoholic beverage made from grapes The examples above are handpicked and edited, of course. But in a corpus like the BNC, you will find at least as much relevant information. Introduction The distributional hypothesis What is the meaning of “bardiwac”? I He handed her her glass of bardiwac. I Beef dishes are made to complement the bardiwacs. I Nigel staggered to his feet, face flushed from too much bardiwac. I Malbec, one of the lesser-known bardiwac grapes, responds well to Australia’s sunshine. © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 5 / 44 I The drinks were delicious: blood-red bardiwac as well as light, sweet Rhenish. + bardiwac is a heavy red alcoholic beverage made from grapes The examples above are handpicked and edited, of course. But in a corpus like the BNC, you will find at least as much relevant information. Introduction The distributional hypothesis What is the meaning of “bardiwac”? I He handed her her glass of bardiwac. I Beef dishes are made to complement the bardiwacs. I Nigel staggered to his feet, face flushed from too much bardiwac. I Malbec, one of the lesser-known bardiwac grapes, responds well to Australia’s sunshine. I I dined off bread and cheese and this excellent bardiwac. © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 5 / 44 + bardiwac is a heavy red alcoholic beverage made from grapes The examples above are handpicked and edited, of course. But in a corpus like the BNC, you will find at least as much relevant information. Introduction The distributional hypothesis What is the meaning of “bardiwac”? I He handed her her glass of bardiwac. I Beef dishes are made to complement the bardiwacs. I Nigel staggered to his feet, face flushed from too much bardiwac. I Malbec, one of the lesser-known bardiwac grapes, responds well to Australia’s sunshine. I I dined off bread and cheese and this excellent bardiwac. I The drinks were delicious: blood-red bardiwac as well as light, sweet Rhenish. © Evert/Lenci/Baroni/Lapesa (CC-by-sa) DSM Tutorial – Part 1 wordspace.collocations.de 5 / 44 Introduction The distributional hypothesis What is the meaning of “bardiwac”? I He handed her her glass of bardiwac. I Beef dishes are made to complement the bardiwacs. I Nigel staggered to his feet, face flushed from too much bardiwac. I Malbec, one of the lesser-known bardiwac grapes, responds well to Australia’s sunshine. I I dined off bread and cheese and this excellent bardiwac. I The drinks were delicious: blood-red bardiwac as well as light, sweet Rhenish. + bardiwac is a heavy red alcoholic beverage made from grapes The examples above are handpicked and edited, of course. But in a corpus like the BNC, you will find at least as much relevant information.

View Full Text

Details

  • File Type
    pdf
  • Upload Time
    -
  • Content Languages
    English
  • Upload User
    Anonymous/Not logged-in
  • File Pages
    76 Page
  • File Size
    -

Download

Channel Download Status
Express Download Enable

Copyright

We respect the copyrights and intellectual property rights of all users. All uploaded documents are either original works of the uploader or authorized works of the rightful owners.

  • Not to be reproduced or distributed without explicit permission.
  • Not used for commercial purposes outside of approved use cases.
  • Not used to infringe on the rights of the original creators.
  • If you believe any content infringes your copyright, please contact us immediately.

Support

For help with questions, suggestions, or problems, please contact us