<<

The role of veridicality and factivity in clause selection

Aaron Steven White 1 Kyle Rawlins 2 NELS 48 University of Iceland 27th October, 2017

1University of Rochester, Department of Institute for Data Science 2Johns Hopkins University, Department of Cognitive Science

1 Slides available at aswhite.net

2 Introduction Overarching

Which of a verb’s semantic properties determine its syntactic distribution? Gruber 1965, Fillmore 1970, Zwicky 1971, Jackendoff 1972, Grimshaw 1979, 1990, Pesetsky 1982, 1991, Pinker 1989, Levin 1993

Semantic Syntactic Properties Distribution     + telic [ NP]     − durative [ S]   −  [ VP] stative   ......

4 Overarching question

Which of a verb’s semantic properties determine its syntactic distribution? Gruber 1965, Fillmore 1970, Zwicky 1971, Jackendoff 1972, Grimshaw 1979, 1990, Pesetsky 1982, 1991, Pinker 1989, Levin 1993

Semantic Syntactic Properties Distribution     + telic [ NP]     − durative [ S]   −  [ VP] stative   ......

4 Overarching question

Which of a verb’s semantic properties determine its syntactic distribution? Gruber 1965, Fillmore 1970, Zwicky 1971, Jackendoff 1972, Grimshaw 1979, 1990, Pesetsky 1982, 1991, Pinker 1989, Levin 1993

Semantic Syntactic Properties Distribution     + telic [ NP]     − durative [ S]   −  [ VP] stative   ......

4 Distribution of nominals Sensitive to event structural properties like stativity, , du- rativity, causativity, transfer, etc. (see Levin & Rappaport Hovav 2005)

Distribution of clauses Sensitive to intentional properties like representationality, pref- erentiality, factivity/veridicality, communicativity, etc. Bolinger 1968, Hintikka 1975, Hooper 1975, Stalnaker 1984, Farkas 1985, Villalta 2000, 2008, Kratzer 2006, Egré 2008, Scheffler 2009, Moulton 2009, Anand & Hacquard 2013, Rawlins 2013, Portner & Rubinstein 2013, Anand & Hacquard 2014, Spector & Egré 2015, Bogal-Allbritten 2016, Theilier et al. 2017 among many others

An apparent split

5 Distribution of clauses Sensitive to intentional properties like representationality, pref- erentiality, factivity/veridicality, communicativity, etc. Bolinger 1968, Hintikka 1975, Hooper 1975, Stalnaker 1984, Farkas 1985, Villalta 2000, 2008, Kratzer 2006, Egré 2008, Scheffler 2009, Moulton 2009, Anand & Hacquard 2013, Rawlins 2013, Portner & Rubinstein 2013, Anand & Hacquard 2014, Spector & Egré 2015, Bogal-Allbritten 2016, Theilier et al. 2017 among many others

An apparent split

Distribution of nominals Sensitive to event structural properties like stativity, telicity, du- rativity, causativity, transfer, etc. (see Levin & Rappaport Hovav 2005)

5 An apparent split

Distribution of nominals Sensitive to event structural properties like stativity, telicity, du- rativity, causativity, transfer, etc. (see Levin & Rappaport Hovav 2005)

Distribution of clauses Sensitive to intentional properties like representationality, pref- erentiality, factivity/veridicality, communicativity, etc. Bolinger 1968, Hintikka 1975, Hooper 1975, Stalnaker 1984, Farkas 1985, Villalta 2000, 2008, Kratzer 2006, Egré 2008, Scheffler 2009, Moulton 2009, Anand & Hacquard 2013, Rawlins 2013, Portner & Rubinstein 2013, Anand & Hacquard 2014, Spector & Egré 2015, Bogal-Allbritten 2016, Theilier et al. 2017 among many others

5 Hypothesis The distribution of clauses is determined by the same semantic properties as the distribution of nouns (cf. Koenig & Davis 2001)

Not intentional properties (cf. White & Rawlins 2017)

Intuition Intentional properties require that an eventuality have infor- mational content, but not all eventualities have such content, resulting in a piece-wise semantic-to-syntax mapping

Overarching Hypothesis

6 Not intentional properties (cf. White & Rawlins 2017)

Intuition Intentional properties require that an eventuality have infor- mational content, but not all eventualities have such content, resulting in a piece-wise semantic-to-syntax mapping

Overarching Hypothesis

Hypothesis The distribution of clauses is determined by the same semantic properties as the distribution of nouns (cf. Koenig & Davis 2001)

6 Intuition Intentional properties require that an eventuality have infor- mational content, but not all eventualities have such content, resulting in a piece-wise semantic-to-syntax mapping

Overarching Hypothesis

Hypothesis The distribution of clauses is determined by the same semantic properties as the distribution of nouns (cf. Koenig & Davis 2001)

Not intentional properties (cf. White & Rawlins 2017)

6 Overarching Hypothesis

Hypothesis The distribution of clauses is determined by the same semantic properties as the distribution of nouns (cf. Koenig & Davis 2001)

Not intentional properties (cf. White & Rawlins 2017)

Intuition Intentional properties require that an eventuality have infor- mational content, but not all eventualities have such content, resulting in a piece-wise semantic-to-syntax mapping

6 Claims Use experiments that measure (i) syntactic distribution and (ii) factivity/veridicality for all clause-embedding verbs to show that...

1. ...selection doesn’t directly traffic in these properties. 2. ...apparent correlations between selection and factivity and veridicality arise from... 2.1 ...only analyzing frequent verbs. 2.2 ...lack of attention to confounding event structural variables like transfer and stativity.

Today’s talk

Focus Two intentional properties—factivity and veridicality—that are argued to determine selection of interrogatives & declaratives

7 1. ...selection doesn’t directly traffic in these properties. 2. ...apparent correlations between selection and factivity and veridicality arise from... 2.1 ...only analyzing frequent verbs. 2.2 ...lack of attention to confounding event structural variables like transfer and stativity.

Today’s talk

Focus Two intentional properties—factivity and veridicality—that are argued to determine selection of interrogatives & declaratives

Claims Use experiments that measure (i) syntactic distribution and (ii) factivity/veridicality for all clause-embedding verbs to show that...

7 2. ...apparent correlations between selection and factivity and veridicality arise from... 2.1 ...only analyzing frequent verbs. 2.2 ...lack of attention to confounding event structural variables like transfer and stativity.

Today’s talk

Focus Two intentional properties—factivity and veridicality—that are argued to determine selection of interrogatives & declaratives

Claims Use experiments that measure (i) syntactic distribution and (ii) factivity/veridicality for all clause-embedding verbs to show that...

1. ...selection doesn’t directly traffic in these properties.

7 2.1 ...only analyzing frequent verbs. 2.2 ...lack of attention to confounding event structural variables like transfer and stativity.

Today’s talk

Focus Two intentional properties—factivity and veridicality—that are argued to determine selection of interrogatives & declaratives

Claims Use experiments that measure (i) syntactic distribution and (ii) factivity/veridicality for all clause-embedding verbs to show that...

1. ...selection doesn’t directly traffic in these properties. 2. ...apparent correlations between selection and factivity and veridicality arise from...

7 2.2 ...lack of attention to confounding event structural variables like transfer and stativity.

Today’s talk

Focus Two intentional properties—factivity and veridicality—that are argued to determine selection of interrogatives & declaratives

Claims Use experiments that measure (i) syntactic distribution and (ii) factivity/veridicality for all clause-embedding verbs to show that...

1. ...selection doesn’t directly traffic in these properties. 2. ...apparent correlations between selection and factivity and veridicality arise from... 2.1 ...only analyzing frequent verbs.

7 Today’s talk

Focus Two intentional properties—factivity and veridicality—that are argued to determine selection of interrogatives & declaratives

Claims Use experiments that measure (i) syntactic distribution and (ii) factivity/veridicality for all clause-embedding verbs to show that...

1. ...selection doesn’t directly traffic in these properties. 2. ...apparent correlations between selection and factivity and veridicality arise from... 2.1 ...only analyzing frequent verbs. 2.2 ...lack of attention to confounding event structural variables like transfer and stativity. 7 Today’s talk

Focus Two intentional properties—factivity and veridicality—that are argued to determine selection of interrogatives & declaratives

Claims Use experiments that measure (i) syntactic distribution and (ii) factivity/veridicality for all clause-embedding verbs to show that...

1. ...selection doesn’t directly traffic in these properties. 2. ...apparent correlations between selection and factivity and veridicality arise from... 2.1 ...only analyzing frequent verbs. 2.2 ...lack of attention to confounding event structural variables like transfer and stativity. 7 Background: veridicality & factivity

Measuring syntactic distribution

Measuring veridicality and factivity

Results and analysis

Conclusion

Outline

Introduction

8 Measuring syntactic distribution

Measuring veridicality and factivity

Results and analysis

Conclusion

Outline

Introduction

Background: veridicality & factivity

8 Measuring veridicality and factivity

Results and analysis

Conclusion

Outline

Introduction

Background: veridicality & factivity

Measuring syntactic distribution

8 Results and analysis

Conclusion

Outline

Introduction

Background: veridicality & factivity

Measuring syntactic distribution

Measuring veridicality and factivity

8 Conclusion

Outline

Introduction

Background: veridicality & factivity

Measuring syntactic distribution

Measuring veridicality and factivity

Results and analysis

8 Outline

Introduction

Background: veridicality & factivity

Measuring syntactic distribution

Measuring veridicality and factivity

Results and analysis

Conclusion

8 Background: veridicality & factivity (1) a. Jo knew that Bo was alive → Bo was alive b. Jo proved that Bo was alive → Bo was alive

Factivity

A verb v is factive iff np v s presupposes s Kiparsky & Kiparsky 1970, Karttunen 1971b et seq

(2) a. Jo didn’t know that Bo was alive → Bo was alive b. Jo didn’t prove that Bo was alive ̸→ Bo was alive

Veridicality and factivity

Veridicality

A verb v is veridical iff np v s entails s Karttunen 1971a, Egré 2008, Kart- tunen 2012, Spector & Egré 2015 a.o.

10 b. Jo proved that Bo was alive → Bo was alive

Factivity

A verb v is factive iff np v s presupposes s Kiparsky & Kiparsky 1970, Karttunen 1971b et seq

(2) a. Jo didn’t know that Bo was alive → Bo was alive b. Jo didn’t prove that Bo was alive ̸→ Bo was alive

Veridicality and factivity

Veridicality

A verb v is veridical iff np v s entails s Karttunen 1971a, Egré 2008, Kart- tunen 2012, Spector & Egré 2015 a.o.

(1) a. Jo knew that Bo was alive → Bo was alive

10 Factivity

A verb v is factive iff np v s presupposes s Kiparsky & Kiparsky 1970, Karttunen 1971b et seq

(2) a. Jo didn’t know that Bo was alive → Bo was alive b. Jo didn’t prove that Bo was alive ̸→ Bo was alive

Veridicality and factivity

Veridicality

A verb v is veridical iff np v s entails s Karttunen 1971a, Egré 2008, Kart- tunen 2012, Spector & Egré 2015 a.o.

(1) a. Jo knew that Bo was alive → Bo was alive b. Jo proved that Bo was alive → Bo was alive

10 (2) a. Jo didn’t know that Bo was alive → Bo was alive b. Jo didn’t prove that Bo was alive ̸→ Bo was alive

Veridicality and factivity

Veridicality

A verb v is veridical iff np v s entails s Karttunen 1971a, Egré 2008, Kart- tunen 2012, Spector & Egré 2015 a.o.

(1) a. Jo knew that Bo was alive → Bo was alive b. Jo proved that Bo was alive → Bo was alive

Factivity

A verb v is factive iff np v s presupposes s Kiparsky & Kiparsky 1970, Karttunen 1971b et seq

10 b. Jo didn’t prove that Bo was alive ̸→ Bo was alive

Veridicality and factivity

Veridicality

A verb v is veridical iff np v s entails s Karttunen 1971a, Egré 2008, Kart- tunen 2012, Spector & Egré 2015 a.o.

(1) a. Jo knew that Bo was alive → Bo was alive b. Jo proved that Bo was alive → Bo was alive

Factivity

A verb v is factive iff np v s presupposes s Kiparsky & Kiparsky 1970, Karttunen 1971b et seq

(2) a. Jo didn’t know that Bo was alive → Bo was alive

10 Veridicality and factivity

Veridicality

A verb v is veridical iff np v s entails s Karttunen 1971a, Egré 2008, Kart- tunen 2012, Spector & Egré 2015 a.o.

(1) a. Jo knew that Bo was alive → Bo was alive b. Jo proved that Bo was alive → Bo was alive

Factivity

A verb v is factive iff np v s presupposes s Kiparsky & Kiparsky 1970, Karttunen 1971b et seq

(2) a. Jo didn’t know that Bo was alive → Bo was alive b. Jo didn’t prove that Bo was alive ̸→ Bo was alive 10 Veridicality/factivity and responsivity

Responsivity (Lahiri 2002) A verb is responsive iff it takes interrogatives and declaratives see also Karttunen 1977a,b, Groenendijk & Stokhof 1984 et seq

(3) a. Jo knew that Bo was alive. b. Jo knew whether Bo was alive.

Generalization

A verb is responsive iff {factive (Hintikka 1975) / veridical (Egré 2008)} see also George 2011, Uegaki 2012, 2015; cf. Beck & Rullmann 1999, Spector & Egré 2015

(4) a. Jo knew {that, whether} Bo was alive. b. Jo thought {that, *whether} Bo was alive. 11 Predicted correlation Responsivity

Factivity/Veridicality 12 Measuring syntactic distribution for 1000 clause-embedding verbs × 50 syntactic frames

Measuring syntactic distribution

MegaAttitude dataset (White & Rawlins 2016)

Ordinal (1-7 scale) acceptability ratings

14 × 50 syntactic frames

Measuring syntactic distribution

MegaAttitude dataset (White & Rawlins 2016)

Ordinal (1-7 scale) acceptability ratings for 1000 clause-embedding verbs

14 Measuring syntactic distribution

MegaAttitude dataset (White & Rawlins 2016)

Ordinal (1-7 scale) acceptability ratings for 1000 clause-embedding verbs × 50 syntactic frames

14 MegaAttitude verbs

15 Solution Construct semantically bleached frames using indefinites

(5) a. know + NP _ed {that, whether} S Someone knew {that, whether} something happened. b. tell + NP _ed NP {that, whether} S Someone was told {that, whether} something happened. c. bother + NP was _ed {that, which NP} S Someone was bothered {that something, which thing} happened.

Sentence construction

Challenge Automate construction of a very large set of frames in a way that is sufficiently general to many verbs

16 (5) a. know + NP _ed {that, whether} S Someone knew {that, whether} something happened. b. tell + NP _ed NP {that, whether} S Someone was told {that, whether} something happened. c. bother + NP was _ed {that, which NP} S Someone was bothered {that something, which thing} happened.

Sentence construction

Challenge Automate construction of a very large set of frames in a way that is sufficiently general to many verbs

Solution Construct semantically bleached frames using indefinites

16 b. tell + NP _ed NP {that, whether} S Someone was told {that, whether} something happened. c. bother + NP was _ed {that, which NP} S Someone was bothered {that something, which thing} happened.

Sentence construction

Challenge Automate construction of a very large set of frames in a way that is sufficiently general to many verbs

Solution Construct semantically bleached frames using indefinites

(5) a. know + NP _ed {that, whether} S Someone knew {that, whether} something happened.

16 c. bother + NP was _ed {that, which NP} S Someone was bothered {that something, which thing} happened.

Sentence construction

Challenge Automate construction of a very large set of frames in a way that is sufficiently general to many verbs

Solution Construct semantically bleached frames using indefinites

(5) a. know + NP _ed {that, whether} S Someone knew {that, whether} something happened. b. tell + NP _ed NP {that, whether} S Someone was told {that, whether} something happened.

16 Sentence construction

Challenge Automate construction of a very large set of frames in a way that is sufficiently general to many verbs

Solution Construct semantically bleached frames using indefinites

(5) a. know + NP _ed {that, whether} S Someone knew {that, whether} something happened. b. tell + NP _ed NP {that, whether} S Someone was told {that, whether} something happened. c. bother + NP was _ed {that, which NP} S Someone was bothered {that something, which thing} happened.

16 Sentence construction

Challenge Automate construction of a very large set of frames in a way that is sufficiently general to many verbs

Solution Construct semantically bleached frames using indefinites

(5) a. know + NP _ed {that, whether} S Someone knew {that, whether} something happened. b. tell + NP _ed NP {that, whether} S Someone was told {that, whether} something happened. c. bother + NP was _ed {that, which NP} S Someone was bothered {that something, which thing} happened.

16 Measuring veridicality and factivity Task

...you will be given a statement and a question related to that statement. Your task will be to respond yes, maybe or maybe not, or no to the question, assuming that the statement is true. (cf. Karttunen et al. 2014)

18 Task

19 Task

20 • 348 verbs only in the active frame • 142 only in the passive frame • 27 in both

1,088 items randomly partitioned into 16 lists of 68

Stimuli

517 verbs from the MegaAttitude based on their acceptability in the [NP _ that S] and [NP was _ed that S] frames

21 • 348 verbs only in the active frame • 142 only in the passive frame • 27 in both

1,088 items randomly partitioned into 16 lists of 68

Stimuli

517 verbs from the MegaAttitude based on their acceptability in the [NP _ that S] and [NP was _ed that S] frames

22 • 142 only in the passive frame • 27 in both

1,088 items randomly partitioned into 16 lists of 68

Stimuli

517 verbs from the MegaAttitude based on their acceptability in the [NP _ that S] and [NP was _ed that S] frames

• 348 verbs only in the active frame

22 • 27 in both

1,088 items randomly partitioned into 16 lists of 68

Stimuli

517 verbs from the MegaAttitude based on their acceptability in the [NP _ that S] and [NP was _ed that S] frames

• 348 verbs only in the active frame • 142 only in the passive frame

22 1,088 items randomly partitioned into 16 lists of 68

Stimuli

517 verbs from the MegaAttitude based on their acceptability in the [NP _ that S] and [NP was _ed that S] frames

• 348 verbs only in the active frame • 142 only in the passive frame • 27 in both

22 Stimuli

517 verbs from the MegaAttitude based on their acceptability in the [NP _ that S] and [NP was _ed that S] frames

• 348 verbs only in the active frame • 142 only in the passive frame • 27 in both

1,088 items randomly partitioned into 16 lists of 68

22 Passive

(7) a. Someone was told that a particular thing happened. b. Someone wasn’t told that a particular thing happened.

(8) a. Someone was bothered that a particular thing happened. b. Someone wasn’t bothered that a particular thing happened.

Stimuli

Active

(6) a. Someone thought that a particular thing happened. b. Someone didn’t think that a particular thing happened.

23 (8) a. Someone was bothered that a particular thing happened. b. Someone wasn’t bothered that a particular thing happened.

Stimuli

Active

(6) a. Someone thought that a particular thing happened. b. Someone didn’t think that a particular thing happened.

Passive

(7) a. Someone was told that a particular thing happened. b. Someone wasn’t told that a particular thing happened.

23 Stimuli

Active

(6) a. Someone thought that a particular thing happened. b. Someone didn’t think that a particular thing happened.

Passive

(7) a. Someone was told that a particular thing happened. b. Someone wasn’t told that a particular thing happened.

(8) a. Someone was bothered that a particular thing happened. b. Someone wasn’t bothered that a particular thing happened.

23 • 10 ratings per item... • ...given by 10 different participants

Participants

160 unique participants through Amazon’s Mechanical Turk

24 • ...given by 10 different participants

Participants

160 unique participants through Amazon’s Mechanical Turk

• 10 ratings per item...

24 Participants

160 unique participants through Amazon’s Mechanical Turk

• 10 ratings per item... • ...given by 10 different participants

24 Results and analysis Raw responses

know prove think V(p) ¬V(p)

no yes no yes no yes 26 maybe maybe maybe Raw responses

know prove think V(p) ¬V(p)

no yes no yes no yes 27 maybe maybe maybe Raw responses

know prove think V(p) ¬V(p)

no yes no yes no yes 28 maybe maybe maybe Raw responses

know prove think V(p) ¬V(p)

no yes no yes no yes 29 maybe maybe maybe Raw responses

know prove think V(p) ¬V(p)

no yes no yes no yes 30 maybe maybe maybe Raw responses

know prove think V(p) ¬V(p)

no yes no yes no yes 31 maybe maybe maybe Raw responses

know prove think V(p) ¬V(p)

no yes no yes no yes 32 maybe maybe maybe Transformation (roughly) Map each verb to single two-dimensional point by assigning -1 to no, 0 to maybe, and 1 to yes, then take the mean.

Normalize Use ridit scoring to normalize for how often a particular partic- ipant gives a particular response. (Similar to z-scoring.)

Normalization

33 Normalize Use ridit scoring to normalize for how often a particular partic- ipant gives a particular response. (Similar to z-scoring.)

Normalization

Transformation (roughly) Map each verb to single two-dimensional point by assigning -1 to no, 0 to maybe, and 1 to yes, then take the mean.

33 Normalized responses p → V(p) ← ¬p

¬p ← ¬V(p) → p 34 (Similar to z-scoring.)

Normalization

Transformation (roughly) Map each verb to single two-dimensional point by assigning -1 to no, 0 to maybe, and 1 to yes, then take the mean.

Normalize Use ridit scoring to normalize for how often a particular partic- ipant gives a particular response.

35 Normalized responses p → V(p) ← ¬p

¬p ← ¬V(p) → p 36 Normalized responses p → Nonveridicals decide promise think hope

V(p) wish

believe ← ¬p

Frame a NP _ that S a NP was _ed that S

¬p ← ¬V(p) → p 37 Normalized responses

Factives

know love surprise hate find_out p → Nonveridicals decide promise think hope

V(p) wish

believe ← ¬p

Frame a NP _ that S a NP was _ed that S

¬p ← ¬V(p) → p 38 Normalized responses

Veridicals Factives

verify show know love prove find surprise hate show find_out ensure

indicate p → Nonveridicals decide promise think hope

V(p) wish

believe ← ¬p

Frame a NP _ that S a NP was _ed that S

¬p ← ¬V(p) → p 39 Normalized responses

Veridicals Factives

verify show know love prove find surprise hate show find_out ensure

indicate p → Nonveridicals decide promise think hope

V(p) wish

believe ←

fabricate

¬p pretend Antiveridicals mislead

misinform fake Frame a NP _ that S a NP was _ed that S

¬p ← ¬V(p) → p 40 Normalized responses

Veridicals Factives

verify show know love prove find surprise hate show find_out ensure

indicate p → Nonveridicals decide promise think hope

V(p) wish

believe ←

fabricate hallucinate ¬p pretend Antiveridicals mislead Antifactives?

misinform fake Frame a NP _ that S a NP was _ed that S

¬p ← ¬V(p) → p 41 Normalized responses p → V(p) ← ¬p

¬p ← ¬V(p) → p 42 Normalized responses

Veridicals Factives

verify show know love prove find surprise hate show find_out ensure

indicate

Nonveridicals decide promise think hope wish

believe

fabricate Veridicality hallucinate pretend Antiveridicals mislead Antifactives?

misinform fake Frame a NP _ that S a NP was _ed that S

Factivity 43 Relating factivity, veridicality, and question-taking

Question Do factivity/veridicality positively correlate with question-taking?

44 Correlation: factivity and question-taking Acceptability of [_ CP[+Q]]

Factivity 45 Intuition If a verb is acceptable in some frame that contains an interrog- ative , it is acceptable with interrogatives.

Measure of question selection

Acceptability of [ CP[+Q]] For a particular verb, maximum acceptability over all frames that contain an interrogative complement.

46 Measure of question selection

Acceptability of [ CP[+Q]] For a particular verb, maximum acceptability over all frames that contain an interrogative complement.

Intuition If a verb is acceptable in some frame that contains an interrog- ative complement, it is acceptable with interrogatives.

46 Correlation: factivity and question-taking Acceptability of [_ CP[+Q]]

Factivity 47 Correlation: factivity and question-taking Acceptability of [_ CP[+Q]]

Factivity 48 Correlation: factivity and question-taking Acceptability of [_ CP[+Q]]

Factivity 49 Correlation: veridicality and question-taking Acceptability of [_ CP[+Q]]

Veridicality 50 Correlation: veridicality and question-taking Acceptability of [_ CP[+Q]]

Veridicality 51 Correlation: veridicality and question-taking Acceptability of [_ CP[+Q]]

Veridicality 52 Two hypotheses

1. Previous analyses were biased by verb frequency. 2. Our analysis missed subregularities due to verb class.

What’s going on?

Question How could we have gotten the direction of correlation so wrong?

53 2. Our analysis missed subregularities due to verb class.

What’s going on?

Question How could we have gotten the direction of correlation so wrong?

Two hypotheses

1. Previous analyses were biased by verb frequency.

53 Finding #1 If we look at only the most frequent verbs, the correlations flip.

Finding #2 There are subregularities, but they don’t validate the purported correlation.

Two findings

54 Finding #2 There are subregularities, but they don’t validate the purported correlation.

Two findings

Finding #1 If we look at only the most frequent verbs, the correlations flip.

54 Correlation: factivity with all verbs Acceptability of [_ CP[+Q]]

55 Factivity Correlation: factivity with high-frequency verbs

know

write think showshow tell see say find

require Acceptability of [_ CP[+Q]]

56 Factivity Correlation: veridicality with all verbs Acceptability of [_ CP[+Q]]

57 Veridicality Correlation: veridicality with high-frequency verbs

know

write tell think show show say see find

require Acceptability of [_ CP[+Q]]

58 Veridicality What’s going on?

Question How could we have gotten the direction of correlation so wrong?

Two hypotheses

1. Previous analyses were biased by verb frequency. 2. Our analysis missed subregularities due to verb class.

59 Finding #2 There are subregularities, but they don’t validate the purported correlation.

Two findings

Finding #1 If we look at only the most frequent verbs, the correlations flip.

60 Two findings

Finding #1 If we look at only the most frequent verbs, the correlations flip.

Finding #2 There are subregularities, but they don’t validate the purported correlation.

60 1. veridicality/factivity 2. full syntactic distribution (not just question-taking)

Possibility The question-taking correlation holds in some clusters.

Finding subregularities

Aim Find overlapping clusters of verbs that best explain both...

61 2. full syntactic distribution (not just question-taking)

Possibility The question-taking correlation holds in some clusters.

Finding subregularities

Aim Find overlapping clusters of verbs that best explain both...

1. veridicality/factivity

61 Possibility The question-taking correlation holds in some clusters.

Finding subregularities

Aim Find overlapping clusters of verbs that best explain both...

1. veridicality/factivity 2. full syntactic distribution (not just question-taking)

61 Finding subregularities

Aim Find overlapping clusters of verbs that best explain both...

1. veridicality/factivity 2. full syntactic distribution (not just question-taking)

Possibility The question-taking correlation holds in some clusters.

61 MegaAttitude frames

Syntactic type

NP PP S

ACTIVE PASSIVE COMP TENSE

that [+Q] for ∅ [+FIN] [-FIN] [ NP] [ NP PP] [ PP] [ PP S] [ NP S] [ S] whether which NP -ed would to ∅ -ing

62 1. veridicality/factivity to syntactic distribution 2. syntactic distribution to veridicality/factivity

Veridicality Distributional representation representation

Veridicality Acceptability judgments judgments

Canonical Correlation Analysis (CCA)

Intuition Find best way of simultaneously mapping...

63 2. syntactic distribution to veridicality/factivity

Veridicality Distributional representation representation

Veridicality Acceptability judgments judgments

Canonical Correlation Analysis (CCA)

Intuition Find best way of simultaneously mapping...

1. veridicality/factivity to syntactic distribution

63 Canonical Correlation Analysis (CCA)

Intuition Find best way of simultaneously mapping...

1. veridicality/factivity to syntactic distribution 2. syntactic distribution to veridicality/factivity

Veridicality Distributional representation representation

Veridicality Acceptability judgments judgments

63 Canonical Correlation Analysis (CCA)

Intuition Find best way of simultaneously mapping...

1. veridicality/factivity to syntactic distribution 2. syntactic distribution to veridicality/factivity

Veridicality Distributional representation representation

Veridicality Acceptability judgments judgments

63 Canonical Correlation Analysis (CCA)

Intuition Find best way of simultaneously mapping...

1. veridicality/factivity to syntactic distribution 2. syntactic distribution to veridicality/factivity

Veridicality Distributional representation representation

Veridicality Acceptability judgments judgments

63 Canonical Correlation Analysis (CCA)

Intuition Find best way of simultaneously mapping...

1. veridicality/factivity to syntactic distribution 2. syntactic distribution to veridicality/factivity

Veridicality Distributional representation representation

Veridicality Acceptability judgments judgments

63 Canonical Correlation Analysis (CCA)

Intuition Find best way of simultaneously mapping...

1. veridicality/factivity to syntactic distribution 2. syntactic distribution to veridicality/factivity

Veridicality Distributional representation representation

Veridicality Acceptability judgments judgments

63 CCA verb scores CCA Component 2

CCA Component 1 64 CCA verb scores CCA Component 2

CCA Component 1 65 CCA verb scores CCA Component 2

Class communicative emotive neither CCA Component 1 66 CCA verb scores CCA Component 2

Class communicative emotive neither CCA Component 1 67 CCA frame loadings

NP to NP

to NP that S

toto NP NP whether thatto NP S futurewhether S future S whichNP to VP

NP whichNP S S

about NP to NP thatthat S SnotenseS NP that S that S notense NP to VPstative whichNP to VP whichNPwhether S to VP NP VPing NP that S notense that S whichNP S null so whether S NP that S future whether S future that S notense that S future

that S future NP whether S future about NP so NP VP to VPeventive VPing CCA Component 2 Slift whetherabout S whether S

whether to VP null NP whether S NP to VPeventive whether S future about whether S to VPeventiveto VPstative a active a passive for NPNP to to VP VPstative CCA Component 1 68 CCA loadings

npanim[T.to]

npinanim[T.bare]

complementizer[which]

complementizer[that]

complementizer[Q]tense[T.tensed]tense[T.past] tense[T.future] embedded_subject[T.TRUE]complementizer[direct] npinanim[T.about] complementizer[whether]complementizer[T]

progressive[T.TRUE]other[T.so] tense[T.null]npanim[T.bare] eventivity[T.eventive] other[T.about] infinitival[T.TRUE]complementizer[null] CCA Component 2 eventivity[T.stative] complementizer[aboutwhether]

complementizer[for] CCA Component 1 69 Positive finding Veridicality/factivity correlates with NP- and PP-taking (Goal / Experiencer arguments)

Discussion

Negative finding Veridicality/factivity does not correlate with question-taking

70 Discussion

Negative finding Veridicality/factivity does not correlate with question-taking

Positive finding Veridicality/factivity correlates with NP- and PP-taking (Goal / Experiencer arguments)

70 Possibility #2 Question selection can be reduced to semantic properties that control NP- and PP-taking

Discussion

Possibility #1 Veridicality/factivity can be reduced to semantic properties that control NP- and PP-taking.

71 Discussion

Possibility #1 Veridicality/factivity can be reduced to semantic properties that control NP- and PP-taking.

Possibility #2 Question selection can be reduced to semantic properties that control NP- and PP-taking

71 Conclusion Distribution of clauses Sensitive to intentional properties like representationality, pref- erentiality, factivity/veridicality, communicativity, etc.

Conclusion

Distribution of nominals Sensitive to event structural properties like stativity, telicity, du- rativity, causativity, transfer, etc.

73 Conclusion

Distribution of nominals Sensitive to event structural properties like stativity, telicity, du- rativity, causativity, transfer, etc.

Distribution of clauses Sensitive to intentional properties like representationality, pref- erentiality, factivity/veridicality, communicativity, etc.

73 Not intentional properties

Intuition Intentional properties require that an eventuality have infor- mational content, but not all eventualities have such content

Conclusion

Hypothesis The distribution of clauses is determined by the same semantic properties as the distribution of nouns

74 Intuition Intentional properties require that an eventuality have infor- mational content, but not all eventualities have such content

Conclusion

Hypothesis The distribution of clauses is determined by the same semantic properties as the distribution of nouns

Not intentional properties

74 Conclusion

Hypothesis The distribution of clauses is determined by the same semantic properties as the distribution of nouns

Not intentional properties

Intuition Intentional properties require that an eventuality have infor- mational content, but not all eventualities have such content

74 Findings

1. Veridicality and factivity do not correlate with question-taking 2. Veridicality and factivity correlate with NP- and PP-taking

Conclusion

Focus Two intentional properties—factivity and veridicality—that are argued to determine selection of interrogatives & declaratives

75 2. Veridicality and factivity correlate with NP- and PP-taking

Conclusion

Focus Two intentional properties—factivity and veridicality—that are argued to determine selection of interrogatives & declaratives

Findings

1. Veridicality and factivity do not correlate with question-taking

75 Conclusion

Focus Two intentional properties—factivity and veridicality—that are argued to determine selection of interrogatives & declaratives

Findings

1. Veridicality and factivity do not correlate with question-taking 2. Veridicality and factivity correlate with NP- and PP-taking

75 Approach Attempt to explicitly measure semifactivity.

Future directions

Limitation We didn’t distinguish between factivity and semifactivity.

76 Future directions

Limitation We didn’t distinguish between factivity and semifactivity.

Approach Attempt to explicitly measure semifactivity.

76 Future directions

Old prompt Someone _ed that a particular thing happened. Did that thing happen?

New prompt If someone _ed that a particular thing happened, did that thing happen?

77 Measuring semifactivity

Veridicals Factives

verify show know love prove find surprise hate show find_out ensure

indicate p → Nonveridicals decide promise think hope

V(p) wish

believe ←

fabricate hallucinate ¬p pretend Antiveridicals mislead Antifactives?

misinform fake Frame a NP _ that S a NP was _ed that S

¬p ← ¬V(p) → p 78 Measuring semifactivity

verify show know love prove find surprise hate show find_out ensure

indicate p → decide

promise think hope

V(p) wish

believe ←

fabricate hallucinate ¬p pretend mislead

misinform fake Frame a NP _ that S a NP was _ed that S

¬p ← ¬V(p) → p 79 Thanks

We are grateful to audiences at Johns Hopkins University and the University of Rochester for discussion of this work. We would like to thank Rachel Rudinger and Ben Van Durme in particular for useful comments.

This work was partly funded by NSF INSPIRE BCS-1344269 (Gradient symbolic computation) and the JHU Science of Learning Institute.

80 Bibliography I

Anand, Pranav & Valentine Hacquard. 2013. Epistemics and attitudes. and 6(8). 1–59. Anand, Pranav & Valentine Hacquard. 2014. Factivity, belief and . In Luka Crnič & Uli Sauerland (eds.), The Art and Craft of Semantics: A Festschrift for Irene Heim, vol. 1, 69–90. Cambridge, MA: MIT Working Papers in Linguistics. Beck, Sigrid & Hotze Rullmann. 1999. A flexible approach to exhaustivity in . Natural Language Semantics 7(3). 249–298. Bogal-Allbritten, Elizabeth A. 2016. Building Meaning in Navajo: University of Massachusetts, Amherst dissertation.

81 Bibliography II

Bolinger, Dwight. 1968. Postposed main phrases: an English rule for the Romance subjunctive. Canadian Journal of Linguistics 14(1). 3–30. Egré, Paul. 2008. Question-embedding and factivity. Grazer Philosophische Studien 77(1). 85–125. Farkas, Donka. 1985. Intensional Descriptions and the Romance Subjunctive Mood. New York: Garland Publishing. Fillmore, Charles John. 1970. The grammar of hitting and breaking. In R.A. Jacobs & P.S. Rosenbaum (eds.), Readings in English Transformational Grammar, 120–133. Waltham, MA: Ginn. George, Benjamin Ross. 2011. Question Embedding and the Semantics of Answers: University of California Los Angeles dissertation. Grimshaw, Jane. 1979. Complement selection and the lexicon. Linguistic Inquiry 10(2). 279–326.

82 Bibliography III

Grimshaw, Jane. 1990. structure. Cambridge, MA: MIT Press. Groenendijk, Jeroen & Martin Stokhof. 1984. Studies on the Semantics of Questions and the Pragmatics of Answers: University of Amsterdam dissertation. Gruber, Jeffrey Steven. 1965. Studies in Lexical Relations: Massachusetts Institute of Technology dissertation. Hintikka, Jaakko. 1975. Different Constructions in Terms of the Basic Epistemological Verbs: A Survey of Some Problems and Proposals. In The Intentions of Intentionality and Other New Models for Modalities, 1–25. Dordrecht: D. Reidel. Hooper, Joan B. 1975. On assertive predicates. In John P. Kimball (ed.), Syntax and Semantics, vol. 4, 91–124. New York: Academy Press. Jackendoff, Ray. 1972. Semantic Interpretation in . Cambridge, MA: MIT Press.

83 Bibliography IV

Karttunen, Lauri. 1971a. Implicative verbs. Language 340–358. Karttunen, Lauri. 1971b. Some observations on factivity. Papers in Linguistics 4(1). 55–69. Karttunen, Lauri. 1977a. Syntax and semantics of questions. Linguistics and Philosophy 1(1). 3–44. Karttunen, Lauri. 1977b. To doubt whether. In The CLS Book of Squibs, Chicago Linguistic Society. Karttunen, Lauri. 2012. Simple and phrasal implicatives. In Proceedings of the First Joint Conference on Lexical and , 124–131. Association for Computational Linguistics.

84 Bibliography V

Karttunen, Lauri, Stanley Peters, Annie Zaenen & Cleo Condoravdi. 2014. The Chameleon-like Nature of Evaluative Adjectives. In Christopher Piñón (ed.), Empirical Issues in Syntax and Semantics 10, 233–250. CSSP-CNRS. Kiparsky, Paul & Carol Kiparsky. 1970. Fact. In Manfred Bierwisch & Karl Erich Heidolph (eds.), Progress in Linguistics: A collection of papers, 143–173. The Hague: Mouton. Koenig, Jean-Pierre & Anthony R. Davis. 2001. Sublexical Modality and the Structure of Lexical Semantic Representations. Linguistics and Philosophy 24(1). 71–124. http://www.jstor.org/stable/25001804. Kratzer, Angelika. 2006. Decomposing attitude verbs. http://semanticsarchive.net/Archive/DcwY2JkM/ attitude-verbs2006.pdf .

85 Bibliography VI

Lahiri, Utpal. 2002. Questions and Answers in Embedded Contexts. Oxford University Press. Levin, Beth. 1993. English Verb Classes and Alternations: A preliminary investigation. Chicago: University of Chicago Press. Levin, Beth & Malka Rappaport Hovav. 2005. Argument Realization. Cambridge: Cambridge University Press. Moulton, Keir. 2009. Natural Selection and the Syntax of Clausal Complementation: University of Massachusetts, Amherst dissertation. Pesetsky, David. 1982. Paths and Categories: Massachusetts Institute of Technology dissertation. Pesetsky, David. 1991. Zero syntax: vol. 2: Infinitives.

86 Bibliography VII

Pinker, Steven. 1989. Learnability and Cognition: The Acquisition of Argument Structure. Cambridge, MA: MIT Press. Portner, Paul & Aynat Rubinstein. 2013. Mood and contextual commitment. In Semantics and Linguistic Theory, vol. 22, 461–487. Rawlins, Kyle. 2013. About ‘about’. In Todd Snider (ed.), Semantics and Linguistic Theory, vol. 23, 336–357. Scheffler, Tatjana. 2009. and German attitude verbs. University of Pennsylvania Working Papers in Linguistics 15(1). Spector, Benjamin & Paul Egré. 2015. A uniform semantics for embedded interrogatives: An answer, not necessarily the answer. Synthese 192(6). 1729–1784. Stalnaker, Robert. 1984. Inquiry. Cambridge University Press.

87 Bibliography VIII

Theilier, Nadine, Floris Roelofsen & Maria Aloni. 2017. What’s wrong with believing whether? In Proceedings of SALT 27,. Uegaki, Wataru. 2012. Content nouns and the semantics of question-embedding predicates. Proceedings of Sinn und Bedeutung 16 613–626. Uegaki, Wataru. 2015. Content nouns and the semantics of question-embedding. Journal of Semantics . Villalta, Elisabeth. 2000. Spanish subjunctive clauses require ordered alternatives. In Semantics and Linguistic Theory, vol. 10, 239–256. Villalta, Elisabeth. 2008. Mood and gradability: an investigation of the subjunctive mood in Spanish. Linguistics and Philosophy 31(4). 467–522.

88 Bibliography IX

White, Aaron Steven & Kyle Rawlins. 2016. A computational model of S-selection. In Mary Moroney, Carol-Rose Little, Jacob Collard & Dan Burgdorf (eds.), Semantics and Linguistic Theory, vol. 26, 641–663. White, Aaron Steven & Kyle Rawlins. 2017. Question agnosticism and change of state. In Proceedings of Sinn und Bedeutung 21, to appear. Zwicky, Arnold M. 1971. In a manner of speaking. Linguistic Inquiry 2(2). 223–233.

89