The Power of Arguments

A Survey Experiment of the Impact of Economic, Cultural and Poli;cal Frames on Support for Leaving/Remaining in the EU

MaDhew Goodwin (Kent), Simon Hix (LSE) and Mark Pickup (Simon Fraser) Brexit Arguments Mo5va5on

Forthcoming referendum on UK membership in the EU

Mo;va;on Mul;ple campaigns, e.g.: Theory Leave Side Remain Side Experiment Britain Stronger In Results Leave.EU Bri;sh Influence Conclusions Conserva;ves for Britain Labour In for Britain Conserva;ves for Reform in Europe ScoRsh Na;onal Party UK Independence Party Liberal Democrats Grassroots Out UKIP to Stay (?!) BeDer Off Out etc.

⇒ Voters bombarded with messages Which ones will work, and for which side? Brexit Arguments Plus opinion polls are ;ght, so “winning frames” during the campaign

could make a difference

Mo;va;on Theory Experiment Results Conclusions

Source: whatukthinks.org Brexit Arguments What we know about UK a=tudes towards the EU

Par;es maDer! Evidence from Bri;sh Elec;on Study 2015, Wave 6

%#Leave# %#Stay# Mo;va;on Theory 100%# Experiment 90%# Results 80%# Conclusions 70%# 60%#

50%#

40%# 30%# 20%# 10%# 0%#

UKIP# Labour# SNP/PC# LibDem# Other#party# Conserva9ve# Brexit Arguments Significant regional varia5on (BES 2015 Wave 6)

Midlands & Eastern

Mo;va;on Theory South East & South West Experiment Results Conclusions North E/W & Yorkshire

London

Wales 0 .05 .1 .15 .2 Support for Leaving EU (relative to Scotland) Brexit Arguments Other key covariates BES 2015 Wave 6. Mul;variate logit, N = 9,248, Psuedo R2 = 0.208

Average marginal effects with 95% CIs Left Mo;va;on Centre-Left Theory v. Centre Centre-Right Experiment Right Results Top issue: immigration Conclusions Top issue: economy Education: left <17 v. lef 20+ Eduction: left 17-19 Age: <25 Age: 26-35 v. 66+ Age: 36-45 Age: 46-55 Age: 56-65 Social class: C2DE Ethnicity: White English -.2 0 .2 .4 Probability of Supporting Leave EU (relative to baseline) Brexit Arguments Literature I – A=tudes towards the EU

Huge literature on public aRtudes to EU (e.g. review see Hobolt & de Vreese 2016)

Recent experimental work shows mul;-dimensional nature of opinions (e.g. Bechtel et al. 2014; Boomgaarden et al. 2011)

Mo;va;on Three explanatory frameworks rou;nely iden;fied: Theory Experiment 1. Economic factors – aRtudes towards trade integra;on, EU migra;on & Results integra;on driven by economic cost-benefit calcula;ons and/or personal asset Conclusions endowments, including educa;onal level (e.g. Gabel 1998; Hainmuller & Hiscox 2006, 2010)

2. Cultural factors – aRtudes influenced more by cultural threat than economic calcula;ons. Anxie;es over na;onal iden;ty & ethnic in-group key Likely to be relevant for EU Ref: unlike 1975 there is now strong associa;on between EU & immigra;on (Evans & Mellon 2016; Goodwin & Milazzo 2015) 3. Poli5cal factors – especially at referendums, aRtudes may be driven by domes;c poli;cal factors, such as party ID (e.g. Hug 2003, Hobolt 2009), and concerns about democracy and sovereignty (e.g. Abbarno & Zapryanova 2013) But each argument can be framed in a very different way, by media and campaigns…. Brexit Arguments Literature II – Message Framing Frames select and organise informa;on on issues, provide meaning, aDribute posi;ve or nega;ve values -> influence aRtudes (Entman 1993; Chong & Druckman 2007; de Vreese & Boomgaarden 2003) People can make very different decisions (e.g. EU Ref) when presented with message Mo;va;on that stresses posi/ve or nega/ve aspects of argument (Tversky & Kahneman 1981) Theory For example, Schuck and de Vreese (2006) found public support for EU varied Experiment significantly according to whether enlargement presented as ‘risk’ or ‘opportunity’ Results Past studies suggest that nega;ve framing of the EU as a threat (especially cultural) will Conclusions suppress public support for integra;on (McLaren 2002; Werts et al. 2012) Conversely, studies that frame EU membership as opportunity for benefits & gains will help to mobilise support for EU membership, but especially among certain groups….

-> Different framing effects for different social groups: Framing EU as threat will mobilize support for Leave among older, less well educated & lower social grade voters who are known to be more anxious over perceived threats from EU and immigra;on (Ford & Goodwin 2014; McLaren) Framing EU as posi;ve opportunity will resonate more strongly among younger, fiscally secure and more highly educated voters who are consistently most pro-EU Brexit Arguments

Some priors (not quite proposi;ons!)

Mo;va;on Aggregate level Theory Pro-EU economic framing should increase (reduce) support for Remain (Leave) Experiment An/-EU cultural framing should increase (reduce) support for Leave (Remain) Results An/-EU poli/cal framing should increase (reduce) support for Leave (Remain) Conclusions

Sub-group level

Pro-EU framing should affect “winners” (younger, ABC1s, southerners) An/-EU framing should affect “losers” (older, C2DEs, northerners) Brexit Arguments Experiment Design

Panel study, conducted by YouGov

Wave 1: In the field 24 Sept-1 Oct 2015 Mo;va;on Q1: EU referendum vote inten5on: “How would you vote if the referendum on Britain’s membership of the EU were held tomorrow? Theory (Remain in the EU / Leave the EU)” Experiment Q2. General EU a=tude: “On a scale of 0 to 10, how suppor/ve are you of Results Britain’s membership of the ?” Conclusions 0 = Strongly opposed to Bri/sh membership of the EU 10 = Strongly in favour of Bri/sh membership of the EU YouGov’s baDery of socio-demographics Wave 2: In the field 16 Oct-9 Nov 2015 Control group + 8 treatment groups: (randomly assigned & ordered) a ‘pro’ or ‘an;’ cultural argument + a ‘pro’ or ‘an;’ economic argument + a ‘pro’ or ‘an;’ poli/cal argument Then same 2 EU ques;ons from Wave 1 N = 5,333 (i.e. approx. 590 per group) Brexit Arguments Vigne[es – Cultural

Pro-EU cultural: “Britain shares important values with our European Mo;va;on neighbours, such as freedom of speech, gender equality, the rule of law, and respect for liberal democracy. Amid a world that seems less stable, and where Theory there are compe;ng ideologies, European countries can beDer promote and Experiment protect their values by ac;ng together, as members of the European Union. For Results Britain, remaining in the EU would help defend its na;onal culture, tradi;ons Conclusions and values.”

An5-EU cultural: “One of the founding pillars of the European Union is ‘free movement’, which allows ci;zens of EU member states to travel and work freely in other EU member states. But this free movement of migrant workers into Britain poses a threat to the country’s long established values and ways of life. For Britain, leaving the EU would help protect its na;onal culture, values and tradi;ons.” Brexit Arguments Vigne[es – Economic

Pro-EU economic: “Britain’s membership of the European Union aDracts significant inward foreign investment into the Bri;sh economy. The EU is Mo;va;on Britain’s major trading partner, which in 2014 accounted for 45% of exports and Theory 53% of imports of goods and services. It is es;mated that over three million Experiment jobs in Britain are linked, directly or indirectly, to its exports to the European Results Union. By remaining in the EU, these economic benefits would be Conclusions safeguarded.”

An5-EU economic: “The Eurozone economy is experiencing significant economic problems, including high debt and youth unemployment. Britain’s membership of the EU is also costly. In 2014 alone, Britain’s net contribu;on to the EU budget was an es;mated £9.8 billion, up from £3.3 billion in 2008. For Britain, remaining in the EU would risk its economic recovery and endanger the jobs of Bri;sh wage earners.” Brexit Arguments Vigne[es – Poli5cal

Pro-EU poli5cal: “If the European Union is to work in Britain’s interests, then Britain needs to be involved in the decision-making process. France and Mo;va;on Germany would have no incen;ve to listen to Britain if it is not working closely Theory with them as a member of the EU. If Britain were to leave the EU, to con;nue Experiment to trade with EU countries it will need to apply EU rules on trade, investment, Results product standards and services, but it will have no say when these rules are Conclusions made. For Britain, remaining in the EU would ensure that it enjoys these poli;cal benefits.”

An5-EU poli5cal: “By leaving the European Union, Britain would be able to set its own course. Britain does not need to be a member of the EU to play an important role in the world. Britain has a ‘porzolio of power’ in its own right, which includes membership of the G20 and G8 na;ons, a permanent seat on the UN Security Council, leadership of the Commonwealth of 54 na;ons, and a close rela;onship with the United States. London is the financial capital of the world. For Britain, leaving the EU would allow the country to regain its na;onal sovereignty while con;nuing to be a major power on the world stage.” Brexit Arguments Baseline change in the control group

50 43.9 44.0 Mo;va;on 45 Theory 40 38.2 37.1 Experiment 35 Results Conclusions 30 Remain

% 25 18.8 Leave 20 17.9 15 Don't Know 10 5 0 Wave 1 Wave 2 Brexit Arguments Control group “flows” from wave 1 to wave 2

Mo;va;on Theory Experiment Results Conclusions

Brexit Arguments Highly polarised a=tudes

Wave 1, all respondents

Remain Leave Don't Know Mo;va;on Theory 100 Experiment 90 Results 80 Conclusions 70 60 % 50 40 30 20 10 0 0 1 2 3 4 5 6 7 8 9 10 (944) (191) (318) (370) (307) (646) (330) (476) (505) (193) (679) Posi'on on EU a,tude scale (n) Brexit Arguments Balance between treatment groups

Means for treatment groups

Mo;va;on Control +C+E+P -C+E+P +C-E+P -C-E+P +C+E-P -C+E-P +C-E-P -C-E-P P>|t| Theory Leave (%), wave1 0.439 0.431 0.390 0.429 0.398 0.422 0.439 0.406 0.442 0.550 Experiment Remain (%), wave1 0.382 0.376 0.426 0.407 0.392 0.400 0.392 0.410 0.408 0.786 Results Party ID 2015 7.31 8.21 10.12 8.13 8.20 7.32 7.38 8.52 8.86 0.366 Conclusions Age 50.8 50.6 50.9 51.2 51.3 52.1 50.4 51.1 51.2 0.816

EducaQon level 3.26 3.26 3.21 3.32 3.31 3.26 3.32 3.31 3.33 0.930

Ethnicity 1.54 1.52 1.51 1.60 1.60 1.60 1.49 1.41 1.54 0.874 Gender 1.53 1.52 1.52 1.49 1.47 1.51 1.51 1.50 1.51 0.731 Household income 9.26 9.06 8.55 9.41 8.92 9.36 9.04 9.17 9.06 0.211 Social grade 2.52 2.22 2.30 2.20 2.24 2.21 2.23 2.22 2.22 0.942 Region 3.46 3.37 3.34 3.40 3.37 3.50 3.37 3.42 3.39 0.918 Brexit Arguments Results

Support for “Remain in EU” by treatment group in Waves 1 & 2

Control group - no vigne4es Mo;va;on Theory Pro Cultural, Pro Economic, Pro Poli

Conclusions An< Cultural, Pro Economic, Pro Poli

Pro Cultural, An< Economic, Pro Poli

An< Cultural, An< Economic, Pro Poli

Pro Cultural, An< Economic, An< Poli

An< Cultural, Pro Economic, An< Poli

An< Cultural, An< Economic, An< Poli

0.30 0.35 0.40 0.45 0.50 Percent support for Remain Brexit Arguments Difference-in-Difference analysis

W1 to W2 change in support for Remain/Leave by treatment group vs. W1 to W2 change in support for Remain/Leave in control group (90% CIs) Remain Leave Mo;va;on Pro Cult, Pro Econ, Pro Poli Theory Experiment Pro Cult, Pro Econ, Anti Poli Results Anti Cult, Pro Econ, Pro Poli Conclusions

Pro Cult, Anti Econ, Pro Poli

Anti Cult, Anti Econ, Pro Poli

Pro Cult, Anti Econ, Anti Poli

Anti Cult, Pro Econ, Anti Poli

Anti Cult, Anti Econ, Anti Poli

-.08 -.04 0 .04 .08 -.08 -.04 0 .04 .08 Brexit Arguments PPP vs AAA “flows” from wave 1 to wave 2

Pro Cultural, Pro Economic, Pro Poli5cal An5 Cultural, An5 Economic, An5 Poli5cal

Mo;va;on Theory Experiment Results Conclusions

Brexit Arguments Power of individual frames

Average effect (diff-in-diff) of a set of frames containing a par;cular vigneDe, rela;ve to the control group

Remain Leave

Mo;va;on Pro Cultural Theory Experiment Pro Economic Results Conclusions Pro Political

Anti Cultural

Anti Economic

Anti Political

-.05 -.025 0 .025 .05 -.05 -.025 0 .025 .05 Brexit Arguments Rela5ve volume of arguments

=> Volume is more important than type of argument Remain Leave

Mo;va;on 3 Pro / 0 Anti Theory Experiment Results Conclusions 2 Pro / 1 Anti

1 Pro / 2 Anti

0 Pro / 3 Anti

-.08 -.04 0 .04 .08 -.08 -.04 0 .04 .08 Brexit Arguments Effect of frames by sub-group: Party ID Pro-EU frames affect Labour voters most An;-EU frames affect Conserva;ves voters most Remain Don't Know Leave

Mo;va;on 3 Pro / 0 Anti Theory Experiment Results 2 Pro / 1 Anti Conclusions

1 Pro / 2 Anti

0 Pro / 3 Anti

-.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12

Conservatives Labour Brexit Arguments Effect on sub-groups: Social grade Pro-EU frames have a bigger effects on C2DE

Remain Don't Know Leave

Mo;va;on 3 Pro / 0 Anti Theory Experiment

Results 2 Pro / 1 Anti Conclusions

1 Pro / 2 Anti

0 Pro / 3 Anti

-.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12

ABC1 C2DE Brexit Effect on sub-groups: Age Arguments Pro-EU frames work on youngest, and with substan;ve effect An;-EU frames work on older, but with smaller effects Remain Don't Know Leave

Mo;va;on 3 Pro / 0 Anti Theory Experiment Results 2 Pro / 1 Anti Conclusions

1 Pro / 2 Anti

0 Pro / 3 Anti

-.3 -.2 -.1 0 .1 .2 .3 -.3 -.2 -.1 0 .1 .2 .3 -.3 -.2 -.1 0 .1 .2 .3

Age 18-24 Age 25-39 Age 40-59 Age 60+ Brexit Effect on sub-groups: Region Arguments Pro-EU and An;-EU frames more effec;ve in the North and Midlands & Eastern England Remain Don't Know Leave

Mo;va;on 3 Pro / 0 Anti Theory Experiment Results 2 Pro / 1 Anti Conclusions

1 Pro / 2 Anti

0 Pro / 3 Anti

-.12-.06 0 .06 .12 -.12-.06 0 .06 .12 -.12-.06 0 .06 .12

London Southern Midlands & Eastern Northern Brexit Arguments Subgroups: Moderates vs Extremists Moderates moved more than Extremists An;-EU frames ‘priced-in’ for Extremists Remain Don't Know Leave

Mo;va;on 3 Pro / 0 Anti Theory Experiment Results 2 Pro / 1 Anti Conclusions

1 Pro / 2 Anti

0 Pro / 3 Anti

-.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12

EU moderate Anti-EU extremist Pro-EU extremist Brexit Arguments Who are the ‘EU moderates’ ?

Conservative

Mo;va;on Labour Theory Experiment Age 18-24 Results Conclusions Age 25-39

Age 40-59

Female

Social class: C2DE

Midlands & East

-.05 0 .05 .1 .15 Brexit Arguments Who are the ‘EU Extremists’ ?

Conservative

Labour Mo;va;on Theory Age 18-24

Experiment Age 25-39 Results Conclusions Age 40-59 Female

Social class: ABC1

Education level: 20+

Income: £70k+

Midlands & East

-.4 -.2 0 .2

Pro-EU extremists Anti-EU extremists Brexit Arguments Are An5-EU arguments “priced in”? i.e. Mail/Express/Sun/Star readers (n=1,934) more likely to have heard an;-EU arguments already

Remain Leave

Pro Cult, Pro Econ, Pro Poli Mo;va;on Theory Pro Cult, Pro Econ, Anti Poli Experiment Results Anti Cult, Pro Econ, Pro Poli Conclusions Pro Cult, Anti Econ, Pro Poli

Anti Cult, Anti Econ, Pro Poli

Pro Cult, Anti Econ, Anti Poli

Anti Cult, Pro Econ, Anti Poli

Anti Cult, Anti Econ, Anti Poli

-.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12

Mail/Express/Sun/Star Other newspapers Brexit Arguments Conclusions

EU aRtudes are highly polarised and correlated with main social divisions

In a close referendum, argument framing could make all the difference Mo;va;on Our experimental design tests the effect of established “pro-Remain” and Theory “pro-Leave” vigneDes Experiment Results Main findings: Pro-EU arguments significantly increase support for Remain while an;-EU Conclusions arguments have less of an impact on support for either side

Po-EU frames increase support for Remain among Labour voters, undecided voters, lower social grades, younger & southern voters An;-EU arguments, when combined, reduce support for Remain among Conserva;ve voters, older voters & northerners Suggests that people not usually exposed to pro arg’s are responsive to them => an;-EU arguments are ‘priced in’ (afer 30+ years of an;-EU press) But, readers of an;-EU papers are persuaded by both Pro- and An;- arguments (?!)