The Power of Brexit Arguments
A Survey Experiment of the Impact of Economic, Cultural and Poli;cal Frames on Support for Leaving/Remaining in the EU
MaDhew Goodwin (Kent), Simon Hix (LSE) and Mark Pickup (Simon Fraser) Brexit Arguments Mo5va5on
Forthcoming referendum on UK membership in the EU
Mo;va;on Mul;ple campaigns, e.g.: Theory Leave Side Remain Side Experiment Vote Leave Britain Stronger In Results Leave.EU Bri;sh Influence Conclusions Conserva;ves for Britain Labour In for Britain Labour Leave Conserva;ves for Reform in Europe Business for Britain ScoRsh Na;onal Party UK Independence Party Liberal Democrats Grassroots Out UKIP to Stay (?!) BeDer Off Out etc.
⇒ Voters bombarded with messages Which ones will work, and for which side? Brexit Arguments Plus opinion polls are ;ght, so “winning frames” during the campaign
could make a difference
Mo;va;on Theory Experiment Results Conclusions
Source: whatukthinks.org Brexit Arguments What we know about UK a=tudes towards the EU
Par;es maDer! Evidence from Bri;sh Elec;on Study 2015, Wave 6
%#Leave# %#Stay# Mo;va;on Theory 100%# Experiment 90%# Results 80%# Conclusions 70%# 60%#
50%#
40%# 30%# 20%# 10%# 0%#
UKIP# Labour# SNP/PC# LibDem# Other#party# Conserva9ve# Brexit Arguments Significant regional varia5on (BES 2015 Wave 6)
Midlands & Eastern
Mo;va;on Theory South East & South West Experiment Results Conclusions North E/W & Yorkshire
London
Wales 0 .05 .1 .15 .2 Support for Leaving EU (relative to Scotland) Brexit Arguments Other key covariates BES 2015 Wave 6. Mul;variate logit, N = 9,248, Psuedo R2 = 0.208
Average marginal effects with 95% CIs Left Mo;va;on Centre-Left Theory v. Centre Centre-Right Experiment Right Results Top issue: immigration Conclusions Top issue: economy Education: left <17 v. lef 20+ Eduction: left 17-19 Age: <25 Age: 26-35 v. 66+ Age: 36-45 Age: 46-55 Age: 56-65 Social class: C2DE Ethnicity: White English -.2 0 .2 .4 Probability of Supporting Leave EU (relative to baseline) Brexit Arguments Literature I – A=tudes towards the EU
Huge literature on public aRtudes to EU (e.g. review see Hobolt & de Vreese 2016)
Recent experimental work shows mul;-dimensional nature of opinions (e.g. Bechtel et al. 2014; Boomgaarden et al. 2011)
Mo;va;on Three explanatory frameworks rou;nely iden;fied: Theory Experiment 1. Economic factors – aRtudes towards trade integra;on, EU migra;on & Results integra;on driven by economic cost-benefit calcula;ons and/or personal asset Conclusions endowments, including educa;onal level (e.g. Gabel 1998; Hainmuller & Hiscox 2006, 2010)
2. Cultural factors – aRtudes influenced more by cultural threat than economic calcula;ons. Anxie;es over na;onal iden;ty & ethnic in-group key Likely to be relevant for EU Ref: unlike 1975 there is now strong associa;on between EU & immigra;on (Evans & Mellon 2016; Goodwin & Milazzo 2015) 3. Poli5cal factors – especially at referendums, aRtudes may be driven by domes;c poli;cal factors, such as party ID (e.g. Hug 2003, Hobolt 2009), and concerns about democracy and sovereignty (e.g. Abbarno & Zapryanova 2013) But each argument can be framed in a very different way, by media and campaigns…. Brexit Arguments Literature II – Message Framing Frames select and organise informa;on on issues, provide meaning, aDribute posi;ve or nega;ve values -> influence aRtudes (Entman 1993; Chong & Druckman 2007; de Vreese & Boomgaarden 2003) People can make very different decisions (e.g. EU Ref) when presented with message Mo;va;on that stresses posi/ve or nega/ve aspects of argument (Tversky & Kahneman 1981) Theory For example, Schuck and de Vreese (2006) found public support for EU varied Experiment significantly according to whether enlargement presented as ‘risk’ or ‘opportunity’ Results Past studies suggest that nega;ve framing of the EU as a threat (especially cultural) will Conclusions suppress public support for integra;on (McLaren 2002; Werts et al. 2012) Conversely, studies that frame EU membership as opportunity for benefits & gains will help to mobilise support for EU membership, but especially among certain groups….
-> Different framing effects for different social groups: Framing EU as threat will mobilize support for Leave among older, less well educated & lower social grade voters who are known to be more anxious over perceived threats from EU and immigra;on (Ford & Goodwin 2014; McLaren) Framing EU as posi;ve opportunity will resonate more strongly among younger, fiscally secure and more highly educated voters who are consistently most pro-EU Brexit Arguments
Some priors (not quite proposi;ons!)
Mo;va;on Aggregate level Theory Pro-EU economic framing should increase (reduce) support for Remain (Leave) Experiment An/-EU cultural framing should increase (reduce) support for Leave (Remain) Results An/-EU poli/cal framing should increase (reduce) support for Leave (Remain) Conclusions
Sub-group level
Pro-EU framing should affect “winners” (younger, ABC1s, southerners) An/-EU framing should affect “losers” (older, C2DEs, northerners) Brexit Arguments Experiment Design
Panel study, conducted by YouGov
Wave 1: In the field 24 Sept-1 Oct 2015 Mo;va;on Q1: EU referendum vote inten5on: “How would you vote if the referendum on Britain’s membership of the EU were held tomorrow? Theory (Remain in the EU / Leave the EU)” Experiment Q2. General EU a=tude: “On a scale of 0 to 10, how suppor/ve are you of Results Britain’s membership of the European Union?” Conclusions 0 = Strongly opposed to Bri/sh membership of the EU 10 = Strongly in favour of Bri/sh membership of the EU YouGov’s baDery of socio-demographics Wave 2: In the field 16 Oct-9 Nov 2015 Control group + 8 treatment groups: (randomly assigned & ordered) a ‘pro’ or ‘an;’ cultural argument + a ‘pro’ or ‘an;’ economic argument + a ‘pro’ or ‘an;’ poli/cal argument Then same 2 EU ques;ons from Wave 1 N = 5,333 (i.e. approx. 590 per group) Brexit Arguments Vigne[es – Cultural
Pro-EU cultural: “Britain shares important values with our European Mo;va;on neighbours, such as freedom of speech, gender equality, the rule of law, and respect for liberal democracy. Amid a world that seems less stable, and where Theory there are compe;ng ideologies, European countries can beDer promote and Experiment protect their values by ac;ng together, as members of the European Union. For Results Britain, remaining in the EU would help defend its na;onal culture, tradi;ons Conclusions and values.”
An5-EU cultural: “One of the founding pillars of the European Union is ‘free movement’, which allows ci;zens of EU member states to travel and work freely in other EU member states. But this free movement of migrant workers into Britain poses a threat to the country’s long established values and ways of life. For Britain, leaving the EU would help protect its na;onal culture, values and tradi;ons.” Brexit Arguments Vigne[es – Economic
Pro-EU economic: “Britain’s membership of the European Union aDracts significant inward foreign investment into the Bri;sh economy. The EU is Mo;va;on Britain’s major trading partner, which in 2014 accounted for 45% of exports and Theory 53% of imports of goods and services. It is es;mated that over three million Experiment jobs in Britain are linked, directly or indirectly, to its exports to the European Results Union. By remaining in the EU, these economic benefits would be Conclusions safeguarded.”
An5-EU economic: “The Eurozone economy is experiencing significant economic problems, including high debt and youth unemployment. Britain’s membership of the EU is also costly. In 2014 alone, Britain’s net contribu;on to the EU budget was an es;mated £9.8 billion, up from £3.3 billion in 2008. For Britain, remaining in the EU would risk its economic recovery and endanger the jobs of Bri;sh wage earners.” Brexit Arguments Vigne[es – Poli5cal
Pro-EU poli5cal: “If the European Union is to work in Britain’s interests, then Britain needs to be involved in the decision-making process. France and Mo;va;on Germany would have no incen;ve to listen to Britain if it is not working closely Theory with them as a member of the EU. If Britain were to leave the EU, to con;nue Experiment to trade with EU countries it will need to apply EU rules on trade, investment, Results product standards and services, but it will have no say when these rules are Conclusions made. For Britain, remaining in the EU would ensure that it enjoys these poli;cal benefits.”
An5-EU poli5cal: “By leaving the European Union, Britain would be able to set its own course. Britain does not need to be a member of the EU to play an important role in the world. Britain has a ‘porzolio of power’ in its own right, which includes membership of the G20 and G8 na;ons, a permanent seat on the UN Security Council, leadership of the Commonwealth of 54 na;ons, and a close rela;onship with the United States. London is the financial capital of the world. For Britain, leaving the EU would allow the country to regain its na;onal sovereignty while con;nuing to be a major power on the world stage.” Brexit Arguments Baseline change in the control group
50 43.9 44.0 Mo;va;on 45 Theory 40 38.2 37.1 Experiment 35 Results Conclusions 30 Remain
% 25 18.8 Leave 20 17.9 15 Don't Know 10 5 0 Wave 1 Wave 2 Brexit Arguments Control group “flows” from wave 1 to wave 2
Mo;va;on Theory Experiment Results Conclusions
Brexit Arguments Highly polarised a=tudes
Wave 1, all respondents
Remain Leave Don't Know Mo;va;on Theory 100 Experiment 90 Results 80 Conclusions 70 60 % 50 40 30 20 10 0 0 1 2 3 4 5 6 7 8 9 10 (944) (191) (318) (370) (307) (646) (330) (476) (505) (193) (679) Posi'on on EU a,tude scale (n) Brexit Arguments Balance between treatment groups
Means for treatment groups
Mo;va;on Control +C+E+P -C+E+P +C-E+P -C-E+P +C+E-P -C+E-P +C-E-P -C-E-P P>|t| Theory Leave (%), wave1 0.439 0.431 0.390 0.429 0.398 0.422 0.439 0.406 0.442 0.550 Experiment Remain (%), wave1 0.382 0.376 0.426 0.407 0.392 0.400 0.392 0.410 0.408 0.786 Results Party ID 2015 7.31 8.21 10.12 8.13 8.20 7.32 7.38 8.52 8.86 0.366 Conclusions Age 50.8 50.6 50.9 51.2 51.3 52.1 50.4 51.1 51.2 0.816
EducaQon level 3.26 3.26 3.21 3.32 3.31 3.26 3.32 3.31 3.33 0.930
Ethnicity 1.54 1.52 1.51 1.60 1.60 1.60 1.49 1.41 1.54 0.874 Gender 1.53 1.52 1.52 1.49 1.47 1.51 1.51 1.50 1.51 0.731 Household income 9.26 9.06 8.55 9.41 8.92 9.36 9.04 9.17 9.06 0.211 Social grade 2.52 2.22 2.30 2.20 2.24 2.21 2.23 2.22 2.22 0.942 Region 3.46 3.37 3.34 3.40 3.37 3.50 3.37 3.42 3.39 0.918 Brexit Arguments Results
Support for “Remain in EU” by treatment group in Waves 1 & 2
Control group - no vigne4es Mo;va;on Theory Pro Cultural, Pro Economic, Pro Poli Conclusions An< Cultural, Pro Economic, Pro Poli Pro Cultural, An< Economic, Pro Poli An< Cultural, An< Economic, Pro Poli Pro Cultural, An< Economic, An< Poli An< Cultural, Pro Economic, An< Poli An< Cultural, An< Economic, An< Poli 0.30 0.35 0.40 0.45 0.50 Percent support for Remain Brexit Arguments Difference-in-Difference analysis W1 to W2 change in support for Remain/Leave by treatment group vs. W1 to W2 change in support for Remain/Leave in control group (90% CIs) Remain Leave Mo;va;on Pro Cult, Pro Econ, Pro Poli Theory Experiment Pro Cult, Pro Econ, Anti Poli Results Anti Cult, Pro Econ, Pro Poli Conclusions Pro Cult, Anti Econ, Pro Poli Anti Cult, Anti Econ, Pro Poli Pro Cult, Anti Econ, Anti Poli Anti Cult, Pro Econ, Anti Poli Anti Cult, Anti Econ, Anti Poli -.08 -.04 0 .04 .08 -.08 -.04 0 .04 .08 Brexit Arguments PPP vs AAA “flows” from wave 1 to wave 2 Pro Cultural, Pro Economic, Pro Poli5cal An5 Cultural, An5 Economic, An5 Poli5cal Mo;va;on Theory Experiment Results Conclusions Brexit Arguments Power of individual frames Average effect (diff-in-diff) of a set of frames containing a par;cular vigneDe, rela;ve to the control group Remain Leave Mo;va;on Pro Cultural Theory Experiment Pro Economic Results Conclusions Pro Political Anti Cultural Anti Economic Anti Political -.05 -.025 0 .025 .05 -.05 -.025 0 .025 .05 Brexit Arguments Rela5ve volume of arguments => Volume is more important than type of argument Remain Leave Mo;va;on 3 Pro / 0 Anti Theory Experiment Results Conclusions 2 Pro / 1 Anti 1 Pro / 2 Anti 0 Pro / 3 Anti -.08 -.04 0 .04 .08 -.08 -.04 0 .04 .08 Brexit Arguments Effect of frames by sub-group: Party ID Pro-EU frames affect Labour voters most An;-EU frames affect Conserva;ves voters most Remain Don't Know Leave Mo;va;on 3 Pro / 0 Anti Theory Experiment Results 2 Pro / 1 Anti Conclusions 1 Pro / 2 Anti 0 Pro / 3 Anti -.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12 Conservatives Labour Brexit Arguments Effect on sub-groups: Social grade Pro-EU frames have a bigger effects on C2DE Remain Don't Know Leave Mo;va;on 3 Pro / 0 Anti Theory Experiment Results 2 Pro / 1 Anti Conclusions 1 Pro / 2 Anti 0 Pro / 3 Anti -.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12 ABC1 C2DE Brexit Effect on sub-groups: Age Arguments Pro-EU frames work on youngest, and with substan;ve effect An;-EU frames work on older, but with smaller effects Remain Don't Know Leave Mo;va;on 3 Pro / 0 Anti Theory Experiment Results 2 Pro / 1 Anti Conclusions 1 Pro / 2 Anti 0 Pro / 3 Anti -.3 -.2 -.1 0 .1 .2 .3 -.3 -.2 -.1 0 .1 .2 .3 -.3 -.2 -.1 0 .1 .2 .3 Age 18-24 Age 25-39 Age 40-59 Age 60+ Brexit Effect on sub-groups: Region Arguments Pro-EU and An;-EU frames more effec;ve in the North and Midlands & Eastern England Remain Don't Know Leave Mo;va;on 3 Pro / 0 Anti Theory Experiment Results 2 Pro / 1 Anti Conclusions 1 Pro / 2 Anti 0 Pro / 3 Anti -.12-.06 0 .06 .12 -.12-.06 0 .06 .12 -.12-.06 0 .06 .12 London Southern Midlands & Eastern Northern Brexit Arguments Subgroups: Moderates vs Extremists Moderates moved more than Extremists An;-EU frames ‘priced-in’ for Extremists Remain Don't Know Leave Mo;va;on 3 Pro / 0 Anti Theory Experiment Results 2 Pro / 1 Anti Conclusions 1 Pro / 2 Anti 0 Pro / 3 Anti -.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12 EU moderate Anti-EU extremist Pro-EU extremist Brexit Arguments Who are the ‘EU moderates’ ? Conservative Mo;va;on Labour Theory Experiment Age 18-24 Results Conclusions Age 25-39 Age 40-59 Female Social class: C2DE Midlands & East -.05 0 .05 .1 .15 Brexit Arguments Who are the ‘EU Extremists’ ? Conservative Labour Mo;va;on Theory Age 18-24 Experiment Age 25-39 Results Conclusions Age 40-59 Female Social class: ABC1 Education level: 20+ Income: £70k+ Midlands & East -.4 -.2 0 .2 Pro-EU extremists Anti-EU extremists Brexit Arguments Are An5-EU arguments “priced in”? i.e. Mail/Express/Sun/Star readers (n=1,934) more likely to have heard an;-EU arguments already Remain Leave Pro Cult, Pro Econ, Pro Poli Mo;va;on Theory Pro Cult, Pro Econ, Anti Poli Experiment Results Anti Cult, Pro Econ, Pro Poli Conclusions Pro Cult, Anti Econ, Pro Poli Anti Cult, Anti Econ, Pro Poli Pro Cult, Anti Econ, Anti Poli Anti Cult, Pro Econ, Anti Poli Anti Cult, Anti Econ, Anti Poli -.12 -.06 0 .06 .12 -.12 -.06 0 .06 .12 Mail/Express/Sun/Star Other newspapers Brexit Arguments Conclusions EU aRtudes are highly polarised and correlated with main social divisions In a close referendum, argument framing could make all the difference Mo;va;on Our experimental design tests the effect of established “pro-Remain” and Theory “pro-Leave” vigneDes Experiment Results Main findings: Pro-EU arguments significantly increase support for Remain while an;-EU Conclusions arguments have less of an impact on support for either side Po-EU frames increase support for Remain among Labour voters, undecided voters, lower social grades, younger & southern voters An;-EU arguments, when combined, reduce support for Remain among Conserva;ve voters, older voters & northerners Suggests that people not usually exposed to pro arg’s are responsive to them => an;-EU arguments are ‘priced in’ (afer 30+ years of an;-EU press) But, readers of an;-EU papers are persuaded by both Pro- and An;- arguments (?!)