Running head: 3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 1

The 3-Perspectives Model for Understanding Documentaries:

An analysis of how entertainment, persuasion and objectivity influence the impact of

documentaries on political attitudes.

Master’s Thesis

Daniel K Schulz (10627162)

University of Amsterdam | Graduate School of Communication

Political Communication & Journalism

Supervisor: Anouk van Drunen

June 27th, 2014

9.305 words

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 2

Dedication

First of all, I would like to thank all the people that are dear to me, thus without them I would have never made it this far. Specifically I would like to thank my supervisor Anouk for guiding me during this stressful last period of my studies: Thank you for all the freedom and last minute help! Special thanks go to the organizers and admins of TOP DOCUMENTARY FILMS and

DOCUMENTRY ADDICT. You have made this sample size and research possible. Your work is truly great! To anyone who would like to watch documentaries online, check their websites out. Seeing this as my last piece of scientific contribution I would also like to thank the people who have made this journey possible for me in the past years: My family. Thank you Mom!

Thank you Dad! Thank you Grandma! I cannot express enough how thankful I am to be privileged to have you as my parents and mentors. Lastly I would like to thank Camilla and my housemates for all the love and patience that you had to endure when insomnia, writers-block or statistic-sickness got the better end of me.

Please note that you are viewing the:

X Full Academic APA Version (Ugly: only read this if you have to grade this)

Creative Magazine Version (Beautiful: read this if you hate technology)

Interactive PDF Version with embedded media (Recommended: Simply because it saves paper and you can click on stuff. What else could one want?!)

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 3

Abstract

Research on the effects of the film-genre documentaries has been largely neglected in the academic community. Arguing that documentaries make up a new breed of blurred media, mixing auteurist campaigning with styles of news-reporting together with the more than ever mainstream consumption as mere entertainment, this study builds and assesses a conceptual model of understanding this unexplored realm. Testing the 3-Perspectives Model with an online experiment (N=301) clearly indicated that the short political documentary “The Shock Doctrine by Naomi Klein and Alfonso Cuaron” induced omnidirectional attitude changes. Tests for statistical validity hinted towards a moderating role of respondents’ entertainment-perception on the strength of attitudinal. The implications of this study suggest that the most effective strategy to persuade a documentary’s audience is to divert the audience’s cognitive resistance efforts onto different topics whilst not overtly giving rational arguments for the actual line of persuasion.

Keywords:

Media Effects, Persuasion, Resistance, Entertainment, Objectivity, Political & Social Advocacy

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 4

Contents

Abstract ...... 3 Introduction ...... Error! Bookmark not defined. Theory ...... 7 Previous Findings on Documentaries ...... 7 Resistance and Reactance to Persuasion ...... 10 3-Perspectives Model of Persuasion and Resistance within Documentaries ...... 12 Methods ...... 16 Sample ...... 16 Research Design ...... 18 Results ...... 26 Testing Adequacy of Methods ...... 27 Testing Model Hypotheses ...... 32 Discussion...... 36 References ...... 43 Appendix 1 - Content Analysis ...... 48 Appendix 2 – Primers ...... 54 Appendix 3 – Primers Pretest ...... 57 Appendix 4 - Survey Questionnaire ...... 58 Appendix 5 – Statistical Tests & Tables ...... 69

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 5

We live in a time in which we constantly carry devices in our pockets or even on our faces that enable us to consume media every second of the day. New media as well as old media are an omnipresent factor in our lives. Consequently it has become the norm to use a fully integrated

360 degrees communication approach, leveraging on all forms of visual storytelling, when trying to persuade the public of any product or cause. In the realm of political communication, scholars and communications specialists have termed this development The Postmodern Period of

Political Communication (Strömbäck, 2007) or even proclaimed the Third Age of

Communication (Blumler & Kavanagh, 1999). Highly professionalized media campaigns and mass media advocacy efforts have become the standard of any political or social group.

Adding the relatively new affordability to produce and distribute persuasive films with the means of a couple of clicks, formerly niche social movements and civil disobedience organizations have hopped on the bandwagon and are producing persuasive content en masse. It is not a new revelation that the most prevailing choice for these kinds of advocacy efforts has been documentary films. However, when adding the abundance of highly professionalized communication specialists to the mix, the production value and persuasive qualities of documentaries have reached new heights. On top of that, from an audience perspective, the genre of documentaries has fully arrived in the mainstream. Documentaries have not only gained popular acknowledgment through film-prizes but now also make large profits in the cinemas

(Higgins, 2005). It is surprising that this rise in popularity with both filmmakers and audiences has not translated into scholarly interest. Most existing research on persuasive media effects can be divided into overt advertising (Bandura, 2001; McCarthy, 2004; Kniazeva, 2004; Laran,

Dalton and Andrade, 2011), news media (Schuck, Boomgaarden & Vreese, 2013; Ladd & Lenz,

2009; DellaVigna & Kapplan, 2008; Higgins, 2005), and fictional entertainment media (Moyer-

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 6

Gusé, 2008; Bhatnagar, Aksoy & Malkoc, 2004; Green, Garst & Brock, 2004; Higgins, 2005).

Whilst one can explain this academic negligence for documentaries with a marginalized popularity within the mainstream in the past, in times of their risen popularity and professional usage, it seems more than overdue to pay more attention to the medium . Therefore the first aim of this study is to clarify in how far the effects of political documentaries compare to the effects of the above mentioned categories. By showing a political documentary and testing to what extent it affects its audience’s political attitudes one can formulate the main research question as follows:

RQ1: To what extent do the persuasive messages of the political documentary “The

Shock Doctrine by Naomi Klein and Alfonso Cuaron” affect audiences’ political

attitudes?

The need for in depth research documentaries becomes clear at the very least when failing to find a commonly agreed definition for the term itself. Whilst the term documentary often implicates a very specific type of medium within the mindset of an individual, a common definition for what a documentary actually is, is far more difficult to come by. Higgins (2005), who discusses a current shift of popular understanding of the term documentary, roots the concept back to the emergence of Social Issues and Public Affairs Broadcasts (SIPA)

(Fitzsimmons & Osburn, 1968) or simply put: Informational documentaries. Higgins (2005) argues that the original popular understanding and connotations for this medium used to be clearly connected to truthful mass education and moreover a justifiable persuasion by an objective and powerful elite institution. She however concludes that this popular understanding of documentaries has been rather washed out and shifted to an acknowledgement of an “openly auteurist” and even “defiantly partisan” (p.22) nature for this medium; as a medium which can

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 7 moreover be consumed in more ways than for purposes of education or persuasion, namely entertainment. This perceived change in understanding is most fittingly coined by Green, Garst and Brock (2004), who describe documentaries as “blurred media” (p.165), for which its audience cannot entirely distinguish fiction and non-fiction.

Therefore the second part of this study is building on Higgins’ (2005) and Green, Garst and Brock’s (2004) work. It is important to investigate how the various general expectations and specific perceptions of documentaries, that seem to make the genre so special, can influence any effects found in the first part of this research. Therefore this study will extract theoretical ideas connected to the implications of differentiated interpretations about documentaries and build a model focused on the following research question:

RQ2: To what extent do audience perceptions of entertainment and objectivity moderate

a documentary’s effect on political attitudes?

Theory

Previous Findings on Documentaries

As already discussed before, the research on effects of the genre documentaries has been largely neglected. In the recent history Natalie Stroud (2007) has produced the only work on documentaries that has been cited to a significant amount. Her study on media effects and selective exposure stands for the entire range of research recently conducted on documentaries:

Although she found that the film did indeed result in attitude effects and a higher frequency of political discussion, her main argument was that of strengthened polarization, rather than a directional change in attitudes. This argument was mostly backed by her finding that people selectively exposed themselves to the documentary, meaning that people favoring the before

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 8 known message of the film were more likely to seek exposure to it than people with opposing viewpoints. Whilst these findings give a quite useful understanding of how documentaries can affect their audiences given the circumstances of actively selecting a movie in the cinema, notably quite a financial and timely effort, the spectrum of modern documentaries in an increasingly online environment are far not extensively explored in an academic way.

Additionally the previous research has mostly regarded the genre of documentaries with the premise of it being a biased piece of information, rather than delving deeper into the blurred forms of information, entertainment and persuasion, as discussed by Green, Garst and Brock

(2004). Nonetheless her findings suggest that one can expect to find a general impact on attitudes when showing a documentary to an audience:

H1: The documentary is expected to change political attitudes of its audience.

As Stroud (2007) found that a documentary changed viewers’ attitudes in the certain direction that was expected from the general argumentation and focus of the documentary, one can derive a set of hypotheses about the direction of attitude change discussed in H1. Following her findings one can expect that attitudes will change negatively when a topic is either argued against in a rational way, depicted as something unenjoyable, or brought into connection with a commonly undesirable topic or behavior. In the same manner one can expect a positive attitude change for a topic when it is rationally argued for, depicted as visually enjoyable, or brought into direct connection with a commonly desirable topic or behavior. Taking these expectations and applying them to the findings of the qualitative content analysis (which is largely discussed in the M-Section) one can expect the following attitudinal changes induced by the documentary of this study:

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 9

H1a: Respondents are expected to feel emotional about the imagery and change their

attitudes positively towards the rights of mentally ill patients.

H1b: The documentary is expected to influence its viewers negatively towards the idea of

a free market economy.

H1c: The documentary is expected to negatively influence its viewers’ evaluation of

democracy.

H1d: The documentary is expected to negatively influence its viewers’ belief that they

can influence politics.

H1e: The documentary is expected to positively influence its viewers’ belief that forms of

civil disobedience, such as illegal demonstrations, are a good way to influence politics.

Instead of directly building on Stroud’s (2007) research on selective exposure, findings that are sufficiently proven and reproduced at large (Levendusky, 2013; Knobloch-Westerwinck,

2012), this study will mainly focus on the specific attitudinal effects, which have not been paid attention to in the picture of blurred forms of media within documentaries. As discussed at large in a later point, different aspects in a documentaries narrative and argumentation can lead to very different interpretations and evaluations. Hence different attitudes concerning the documentary as well as the underlying political ideologies might be affected individually. As the main goal is to gain a better understanding on how these different, and often very individual, interpretations of messages have an effect on specific political attitudes, a subset of hypotheses (H1a – H1e) will be discussed in the Method & Results section.

Keeping in mind that Stroud’s (2007) findings showed polarization as the key effect in attitudinal change, rather than omnipresent directional change, it is important to control for

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 10 viewers previous attitudes and preferences. Deriving from her findings the following hypothesis can be formulated:

H2: The respondents’ attitudes are expected to polarize, instead of changing into a single

direction.

Resistance and Reactance to Persuasion

The need to analyze all three forms of interpretations of documentaries becomes clear when considering all implications we can gather from theories about the resistance towards persuasive messages. The base of understanding derives from Friestad and Wright’s (1994)

Persuasion Knowledge Model (PKM), which indicates that people’s knowledge about persuasion techniques influences their responses to persuasion attempts. In detail this means that any interpretation and evaluation of a persuasion attempt depend on the receiver’s agent knowledge, or the previous perceptions about the message sender, the persuasion knowledge, or the receiver’s identification of persuasion techniques, and lastly the topic knowledge, in other words the previous involvement and information the receiver held about the topic of the message.

According to their model the most common effects of interpreting a message as a persuasion attempt are disengagement and detachment from the ongoing interaction or message. A very compelling example of this negative effect of perceived persuasion is Laran, Dalton and

Andrade’s (2011) study on people’s perceptions of advertisement slogans. Their research shows that the mere perception of a sentence as a slogan, which is commonly known to be an attempt to persuade its recipients, instead of perceiving it as a simple statement influenced the respondents’ attitudes to be counter-intentional of the advertising message, whilst the statement influenced the respondents in the desired direction.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 11

The above described principle of resisting perceived persuasion or force was coined psychological reactance by Jack Brehm (1972). According to him the human need for self-determination leads to the motivation to reestablish free behavior, which in the case of a persuasion attempt has been threatened. Burgoon, Alvara, Grandpre and Voulodakis (2002) elaborated on this psychological principle and found that only certain types of persuasive messages, namely forceful or intense messages that impose a specific desired behavior, are likely to arouse reactance. They furthermore established three types of reactance to messages.

Depending on how threatened the receiver feels he is likely to engage in simply ignoring the persuasive attempt to derogating the source, ending up with a similar behavior that was previously described with the example of Laran et al. (2011): Engaging in more of the undesired behavior in order to demonstrate choice. Burgoon et al. (2002) fittingly named this reactant behavior the boomerang effect.

Since not only the strength of persuasion effect can be questioned, but also the direction of effect might be reversed, when receivers perceive a persuasive message as choice- threatening or simply persuasive, scholars have been looking to find ways in which this resistance to messages can be lowered in order to not encounter a reactant behavior. Whilst researchers have discussed whole strategies on how to counter reactance (Knowles & Linn,

2004), how to disrupt or minimize the perceived threat of an open persuasion (Fennis, Das &

Pruyn, 2004), or even how to use reactance for one’s own advantage by applying reverse psychology (Knowles & Linn, 2004), the most interesting realm of counteracting for this study is the strategy of preventing the receiver to recognize the persuasive attempt (Knowles & Linn,

2004; Matthes, Schemer & Wirth, 2007; Moyer-Guse, 2008; Green, Garst & Brock, 2004). One

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 12 of the most studied strategies to avoid the detection of the persuasion is the implementation of persuasive messages into entertainment narratives (Moyer-Guse, 2008; Green et al., 2004).

Connecting that prevalence of research on resistance to persuasion within entertainment with the reported development that documentaries are increasingly being watched for entertainment purposes (Higgins, 2005), the research on resistance and persuasion becomes very important for the understanding of documentaries’ effects. Reminding oneself of Green, Garst and Brock’s (2004) finding that documentaries are a blurred medium, the need to detangle the possible ways of consuming and interpreting messages in documentaries becomes most crucial for further investigation. The changes in documentary production as well as consumption force any analysis to differentiate between various ways of how they influence interpretation. Building up on Higgins’ (2005) and Green, Garst and Brock’s (2004) ideas three broad different categories of documentaries can be identified: Firstly proclaimed objective documentaries that are consumed with similar expectations and assumptions as news-articles. Secondly overtly partisan films, understood as media-campaigns and interpreted with all the connected reactions to persuasion. And lastly, especially induced by the changes in popular consumption, a new possibility to view documentaries as similar to pieces of entertaining narrative or even fiction arose. Deriving from this distinction and the help of Friestad and Wright’s (1994) PKM a scaled model can be developed that ranks the possible perceptions of persuasiveness and therefore implications for resistance within the three categories of interpretation.

3-Perspectives Model of Persuasion and Resistance within Documentaries

The perception of documentaries as biased forms of media campaigning clearly ranks highest in acknowledged persuasion attempts with its receivers. One can expect that receivers

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 13 perceive a documentary as most attempting to persuade if either the author, the channel of distribution or line of argumentation is openly biased or openly committed to a goal. One can therefore expect that receivers will interpret the messages as strong persuasion attempts, leading to a high recall of persuasion knowledge subsequently prompting a large amount of reactance towards the message goals if they are opposing previous attitudes of the receiver.

When documentaries are presented and interpreted as objective pieces of information or education, similar to a news report, one can expect that receivers will not interpret the messages as overtly persuasive as they would with the discussed form of interpretation as media campaign.

Receivers are expected to only apply their persuasion knowledge when the line of argumentation is perceived as biased. This means that only a biased part of a documentary is expected to provoke a reactance towards the message goals, whilst respondents might be more susceptible and less reactant to other less suspicious parts.

Lastly the identification of a documentary as a piece of art or entertainment should activate some if not all counter-reactance strategies, or as Moyer-Guse (2008) puts it, “an entertainment-education program is not perceived as having persuasive intent, it should

[therefore] not induce the kind of reactance that is often evoked by overtly persuasive messages”

(p.415). The argument is mainly built on the idea that either a dramatic narrative or the focus on artistic appearance distracts the receivers from recognizing persuasive intent. In terms of persuasion knowledge this suggests that receivers are not likely to cognitively engage and apply interpretations of persuasion attempts within the documentary, leaving one to expect that this form of consumption will provoke the least amount of reactance with its audience.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 14

Applying this model to the specific study at hand one can expect the above mentioned perspectives of interpretation to have an effect on the attitudinal influence of a documentary. To put this in form of a hypotheses one can expect:

H3a: The more entertaining respondents perceive the documentary, the less resistant

they are towards the persuasive messages, and hence the more they change their attitudes

in the previously desired directions. (Perceived entertainment will moderate the effect of

the stimulus documentary on political attitudes.)

H3b: The more objective respondents perceive the documentary, the less resistant they

are towards the persuasive messages, and hence the more they change their attitudes in

the previously desired directions. (Perceived objectivity will moderate the effect of the

stimulus documentary on political attitudes.)

One should note that these hypotheses are based on the assumption that the stimulus documentary is evaluated with distinct differences in regards to objectivity and entertainment. It is therefore necessary to consider the installment of a control component: Respondents should be influenced towards perceiving the documentary as more entertaining, informative or persuasive.

As discussed extensively in the M-Section a technique was used to influence the respondents’ contextual understanding and interpretation of the documentary. This method of influencing respondents’ evaluations of a message is called priming, a concept created by Salancik (1974). It stands for the psychological effect on individuals’ accessibility of information in one’s memory, subsequently influencing their information processing and evaluation of given topics. In this case this means that priming respondents with information about the context, in which the documentary is broadcasted, should influence their perception about how informative, entertaining or persuasive the nature of this film is.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 15

Taking the concepts of resistance and reactance at hand, a very specific dimension must be discussed considering the documentary of this study. As the film tends to use persuasive techniques and narratives that are usually found in popular conspiracy theories, it is important to address the issues of the general receptiveness to conspiracies, or how Craig and Gregory (1999) call it: the respondents’ Conspiracist Ideation. According to their findings, one can measure people’s susceptibility to believe commonly disregarded information and theories to be truthful.

The higher this ideation is the more likely they are to believe in unrelated narratives, both non- fiction and fiction, with similarly arranged argumentations. In that same reasoning people with a low ideation are more likely to reject narratives as untrue, merely due the fact that they usually disregard stories with a similar structure of argumentation as untruthful. In the case of this documentary the implication is that people with such low conspiracy theory should have a higher reactance to the arguments of the documentary at hand because of it conspiracist-like argumentation, hence allowing for smaller changes in attitudes.

Combining all hypotheses of this section, this research aims to test if a political documentary has an effect on political attitudes and whether this effect is moderated by different evaluations of the documentary. A graphic summary always helps to clarify the nature and idea of this research. Figure 1 presents exactly that: A visualized model of all expected effects within this research.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 16

Figure 1: Visualized model of expected effects

Methods

Sample

Since Stroud (2007) found that the main concept connected to documentaries is the effect of selective exposure, it seems rational to focus on a sample that would be very likely to expose itself to the documentary voluntarily. Surely this selection diminishes the possibility to make widely generalizable claims within a large population that a randomized sample representing society as a whole could have done. However it can be assumed that the used purposeful sample is more representative to the actual audience of a documentary, hence measuring exactly that kind of population that would be exposed to the documentary in reality.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 17

Given the limited resources for this

research the sampling was based on a

purposeful snowball technique. The

two websites Top Documentary Films

(http://topdocumentaryfilms.com/) and

Documentary Addict

(http://documentaryaddict.com/), both

aggregators for large databases of

freely available documentaries online,

were approached to recruit participants

for the experiment and feature a link to the survey on their social media channels and websites. Furthermore participants of the experiments were asked to share a link to the experiment on their respectable social media channels. Due to the pages’ and participants’ link-sharing the provided link appeared on 1,595

Facebook users’ newsfeeds and generated the desired sample size of N=301 within 7 days.

Figure 2 presents one of the posts that was disseminated on social media.

Given the purposefulness of the sampling technique it is not surprising that a vast majority of 93.8% of the respondents find documentaries enjoyable. It is safe to assume that the purpose of the sampling was therefore effective. The two other most defining commonalities of this sample were that 90.1% had at least some college degree and 76.1% resided in Europe,

17.5% respectively in North America and 6.4% in the rest of the world. Furthermore the general composition of the sample is comprised as follows: 39.9% of the respondents were male and

58.1% were female. 87.4% of the entire sample was between 18 and 35 years old (Mean = 28;

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 18

Median = 24). This information makes it safe to say that the sample can be described as highly educated young adults form an Anglo-European culture setting who enjoy watching documentaries.

This description is important to keep in mind when assessing any outcomes of the study. One should be aware that the trends are not necessarily applicable to the general public. A good example of that is the average attitude of the sample towards the Free Market Economy:

Whilst 54.5% of the sample had negative sentiments against the idea of a Free Market whilst a randomized sample of the Pew Research Center’s (2009) Global attitudes project showed that throughout the population in Western Europe (UK, France, Germany and Italy) only 29% had negative sentiments against the Free Market economy. With taking this comparison only as an example, this means that all findings can only be reliably stated for the above mentioned sampling technique.

Research Design

In order to understand the affective processes of a documentary in most detail an experiment seemed the most appropriate. Similar to the reasoning of how to choose the sample a purposeful selection of variables and possible influencers seemed more valuable than an inclusion of all possible influencers that occur in a daily life. Therefore the choice fell on a simple repeated measure attitude test before and after a stimulus, in this case a short political documentary.

Since the experiment was conducted online it was crucial to find a conclusive piece of documentary that would not be too long for respondents to lose interest and drop out of the experiment and at the same time offer enough differentiated possibilities for respondents to

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 19 interpret the film in the three ways that were discussed in the theory section. The 6 minutes version of The Shock Doctrine by Naomi Klein and Alfonso Cuaron

(https://www.youtube.com/watch?v=aSF0e6oO_tw) combined at least two of the three possible interpretations, namely as media campaign or as piece of entertainment. The journalist Jason

Sondhi describes this short clip as follows: “Part documentary, half advertisement and in places an artistic short film, with a solid dose of agit-prop thrown in, The Shock Doctrine is a slick piece of media that employs a smorgasbord of filmic and graphic techniques.” (Sondhi, 2007)

Whilst this film was originally produced to advertise a book with the same title, it does indeed mix film techniques common in documentary films, with artistic features usually found in entertainment films. At the same time the narrator makes a very overt persuasion attempt for people to take action. This left room enough for individual interpretations by the respondents according to their previous beliefs about documentaries as well as a great platform to prime respondents towards the three discussed models without having to show three different documentaries that would discuss the same topic. Figure 3 presents four screenshots of the documentary representing the mood and visual style:

Figure 3: Presentation of the artistic visualization of the documentary

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 20

And indeed an analysis of how the documentary was evaluated in the experiment showed that respondents agreed most with evaluating the documentary as informative (M=5.28,

SD=1.28) followed by finding it on average somewhat entertaining (M=4.95, SD=1.05).

Respondents evaluated the objectivity significantly lower (M=3.54, SD=1.60). Nonetheless respondents liked the documentary somewhat on average (M=4.91, SD=1.64). These evaluations were useful to test whether former expectations about documentaries in general had any influence on the actual perception of the documentary.

In order to systematically condense the narrative of the documentary into topic clusters that could possibly affect a certain sets of attitudes, a qualitative content analysis was used as the basis of understanding1. Every topic, public person or political theme was rated in regards to how central they were to the storyline, into what direction the position seemingly tried to push the audience into, and how rational or emotional that persuasive argumentation was. Using Zuwerink and Cameron’s (2003) summary of resistance strategies, possible strategies such as source derogation, negative affect, biased assimilation or attitude bolstering were noted. Additionally descriptions of the perceived overtness of the persuasion attempt and possible interpretations in regards to entertainment and information value were stated. Based on the found focus topics and persuasiveness the film at hand can be roughly categorized into the theme of anti-capitalist/anti- elitist conspiracy theory.

The documentary starts off with a visually disturbing depiction of electric shock therapy as treatment for mental illness. Considering the level of negative excitement, this depiction could

1 For a detailed overview please turn to Appendix 1 - Content Analysis on page 48.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 21 possibly steer viewers into disapproving of shock treatment and into support of more agency for mentally ill patients. The argumentation follows moderately by relating the shock-therapy principle to interrogation techniques of the CIA. Again negatively if not disturbingly presented, such depiction seemed to aim to push viewers into disapproving of the CIA and its techniques.

For further analysis it should be noted that both of these argumentation styles are mainly leveraging on emotional appeal rather than cognitive information to persuade. A sudden change in perspective towards economic backgrounds and societal crises such as 9/11 and the 2004

Tsunami quickly spirals the argumentation into commonly used frames of elite domination of the common man. Whilst still keeping up the emotional appeal, the persuasion strategy clearly tries to appeal to rational arguments against the idea of a Free Market Economy, foreign military involvements and current politicians in power. In the same context demonstrations are somewhat depicted as tool against the powers of politicians and “free market oppression” and could therefore influence viewers’ attitudes positively towards them. As a final element, historical context is shown in order to function as examples of the discussed theories. The contextual examples are flickering in fast frequency through the video, almost too quick to consciously process them, therefore rather overwhelming with possible emotional and affective responses rather than stimulating cognitive processes. Clustering all 51 individual topics into broad categories that could then be tested within a quantitative survey the following themes emerged:

Mental Illness, The Free Market Economy, US Foreign Policy, Torture, Civil Disobedience and

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 22

Conspiracist Ideation. Furthermore the findings of this content analysis are used as the base for the creation for the sub-hypotheses of H12: H1a, H1b, H1c, H1d and H1e.

The quantitative survey3 was then built inquiring about the attitudes towards the above found categories. For the purposes of analysis all attitudes were asked on a Likert-scale (from 1

= strongly disagree to 7 = strongly agree) measuring their agreement to 20 individual statements:

As the focus of the documentary was not necessarily the stigmatization of mentally ill people itself, the focus of questions rather laid on the issue of shock therapy and normative implications of inflicting pain as doctors. The questions were built by using the documentary’s own terminology asking the respondents about their agreement whether mentally ill patients should be able to decide what treatment to receive, whether they should have the same rights and obligations as healthy people, and whether doctors should be allowed to inflict pain on for the treatment of mental illness. Similarly the topic of US foreign policy and government violence was not addressed directly but rather used as a tool to arouse emotions in order to set the mood.

Therefore three statements about the agreement with US foreign policy, military force as solution in foreign crises and torture to save civilians, were asked to assess the respondents’ feelings about these out-of-focus attitudes.

The main focus of the documentary was found to be the discussion on use and necessity of the free market economy. In order to ensure comparability to other findings all questions regarding this cluster were taken from the economic testing part of the Pew Research Center’s

2 Find the hypotheses here: Previous Findings on Documentaries .

3 For a complete overview please turn to Appendix 4 - Survey Questionnaire.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 23

(2009) Global attitudes project. Considering the normative implications that the documentary made into account, measuring attitudes about the principles of democracy and civil participation reliably was more complex. As Bollen (1990) discusses it is hard to find reliable measures of what constitutes democracy let alone what individuals connote with that idea. Therefore the following statements aimed less at measuring attitudes about the global idea of democracy but rather about the connotations that came with the stimulus film: Respondents were asked to agree or disagree with whether democracy is the ideal system to govern people; politicians in their country have more power than they should; they have the ability to influence politics; and whether they felt that legal or illegal demonstrations are a good way to influence politics. Lastly, as discussed in H3 (p.12) statements controlling for Craig and Gregory’s (1999) Conspiracist

Ideation were posed. Using question-sets from Craig and Gregory (1999) as well as Brotheron,

French and Pickering (2013) four underlying dimensions of beliefs in conspiracies were being tested for. The first dimension consisted of statements that tested the respondents’ self- assessment about mistrust in authority and disadvantage in society. The other three dimensions were measured with statements about the beliefs in government conspiracies against their own citizens, small-group conspiracies to rule world politics and information control conspiracies to keep crucial information from the public.

In order to test whether the survey questions effectively measured the above discussed clusters in political attitudes a principal component analysis (PCA) was conducted on the 20 individual questions on the political attitudes with oblique rotation (promax). The KMO measure

(.705) proved the sampling adequacy for the analysis (good according to Hutcheson &

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 24

Sofroniou, 1999). Deriving a threshold of factor loadings above 0.64, six clusters could be retained. As expected in the planning of the survey these clusters were: 1 = Conspiracist Ideation

(α = .73), made up from questions taken from Craig and Gregory’s (1999) work on attitudes on conspiracies, therefore a measurement of the respondents’ general receptiveness to conspiracies;

2 = Attitudes towards the Free market Economy (α = .81); 3 = Attitudes towards government violence (α = .67), made out of the attitudes towards torture, military force, and US foreign policy; 4 = Attitudes towards civil rights of Mentally Ill people (α = .62), which interestingly was not correlated to the opinions about whether a doctor should be able to inflict pain if deemed helpful for the treatment; 5 = Attitudes towards civil disobedience (α = .60), mainly made up by attitudes about legal and illegal demonstrations. Two other factors are made up from single questions, namely 6 = respondents’ self-perceived ability to change the course of their government and above mentioned 7 = opinion on whether pain should be allowed in order to treat mentally ill people. As the reported Cronbach’s alpha (α) show, all clusters showed a good internal consistency and were therefore reliable.

Besides inquiring about political attitudes the survey was also designed to find out about the respondents’ attitudes towards documentaries. Firstly a set of comparative questions was asked about the general preferences in different film genres to control for the sample purpose and find any irregularities regarding preferences. Secondly, based on of Higgins’ (2005) possible

4 Please turn to Factor loadings for clusters in Political Attitudes to view the exact Factor loadings and clusters.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 25 classifications, a set of thirteen statements5 regarding expectations about the educational, entertaining or persuasive value of documentaries in general were posed to which the respondents indicated how far they agreed (Likert-scale: from 1 = strongly disagree to 7 = strongly agree). Continuing to use the same scale format, respondents were asked to evaluate the documentary on 21 points after watching. These points constituted assessments of entertainment value, information value, level of objectivity and bias, liking of the documentary, and agreement with the social cause of the documentary.

Testing whether the survey questions effectively measured the above evaluation measurements the answers were clustered via another PCA with oblique rotation (promax). The

KMO measure (.902) showed that the sampling was more than adequate for the analysis

(excellent according to Hutcheson & Sofroniou, 1999). Extracting the variables with factor loadings above 0.76, five clusters could be retained. Concurring with the planned methods in the survey they can be named as following: 1 = Agreement with Information (α = .92), made up from attitudes about the informative value, societal benefit of the documentary, and agreement with the points made in the documentary; 2 = Perceived Entertainment Value (α = .89), made up by self-assessments about the respondents’ excitement and enjoyment as well as attitudes about the artistic and entertaining qualities of the film; 3 = Perceived Objectivity (α = .89); 4 = Topic

Knowledge (only one answer); and 5 = Perceived level of persuasion (only one answer). These

5 For a complete overview please turn to Appendix 4 - Survey Questionnaire.

6 Please turn to Factor loadings for clusters in Stimulus Evaluation to view the exact Factor loadings and clusters.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 26 tests prove that the planned clustering of political attitudes was successful. The Cronbach alphas showed a very high reliability.

Concerning the need to assure different interpretations of the documentary to test the 3-

Perspectives Model primers were implemented as discussed in the theory section. In this case, priming respondents with information about the context in which the documentary was broadcasted was aimed to influence their perception about how informative, entertaining or persuasive the nature of this film was going to be. As seen in figures A2a, A2b, and A2c7 the primers were aimed at contextualizing the documentary in the setting of a website that supposedly published the documentary: a) A simulation of the CNN World news website presented a descriptive focus on the informational value, was expected to prime the respondents to evaluate the documentary as more informative; b) A simulation of the Occupy Movement’s website, a social activist group, with a focus on the argumentative and persuasive value, which was expected to prime respondents to evaluate the film’s content as more biased and persuasive; and c) A simulation of the Raindance film festival’s website with a focus on the documentary’s artistic value, which was expected to prime respondents to evaluate the film’s content as more entertaining than the other two primers.

Results

7 Please turn to Appendix 2 – P to view a full version of the primers as they were presented to the respondents.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 27

Testing Adequacy of Methods

The respondents’ general expectations about documentaries indeed showed the blurred understanding of what makes up a documentary. Interestingly the majority of 95.3% watch documentaries to be educated but only 48.6% expect documentaries to be objective. Combined with the facts that 92.9% find an exciting narrative important and 74.9% find it important that a documentary is artistic, one can support Higgins’ (2005) categorization as a blurred media:

People actively strive to be educated by documentaries, however also expect to be entertained.

On top of that one half of the sample does see documentaries as an objective entity whilst the other half acknowledges its biased nature. In other words this was a direct validation of the 3-

Perspectives Model (PPRD) assuming that people can interpret films within the genre documentaries in a differentiated way. For the study this meant that people might evaluate the stimulus documentary in various ways, leaving the assumption that these evaluations might have an impact on the effects of the stimulus itself.

Regression analyses were conducted to test former expectations predicted the posttest evaluations of the stimulus documentary. Correlating these evaluations with another, a

Regression analysis indicated that the perceived entertainment value and the perceived objectivity explained 47.9% of the variance of liking the documentary (R²=.479, F(2,208)=95.66, p=.000). This means that perceiving the documentary as entertaining predicted liking of the documentary (β=.807, p=.000) as did perceiving the documentary as objective (β=.343, p=.000).

Controlling for the influence of general expectations about documentaries one should state that a stated general enjoyment of documentaries does significantly influence the perceived entertainment of the stimulus documentary (R²=.076, F(1,209)=17.19, p=.000)(β=.305, p=.000).

Nonetheless the Regression analysis only explained about 7.6% of the variance in perceiving the

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 28 documentary as entertaining. Considering that this regression was the only significant one testing for influences on evaluations about entertainment one can state that the evaluation of this documentary is barely influenced by general expectations towards documentaries.

Table 1: Summary of general evaluations of the stimulus documentary

Perceived Persuasion Perceived Entertainment Perceived Objectivity

Valid 245 246 246 N= Missing 56 55 55

Mean 4.77 4.82 3.70

Median 5.00 5.00 3.50

Std. Deviation 1.50 1.11 1.49

Variance 2.25 1.23 2.22

The evaluations of the stimulus documentary themselves are presented in table 4. Whilst the table gives an adequate overview how the documentary itself was assessed on average, the more important scores to look at are the variances of these means. For the purpose of testing the research model the small standard deviation and variance is to be seen negative. In other words, for an analysis to test whether the different evaluations had an effect on political attitudes the evaluations must be different enough. In the case of this sample respondents found the stimulus documentary overwhelmingly and homogeneously entertaining but rather not objective.

Subsequently the test for whether the primers induced the sample to give a differentiated evaluation of the documentary failed, although a small qualitative pretest (N=13), which had been conducted to assess, whether the primers would influence respondents in their evaluation of the documentary, suggested that a variance could be expected. The screenshots were shown to

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 29 pretest respondents, who were then informally questioned about their expectations and evaluations of the documentary. The pretest suggested that the before mentioned expectations could be verified. However when analyzing the larger quantitative sample with three one-way

ANOVAs to test for the effectiveness of the primers on the entertaining, objectivity and informative evaluations of the respondents, the only statistically significant difference was yielded with the test for perceived objectivity (F(2,208)=3.217, p =.042). A Post-Hoc test showed that the group that had seen the screenshot of the Occupy website evaluated the objectivity lower (M =3.31,SD=1.29) than the groups that had seen the CNN website (M=3.86,

SD=1.49) or the Sundance website (M=3.89, SD=1.49). The one-way ANOVAs for perceived entertainment (F(2,208)=1.117, p=.329) and perceived informational value (F(2,208)=.487, p=.730) showed that the group that had seen the Sundance website had a tendency to view the documentary as more entertaining and informative than the other two groups. These tendencies were however were not statistically significant. It is fair to say that the primers worked in the desired direction, however not effectively.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 30

CNN Sundance Occupy

5.5

5

4.5

4

3.5

3 Perceived Entertainment Perceived Persuasion Perceived Objectivity CNN 4.8443 4.64 3.875 Sundance 5.0468 4.56 3.8571 Occupy 4.8689 5.12 3.3115

Figure 4: Visualization of the Influence of primers on the evaluation of the stimulus documentary

Correspondingly the primers did not significantly influence political attitudes. None of the ANOVAs conducted, that compared the attitudinal means, yielded big enough F-values or showed statistical significance. This means that the method of priming did not work to generate a significant variance of evaluations within the sample. In regards to the model this means that a controlled evaluation of the documentary was not possible, as seen in figure 5:

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 31

Figure 5: Research Model with focus on effect of primers (full line= significant; dotted line= not significant)

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 32

Testing Model Hypotheses

Before Stimulus After Stimulus

5.5

5

4.5

4

3.5

3

2.5

2

1.5

Attitudes Attitudes Attitudes Attitudes Attitudes towards: towards: towards: towards: towards: Rights of Free market Governmen Democracy US Foreign Conspiracist Mentally Ill Economy t Violence Policy Ideation

M before 4.24 3.51 2.40 5.08 2.65 3.92 Stimulus SD = 1.26 SD = 1.27 SD = 1.00 SD = 1.44 SD = 1.16 SD = .99 M after Stimulus 4.56 3.28 2.27 4.83 2.46 4.11 SD = 1.31 SD = 1.30 SD = .96 SD = 1.47 SD = 1.16 SD = 1.03 M difference + .32 - .23 - .13 - .25 - .19 + .19 t-value t = 5.765 t = -4.604 t = -4.131 t = -4.335 t = -4.254 t = 5.331 Significance p = .000 p = .000 p = .000 p = .000 p = .000 p = .000

Figure 6: Summary of statistically significant mean changes in political attitudes measured by

paired sample-t-tests. All means were measured on a scale from 1(strongly disagree) to

7(strongly agree). N=209

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 33

The measurements in figure 7 show that the stimulus documentary had a clearly negative and statistically significant impact on the respondents’ attitudes towards the free market economy, government violence, democracy as ideal system and US foreign policy. Furthermore respondents showed a statistically significant more positive attitude towards the rights of mentally ill people and conspiracy theories. The paired sample-t-test for attitudes towards cluster civil disobedience showed a slightly positive change from M=4.44, SD=1.19 to M=4.50,

SD=1.34 (scale from 1 to 7), however these observances were not statistically significant

(t(209)=1.38, n.S. (p=.168)). Looking upon attitude changes for single questions the largest effect was measured for attitudes about inflicting pain on mentally ill if deemed helpful for their treatment. The mean changed from M=3.04, SD=1.51 to M=2.55, SD=1.55 (on a scale from 1 to

7) (t(210)=-6.71, p=.000). These findings validate hypotheses 1a (expected positive change towards the rights of mentally ill patients), 1b (expected negative change towards the idea of a free market economy) and 1c (expected negative change towards evaluation of democracy) however show that hypotheses 1d and 1e could not be proven to be statistically significant.8

In order to control for the Stroud’s (2007) found polarization effect on the outcomes of hypotheses 1a – 1e a closer look was taken at the previous political attitudes of the respondents.

The scaled responses for pretest attitudes towards the Free Market Economy, Rights of Mentally ill patients, Government Violence, and Civil Disobedience were recomputed into dummy variables, categorizing the answers into positive and negative attitudes. These new variables

8 For a presentation of all individual statements being tested please turn to Paired Sample t-Test for individual questions

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 34 made it possible to compare whether a previously negative attitude towards a topic would lower or even invert a positive effect of the documentary. A series of independent sample t-tests showed that respondents with positive attitudes towards the Free Market Economy (M=-.39,

SD=.85) changed their attitudes significantly different than respondents with negative attitudes

(M=-.06, SD=.64) (t(156)=2.813, p=.006), respondents with negative attitudes towards the rights of mentally ill patients (M=.56, SD=1.03) changed their attitudes significantly different than respondents with negative attitudes (M=.17, SD=.85) (t(171)=3.009, p=.003), and respondents with positive attitudes towards government violence (M=.86, SD=1.17) changed their attitudes significantly different than respondents with negative attitudes (M=-.11, SD=.47) (t(194)=3.853, p=.000). These results actually showed that respondents with positive attitudes towards the Free

Market Economy changed more drastically into the negative direction than respondents with previously negative attitudes. The same finding was observed with attitudes towards mental illness, previously negative attitudes yielded a greater change towards the positive, and attitudes towards government violence, previously positive attitudes yielded greater change towards the negative. As these findings prove the opposite of what could be expected with polarization, hypothesis 2 can be rejected: All attitudinal changes occurred into the same direction.

Table 2: Summary of t-test on polarization effects

Mean Change of Mean Change of Attitude Change Difference in previously previously negative t df p-value towards: Mean Change positive Attitudes attitudes Free Market - .391 - .056 .334 2.813 156 .009 Economy Rights of Mentally .170 .557 .387 3.009 171 .003 Ill Government - .857 - .109 .748 3.853 194 .000 Violence Civil .029 .026 .003 - .033 176 .974 Disobedience

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 35

Although the primers, in form of website screenshots, did not generate any direct and statistically significant mean differences in political attitudes a series of regression analyses were conducted to test whether different perceptions of entertainment and objectivity had an effect on changes in political attitudes. However none of the 28 regression analyses9 yielded statistical significance. The only analysis that was close to produce statistically significant results was a linear regression analysis to test the influence of perceived entertainment on the change in attitudes towards the free market economy (R²=.017, F(1,209)=3.62, p=.058)(β= -.089, p=.058).

The missing significance of results leaves hypotheses 3a and 3b to be disproven with the current sample and study.

Figure 7 presents a visualized summary of the tested hypotheses and shows what implications they had on the model. An extensive explanation follows in the next chapter:

9 Please turn to Testing Effects of Evaluations on Change in Political Attitudes view a summary of all Regression analyses.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 36

Figure 7: Summary of tested Hypotheses (Black = statistically significant; Red = not significant)

Discussion

Before discussing any found effects at large, one should keep the context of this study in mind.

Considering the purposeful sampling due to a theoretical buildup on selective exposure, the findings are not generalizable to the broad public, but only applicable to the description of the sample: Highly educated young adults from an Anglo-European culture setting, who enjoy watching documentaries. Reminding oneself of the unusually high average of negative sentiment towards the Free Market Economy, it is not implausible that the sample in this study has more consistent irregularities compared to a truly randomized sample. Although tests showed that previous attitudes towards the Free market Economy influenced neither evaluations of the documentary nor any change in attitudes, it is possible that other prerequisites of the sample had impacts, which were not controlled for.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 37

This paper has discussed the lack of research on documentaries at large. Building on the risen popularity and professionalization of this genre one can argue that it was overdue to shed more light on the underlying principles and effects of documentaries on their audiences. The first part of this research was therefore aimed to find empirical backing for this call to further focus on this genre by analyzing the general influence of political documentaries on political attitudes.

Indeed the confirmation of most parts of Hypothesis 1 showed that the documentary at hand significantly affected its audience’s attitudes on political matters discussed in the documentary.

Interestingly all attitudinal effects occurred in the expected direction. In other words a documentary that depicted the democratic processes as flawed and more so overtly argued against the idea of a Free Market Economy, US Foreign Policy or government violence, stirred its audience to report significantly more negative attitudes towards all of the mentioned themes.

Incidentally the largest attitudinal effect could be observed on a topic that was not central to the argumentative storyline: Used as a compelling narrative to emotionally touch the audience, the depiction of shock-treatment on mentally ill patients induced the largest shift in attitudes. This was taken as a first indication that the theory about strategies to overcome resistance (Moyer-

Guse, 2008) could be confirmed: By removing the recognition of overt persuasion, the reactance seemed to be lowered, allowing for greater attitudinal changes.

When assessing the finding that all attitudinal changes occurred into the same direction,

H2, which expected a clear polarization of attitudes, had to be rejected. Accounting for the existing research on documentaries by Stroud (2007) these findings surprised. It seems as if the documentary’s persuasion was especially strong with respondents who had previously stated opposing attitudes towards the direction the documentary tried to push for, indicating that posttest attitudes were mostly regulated by the stimulus documentary, rather than by previously

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 38 stated attitudes. This suggests that the documentary was very effective in moving its viewers to a very specific level of attitudinal strength. Surely one should not see this as an affirmative proof for the all so notoriously known Hypodermic Model (Bineham, 1988). Although the effects found are immense, one has to consider a large limitation of this research: The short interval between stimulus and attitudinal measurement. The findings clearly deliver no proof for any long term attitudinal effect. This means that the possibility exists that the effects of the documentary might dissolve, as soon as the film has left the conscious and cognitive memory of its viewers.

Especially in regards to political attitudes most efforts of persuasion are aimed at long and sustainable changes of attitudes rather than the measured short term effect. Due to the limited resources it was impossible to conduct more measurements at a later point in time, examining long term effects. Whilst the current findings are still significant and suggest the previously stated implications, future research should account for the long term effects, controlling whether attitudinal changes are actually sustainable.

These findings open up new questions regarding the involved influence of resistance. On the one side, attitudes were affected by overt persuasion, and more so in a unidirectional way, whilst on the other side even larger effects could be observed with topics that were positioned outside of the persuasive narrative. The resulting implications leave one to question how strong the involvement of resistance towards the persuasion actually was. Whereas the experimental method aimed to indicate resistance with the occurrence of attitude bolstering or polarization, as discussed in Zuwerink and Cameron’s (2003) work about resistance strategies, none of the two behaviors could be found with the respondents. Nonetheless one can argue that resistance, although slightly, could be observed: Non-persuasive parts of the narrative had a greater attitudinal effect than the overtly persuasive parts. In other words, the messages that tried

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 39 to persuade the audience with cognitive argumentation and examples affected attitudes less than messages that aimed to build up to the persuasive messages with emotionally compelling imagery.

As H3, composed from the literature on effects of entertainment media (Moyer-

Guse, 2008) and resistance strategies (Zuwerink & Cameron, 2003), suggested, the stronger effect of non-persuasive and artistic messages were anticipated in the design of this research.

Conceptualizing the 3-Perspectives Model, the second part of this study was directly aimed to shed light on the moderators, perceived entertainment and perceived objectivity (RQ2). Focusing on the pure direction of observed effects one could see a suggested confirmation of the model:

Higher perceived Entertainment predicted a more negative attitudinal change towards the Free

Market Economy and US Foreign Policy whilst predicting a more positive attitude change towards Civil Disobedience. However none of these findings were statistically significant. The fact that most expectations actually occurred in the expected directions, can be taken as indication that the model is correct, was however not tested properly. Analyzing the data for possible reasons of such statistical fallacy of the model one can assume that the main reason for such insignificance in results is the chosen documentary and its overall positive homogeneous evaluation by the audience. It becomes apparent that the decision to show a single documentary due to reasons of feasibility was hindering for the second part of the analysis. The audience evaluated the documentary too homogeneously, leaving no room for actual comparison. Whilst the limitations of showing only one stimulus were anticipated, the undertaking to counter this risk of homogeneity in form of showing primers before the actual stimulus did not work in the quantitative research.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 40

Although a short qualitative pretest gave confidence that the broad quantitative sample would assess the entertainment value in different ways, the priming screenshots failed to stand up to the test in a statistically significant manner. The learnings from this are clear: In order to truly validate or disprove the 3-Perspectives Model further research must adjust the way people are influenced to perceive its entertainment and objectivity value. Since the priming of respondents with simple information beforehand was not adequate enough to influence their perception, more resources should be spent on modifying the documentary itself in certain ways to cut either, entertainment or persuasion significantly. To give the example of this specific documentary, one version should exchange all artistic features, such as graphic stimulations and music with monotone pictures without music, whilst the other should cut the historic explanations, letting the film appear more than a graphic novel rather than a traditional documentary.

Disregarding the statistical insignificance of the matter for a second, one is provided with a very informative set of results. Combining the specific assessments of the qualitative content analysis with the attitudinal effects of the stimulus, the hints towards a confirmation of the 3-

Perspectives Model become strong enough to encourage a more resourced approach to statistically test the theory. Although most attitudinal clusters were affected in general, the largest attitudinal changes occurred with topics and themes that were not central to the persuasive narrative: Because the depiction of electronic shock therapy on mentally ill patients was used as a stylistic mood-setter instead of adding logical support for the documentary’s aim to change people’s minds about democratic decision making processes, it was met with the least resistance, ergo the largest attitudinal shift. Similar observations can be made about attitudinal change towards US foreign policy.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 41

Should the findings be proven statistically correct at a later point in time, the implications would be large for filmmakers and media professionals. Being aware that audiences seem to only focus on the main persuasion that they interpret as most overt, persuasive strategies can leverage on that. Especially in times in which people become more and more aware of advertising and persuasive strategies (Friestad & Wright, 1994) this limited attention can help to hide the true persuasive agenda. The key seems to be to make the main persuasive efforts of a movie appear to lie on a topic that one does not intend to change, whilst presenting the actual persuasive focus without any normative or judgmental intent. Viewers should only be prompted to process the actual persuasion in the peripherals of their cognitive ability, whilst they are busy defending their attitudes against a persuasion that is not even meant to succeed. Being aware of these implications for embedded persuasive strategies within entertainment media, I suggest to media analysts and regulators to spend more efforts on analyzing seemingly peripheral and unintended parts of the narratives, as they can actually influence their audience larger than the central ones.

All in all, this study should be seen as the first basic step to analyze the genre documentaries. A basic model for understanding the complex components of the genre, namely the 3-Perspectives Model, was created. Having established the three possible paradigms of interpretation, objective truth reporting, biased media campaigning, and mere entertainment without informational value, the next future step is to find adequate ways to reliably test the hypotheses. Although none of the tests for the moderating influence of entertainment and objectivity yielded significant results, the effect directions and the presented theoretical background from other realms of media studies give confidence that a study with more resources and timely possibilities could quite possibly result in more significant outcomes. Especially the finding that different topics, which were not part of the main persuasive narrative, induced a

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 42 greater change in attitudes than the overtly persuasive topics shows that the hypotheses are on the right track and merely need more sophisticated attention.

If these suggestions should not be compelling enough, the general attitudinal shifts caused by the documentary should be more than enough reason to gain more scholarly interest for documentaries. After all documentaries have arrived in the mainstream and political actors increasingly use them. The more effort political and social groupings put into producing this mix made out of campaign, entertainment and news-information, the more important it becomes for people to understand what effects documentaries can possibly have on attitudes, and why.

One thing is for certain: In the third age of communication (Blumler & Kavanagh, 1999) political campaigners with persuasive intent will most definitely try to leverage on any hint of attitude-changing effect that they could possibly use. Furthermore the time has passed in which only well-established professionals, with proper ethical codes and training, have the means to distribute their material to large audiences. The risk is too high that malicious communicators, who were previously barred to the fringes of society, now experiment and eventually succeed in using new powerful persuasion-techniques before they are fully understood by scientists.

Regulators and concerned citizens cannot afford to be left in the dark about the possible implications of the findings discussed in this study.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 43

REFERENCES

Ahluwalia, R. (2000). Examination of psychological processes underlying resistance to persuasion.

Journal of Consumer Research, 27(2), 217-232.

Babbie, E. (2008). The basics of social research (4th edition). Belmont, California: Thomson

Wadsworth.

Bandura, A. (2001). Social cognitive theory of mass communications. In Bryant, J. & Zillman (Eds.).

Media effects: Advances in theory and research (2nd ed.), 121-153. Hillsdale, NJ: Lawrence

Erlbaum.

Bhatnagar, N, Aksoy, L. & Malkoc, S. (2004). Embedding brands within media content: The impact

of message, media and consumer characteristics on placement efficacy. In Shrum, L. (Ed.). The

psychology of entertainment media: Blurring the lines between entertainment and persuasion.99-

116. Mahwah, New Jersey: Lawrence Erlbaum.

Bineham, J. (1988). A historical account of the hypodermic model in mass communication.

Communication Monographs, 55(1), 230-246.

Blumler, J. & Kavanagh, D. (1999). The third age of political communication: Influences and

features. Political Communication, 16(3), 209-230.

Bollen, K. (1990). Political democracy: conceptual and measurement traps. Studies in Comparative

International Development, 25(1), 7-24.

Brehm, J. W. (1972). Responses to the loss of freedom: A theory of psychological reactance. General

Learning Press.

Brotheron, R., French, C. & Pickering, A. (2013). Measuring belief in conspiracy theories: The

generic conspiracist beliefs scale. Frontiers in Psychology. 4(1), 1-15.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 44

Bruder, M., Haffke, P., Neave, N., Nouripanah, N. & Imhoff, R. (2013). Measuring individual

differences in generic beliefs in conspiracy theories across cultures: Conspiracy mentality

questionnaire. Frontiers in Psychology, 4(225), 1-15.

Burgoon, M., Alvaro, E., Grandpre, J., & Voulodakis, M. (2002). Revisiting the theory of

psychological reactance. The persuasion handbook, 213-232.

Campbell, D. (1950). The indirect assessment of social attitudes.Psychological Bulletin, 47(1), 15-38.

Craig, T. & Gregory, W. (1999). Beliefs in conspiracies. Political Psychology, 20(3), 637-647.

DellaVigna, S. & Kaplan, E. (2007). The Fox News effect: Media bias and voting. The Quarterly

Journal of Economics, 122(3), 1187-1234.

Dillard, J & Peck, E. (2000). Affect and persuasion: Emotional responses to public service

announcements. Communication Research, 27(4), 461-495.

Dovidio, J. & Fazio, R. (1992). New technologies for the direct and indirect assessment of

attitudes. Questions about questions: Inquiries into the cognitive bases of surveys, 21, 204-237.

Erdelyi, M. & Zizak, D. (2004). Beyond Gizmo Subliminality. In Shrum, L. (Ed.). The psychology of

entertainment media: Blurring the lines between entertainment and persuasion.13-44. Mahwah,

New Jersey: Lawrence Erlbaum.

Fennis, B. M., Das, E. H., & Pruyn, A. T. H. (2004). “If You Can’t Dazzle Them with Brilliance,

Baffle Them with Nonsense”: Extending the Impact of the Disrupt-Then-Reframe Technique of

Social Influence. Journal of Consumer Psychology, 14(3), 280-290.

Fitzsimmons, S. & Osburn, H. (1968). The impact of social issues and public affairs television

documentaries. The Public Opinion Quarterly, 32(3), 379-397.

Freedman, P. & Goldstein, K. (1999). Measuring media exposure and the effects of negative

campaign ads. American journal of political Science, 1189-1208.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 45

Friestad, M., & Wright, P. (1994). The persuasion knowledge model: How people cope with

persuasion attempts. Journal of consumer research, 1-31.

Green, M., Garst, J. & Brock, T. (2004). The power of fiction: Determinants and boundaries. In

Shrum, L. (Ed.). The psychology of entertainment media: Blurring the lines between

entertainment and persuasion.161-176. Mahwah, New Jersey: Lawrence Erlbaum.

Haugtvedt, C. & Petty, R. (1992). Personality and persuasion: Need for cognition moderates the

persistence and resistance of attitude changes. Journal of Personality and Social Psychology,

63(2), 308-319.

Herr, P. (1989). Priming price: Prior knowledge and context effects. Journal of Consumer Research,

16(1), 67-75.

Higgins, L. (2005). Documentary in an age of terror. South Central Review, 22(2), 20-38.McCarthy,

J. (2004). Product Placements: How to measure their Impact. In Shrum, L. (Ed.). The psychology

of entertainment media: Blurring the lines between entertainment and persuasion.63-78.

Mahwah, New Jersey: Lawrence Erlbaum.

Huber, G. & Arceneaux, K. (2007). Identifying the persuasive effects of presidential advertising.

American Journal of Political Science, 51(4), 957-977.

Kniazeva, M. (2004). Between the ads: Effects of nonadvertising TV Messages on consumption

behavior. In Shrum, L. (Ed.). The psychology of entertainment media: Blurring the lines between

entertainment and persuasion. 213-232. Mahwah, New Jersey: Lawrence Erlbaum.

Knobloch‐Westerwick, S. (2012). Selective exposure and reinforcement of attitudes and partisanship

before a presidential election. Journal of Communication, 62(4), 628-642.

Knowles, E. S., & Linn, J. A. (2004). Approach-avoidance model of persuasion: Alpha and omega

strategies for change. Resistance and persuasion, 117-148.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 46

Ladd, J. & Lenz, G. (2009). Exploiting a rare communication shift to document the persuasive power

of the news media. American Journal of Political Science, 53(2), 394-410.

Laran, J., Dalton, A. N., & Andrade, E. B. (2011). The curious case of behavioral backlash: Why

brands produce priming effects and slogans produce reverse priming effects. Journal of

Consumer Research, 37(6), 999-1014.

Levendusky, M. S. (2013). Why Do Partisan Media Polarize Viewers? American Journal of Political

Science, 57(3), 611-623.

Matthes, J., Schemer, C., & Wirth, W. (2007). More than meets the eye. International Journal of

Advertising, 26(4), 477-503.

McCarthy, J. (2004). Product Placements: How to measure their Impact. In Shrum, L. (Ed.). The

psychology of entertainment media: Blurring the lines between entertainment and persuasion.

63-78. Mahwah, New Jersey: Lawrence Erlbaum.

Moyer-Gusé, E. (2008). Toward a theory of entertainment persuasion: Explaining the persuasive

effects of entertainment-education messages. Communication Theory, 18(3), 407-425.

Murry, J., Stam, A. & Lastovick, J. (1996). Paid- versus donated-media strategies for public service

announcement campaigns. Public Opinion Quarterly, 60(1), 1-29.

Perloff, R. (2010). The dynamics of persuasion: Communication and attitudes in the 21st century (4th

edition). New York, New York: Routledge.

Petty, R. & Cacioppo, J. (1986). Communication and persuasion: Central and peripheral routes to

attitude change. New York, New York: Springer-Verlag.

Pew Research Center (2009). Pew Global Attitudes Project August - September 2009 Survey Topline

Results. Retrieved from http://www.pewglobal.org/files/2009/11/Pew-Global-Attitudes-2009-

Pulse-of-Europe-Report-Topline.pdf on 02.06.2014 at 22:59.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 47

Salancik, J. (1974). Inference of one's attitude from behavior recalled under linguistically

manipulated cognitive sets. Journal of Experimental and Social Psychology, 10, 415-427.

Scheufele, D. (2000). Agenda-Setting, priming, and framing revisited: Another look at cognitive

effects of political communication. Mass Communication and Society, 3(2), 297-316.

Schuck, A., Boomgaarden, H., & Vreese, C. (2013). Cynics all around? The impact of election news

on political cynicism in comparative perspective. Journal of Communication.

Shrum, L. (2004). The psychology of entertainment media: Blurring the lines between entertainment

and persuasion. Mahwah, New Jersey: Lawrence Erlbaum.

Slater, M. & Rouner, D. (2002). Entertainment-education and elaboration likelihood: Understanding

the processing of narrative persuasion. Communication Theory, 12(2), 173-191.

Sondhi, J. (2007). The Shock Doctrine. Short of the Week. Retrieved from

http://www.shortoftheweek.com/2007/10/21/the-shock-doctrine/ on 27.03.2014 22:18.

Strömbäck, J. (2007). Political marketing and professionalized campaigning: A conceptual analysis.

Journal of Political Marketing, 6(2), 49-67.

Stroud, N. (2007). Media effects, selective exposure, and Fahrenheit 9/11. Political Communication,

24(4), 415-432.

Swami, V., Coles, R., Stieger, S., Pietschnig, J., Furnham, A., Rehim, S. & Voracek, M. (2011).

Conspiracist ideation in Britain and Austria: Evidence of a monological belief system and

associations between individual psychological differences and real-world and fictitious

conspiracy theories. British Journal of Psychology, 102(1), 443-463.

Turner, J. (1991). Social Influence. Bristol, Pennsylvania: Princeton University Press.

Zuwerink, J. & Cameron, K. A. (2003). Strategies for resisting persuasion. Basic and Applied Social

Psychology, 25(2), 145-161.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 48

Appendix 1 - Content Analysis

The Shock Doctrine by Naomi Klein and Alfonso Cuaron - https://www.youtube.com/watch?v=aSF0e6oO_tw - 6:45 minutes version

Name of Political Ideology/Person/Theme | Strength of Focus (0=Minor, 5=Main) | Description | Presented Attitude | Sub-Topics | Attitude to Sub-Topics | Strength rational argument (0-5) | Strength of emotional appeal (0-5) | Possible resistance strategy | Overtness in Persuasion | Entertaining & Informative value?

Example

Name of Strength Description Attitude Rational Emotional Possible Overtness in Entertaining Theme of Focus Argumenta appeal Resistance Persuasion & (0-5) tion (0-5) (0-5) Information Name 3 Strong emphasis on showing Rather positive 4 1 Source what this theme is about and stance towards Derogation how it is presented examples

Resistance Strategies:

Source Derogation, Negative Affect, Avoidance, Weighing Attributes, Minimizing Impact, Biased Assimilation

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 49

Name of Strength Description Attitude Rational Emotional Possible Overtness in Entertaining Theme of Focus Argument appeal Resistance Persuasion & (0-5) ation (0-5) (0-5) Information Psychiatry 2 – “Cure mentally ill adults” Presentation as 1 4 Weighing No direct Value of old introductio “Psychiatry triumphs” scary movie attributes: attempt to scary movie n “Sick patients are wiped clean, and a thing of ‘Thing of the deem as Possible giving them a fresh start” the past. Brutal past”, negative interpretation “Shock-Therapy” -Negative “Necessary as old piece of - evil”, valid In form of an old public Unnecessary documentation information campaign Dramatization of truth from past Shock 4 – “Shocking them into Negative 1 5 Unnecessary Overt attempt See above Therapy metaphor obedience” “Childlike state” dramatization to scare for large Metaphor for society and civil viewers principle obedience CIA 4 Narrative out of a “secret” CIA Very negative 2 4 Dramatization Could be seen handbook. Source as piece of CIA as bad player that derogation – pure experiments with people and this could be information uses the findings against them fake “Official handbook” CIA 4 Vivid illustrations of torture Very negative 3 5 Almost Almost like a torture comical graphic novel techniques “artsy” (a) Sleep 2 illustration Neutral 2 3 Little Almost like a deprivatio presentation persuasion graphic novel n w negative at “artsy” (b) Use of 2 illustration Neutral 2 3 Little Almost like a phobias presentation persuasion graphic novel w negative at “artsy” (c) Stress 2 illustration Neutral 2 3 Little Almost like a positions presentation persuasion graphic novel w negative at “artsy” (d) 3 illustration Neutral 2 3 Little Almost like a Isolation presentation persuasion graphic novel w negative at “artsy” (e) 2 illustration Neutral 2 4 torture Little Almost like a Simulated presentation persuasion graphic novel Drowning w negative at “artsy”

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 50

(f) Physical 2 illustration Neutral 2 4 Little Almost like a Violence presentation persuasion graphic novel w negative at “artsy” Name of Strength Description Attitude Rational Emotional Possible Overtness in Entertaining Theme of Focus Argument appeal Resistance Persuasion & (0-5) ation (0-5) (0-5) Information (g) electro 4 illustration Neutral 2 4 Little Almost like a shocks presentation persuasion graphic novel w negative at “artsy” Leadership 3 We are more inclined to leaders Negative 2 3 Strong who claim to protect us. obedience to Suggestion that leaders do not leadership protect us in reality G W Bush 1 Presented as taking advantage of Negative 3 3 Strong 9/11 – Bush as conspiring to partisanship to terrorism? Bush or US republicans - Too many conspiracies about 911 9/11 3 Depiction of plane flying into Neutral 0 5 Not another Obvious Presentation of WTC. Basically no commentary presentation conspiracy appeal to a documentary – Very powerful w negative at theory about emotionality. (real life 9/11 pictures) Milton 4 Presentation as a dangerous Very negative. 4 3 Partisanship Very biased No Friedman mastermind that wants to rule As the root of towards free presentation entertaining the poor in the world. “One of all evil market system value. Try to the most famous economists of or associates present as our era” of Friedman information without subjectivity Free 5 Presentation as something Negative 5 5 Partisanship Clearly biased Presentation as Market unpopular since it moves the towards free presentation in news, not very Economy masses into poverty. Something market system rational as well entertaining that enriches the rich. – Born in or associates as emotional Shock. ‘Wasn’t born in freedom of ruling class, arguments. and democracy” or part of the One sidedness economic system or government

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 51

Trade- 1 Simple mentioning Rather positive 3 3 Conservatism One sidedness Protection & liberlaism Price 1 Simple mentioning Rather positive 3 3 Conservatism One sidedness deregulatio & liberalism n Name of Strength Description Attitude Rational Emotional Possible Overtness in Entertaining Theme of Focus Argument appeal Resistance Persuasion & (0-5) ation (0-5) (0-5) Information Strong 2 Government services as victim Rather positive 3 3 liberlism One sidedness governmen of Milton Friedman t Richard 1 As influenced by & associated Rather negative 1 3 Positive Nixon with Milton Friedman attitude towards persona Margaret 1 As influenced by & associated Very negative 1 4 Positive Thatcher with Milton Friedman. Seen as attitude unpopular in later example towards persona Augusto 1 As influenced by & associated Rather negative 1 3 Positive Pinochet with Milton Friedman attitude towards persona Ronald 1 As influenced by & associated Rather negative 1 3 Positive Reagan with Milton Friedman attitude towards persona Unemploy 1 Outcome of free market Negative 4 3 Rather overt No entertain ment economy Governme 3 Discussion of how the Positive 4 3 Conservatism Rather overt No entertain nt government disregarded this & liberalism responsibil duty(?) in preference for free ity for the market economy weak Democratic 3 Shock doctrine in order to Very positive & 4 4 Negative Rather overt No entertain decision circumvent the democratic necessity attitude to making decision making process.is protests process vulnerable. Should be norm (connected) Demonstra 3 In connection with unpopularity Rather positive 2 4 Disliking of Presentation in No entertain

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 52 tions / masses shown to be violence / news format. Protests demonstrating and violently Disliking of Presented as fighting against police & civil righteous military disobedience Police 2 Against public demonstration negative 2 4 Disliking of action protests US Army 3 Blindfolding, Handcuffing. negative 2 4 Unbelievable One sided Graphic novel prisoner Psychological stress. Prevent or exaggerated (cool abduction subject from recovering from illustrations presentation) technique shock – Graphic novel entertaining US foreign 1 Sarcastic remark “I am liberating negative 2 4 Partisanship to Clear Entertaining policy you sir” – invasion of Iraq US policy. subjectivity by through Associations negative comedy with military sarcasm Name of Strength Description Attitude Rational Emotional Possible Overtness in Entertaining Theme of Focus Argument appeal Resistance Persuasion & (0-5) ation (0-5) (0-5) Information Elite ruling 3 Advising politicians to push Very negative 1 4 Too much of a One sided Rather politicians through hurtful and unpopular conspiracy persuasion policies theory than informative Economic 5 Also shock doctrine – Title of Very negative 4 4 Too much of a Clearly one Presentation of shock the documentary: Using disasters conspiracy sided. Focus of typical treatment or crises to advantage of rulers. theory documentary documentary. Indirect implication that rulers FOCUS produce crises

Chile 1973 2 Incomes for the rich up. negative 4 3 conspiracy Very overt Population in poverty flashy and too quick to read Incomes of 1 In relation to Chile. Seen as Very negative 2 4 Being rich. Rather overt rich proof for undemocratic decision conspiracy making process Falkland 2 910 people die, Thatcher’s Very negative 4 4 Positive very War 1982 popularity doubles, privatization associations war on unions Unemployment with connected triples themes Privatizatio 4 Mentioned in connection with Very Negative 2 2 Barely as only Mentioning as

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 53 n Thatcher. Reoccurring as mentioned popular description of bad outcomes of knowledge crises and the free market economy Trade 1 Mentioned in connection with Positive 2 2 Used as Unions Thatcher argument itself Wars 2 Planned violence Negative 2 3 Necessity to Used as fight evil argument itself Coup 2 Reaching for power through Negative 2 3 Used as d’état military force argument itself Massacre 2 Fighting against civilians not Negative 2 3 Used as soldiers argument itself Terrorism 2 Killing civilians/military to gain Negative 2 3 Depends on Used as popular attention fear perspective argument itself War on 3 After 911 the US launch mainly Very negative 3 4 Conspiracy. One-sided Terror privatized effort. US spy Serving in US agencies outsource 70% of their wars. Family budget. Increased budget for war killed in US wars Name of Strength Description Attitude Rational Emotional Possible Overtness in Entertaining Theme of Focus Argument appeal Resistance Persuasion & (0-5) ation (0-5) (0-5) Information Private 1 Mentioned in the war on terror negative 2 3 One sided contractors for military duty Invasion of 2 Most privatized war in modern Very negative 4 4 Served in Iraq One sided Iraq 2003 history. 200. 100.000s killed Resisting 4 Isolation, disorientation silence. Very positive 3 5 Resistance Graphic novel shock Should all be fought against towards the in artistic “Information is shock whole movie manner resistance” “Arm yourself” already Capitalism 1 Connected to way of thinking negative Patriotism 0 Not mentioned but connected Civil 0 Not mentioned but connected disobedien ce Governme 0 Not mentioned but connected nt

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 54

Appendix 2 – Primers

A2a

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 55

A2b

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 56

A2c

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 57

Appendix 3 – Primers Pretest

PRIM ENTERTAINM OBJECTIVI ENTERTAINM OBJECTIV CHANGE CHANGE ER ENT TY ENT ITY ENTERTAINM OBJECTIV EXPECTATIO EXPECTAT EVALUATION EVALUATI ENT ITY N ION ON CNN YES NO NO NO negative 0 CNN NO YES YES NO positive negative CNN NO YES NO YES 0 0 CNN NO YES NO NO 0 Negative Sunda YES NO YES NO 0 0 nce Sunda YES YES YES YES 0 0 nce Sunda NO NO NO NO 0 0 nce Sunda YES NO YES NO 0 0 nce Occup NO YES NO YES 0 0 y Occup YES NO YES NO 0 0 y Occup NO NO NO NO 0 0 y Occup NO NO NO NO 0 0 y Occup YES NO YES NO 0 0 y

Boxes colored RED mean that the respondent did not evaluate the documentary according to the expectation given to the primer.

Boxes colored in PURPLE mean that the respondents changed their evaluation after watching the documentary.

CNN was expected to positively affect evaluation of OBJECTIVITY (= successful on expectation but not evaluation)

SUNDANCE was expected to positively affect evaluation of ENTERTAINMENT (=successful)

OCCUPY was expected to negatively affect evaluation of OBJECTIVITY (=successful)

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 58

Appendix 4 - Survey Questionnaire

Welcome, and THANK YOU for taking the time to complete this survey.

With your help and honest opinions I aim to find out what people appreciate about documentaries and how these films in turn affect people’s lives. As part of a research project by the University of Amsterdam I hope to find valuable insights that will help scientists and filmmakers to understand the impact of this medium.

– At the end of this survey you will be redirected to more information about the research and up to date findings.

This research will take you approximately 15 minutes of your time. As part of this questionnaire you will be presented with a short documentary which I will ask you to asses. Please read and answer all questions carefully and honestly.

Note that there are no right or wrong answers, they simply reflect your personal and anonymous opinions.

I can guarantee that:

1. Your anonymity will be safeguarded, and that your answers or data will not be passed on to third parties under any conditions, unless you first give your express permission for this.

2. You can refuse to participate in the research or cut short your participation without having to give a reason for doing so. You also have up to 24 hours after participating to withdraw your permission to allow your answers or data to be used in the research.

3. Participating in the research will not entail you being subjected to any appreciable risk or discomfort, and you will not be exposed to any explicitly offensive material.

For more information about the research, you are welcome to contact me at any time: Daniel Schulz, University of Amsterdam, Kloveniersburgwal 48, 1012 CX Amsterdam; [email protected].

Should you have any complaints or comments about the course of the research and the procedures it involves as a consequence of your participation in this research, you can contact the designated member of the Ethics Committee representing the University of Amsterdam, at the following address: Ethics Committee, University of Amsterdam, Kloveniersburgwal 48, 1012 CX Amsterdam; 020-525 3680; [email protected]. Any complaints or comments will be treated in the strictest confidence.

I hope that I have provided you with sufficient information. I would like to take this opportunity to thank you in advance for your assistance with this research.

Thank You, Daniel

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 59

Let's begin. To start with it is helpful to know what preferences and feelings you have about films and documentaries.

Please indicate how strongly you like or dislike the following forms of media:

1 2 3 4 5 6 7 Dislike Extremely Neither Like Extremely Dis-/Like Political Documentaries [space space ] O O O O O O O Hollywood Blockbusters O O O O O O O Art-House Movies O O O O O O O Advertising / Commercials O O O O O O O Sponsored Short Films O O O O O O O News Programming O O O O O O O

Please indicate how strongly you agree or disagree with the following statements:

1 2 3 4 5 6 7 Disagree Extremely Neither Agree Extremely Dis-/Agree I usually enjoy watching documentaries. O O O O O O O I usually find documentaries entertaining. O O O O O O O I usually find documentaries relaxing. O O O O O O O I usually find documentaries exciting. O O O O O O O I usually watch documentaries to learn O O O O O O O something. Documentaries usually present a balanced O O O O O O O view of events. Documentaries usually try to persuade me O O O O O O O of something.

The following question aims to find out what is important to make a good documentary. Please indicate how important the following components are to you in a documentary.

1 2 3 4 5 6 7 Extremely Neither Extremely Unimportant Important/Unimportant Important Exciting Narrative [space spacespace space O O O O O O O space space space space space spacespacespacespacespac] Identification with characters O O O O O O O Topic Relevance O O O O O O O Objectivity O O O O O O O Post-Production Value O O O O O O O Artistic Quality O O O O O O O

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 60

Please Indicate how strongly you agree or disagree with the following statements:

1 2 3 4 5 6 7 Disagree Neither Agree Extremely Dis- Extremely /Agree Mentally ill people should be able to decide themselves what O O O O O O O treatment to receive.

Mentally ill people should have the same rights and O O O O O O O obligations as healthy people.

If deemed helpful for treatment, a doctor should be allowed O O O O O O O to inflict pain on mentally ill people.

People are better off in a Free Market Economy. O O O O O O O

The free market economy is fairest system to live in. O O O O O O O

The privatization of state owned organizations is a good O O O O O O O thing.

Democracy is the ideal system to govern people. O O O O O O O

Politicians in my country have more power than they should. O O O O O O O

I have the ability to influence the political course of my O O O O O O O government.

Demonstrations are a good way to influence politics. O O O O O O O

Illegal Demonstrations are a good way to influence politics. O O O O O O O

I agree with US foreign policy. O O O O O O O

Military force is a favorable solution for foreign crises. O O O O O O O

Torture is okay if it saves lives of civilians. O O O O O O O

I mistrust authority. O O O O O O O

I am unfairly disadvantaged compared to other members of O O O O O O O society.

The government permits or perpetrates acts of terrorism on O O O O O O O its own soil, disguising its involvement.

The power held by heads of state is second to that of small O O O O O O O unknown groups who really control world politics.

The spread of certain viruses and/or diseases is the result of O O O O O O O the deliberate, concealed efforts of some organization.

A lot of important information is deliberately concealed from O O O O O O O the public out of self-interest.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 61

You have reached the main part of this survey.

On this page you will be presented with a website that published a short documentary. On the following page you will find the documentary itself.

For now, please read the information on the following screenshot.

(Depending on your internet-connection the screenshot may take up to 10 seconds to load)

[PRIMER INFORMATION] - VERSION 110

[PRIMER INFORMATION] - VERSION 2

PRIMER INFORMATION] - VERSION 3

[PRIMER INFORMATION] – VERSION 4 CONTROL GROUP

+++ SHOWN AT THE END OF THE SURVEY +++

[No primer]

[No Video]

[Skip to post test: political attitudes]

Dear Participant,

In order to evaluate all influences of documentaries in a scientific manner, this research is required to include a control group of respondents that is not shown a film. You were chosen at random to be part of this control group. This means you will be immediately directed to the last questions.

Should you be interested to see the documentary, which has been shown to the other participants, I will provide you with a link after the survey.

10 Find pictures of the Primers at Appendix 2 – P on page 0

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 62

Please note that your answers are as important for this research as the answers from people who had to see a short film.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 63

[EMBEDDED VIDEO]

[Measuring time that is spent watching the film]

[Sign of extreme resistance against content or persuasion when skipping the film before it’s finished]

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 64

The following questions are aimed to get an understanding of your thoughts about the documentary. Please indicate how strongly you agree or disagree with the following statements:

1 2 3 4 5 6 7 Disagree Neither Agree Extremely Dis- Extremely /Agree I understood all points of this documentary. O O O O O O O

This documentary was entertaining. O O O O O O O

This documentary was artistic. O O O O O O O

This documentary was informative. O O O O O O O

The documentary was objective. O O O O O O O

The documentary presented issues relevant to me. O O O O O O O

The documentary tried to persuade me to take action. O O O O O O O

This documentary was exciting. O O O O O O O

I enjoyed watching the documentary. O O O O O O O

I would recommend this documentary to friends. O O O O O O O

I disliked the documentary. O O O O O O O

I already knew a lot about the topics touched upon in the O O O O O O O documentary.

I agree with the points made in the documentary. O O O O O O O

The documentary uncovers the truth. O O O O O O O

People would benefit from watching this documentary. O O O O O O O

Please rate the documentary that you have just watched on the following points:

1 2 3 4 5 6 7 Extremely Neither Extremely Bad Bad/Good Good Exciting Narrative [space spacespace space space space O O O O O O O space space space spa] Identification with characters O O O O O O O Topic Relevance O O O O O O O Objectivity O O O O O O O Post-Production Value O O O O O O O Artistic Quality O O O O O O O

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 65

Please Indicate how strongly you agree or disagree with the following statements:

1 2 3 4 5 6 7 Disagree Neither Agree Extremely Dis- Extremely /Agree Mentally ill people should be able to decide themselves what O O O O O O O treatment to receive.

Mentally ill people should have the same rights and O O O O O O O obligations as healthy people.

If deemed helpful for treatment, a doctor should be allowed O O O O O O O to inflict pain on mentally ill people.

People are better off in a Free Market Economy. O O O O O O O

The free market economy is fairest system to live in. O O O O O O O

The privatization of state owned organizations is a good O O O O O O O thing.

Democracy is the ideal system to govern people. O O O O O O O

Politicians in my country have more power than they should. O O O O O O O

I have the ability to influence the political course of my O O O O O O O government.

Demonstrations are a good way to influence politics. O O O O O O O

Illegal Demonstrations are a good way to influence politics. O O O O O O O

I agree with US foreign policy. O O O O O O O

Military force is a favorable solution for foreign crises. O O O O O O O

Torture is okay if it saves lives of civilians. O O O O O O O

I mistrust authority. O O O O O O O

I am unfairly disadvantaged compared to other members of O O O O O O O society.

The government permits or perpetrates acts of terrorism on O O O O O O O its own soil, disguising its involvement.

The power held by heads of state is second to that of small O O O O O O O unknown groups who really control world politics.

The spread of certain viruses and/or diseases is the result of O O O O O O O the deliberate, concealed efforts of some organization.

A lot of important information is deliberately concealed from O O O O O O O the public out of self-interest.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 66

Lastly I would like to ask you for some demographic information that can help to determine unexpected influences to this research. (Of course I assure you that all information is anonymous and treated absolutely confidential!)

What is your Gender?

O Male O Female

How old are you (in years)?

______[Drop-Down Menu]

O Don’t Want to Tell

What is the highest education you have completed?

O Less than High School

O High School

O Some College

O Bachelors Degree

O Masters Degree

O Doctoral Degree

O Don’t Want to Tell

In which country do you reside?

______[Drop-Down Menu]

What is your Nationality?

______[Drop-Down Menu]

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 67

THANK YOU very much for completing this survey!

It is time to tell you that this survey was not only about likings and perceptions of documentaries but mainly about how they affect your attitudes about certain political topics. As part of an experiment you were presented with one out of three imaginary screenshots of different websites to influence the context in which you would assess the documentary. Once all data is gathered your answers will help to understand how different platforms and presentations of the same film can influence the strength of impact the film has on your political attitudes.

It is therefore important to state that the screenshot that you have just seen is fake! None of the websites you have seen in this survey actually posted any of the seen content.

Should you have any complaints or questions about this survey, its findings or technicalities please feel free to contact Daniel Schulz via email: [email protected] .

[Survey End]

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 68

[After recording of answers redirected to this message:]

If you liked the idea of this research or enjoyed taking part of it I would like to ask you for a favor:

In order to reach a proper scientific and valid finding it is absolutely important to question as many people as possible. You can help by sharing the following Facebook-post to help reach a larger population than I could possibly reach alone.

Thank you very much for your help! https://www.facebook.com/UnderstandingDocumentaries

If you were part of the control group and would like to watch the documentary that was shown to the other participants please follow this link:

LINK

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 69

Appendix 5 – Statistical Tests & Tables

Factor loadings for clusters in Political Attitudes

Cluster 1 2 3 4 5 6 Mentally ill people should be able to decide themselves what .798 treatment to receive. Mentally ill people should have the same rights and obligations as .781 healthy people. If deemed helpful for treatment, a doctor should be allowed to .622 inflict pain on mentally ill people. People are better off in a Free Market Economy. .846 The free market economy is fairest system to live in. .831 The privatization of state owned organizations is a good thing. .725 Democracy is the ideal system to govern people. Politicians in my country have more power than they should. .631 I have the ability to influence the political course of my -.617 government. Demonstrations are a good way to influence politics. .757 (Pre) Illegal Demonstrations are a good way to influence politics. .814 I agree with US foreign policy. .660 (Pre) Military force is a favorable solution for foreign crises. .788 Torture is okay if it saves lives of civilians. .628 I mistrust authority. .450 I am unfairly disadvantaged compared to other members of society. .407 -.412 The government permits or perpetrates acts of terrorism on its own .719 soil, disguising its involvement. The power held by heads of state is second to that of small .823 unknown groups who really control world politics. The spread of certain viruses and/or diseases is the result of the .748 deliberate, concealed efforts of some organization. A lot of important information is deliberately concealed from the .482 public out of self-interest.

1 = 2 = 3 = 4 = 5 = 6 = Conspiracist Attitude towards Attitude towards Attitude towards Attitude towards Attitude towards Ideation Free Market Government Rights of Mental Ill Civil Disobedience Pain Treatment Economy Violence Patients

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 70

Factor loadings for clusters in Stimulus Evaluation

Cluster 1 = 2 = 3 = 4 = 5 = Agreement with Perceived Perceived Topic Perceived Information Entertainment Objectivity Knowledge Persuasion

I understood all points of this .775 documentary. This documentary was entertaining. .858 This documentary was artistic. .984

This documentary was informative. .828 The documentary was objective. .844 The documentary presented issues .428 relevant to me. The documentary tried to persuade me .853 to take action.

This documentary was exciting. .692 I enjoyed watching the documentary. .590 I would recommend this documentary to .732 friends. I disliked the documentary. -.629 I already knew a lot about the topics .862 touched upon in the documentary. I agree with the points made in the .910 documentary.

The documentary uncovers the truth. .953 People would benefit from watching this .870 documentary.

Specific evaluation of Exciting Narrative .668 Specific evaluation of Identification with

characters

Specific evaluation of Topic Relevance .481 Specific evaluation of Objectivity .839 Specific evaluation of Post-Production .609 Value Specific evaluation of Artistic Quality .912

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 71

Paired Sample t-Test for individual questions

Mean Std. Std. t df p-value Difference Deviation Error Mean Mentally ill people should be able to decide themselves .412 1.026 .071 5.837 210 .000 what treatment to receive. Mentally ill people should have the same rights and .226 .944 .065 3.453 207 .001 obligations as healthy people. If deemed helpful for treatment, a doctor should be -.490 1.059 .073 -6.710 209 .000 allowed to inflict pain on mentally ill people. People are better off in a Free Market Economy. -.218 1.060 .073 -2.987 210 .003 The free market economy is fairest system to live in. -.137 1.132 .078 -1.764 210 .079 The privatization of state owned organizations is a good -.332 .928 .064 -5.194 210 .000 thing. Democracy is the ideal system to govern people. -.246 .826 .057 -4.335 210 .000 Politicians in my country have more power than they .019 1.037 .071 .265 210 .791 should. I have the ability to influence the political course of my .057 .881 .061 .943 208 .347 government. Demonstrations are a good way to influence politics. .038 .920 .063 .599 210 .550 Illegal Demonstrations are a good way to influence .090 .947 .065 1.385 209 .168 politics. I agree with US foreign policy. -.188 .637 .044 -4.254 206 .000 Military force is a favorable solution for foreign crises. -.062 .789 .054 -1.137 209 .257 Torture is okay if it saves lives of civilians. -.195 .861 .059 -3.285 209 .001 I mistrust authority. .175 1.029 .071 2.475 210 .014 I am unfairly disadvantaged compared to other .133 .868 .060 2.220 210 .027 members of society. The government permits or perpetrates acts of .349 1.262 .087 4.000 208 .000 terrorism on its own soil, disguising its involvement. The power held by heads of state is second to that of .180 .924 .064 2.832 210 .005 small unknown groups who really control world politics. The spread of certain viruses and/or diseases is the result of the deliberate, concealed efforts of some .267 .798 .055 4.843 209 .000 organization. A lot of important information is deliberately concealed .000 .907 .063 .000 209 1.000 from the public out of self-interest.

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 72

Testing effect of Primers

TABLE 1

One-Way Analysis of Perceived Persuasion, Perceived Entertainment & Perceived Objectivity by Primers

Type of evaluation df SS MS F p Between Groups 2 10.69 5.346 2.398 .093 Perceived Persuasion Within Groups 207 461.40 2.229 Total 209 472.10 Between Groups 2 2.48 1.240 1.117 .329 Perceived Entertainment Within Groups 208 230.95 1.110 Total 210 233.43 Between Groups 2 13.90 6.951 3.217 .042 Perceived Objectivity Within Groups 208 449.50 2.161 Total 210 463.40

CNN Sundance Occupy

5.5

5

4.5

4

3.5

3 Perceived Entertainment Perceived Persuasion Perceived Objectivity CNN 4.8443 4.64 3.875 Sundance 5.0468 4.56 3.8571 Occupy 4.8689 5.12 3.3115

3 PERSPECTIVES FOR UNDERSTANDING DOCUMENTARIES 73

Testing Effects of Evaluations on Change in Political Attitudes

DV IV Regression Post-Hoc Attitudes towards the Perceived Entertainment (R²=.017, F(1,209)=3.62, (β= -.089, p=.058) Free Market Economy p=.058) Perceived Objectivity (R²=..001, F(1,209)=.27, (β= -.017, p=.607) p=.607) Liking the documentary (R²=.011, F(1,209)=2.42, (β= -.047, p=.121) p=.121)

Attitudes towards the Perceived Entertainment (R²=.002, F(1,209)=.42, (β= .035, p=.516) rights of mentally ill p=.516) Perceived Objectivity (R²=.000, F(1,209)=.06, (β= -.009, p=.805) p=.805) Liking the documentary (R²=.001, F(1,209)=.239 (β= -.017, p=.625) p=.625)

Attitudes towards Perceived Entertainment (R²=.003, F(1,209)=.69, (β= -.028, p=.409) Government violence p=.409) Perceived Objectivity (R²=..000, F(1,209)=.01, (β= -.002, p=.937) p=.937) Liking the documentary (R²=.002, F(1,209)=.40, (β= .014, p=.529) p=.529)

Attitudes towards Perceived Entertainment (R²=.005, F(1,209)=1.06, (β= -.056, p=.304) democracy p=.409) Perceived Objectivity (R²=.000, F(1,209)=.03, (β= -.006, p=.870) p=.870) Liking the documentary (R²=.000, F(1,209)=.09, (β= 1.011, p=.763) p=.763)

Attitudes towards US Perceived Entertainment (R²=.011, F(1,205)=2.33, (β= -.064, p=.128) foreign policy p=.128) Perceived Objectivity (R²=.004, F(1,205)=.80, (β= -.027, p=.371) p=.371) Liking the documentary (R²=.000, F(1,205)=.01, (β= -.003, p=.925) p=.925)

Attitudes towards Civil Perceived Entertainment (R²=.004, F(1,209)=.83, (β= -.040, p=.363) Disobedience p=.409) Perceived Objectivity (R²=.002, F(1,209)=.35, (β= .019, p=.553) p=.553) Liking the documentary (R²=.007, F(1,209)=1.54, (β= .035, p=.215) p=.215)

Belief that one can Perceived Entertainment (R²=.001, F(1,207)=.18, (β= .024, p=.674) influence politics p=.674) Perceived Objectivity (R²=.000, F(1,207)=.03, (β= .007, p=.874) p=.874) Liking the documentary (R²=.002, F(1,209)=.34, (β= .022, p=.562) p=.562)

Conspiracist Ideation Perceived Entertainment (R²=.003, F(1,209)=.64, (β= .026, p=.423) p=.423) Perceived Objectivity (R²=.009, F(1,209)=1.89, (β= .032, p=.171) p=.117) Liking the documentary (R²=.008, F(1,209)=1.67, (β= .027, p=.197) p=.197)