Cleveland State University EngagedScholarship@CSU Michael Schwartz Library Publications Michael Schwartz Library 6-2017 Evaluating Information: Where Do Librarians and Skeptics Align? Evan Meszaros Case Western Reserve University, [email protected] Mandi Goodsett Cleveland State University, [email protected] Follow this and additional works at: https://engagedscholarship.csuohio.edu/msl_facpub Part of the Library and Information Science Commons How does access to this work benefit ou?y Let us know! Original Citation Meszaros, E. C., & Goodsett, M. (2017, June). Evaluating information: Where do librarians and skeptics align? Poster presented at the Annual Conference of the American Library Association, Chicago, IL. Repository Citation Meszaros, Evan and Goodsett, Mandi, "Evaluating Information: Where Do Librarians and Skeptics Align?" (2017). Michael Schwartz Library Publications. 140. https://engagedscholarship.csuohio.edu/msl_facpub/140 This Poster is brought to you for free and open access by the Michael Schwartz Library at EngagedScholarship@CSU. It has been accepted for inclusion in Michael Schwartz Library Publications by an authorized administrator of EngagedScholarship@CSU. For more information, please contact [email protected]. Evaluating Information: Where Do Librarians and Skeptics Align? Evan Meszaros, MS1, Mandi Goodsett, MS2 1. Research Services Librarian | Kelvin Smith Library | Case Western Reserve University | Cleveland, OH 2. Performing Arts & Humanities Librarian | Michael Schwartz Library | Cleveland State University | Cleveland, OH Introduction Results Alignment of Statements with Personal Beliefs Many factual claims are true for which there is no evidence. Although librarians may not realize it, our profession has many shared goals and values with those who consider themselves The results of our survey are broken down into five sections: Demographics, Evidential Basis for Belief (Not Skeptic-Aligned) ? û methodological or scientific skeptics—a term we denote here as “Skeptics” with a capital ‘S’. A thorough review of the literature Association, Alignment, Awareness, and Application of Skepticism to Demographics I only believe factual claims to the extent that there is evidence for them. (Skeptic-Aligned) ü indicates that, while a Skeptical attitude toward information is arguably important to the work of instruction librarians, no Information Literacy Instruction (data not shown). The ‘Association’ section ? 0.8% n=499 research has been conducted on the Skepticism of librarians. asked participants to associate specific words with Skepticism and critical Intuition is often the best tool for determining truth. 5.6% Truth from Intuition vs. (Not Skeptic-Aligned) û thinking. The ‘Alignment’ section prompted respondents with a series of ? 0–2 Reasoning from Evidence The best method for determining truth is by reasoning from evidence, The researchers of the present study surveyed a variety of librarians who teach information evaluation in an effort to explore statements corresponding (or in opposition) to Skeptical principles. if it's available. (Skeptic-Aligned) ü ? the following research questions: Respondents were asked to indicate how closely each statement aligned 25.9% 3–10 It's important to stick to your beliefs once they have been established. with their personal beliefs, suggesting the extent to which librarians’ values (Not Skeptic-Aligned) ? û • ​What attitudes do librarians have toward Skeptics and Skeptical values? overlap with those of Skeptics. In the ‘Awareness’ section, participants 41.1% Corrigibility If evidence causes me to believe a claim, I am open to changing my mind • How closely do the values of librarians align with those of the Skeptic community? indicated their awareness of the modern Skeptic movement and their 11–20 if new, contrary evidence becomes available. (Skeptic-Aligned) ü ? • ​How much—and in what ways—do librarians who teach information literacy instruction employ Skeptical values and willingness to identify as a Skeptic. Lastly, respondents were asked to share If a trusted source claims that something is true, that alone is sufficient 26.7% evidence. (Not Skeptic-Aligned) û principles? how frequently and in what ways they applied skeptical principles when >20 Corroboration ? teaching information literacy. This section included an open-response Independent confirmation of facts contributes to their reliability. (Skeptic-Aligned) ü ? question which yielded a variety of librarians’ self-reported methods for I do not work in a library/archive / Other Background: The “Skeptic Community” teaching source evaluation. The final survey question asked respondents to It is important to distrust most claims. (Not Skeptic-Aligned) û share any comments or concerns they had with the survey overall, and Figure 2. Percentage of survey respondents Appropriate Skepticism ? The modern Skeptic community is thought to date back to Martin Gardner’s book, “In the Name of Science”, published in 1952. (n=499) reporting number of years spent working It's important to only doubt things when there is good reason for these comments may be found in the Padlet linked on our research guide. doubting. (Skeptic-Aligned) ? û Other early founders of the movement include James “The Amazing” Randi, a magician who appeared often on The Tonight in a library/archive. Show and elsewhere in the media; Paul Kurtz, philosopher and founder of the Committee for the Scientific Investigation of Expert communities are very often mistaken, so it's very important to trust the individuals whose claims resonate most with you. (Not Skeptic-Aligned) ? û Claims of the Paranormal (CSICOP), which eventually became the Committee for Skeptical Inquiry (CSI); and Michael Shermer, Expert Consensus I have more reason to believe something when there is a consensus about the founder of the Skeptics Society and Skeptic Magazine. Intellectuals and public figures from a variety of fields have become Academic 414 Social sciences 130 that issue within the appropriate community of experts. (Skeptic-Aligned) ü ? important (and controversial) voices for the Skeptic community as well, including the late astronomer and science popularizer 113 Public 56 Humanities It's important to consider all possible explanations for a phenomenon Carl Sagan; neurologist Steven Novella; physician and “SkepDoc” Harriet Hall; philosopher Massimo Pigliucci; Center for Applied Parsimony (AKA equally. (Not Skeptic-Aligned) ü û Applied sciences (e.g. … 78 ? Rationality co-founder Julia Galef; and magicians Penn & Teller, among many others. School 22 Occam’s Razor) If there are two hypotheses that explain some data equally well, I choose Natural sciences 54 the simpler one. (Skeptic-Aligned) ü ? û Special 18 Arts 53 I tend to give the claims people make the benefit of the doubt. Sufficient Evidence vs. (Not Skeptic-Aligned) û Archives / special collections 9 ? Do not have a subject area … 22 Benefit of the Doubt I tend to refuse to accept claims that lack sufficient evidence. (Skeptic-Aligned) ü ? Other 5 n=499 Law 5 n=256 I tend to trust most things that a person with credentials says. 0 100 200 300 400 0 50 100 150 (Not Skeptic-Aligned) ü û Appropriate Expertise ? Figure 3. Number of survey respondents (n=499) reporting the Figure 4. Number of academic librarian survey respondents An expert with credentials is more likely to be trustworthy only in her/his specific area of expertise. (Skeptic-Aligned) ü type of library or archive they work at. Note: survey respondents (n=256) reporting discipline(s) or subject area(s) they support. ? could choose more than one answer. n=464 0 50 100 150 200 250 300 350 400 450 Figure 7. Proportion of survey-takers (n=464) responding with “Very much” (green, left-most bar on each graph, symbolized by “ü”), “Somewhat” (gray, middle bar in each graph, symbolized by “?”), and “Not at all” (red, right-most bar on each graph, symbolized by “û”) regarding their agreement with the statement shown to the left of each graph. While statements were presented to survey-takers in a Awareness of Skeptics, Skepticism, and the Skeptic Community random order, pairs of statements—each containing statements deemed “Non-Skeptic Aligned” and “Skeptic-Aligned” by the researchers— are named (far left) for the Skeptical principles they contravene or exemplify, respectively. Are you aware of the modern Skeptics movement? Would you consider yourself a Skeptic? Yes Application of Skepticism to Information Literacy Instruction Yes (83) When asked whether they “Always”, “Often”, “Sometimes”, “Rarely”, or “Never” do the following, the majority of respondents (143) Yes (157) No (135) No who reported having information literacy instruction responsibilities (n=388) reported that they “Always” or “Often” encouraged (239) students to refuse to accept information that lacks sufficient evidence (65.2%), to re-evaluate their beliefs based on new Maybe No (320) Somewhat evidence (64.4%), and to examine the expert consensus within a subject or discipline as part of the source evaluation process (95) (259) (79.1%). 257 of this group also submitted responses to the open question, “What activities or exercises do you use to teach information evaluation?” (See our research guide for a list of representative responses.) Do you know anyone who calls him- or herself a Skeptic? n=477 Figure 1. Digital artifacts of the Skeptic community. From top left: Committee for Skeptical InQuiry (a component of the Center for Figure 5. Numbers of respondents (n=477) answering the three