13 Collecting Statistical Data

Total Page:16

File Type:pdf, Size:1020Kb

13 Collecting Statistical Data 13 Collecting Statistical Data 13.1 The Population 13.2 Sampling 13.3 Random Sampling 1.1 - 1 • Polls, studies, surveys and other data collecting tools collect data from a small part of a larger group so that we can learn something about the larger group. • This is a common and important goal of statistics: Learn about a large group by examining data from some of its members. 1.1 - 2 Data collections of observations (such as measurements, genders, survey responses) 1.1 - 3 Statistics is the science of planning studies and experiments, obtaining data, and then organizing, summarizing, presenting, analyzing, interpreting, and drawing conclusions based on the data 1.1 - 4 Population the complete collection of all individuals (scores, people, measurements, and so on) to be studied; the collection is complete in the sense that it includes all of the individuals to be studied 1.1 - 5 Census Collection of data from every member of a population Sample Subcollection of members selected from a population 1.1 - 6 A Survey • The practical alternative to a census is to collect data only from some members of the population and use that data to draw conclusions and make inferences about the entire population. • Statisticians call this approach a survey (or a poll when the data collection is done by asking questions). • The subgroup chosen to provide the data is called the sample, and the act of selecting a sample is called sampling. 1.1 - 7 A Survey • The first important step in a survey is to distinguish the population for which the survey applies (the target population) and the actual subset of the population from which the sample will be drawn, called the sampling frame. • The ideal scenario is when the sampling frame is the same as the target population–that would mean that every member of the target population is a candidate for the sample. When this is impossible (or impractical), an appropriate sampling frame must be chosen. 1.1 - 8 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL The U.S. presidential election of 1936 pitted Alfred Landon, the Republican governor of Kansas, against the incumbent Democratic President, Franklin D. Roosevelt. At the time of the election, the nation had not yet emerged from the Great Depression, and economic issues such as unemployment and government spending were the dominant themes of the campaign. 1.1 - 9 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL The Literary Digest had used polls to accurately predict the results of every presidential election since 1916, and their 1936 poll was the largest and most ambitious poll ever. The sampling frame for the Literary Digest poll consisted of an enormous list of names that included: 1.1 - 10 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL (1) every person listed in a telephone directory anywhere in the United States, (2) every person on a magazine subscription list, and (3) every person listed on the roster of a club or professional association. 1.1 - 11 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL From this sampling frame a list of about 10 million names was created, and every name on this list was mailed a mock ballot and asked to mark it and return it to the magazine. 1.1 - 12 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL • Based on the poll results, the Literary Digest predicted a landslide victory for Landon with 57% of the vote, against Roosevelt’s 43%. • the election turned out to be a landslide victory for Roosevelt with 62% of the vote, against 38% for Landon. 1.1 - 13 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL • The difference between the poll’s prediction and the actual election results was 19%, the largest error ever in a major public opinion poll. 1.1 - 14 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL • For the same election, a young pollster named George Gallup was able to predict accurately a victory for Roosevelt using a sample of “only” 50,000 people. • What went wrong with the Literary Digest poll and why was Gallup able to do so much better? 1.1 - 15 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL • The first thing seriously wrong with the Literary Digest poll was the sampling frame, consisting of names taken from telephone directories, lists of magazine subscribers, rosters of club members, and so on. Telephones in 1936 were something of a luxury, and magazine subscriptions and club memberships even more so, at a time when 9 million people were unemployed. 1.1 - 16 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL • When it came to economic status the Literary Digest sample was far from being a representative cross section of the voters. This was a critical problem, because voters often vote on economic issues, and given the economic conditions of the time, this was especially true in 1936. 1.1 - 17 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL • When the choice of the sample has a built-in tendency (whether intentional or not) to exclude a particular group or characteristic within the population, we say that a survey suffers from selection bias. • Selection bias must be avoided, but it is not always easy to detect it ahead of time. Even the most scrupulous attempts to eliminate selection bias can fall short. 1.1 - 18 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL • The second serious problem with the Literary Digest poll was the issue of nonresponse bias. • In a typical survey it is understood that not every individual is willing to respond to the survey request (and in a democracy we cannot force them to do so). 1.1 - 19 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL • Those individuals who do not respond to the survey request are called nonrespondents, and those who do are called respondents. • The percentage of respondents out of the total sample is called the response rate. 1.1 - 20 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL • For the Literary Digest poll, out of a sample of 10 million people who were mailed a mock ballot only about 2.4 million mailed a ballot back, resulting in a 24% response rate. • When the response rate to a survey is low, the survey is said to suffer from nonresponse bias. 1.1 - 21 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL • One of the significant problems with the Literary Digest poll was that the poll was conducted by mail. This approach is the most likely to magnify nonresponse bias, because people often consider a mailed questionnaire just another form of junk mail. 1.1 - 22 CASE STUDY 2 THE 1936 LITERARY DIGEST POLL The Literary Digest story has two morals: (1) You’ll do better with a well-chosen small sample than with a badly chosen large one, and (2) watch out for selection bias and nonresponse bias. 1.1 - 23 Examples • Page 516, problems 17,18,19 (Solutions on following slides) NOTE: students should omit problem 28 from homework exercises 1.1 - 24 Examples Solutions 17(a) the citizens of Cleansburg 17(b) the sampling frame is limited to that part of the target population that passes by a city street corner between 4:00 pm and 6:00 pm 1.1 - 25 Examples Solutions 18(a) 475 18(b) yes, this survey is subject to nonresponse bias. The response rate is 475 0.266 1313 475 1.1 - 26 Examples Solutions 19(a) the choice of street corner could make a difference in responses collected 19(b) interviewer D. We are assuming that people who live or work downtown are more likely to answer yes than people in other parts of town. 1.1 - 27 Examples Solutions 19(c) yes. People on street between 4 pm and 6 pm are not representative of the population at large. Also, the five street corners were chosen by the interviewers and the passers-by are unlikely to represent a cross-section of the target population. 19(d) omit 1.1 - 28 Convenience Sampling • One commonly used short-cut in sampling is known as convenience sampling. In convenience sampling the selection of which individuals are in the sample is dictated by what is easiest or cheapest for the data collector, never mind trying to get a representative sample. • A classic example of convenience sampling is when interviewers set up at a fixed location such as a mall or outside a supermarket and ask passersby to be part of a public opinion poll. 1.1 - 29 Convenience Sampling • A different type of convenience sampling occurs when the sample is based on self-selection–the sample consists of those individuals who volunteer to be in it. • Self-selection is the reason why many Area Code 800 polls are not to be trusted. Convenience sampling is not always bad–at times there is no other choice or the alternatives are so expensive that they have to be ruled out. 1.1 - 30 Quota Sampling • Quota sampling is a systematic effort to force the sample to be representative of a given population through the use of quotas–the sample should have so many women, so many men, so many blacks, so many whites, so many people living in urban areas, so many people living in rural areas, and so on. The proportions in each category in the sample should be the same as those in the population. • If we can assume that every important characteristic of the population is taken into account when the quotas are set up, it is reasonable to expect that the sample will be representative of the population and produce reliable data.
Recommended publications
  • 10 Questions Opinion Polls
    Questions you might have on 10opinion polls 1. What is an opinion poll? An opinion poll is a survey carried out to measure views on a certain topic within a specific group of people. For example, the topic may relate to who Kenyans support in the presidential race, in which case, the group of people interviewed will be registered voters. 2. How are interviewees for an opinion poll selected? The group of people interviewed for an opinion poll is called a sample. As the name suggests, a sample is a group of people that represents the total population whose opinion is being surveyed. In a scientific opinion poll, everyone has an equal chance of being interviewed. 3. So how come I have never been interviewed for an opinion poll? You have the same chance of being polled as anyone else living in Kenya. However, chances of this are very small and are estimated at about 1 in 14,000. This is because there are approximately 14 million registered voters in Kenya and, for practical and cost reasons, usually only between 1,000 and 2,000 people are interviewed for each survey carried out. 4. How can such a small group be representative of the entire population? In order to ensure that the sample/survey group is representative of the population, the surveyors must ensure that the group reflects the characteristics of the whole. For instance, to get a general idea of who might win the Kenyan presidential election, only the views of registered voters in Kenya will be surveyed as these are the people who will be able to influence the election.
    [Show full text]
  • Random Selection in Politics
    Random selection in politics Lyn Carson and Brian Martin Published in 1999 by Praeger Publishers, Westport, CT Available for purchase from Praeger This is the text submitted to Praeger in February 1999. It differs from the published version in minor ways, including formatting, copy-editing changes, page numbering (100 pages instead of 161) and omission of the index. This version prepared August 2008 Contents 1. Introduction 1 2. Random selection in decision making 10 3. Direct democracy 26 4. Citizen participation without random selection 36 5. Citizen participation with random selection: the early days 43 6. Citizen participation with random selection: yesterday, today, and tomorrow 52 7. Sortition futures 65 8. Strategies 76 Appendix: Examples of citizen participation 84 Bibliography 93 Acknowledgments Brownlea, John Burnheim, Ned Crosby, Many people we’ve talked to find the Jim Dator, Mary Lane, Marcus Schmidt, idea of random selection in politics and Stuart White. Their input was unnatural and unwelcome. This didn’t valuable even when we decided on an deter us! Fortunately, there were a few alternative approach. Helpful comments enthusiasts who got and kept us going. were also received from Ted Becker, Alan Davies, Fred Emery, and Merrelyn Stephen Healy, Lars Klüver, and Ken Emery provided the original inspiration Russell. Others who provided many years ago as well as ongoing information are acknowledged in the conversations. text. The process of obtaining comments Ted Becker encouraged us to write has been stimulating because not all this book. On drafts, we received readers go with us all the way on extensive comments from Arthur randomness.
    [Show full text]
  • The Effect of Sampling Error on the Time Series Behavior of Consumption Data*
    Journal of Econometrics 55 (1993) 235-265. North-Holland The effect of sampling error on the time series behavior of consumption data* William R. Bell U.S.Bureau of the Census, Washington, DC 20233, USA David W. Wilcox Board of Governors of the Federal Reserve System, Washington, DC 20551, USA Much empirical economic research today involves estimation of tightly specified time series models that derive from theoretical optimization problems. Resulting conclusions about underly- ing theoretical parameters may be sensitive to imperfections in the data. We illustrate this fact by considering sampling error in data from the Census Bureau’s Retail Trade Survey. We find that parameter estimates in seasonal time series models for retail sales are sensitive to whether a sampling error component is included in the model. We conclude that sampling error should be taken seriously in attempts to derive economic implications by modeling time series data from repeated surveys. 1. Introduction The rational expectations revolution has transformed the methodology of macroeconometric research. In the new style, the researcher typically begins by specifying a dynamic optimization problem faced by agents in the model economy. Then the researcher derives the solution to the optimization problem, expressed as a stochastic model for some observable economic variable(s). A trademark of research in this tradition is that each of the parameters in the model for the observable variables is endowed with a specific economic interpretation. The last step in the research program is the application of the model to actual economic data to see whether the model *This paper reports the general results of research undertaken by Census Bureau and Federal Reserve Board staff.
    [Show full text]
  • Preface Chapter 1
    Notes Preface 1. Alfred Pearce Dennis, “Humanizing the Department of Commerce,” Saturday Evening Post, June 6, 1925, 8. 2. Herbert Hoover, Memoirs: The Cabinet and the Presidency, 1920–1930 (New York: Macmillan, 1952), 184. 3. Herbert Hoover, “The Larger Purposes of the Department of Commerce,” in “Republi- can National Committee, Brief Review of Activities and Policies of the Federal Executive Departments,” Bulletin No. 6, 1928, Herbert Hoover Papers, Campaign and Transition Period, Box 6, “Subject: Republican National Committee,” Hoover Presidential Library, West Branch, Iowa. 4. Herbert Hoover, “Responsibility of America for World Peace,” address before national con- vention of National League of Women Voters, Des Moines, Iowa, April 11, 1923, Bible no. 303, Hoover Presidential Library. 5. Bruce Bliven, “Hoover—And the Rest,” Independent, May 29, 1920, 275. Chapter 1 1. John W. Hallowell to Arthur (Hallowell?), November 21, 1918, Hoover Papers, Pre-Com- merce Period, Hoover Presidential Library, West Branch, Iowa, Box 6, “Hallowell, John W., 1917–1920”; Julius Barnes to Gertrude Barnes, November 27 and December 5, 1918, ibid., Box 2, “Barnes, Julius H., Nov. 27, 1918–Jan. 17, 1919”; Lewis Strauss, “Further Notes for Mr. Irwin,” ca. February 1928, Subject File, Lewis L. Strauss Papers, Hoover Presidential Library, West Branch, Iowa, Box 10, “Campaign of 1928: Campaign Literature, Speeches, etc., Press Releases, Speeches, etc., 1928 Feb.–Nov.”; Strauss, handwritten notes, December 1, 1918, ibid., Box 76, “Strauss, Lewis L., Diaries, 1917–19.” 2. The men who sailed with Hoover to Europe on the Olympic on November 18, 1918, were Julius Barnes, Frederick Chatfi eld, John Hallowell, Lewis Strauss, Robert Taft, and Alonzo Taylor.
    [Show full text]
  • American Community Survey Accuracy of the Data (2018)
    American Community Survey Accuracy of the Data (2018) INTRODUCTION This document describes the accuracy of the 2018 American Community Survey (ACS) 1-year estimates. The data contained in these data products are based on the sample interviewed from January 1, 2018 through December 31, 2018. The ACS sample is selected from all counties and county-equivalents in the United States. In 2006, the ACS began collecting data from sampled persons in group quarters (GQs) – for example, military barracks, college dormitories, nursing homes, and correctional facilities. Persons in sample in (GQs) and persons in sample in housing units (HUs) are included in all 2018 ACS estimates that are based on the total population. All ACS population estimates from years prior to 2006 include only persons in housing units. The ACS, like any other sample survey, is subject to error. The purpose of this document is to provide data users with a basic understanding of the ACS sample design, estimation methodology, and the accuracy of the ACS data. The ACS is sponsored by the U.S. Census Bureau, and is part of the Decennial Census Program. For additional information on the design and methodology of the ACS, including data collection and processing, visit: https://www.census.gov/programs-surveys/acs/methodology.html. To access other accuracy of the data documents, including the 2018 PRCS Accuracy of the Data document and the 2014-2018 ACS Accuracy of the Data document1, visit: https://www.census.gov/programs-surveys/acs/technical-documentation/code-lists.html. 1 The 2014-2018 Accuracy of the Data document will be available after the release of the 5-year products in December 2019.
    [Show full text]
  • George Gallup: Highlights of His Life and Work
    George Gallup: Highlights of His Life and Work PRE-BIOGRAPHY AND PRE-HISTORY Understanding the character of creative people and the significance of their achievements requires, in the first place, a study of their pre-biography, together with the pre-history of that branch of science, art or culture where their endeavors have taken place. In other words, the person’s biography is a product of both the genealogy and the environment in which his or her professional activity has taken place. The life and work of George Gallup in this sense are exemplary. In the first place, he belonged to a large family, whose members had vigorously participated in the development of the United States, and whose accomplishments and merits are recorded in the annals of the country. Secondly, even though the modern stage of public opinion research began with the pioneering work of George Gallup in 1935 and 1936, the study of electoral attitudes in the US had a long history prior to that. Accordingly, after examining the pre-biography of George Gallup, we will also review the pre-history of public opinion research. Tenth-Generation American For generations, the large Kollop family resided in Lotharingia (Lorraine). During the Middle Ages some of its descendants moved over to England, retaining the Gollop name. It is believed to have been forged from the German words Gott and Lobe, meaning respectively “God” and “praise”. Over time various spellings of the family name emerged: Gallop, Galloup, Galloupe, Gallupe, and Gollop, with the version prevalent in America becoming Gal- lup. A historical record has been preserved in England concerning John Gollop (born about 1440), who came ‘out of the North in the fifth year of the reign of Edward IV’ (1465).
    [Show full text]
  • MRS Guidance on How to Read Opinion Polls
    What are opinion polls? MRS guidance on how to read opinion polls June 2016 1 June 2016 www.mrs.org.uk MRS Guidance Note: How to read opinion polls MRS has produced this Guidance Note to help individuals evaluate, understand and interpret Opinion Polls. This guidance is primarily for non-researchers who commission and/or use opinion polls. Researchers can use this guidance to support their understanding of the reporting rules contained within the MRS Code of Conduct. Opinion Polls – The Essential Points What is an Opinion Poll? An opinion poll is a survey of public opinion obtained by questioning a representative sample of individuals selected from a clearly defined target audience or population. For example, it may be a survey of c. 1,000 UK adults aged 16 years and over. When conducted appropriately, opinion polls can add value to the national debate on topics of interest, including voting intentions. Typically, individuals or organisations commission a research organisation to undertake an opinion poll. The results to an opinion poll are either carried out for private use or for publication. What is sampling? Opinion polls are carried out among a sub-set of a given target audience or population and this sub-set is called a sample. Whilst the number included in a sample may differ, opinion poll samples are typically between c. 1,000 and 2,000 participants. When a sample is selected from a given target audience or population, the possibility of a sampling error is introduced. This is because the demographic profile of the sub-sample selected may not be identical to the profile of the target audience / population.
    [Show full text]
  • Has Polling Enhanced Representation? Unearthing Evidence from the Literary Digest Issue Polls
    Studies in American Political Development, 21 (Spring 2007), 16–29. Has Polling Enhanced Representation? Unearthing Evidence from the Literary Digest Issue Polls David Karol, University of California, Berkeley How has representation changed over time in the Institutional reforms are not, however, the only United States? Has responsiveness to public opinion factors that can affect representation; technological waxed or waned among elected officials? What are change can also play a significant role. In fact, some the causes of such trends as we observe? Scholars scholars contend that the rise of scientific surveys have pursued these crucial questions in different since the 1930s has yielded more responsive govern- ways. Some explore earlier eras in search of the “elec- ment. According to this school of thought, polls toral connection”, i.e. the extent to which voters held provide recent cohorts of elected officials more accu- office-holders accountable for their actions and the rate assessments of public opinion than their prede- degree to which electoral concerns motivated poli- cessors enjoyed, which allows them to reflect their ticians’ behavior.1 Others explore the effects of insti- constituents’ views to a greater extent than the tutional changes such as the move to direct election politicians of yesteryear. Yet others doubt whether of senators or the “reapportionment revolution.”2 politicians were truly ignorant of public sentiment before the rise of the poll; nor is there much certainty regarding the level of current politicians’ understand- I thank Larry Bartels, Terri Bimes, Ben Bishin, Ben Fordham, ing of constituent opinion. Some also question John Geer, Brian Glenn, Susan Herbst, Mark Kayser, Brian Lawson, whether ignorance is at the root of elected officials’ Taeku Lee, Eileen McDonagh and Eric Plutzer for comments along frequent divergence from their constituents’ wishes.
    [Show full text]
  • Observational Studies and Bias in Epidemiology
    The Young Epidemiology Scholars Program (YES) is supported by The Robert Wood Johnson Foundation and administered by the College Board. Observational Studies and Bias in Epidemiology Manuel Bayona Department of Epidemiology School of Public Health University of North Texas Fort Worth, Texas and Chris Olsen Mathematics Department George Washington High School Cedar Rapids, Iowa Observational Studies and Bias in Epidemiology Contents Lesson Plan . 3 The Logic of Inference in Science . 8 The Logic of Observational Studies and the Problem of Bias . 15 Characteristics of the Relative Risk When Random Sampling . and Not . 19 Types of Bias . 20 Selection Bias . 21 Information Bias . 23 Conclusion . 24 Take-Home, Open-Book Quiz (Student Version) . 25 Take-Home, Open-Book Quiz (Teacher’s Answer Key) . 27 In-Class Exercise (Student Version) . 30 In-Class Exercise (Teacher’s Answer Key) . 32 Bias in Epidemiologic Research (Examination) (Student Version) . 33 Bias in Epidemiologic Research (Examination with Answers) (Teacher’s Answer Key) . 35 Copyright © 2004 by College Entrance Examination Board. All rights reserved. College Board, SAT and the acorn logo are registered trademarks of the College Entrance Examination Board. Other products and services may be trademarks of their respective owners. Visit College Board on the Web: www.collegeboard.com. Copyright © 2004. All rights reserved. 2 Observational Studies and Bias in Epidemiology Lesson Plan TITLE: Observational Studies and Bias in Epidemiology SUBJECT AREA: Biology, mathematics, statistics, environmental and health sciences GOAL: To identify and appreciate the effects of bias in epidemiologic research OBJECTIVES: 1. Introduce students to the principles and methods for interpreting the results of epidemio- logic research and bias 2.
    [Show full text]
  • Third Party Election Spending and the Charter
    ELECTIONSPENDING AND THE CHARTER 429 LIBERTE, EGALITE, ARGENT: THIRD PARTY ELECTION SPENDING AND THE CHARTER 0 ANDREW GEDDIS Both the federal government and the courts have le gouvernementfederal et /es cours de Justice ont brought about changes in election law. The author apportedes modificationsa la loi electorate.l 'auteur reviews these recent changes In the legal landscape revolt le.r recents changementsdans le cadre legal that surroundelection mies. Inparticular third party entourant/es reg/es electorates, tout particulierement electionspending. Thequestions of "whatrules exist" /es depenseselectorates de tiers. la question,a savoir and "who shall make them" are particularly « quelles sont les reg/es qui existent II et « qui les importantto the discussionas this area of law tries to me/Ira en place ,, est particulierement importante reconcile individual interestsin liberty and equality dans celle discussionetant donne que ce domainedu in a democracy.The trio of SupremeC our/ of Canada droit teme de reconcilierles interets individuelset la decisions, Libman v. Quebec (A.G.), Thomson notion de liberte et d'egalite d'une democralie.Les Newspapersv. Canada (A.G.) and Sauve v. Canada trois dkisions de la Cour supreme du Canada. (Chief Electoral Officer), reveal ambiguity In the notamment Libman c. le Quebec (A.G.). Thomson Court's rationalefor limiting Individual liberty at Newspapersc. le Canada (A.G.)et Sauve c. le Canada electiontime. Thisambiguity Is broachedIn the recent (Directeur general des elections), manlfestent Supreme Court of Canada case of Harper v. Canada I 'amblg1111erelativement au raisonnementde la Cour (A.G.)where the Courtaccepted that Parliamentmay de limiter la liberte individuellependant un scrutm.
    [Show full text]
  • Capturing the Effects of Public Opinion Polls on Voter Support in the NY 25Th Congressional Election
    Rochester Institute of Technology RIT Scholar Works Theses 12-23-2014 Capturing the Effects of Public Opinion Polls on Voter Support in the NY 25th Congressional Election Heather Knappen Follow this and additional works at: https://scholarworks.rit.edu/theses Recommended Citation Knappen, Heather, "Capturing the Effects of Public Opinion Polls on Voter Support in the NY 25th Congressional Election" (2014). Thesis. Rochester Institute of Technology. Accessed from This Thesis is brought to you for free and open access by RIT Scholar Works. It has been accepted for inclusion in Theses by an authorized administrator of RIT Scholar Works. For more information, please contact [email protected]. Capturing the Effects of Public Opinion Polls on Voter Support in the NY 25th Congressional Election By Heather Knappen A Thesis Submitted in Partial Fulfillment of the Graduation Requirements for the Degree of Master of Science Department of Science, Technology and Public Policy College of Liberal Arts Rochester Institute of Technology Rochester, New York December 23, 2014 II Capturing the Effects of Public Opinion Polls on Voter Support in the NY 25th Congressional Election by Heather Knappen Masters of Science Science, Technology and Public Policy Thesis Submitted in Partial Fulfillment of the Graduation Requirements for the College of Liberal Arts/Public Policy Program at ROCHESTER INSTITUTE OF TECHNOLOGY Rochester, New York June 2014 Submitted by: Heather Knappen Signature Date Accepted by: Ron Hira, Thesis Advisor Department of Public Policy, R.I.T Signature Date Franz Foltz, Committee Member Department of Public Policy, R.I.T Signature Date Eric Hittinger, Committee Member Department of Public Policy, R.I.T Signature Date III Table of Contents Abstract ..........................................................................................................................................
    [Show full text]
  • 8 Analyzing and Interpreting Polls
    8 Analyzing and Interpreting Polls Thus far, we have considered how public opinion surveys are conducted, how they are reported in the media, and how they influence elections and campaigns. This chapter focuses on the end products of public opinion surveys: the analysis and interpretation of poll data. Interpreting a poll is more an art than a science, even though statistical analysis of poll data is central to the enterprise. An investigator examining poll results has tremendous leeway in deciding which items to analyze, which sample subsets or breakdowns to present, and how to interpret the statistical results. Take, as an example, a poll with three items that mea- sure attitudes toward stem cell research. The investigator may construct an index from these three items, as discussed in Chapter 3. Or the inves- tigator may emphasize the results from one question, perhaps because of space and time constraints and the desire to keep matters simple or because those particular results best support the analyst’s own policy pref- erences. Another possibility is to examine the results from the entire sam- ple and ignore subgroups whose responses deviate from the overall pattern. Again, time and space limitations or the investigator’s own pref- erences may influence the choices. Finally, two investigators may interpret identical poll results in sharply different ways depending on the perspec- tives and values they bring to their data analysis; the glass may be half full or half empty. The analysis and interpretation of poll data entail a high degree of Dosubjectivity not and judgment.copy, Subjectivity, post, in this or context, distribute does not mean deliberate bias or distortion but simply professional judgments about the importance and relevance of information.
    [Show full text]