DOCSLIB.ORG

Statistical Sampling: an Overview for Criminal Justice Researchers April 28, 2016 Stan Orchowsky

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Statistical Sampling: an Overview for Criminal Justice Researchers April 28, 2016 Stan Orchowsky Statistical Sampling: An Overview for Criminal Justice Researchers April 28, 2016 Stan Orchowsky: Good afternoon everyone. My name is Stan Orchowsky, I'm the research director for the Justice Research and Statistics Association. It's my pleasure to welcome you this afternoon to the next in our Training and Technical Assistance Webinar Series on Statistical Analysis for Criminal Justice Research. We want to thank the Bureau of Justice Statistics, which is helping to support this webinar series. Stan Orchowsky: Today's topic will be on statistical sampling, we will be providing an overview for criminal justice research. And I'm going to turn this over now to Dr. Farley, who's going to give you the objectives for the webinar. Erin Farley: Greetings everyone. Erin Farley: Okay, so the webinar objectives. Sampling is a very important and useful tool in social science criminal justice research, and that is because in many, if not most, situations accessing an entire population to conduct research is not feasible. Oftentimes it would be too time-consuming and expensive. As a result, the use of sampling methodology, if utilized properly, can save time, money, and produce sample estimates that can be utilized to make inferences about the larger population. Erin Farley: The objectives of this webinar include: describing the different types of probability and non-probability sampling designs; discussing the strengths and weaknesses of these techniques, as well as discussing the importance of sampling to the external validity of experimental designs and statistical analysis. Erin Farley: This slide presents a simple diagram illustrating the process and goal of sampling. Using the appropriate technique, a sample is drawn from the larger and known population, and if this sample is representative of the population we can take what we have learned about the sample and make an inference about the entire population. Erin Farley: What is missing from this diagram are the important questions that need to be answered prior to drawing a sample. In fact, the answers to these questions will likely impact the type of sampling method that is selected. For example, what is the nature of the study? Is it exploratory, descriptive, or analytical? What are the variables of interest? What is the target population? What is the data collection mode? Is it survey, or interviews? What is the sampling frame, and what is the target sample size? Besides thinking about these keys questions, it is also useful to be familiar with the terminology associated with sampling. So let's take a moment to review a few key terms. Justice Research and Statistics Association Webinar Page 1 of 13 Statistical Sampling: An Overview for Criminal Justice Researchers April 28, 2016 Erin Farley: Target population is the collection of elements about which we wish to make an inference. While we often speak of populations as very large, hence the need for sampling, target populations can be quite small. So in one case the citizens of California may be the population of interest. In another case you may be interested in a very specific population, say 16 to 18-year-old incarcerated females with a history of heroin addiction. Erin Farley: Unit or case refers to the elements you are interested in. These elements could be things like people, organizations, or documents. Erin Farley: Sampling frame is the list of all units of the population of interest. For example, if your target population was a local university's students, then your sampling frame would be all students enrolled at the local university. For another example, let's say you want to survey residents of Maine. You could use voter registration records and/or the phone book as your sampling frame, but I'm sure many of you realize that voter registration and phone books are imperfect and incomplete lists. More resources can be added in an attempt to cover more of the population. For example, in addition to voter registration and phone books one could add DMV records. But even then this would still exclude people, and this highlights a common challenge. In almost all cases the sampling frame will not perfectly match with the target population, and this leads to errors of coverage. This error, referred to as sampling error, means that the sampling does not accurately represent the population. Erin Farley: Other ways that this may occur is through non-response. This could be volunteers selectively refusing to participate or participants refusing to answer particular questions. Understanding sampling error is extremely important when working with sample estimates and attempting to infer to the larger population, and Stan will discuss this later in the presentation. Erin Farley: Okay. So sampling techniques that we are going to discuss today. There are two general categories of sampling techniques: probability and non- probability sampling. With probability sampling every element has a known chance of being selected into the sample. This process eliminates selection bias, allowing for the sample estimates to be generalized to the larger population. The specific sampling methods that fall under probability sampling that will be discussed today include: simple random sampling, stratified sampling, systematic sampling, and cluster sampling. Erin Farley: With non-probability sampling every unit of the population does not have a known probability of being included in the sample. Subjects are Justice Research and Statistics Association Webinar Page 2 of 13 Statistical Sampling: An Overview for Criminal Justice Researchers April 28, 2016 selected based on the subjective judgment of the researcher. As a result, this type of sampling methodology is vulnerable to selection bias and sample estimates that cannot be generalized or inferred to the larger population. Examples that we will be discussing today include: convenience, judgmental purposive, snowball, and quota sampling. Erin Farley: To begin with simple random sampling. In simple random sampling every unit of the population has the same known probability of being included in the sample, and the sample is selected from the population randomly. In other words, each individual in the population has an equal opportunity to be selected for the sample. Erin Farley: Say there are 1000 people in your sampling frame. For example, utilizing a book of names and numbers, going back to the college example, and you have 1000 people in your sampling frame. So you've identified your sampling frame, and you would then number each element in the sampling frame from 1 to n, and in this case, this example, it would be 1 to 1000. Then you would utilize a chance mechanism to assist in selecting the random sample. Here I have listed a web resource called the random number generator. Erin Farley: Advantages of this method is that it is very simple and it relies on probability theory, and it reduces bias. However, this method is also very expensive and time-consuming, and is not feasible in many circumstances. Erin Farley: But to provide you an example, say you work for a research agency interested in conducting a study of non-violent felony offenders diverted to drug court for treatment of a heroin or opiate addiction. A very specific population. You want to follow-up with and interview participants who fit this criteria, and who graduated in 2015. The total number of graduates is 50, and let's say you're interested in sampling 20. The courts have provided you with a list of offenders, how do you pick your 20? Erin Farley: First you must number your graduates from 1 to 50, and then go to the random number generator, for example, this is what ... the link that I provided, it will send you to this page, and then you fill this site out. So for example, you answer this list of questions. How many sets of numbers do you want to generate? You just want to generate one. How many numbers per set? 20, since you're interested in selecting 20. What is the number range? 50 graduates equals 1 to 50. Unique value? Yes. And then, generate? This could be whatever is the personal preference, I Justice Research and Statistics Association Webinar Page 3 of 13 Statistical Sampling: An Overview for Criminal Justice Researchers April 28, 2016 usually choose least to greatest. And then you press on, randomize now, and it will produce a list of numbers. Erin Farley: So I received a random list of numbers, and this resulted in 1, 3, 7, 9, so forth, popping up, and this is my random sample of 20 individuals, 20 graduates. Erin Farley: Okay. So moving onto systematic sampling, this involves the selection of elements from an ordered sampling frame. So it is a variation of simple random sampling, and it is often considered more practical and easier to use in field settings. Using this procedure every element in the population has a known probability of selection, but not every element has an equal chance of being chosen like simple random sampling. In systematic sampling, it is best used when given a population that is logically homogeneous because systematic sample units are uniformly distributed over the population. You're using a constant interval to select your sample. So a researcher needs to make sure that there is no hidden pattern, as this would threaten randomness. Erin Farley: So here is an example, again. Say you wanted to conduct a household victimization survey in a town. Now let's say there are 40 houses in this very small town, and you want to sample 10 of them. First, you would want to establish your selection interview. You would do this by dividing 40, the number of houses, by 10, which is the sample you are interested in, and the result is 4.
Load more

Recommended publications
  • Esomar/Grbn Guideline for Online Sample Quality
    ESOMAR/GRBN GUIDELINE FOR ONLINE SAMPLE QUALITY ESOMAR GRBN ONLINE SAMPLE QUALITY GUIDELINE ESOMAR, the World Association for Social, Opinion and Market Research, is the essential organisation for encouraging, advancing and elevating market research: www.esomar.org. GRBN, the Global Research Business Network, connects 38 research associations and over 3500 research businesses on five continents: www.grbn.org. © 2015 ESOMAR and GRBN. Issued February 2015. This Guideline is drafted in English and the English text is the definitive version. The text may be copied, distributed and transmitted under the condition that appropriate attribution is made and the following notice is included “© 2015 ESOMAR and GRBN”. 2 ESOMAR GRBN ONLINE SAMPLE QUALITY GUIDELINE CONTENTS 1 INTRODUCTION AND SCOPE ................................................................................................... 4 2 DEFINITIONS .............................................................................................................................. 4 3 KEY REQUIREMENTS ................................................................................................................ 6 3.1 The claimed identity of each research participant should be validated. .................................................. 6 3.2 Providers must ensure that no research participant completes the same survey more than once ......... 8 3.3 Research participant engagement should be measured and reported on ............................................... 9 3.4 The identity and personal
    [Show full text]
  • SAMPLING DESIGN & WEIGHTING in the Original
    Appendix A 2096 APPENDIX A: SAMPLING DESIGN & WEIGHTING In the original National Science Foundation grant, support was given for a modified probability sample. Samples for the 1972 through 1974 surveys followed this design. This modified probability design, described below, introduces the quota element at the block level. The NSF renewal grant, awarded for the 1975-1977 surveys, provided funds for a full probability sample design, a design which is acknowledged to be superior. Thus, having the wherewithal to shift to a full probability sample with predesignated respondents, the 1975 and 1976 studies were conducted with a transitional sample design, viz., one-half full probability and one-half block quota. The sample was divided into two parts for several reasons: 1) to provide data for possibly interesting methodological comparisons; and 2) on the chance that there are some differences over time, that it would be possible to assign these differences to either shifts in sample designs, or changes in response patterns. For example, if the percentage of respondents who indicated that they were "very happy" increased by 10 percent between 1974 and 1976, it would be possible to determine whether it was due to changes in sample design, or an actual increase in happiness. There is considerable controversy and ambiguity about the merits of these two samples. Text book tests of significance assume full rather than modified probability samples, and simple random rather than clustered random samples. In general, the question of what to do with a mixture of samples is no easier solved than the question of what to do with the "pure" types.
    [Show full text]
  • Sampling Methods It’S Impractical to Poll an Entire Population—Say, All 145 Million Registered Voters in the United States
    Sampling Methods It’s impractical to poll an entire population—say, all 145 million registered voters in the United States. That is why pollsters select a sample of individuals that represents the whole population. Understanding how respondents come to be selected to be in a poll is a big step toward determining how well their views and opinions mirror those of the voting population. To sample individuals, polling organizations can choose from a wide variety of options. Pollsters generally divide them into two types: those that are based on probability sampling methods and those based on non-probability sampling techniques. For more than five decades probability sampling was the standard method for polls. But in recent years, as fewer people respond to polls and the costs of polls have gone up, researchers have turned to non-probability based sampling methods. For example, they may collect data on-line from volunteers who have joined an Internet panel. In a number of instances, these non-probability samples have produced results that were comparable or, in some cases, more accurate in predicting election outcomes than probability-based surveys. Now, more than ever, journalists and the public need to understand the strengths and weaknesses of both sampling techniques to effectively evaluate the quality of a survey, particularly election polls. Probability and Non-probability Samples In a probability sample, all persons in the target population have a change of being selected for the survey sample and we know what that chance is. For example, in a telephone survey based on random digit dialing (RDD) sampling, researchers know the chance or probability that a particular telephone number will be selected.
    [Show full text]
  • 5.1 Survey Frame Methodology
    Regional Course on Statistical Business Registers: Data sources, maintenance and quality assurance Perak, Malaysia 21-25 May, 2018 4 .1 Survey fram e methodology REVIEW For sampling purposes, a snapshot of the live register at a particular point in t im e is needed. The collect ion of active statistical units in the snapshot is referred to as a frozen frame. REVIEW A sampling frame for a survey is a subset of t he frozen fram e t hat includes units and characteristics needed for t he survey. A single frozen fram e should be used for all surveys in a given reference period Creat ing sam pling fram es SPECIFICATIONS Three m ain t hings need t o be specified t o draw appropriate sampling frames: ▸ Target population (which units?) ▸ Variables of interest ▸ Reference period CHOICE OF STATISTICAL UNIT Financial data Production data Regional data Ent erpri ses are Establishments or Establishments or typically the most kind-of-activity local units should be appropriate units to units are typically used if regional use for financial data. the most appropriate disaggregation is for production data. necessary. Typically a single t ype of unit is used for each survey, but t here are except ions where t arget populat ions include m ult iple unit t ypes. CHOICE OF STATISTICAL UNIT Enterprise groups are useful for financial analyses and for studying company strategies, but they are not normally the target populations for surveys because t hey are t oo diverse and unstable. SURVEYS OF EMPLOYMENT The sam pling fram es for t hese include all active units that are em ployers.
    [Show full text]
  • MRS Guidance on How to Read Opinion Polls
    What are opinion polls? MRS guidance on how to read opinion polls June 2016 1 June 2016 www.mrs.org.uk MRS Guidance Note: How to read opinion polls MRS has produced this Guidance Note to help individuals evaluate, understand and interpret Opinion Polls. This guidance is primarily for non-researchers who commission and/or use opinion polls. Researchers can use this guidance to support their understanding of the reporting rules contained within the MRS Code of Conduct. Opinion Polls – The Essential Points What is an Opinion Poll? An opinion poll is a survey of public opinion obtained by questioning a representative sample of individuals selected from a clearly defined target audience or population. For example, it may be a survey of c. 1,000 UK adults aged 16 years and over. When conducted appropriately, opinion polls can add value to the national debate on topics of interest, including voting intentions. Typically, individuals or organisations commission a research organisation to undertake an opinion poll. The results to an opinion poll are either carried out for private use or for publication. What is sampling? Opinion polls are carried out among a sub-set of a given target audience or population and this sub-set is called a sample. Whilst the number included in a sample may differ, opinion poll samples are typically between c. 1,000 and 2,000 participants. When a sample is selected from a given target audience or population, the possibility of a sampling error is introduced. This is because the demographic profile of the sub-sample selected may not be identical to the profile of the target audience / population.
    [Show full text]
  • Categorical Data Analysis
    Categorical Data Analysis Related topics/headings: Categorical data analysis; or, Nonparametric statistics; or, chi-square tests for the analysis of categorical data. OVERVIEW For our hypothesis testing so far, we have been using parametric statistical methods. Parametric methods (1) assume some knowledge about the characteristics of the parent population (e.g. normality) (2) require measurement equivalent to at least an interval scale (calculating a mean or a variance makes no sense otherwise). Frequently, however, there are research problems in which one wants to make direct inferences about two or more distributions, either by asking if a population distribution has some particular specifiable form, or by asking if two or more population distributions are identical. These questions occur most often when variables are qualitative in nature, making it impossible to carry out the usual inferences in terms of means or variances. For such problems, we use nonparametric methods. Nonparametric methods (1) do not depend on any assumptions about the parameters of the parent population (2) generally assume data are only measured at the nominal or ordinal level. There are two common types of hypothesis-testing problems that are addressed with nonparametric methods: (1) How well does a sample distribution correspond with a hypothetical population distribution? As you might guess, the best evidence one has about a population distribution is the sample distribution. The greater the discrepancy between the sample and theoretical distributions, the more we question the “goodness” of the theory. EX: Suppose we wanted to see whether the distribution of educational achievement had changed over the last 25 years. We might take as our null hypothesis that the distribution of educational achievement had not changed, and see how well our modern-day sample supported that theory.
    [Show full text]
  • Lecture 8: Sampling Methods
    Lecture 8: Sampling Methods Donglei Du ([email protected]) Faculty of Business Administration, University of New Brunswick, NB Canada Fredericton E3B 9Y2 Donglei Du (UNB) ADM 2623: Business Statistics 1 / 30 Table of contents 1 Sampling Methods Why Sampling Probability vs non-probability sampling methods Sampling with replacement vs without replacement Random Sampling Methods 2 Simple random sampling with and without replacement Simple random sampling without replacement Simple random sampling with replacement 3 Sampling error vs non-sampling error 4 Sampling distribution of sample statistic Histogram of the sample mean under SRR 5 Distribution of the sample mean under SRR: The central limit theorem Donglei Du (UNB) ADM 2623: Business Statistics 2 / 30 Layout 1 Sampling Methods Why Sampling Probability vs non-probability sampling methods Sampling with replacement vs without replacement Random Sampling Methods 2 Simple random sampling with and without replacement Simple random sampling without replacement Simple random sampling with replacement 3 Sampling error vs non-sampling error 4 Sampling distribution of sample statistic Histogram of the sample mean under SRR 5 Distribution of the sample mean under SRR: The central limit theorem Donglei Du (UNB) ADM 2623: Business Statistics 3 / 30 Why sampling? The physical impossibility of checking all items in the population, and, also, it would be too time-consuming The studying of all the items in a population would not be cost effective The sample results are usually adequate The destructive nature of certain tests Donglei Du (UNB) ADM 2623: Business Statistics 4 / 30 Sampling Methods Probability Sampling: Each data unit in the population has a known likelihood of being included in the sample.
    [Show full text]
  • Use of Sampling in the Census
    Regional Workshop on the Operational Guidelines of the WCA 2020 Amman, Jordan 1-4 April 2019 Use of sampling in the census Technical Session 5.2 Oleg Cara Statistician, Agricultural Censuses Team FAO Statistics Division (ESS) 1 CONTENTS Complete enumeration censuses versus sample-based censuses Uses of sampling at other census stages Sample designs based on list frames Sample designs based on area frames Sample designs based on multiple frames Choice of sample design Country examples 2 Background As mentioned in the WCA 2020, Vol. 1 (Chapter 4, paragraph 4.34), when deciding whether to conduct a census by complete or sample enumeration, in addition to efficiency considerations (precision versus costs), one should take into account: desired level of aggregation for census data; use of the census as a frame for ongoing sampling surveys; data content of the census; and capacity to deal with sampling methods and subsequent statistical analysis based on samples. 3 Complete enumeration versus sample enumeration census Complete enumeration Sample enumeration Advantages 1. Reliable census results for the 1. Is generally less costly that a smallest administrative and complete enumeration geographic units and on rare events 2. Contributes to decrease the overall (such as crops/livestock types) response burden 2. Provides a reliable frame for the organization of subsequent regular 3. Requires a smaller number of infra-annual and annual sample enumerators and supervisors than a surveys. In terms of frames, it is census conducted by complete much less demanding in respect of enumeration. Consequently, the the holdings’ characteristics non-sampling errors can be 3. Requires fewer highly qualified expected to be lower because of statistical personnel with expert the employment of better trained knowledge of sampling methods enumerators and supervisors and than a census conducted on a sample basis.
    [Show full text]
  • 7.2 Sampling Plans and Experimental Design
    7.2 Sampling Plans and Experimental Design Statistics 1, Fall 2008 Inferential Statistics • Goal: Make inferences about the population based on data from a sample • Examples – Estimate population mean, μ or σ, based on data from the sample Methods of Sampling • I’ll cover five common sampling methods, more exist – Simple random sampling – Stratified random sampling – Cluster sampling – Systematic 1‐in‐k sampling – Convenience sampling Simple Random Sampling • Each sample of size n from a population of size N has an equal chance of being selected • Implies that each subject has an equal chance of being included in the sample • Example: Select a random sample of size 5 from this class. Computer Generated SRS • Obtain a list of the population (sampling frame) • Use Excel – Generate random number for each subject using rand() function – copy|paste special|values to fix random numbers – sort on random number, sample is the first n in this list • Use R (R is a free statistical software package) – sample(1:N,n), N=population size, n=sample size – Returns n randomly selected digits between 1 and N – default is sampling WOR Stratified Random Sampling • The population is divided into subgroups, or strata • A SRS is selected from each strata • Ensures representation from each strata, no guarantee with SRS Stratified Random Sampling • Example: Stratify the class by gender, randomly selected 3 female and 3 male students • Example: Voter poll –stratify the nation by state, randomly selected 100 voters in each state Cluster Sampling • The subjects in
    [Show full text]
  • Eurobarometer 422
    Flash Eurobarometer 422 CROSS-BORDER COOPERATION IN THE EU SUMMARY Fieldwork: June 2015 Publication: September 2015 This survey has been requested by the European Commission, Directorate-General for Regional and Urban Policy and co-ordinated by Directorate-General for Communication. This document does not represent the point of view of the European Commission. The interpretations and opinions contained in it are solely those of the authors. Flash Eurobarometer 422 - TNS Political & Social Flash Eurobarometer 422 Project title “Cross-border cooperation in the EU” Linguistic Version EN Catalogue Number KN-04-15-608-EN-N ISBN 978-92-79-50789-2 DOI 10.2776/964957 © European Union, 2015 Flash Eurobarometer 422 Cross-border cooperation in the EU Conducted by TNS Political & Social at the request of the European Commission, Directorate-General Regional and Urban Policy Survey co-ordinated by the European Commission, Directorate-General for Communication (DG COMM “Strategy, Corporate Communication Actions and Eurobarometer” Unit) FLASH EUROBAROMETER 422 “Cross-border cooperation in the EU” TABLE OF CONTENTS INTRODUCTION .................................................................................................. 2 I. Awareness of EU regional policy-funded cross-border cooperation activities6 II. Going abroad to other countries ................................................................. 10 III. social trust of the EU population living in border regions covered by the Interreg cross-border cooperation programmes .............................................
    [Show full text]
  • STANDARDS and GUIDELINES for STATISTICAL SURVEYS September 2006
    OFFICE OF MANAGEMENT AND BUDGET STANDARDS AND GUIDELINES FOR STATISTICAL SURVEYS September 2006 Table of Contents LIST OF STANDARDS FOR STATISTICAL SURVEYS ....................................................... i INTRODUCTION......................................................................................................................... 1 SECTION 1 DEVELOPMENT OF CONCEPTS, METHODS, AND DESIGN .................. 5 Section 1.1 Survey Planning..................................................................................................... 5 Section 1.2 Survey Design........................................................................................................ 7 Section 1.3 Survey Response Rates.......................................................................................... 8 Section 1.4 Pretesting Survey Systems..................................................................................... 9 SECTION 2 COLLECTION OF DATA................................................................................... 9 Section 2.1 Developing Sampling Frames................................................................................ 9 Section 2.2 Required Notifications to Potential Survey Respondents.................................... 10 Section 2.3 Data Collection Methodology.............................................................................. 11 SECTION 3 PROCESSING AND EDITING OF DATA...................................................... 13 Section 3.1 Data Editing ........................................................................................................
    [Show full text]
  • Ch7 Sampling Techniques
    7 - 1 Chapter 7. Sampling Techniques Introduction to Sampling Distinguishing Between a Sample and a Population Simple Random Sampling Step 1. Defining the Population Step 2. Constructing a List Step 3. Drawing the Sample Step 4. Contacting Members of the Sample Stratified Random Sampling Convenience Sampling Quota Sampling Thinking Critically About Everyday Information Sample Size Sampling Error Evaluating Information From Samples Case Analysis General Summary Detailed Summary Key Terms Review Questions/Exercises 7 - 2 Introduction to Sampling The way in which we select a sample of individuals to be research participants is critical. How we select participants (random sampling) will determine the population to which we may generalize our research findings. The procedure that we use for assigning participants to different treatment conditions (random assignment) will determine whether bias exists in our treatment groups (Are the groups equal on all known and unknown factors?). We address random sampling in this chapter; we will address random assignment later in the book. If we do a poor job at the sampling stage of the research process, the integrity of the entire project is at risk. If we are interested in the effect of TV violence on children, which children are we going to observe? Where do they come from? How many? How will they be selected? These are important questions. Each of the sampling techniques described in this chapter has advantages and disadvantages. Distinguishing Between a Sample and a Population Before describing sampling procedures, we need to define a few key terms. The term population means all members that meet a set of specifications or a specified criterion.
    [Show full text]