MRIP Survey Design and Statistical Methods

Total Page:16

File Type:pdf, Size:1020Kb

MRIP Survey Design and Statistical Methods National Marine Fisheries Service’s Marine Recreational Information Program Survey Design and Statistical Methods for Estimation of Recreational Fisheries Catch and Effort Prepared by: Katherine J. Papacostas, ECS Federal, LLC and John Foster, NOAA-NMFS Acknowledgements The following members of MRIP’s Research and Evaluation Team and Survey Operations Team are gratefully thanked for their review of, and contributions to, this report: Rob Andrews, Lauren Dolinger Few, Yong-Woo Lee, Daemian Schrieber, Tom Sminkey, Lucas Johansen, Ryan Kitts-Jensen, and Dave Van Voorhees. Table of Contents 1. Introduction ........................................................................................................................ 1 2. The Access Point Angler Intercept Survey (APAIS): Catch Rates .............................. 7 2.1 Sampling Design ................................................................................................................. 7 2.1.1 Stratification Variables .................................................................................................... 7 2.1.2 Design Stages ................................................................................................................... 9 2.1.3 Sample Frame: Public Access Fishing Site Register .................................................... 10 2.1.4 Clustering Methods ........................................................................................................ 10 2.1.5 Sample Selection ............................................................................................................ 11 2.1.6 Headboat Sampling Design............................................................................................ 13 2.2 Imputation Methods for Missing Values ........................................................................... 14 2.3 APAIS Estimation Methods ............................................................................................... 15 2.3.1 Final Sample Weight...................................................................................................... 16 2.3.2 Standard Catch Rate Estimation .................................................................................... 18 2.3.3 FES Coverage Adjustment for Out-of-Frame Angler-Trips .......................................... 19 2.3.4 FHS Coverage Adjustment for Out-of-Frame Angler-Trips ......................................... 20 2.3.5 Legacy CHTS Coverage Adjustment for Out-of-Frame Angler-Trips .......................... 20 2.3.6 Area Fished Proportions for Private Boat and Shore Mode Effort ................................ 21 2.4 APAIS Certification Status ................................................................................................ 22 3. The Fishing Effort Survey (FES): Shore and Private Boat Fishing Effort ............... 23 3.1 Sampling Design ............................................................................................................... 23 3.2 Data Collection Design..................................................................................................... 24 3.3 Data Editing ...................................................................................................................... 24 3.4 Estimation Methods .......................................................................................................... 25 3.4.1 FES Weighting ............................................................................................................... 25 3.4.2 Private Boat and Shore Fishing Effort Estimation ......................................................... 27 3.5 FES Certification Status ................................................................................................... 27 4. Legacy Coastal Household Telephone Survey (CHTS) Design: Shore and Private Boat Fishing Effort ..................................................................................................................... 28 4.1 Sampling Design ............................................................................................................... 28 4.2 Data Collection Design..................................................................................................... 29 4.3 Imputation Methods for Missing Values ........................................................................... 30 4.4 Estimation Methods .......................................................................................................... 30 4.4.1 Winsorization ............................................................................................................... 31 4.4.2 Private Boat and Shore Fishing Effort Estimation ....................................................... 31 4.5 CHTS Certification Status................................................................................................. 31 5. The For-Hire Survey (FHS): For-Hire Fishing Effort ................................................ 32 5.1 Sampling Design ............................................................................................................... 32 5.1.2 Stratification Variables and Sample Frame ................................................................... 32 5.1.3 Sample Selection ............................................................................................................ 33 5.2 Data Collection Design..................................................................................................... 33 5.3 Vessel Trip Reports (VTRs) ............................................................................................... 34 5.4 Estimation Methods .......................................................................................................... 35 5.4.1 For-Hire Fishing Effort Estimation ................................................................................ 35 5.4.2 Dockside Validation and Adjustment for Reporting Error ............................................ 36 5.5 FHS Certification Status ................................................................................................... 41 6. Total Catch and Effort Estimation: Combining the Estimate Components from the APAIS, FES, CHTS and FHS .................................................................................................... 42 6.1 Total Effort Estimation ..................................................................................................... 42 6.1.1 FES Total Effort ............................................................................................................. 42 6.1.2 CHTS Total Effort ......................................................................................................... 43 6.1.3 For-Hire Effort – Combining VTR Data with FHS Data ............................................. 44 6.2. Total Catch Estimation .................................................................................................... 47 6.2.1 Standard Total Catch Estimation ................................................................................... 47 6.2.2 Alternative Total Catch Estimation for Small Sample Sizes ......................................... 48 6.2.3 Total Catch Estimation for Public Use Datasets ............................................................ 49 6.3. Length-Frequencies ....................................................................................................... 51 6.4 MRIP Estimation Certification Status .............................................................................. 52 7. Large Pelagics Survey (LPS): Large Pelagics and HMS Catch and Fishing Effort .. 53 7.1 Large Pelagics Telephone Survey (LPTS): Large Pelagics and HMS Fishing Effort ..... 53 7.1.1 LPTS-Private Sampling Design ..................................................................................... 54 7.1.2 Data Collection Design .................................................................................................. 54 7.1.3 LPTS Charter Boat Sampling General Protocols (Add-on to the FHS) ........................ 54 7.1.4 LPTS Imputation ............................................................................................................ 55 7.1.5 LPTS Estimation Methods ............................................................................................. 55 7.2 Large Pelagics Intercept Survey (LPIS): Large Pelagics and HMS Catch Rates ............ 56 7.2.1 LPIS Sampling Design ................................................................................................... 56 7.2.2 Data Collection Design .................................................................................................. 58 7.2.3 LPIS Estimation Methods .............................................................................................. 58 7.3 LPS Total Effort and Catch Estimation ............................................................................ 59 7.3.1 LPS Total Effort ............................................................................................................. 59 7.3.2 LPS Total Catch ............................................................................................................. 60 7.4 Large Pelagics Biological Survey (LPBS) ........................................................................ 61 7.5 LPS Certification Status .................................................................................................... 61 8. Time-Series Calibration Methods .................................................................................
Recommended publications
  • Statistical Theory and Methodology for the Analysis of Microbial Compositions, with Applications
    Statistical Theory and Methodology for the Analysis of Microbial Compositions, with Applications by Huang Lin BS, Xiamen University, China, 2015 Submitted to the Graduate Faculty of the Graduate School of Public Health in partial fulfillment of the requirements for the degree of Doctor of Philosophy University of Pittsburgh 2020 UNIVERSITY OF PITTSBURGH GRADUATE SCHOOL OF PUBLIC HEALTH This dissertation was presented by Huang Lin It was defended on April 2nd 2020 and approved by Shyamal Das Peddada, PhD, Professor and Chair, Department of Biostatistics, Graduate School of Public Health, University of Pittsburgh Jeanine Buchanich, PhD, Research Associate Professor, Department of Biostatistics, Graduate School of Public Health, University of Pittsburgh Ying Ding, PhD, Associate Professor, Department of Biostatistics, Graduate School of Public Health, University of Pittsburgh Matthew Rogers, PhD, Research Assistant Professor, Department of Surgery, UPMC Children's Hospital of Pittsburgh Hong Wang, PhD, Research Assistant Professor, Department of Biostatistics, Graduate School of Public Health, University of Pittsburgh Dissertation Director: Shyamal Das Peddada, PhD, Professor and Chair, Department of Biostatistics, Graduate School of Public Health, University of Pittsburgh ii Copyright c by Huang Lin 2020 iii Statistical Theory and Methodology for the Analysis of Microbial Compositions, with Applications Huang Lin, PhD University of Pittsburgh, 2020 Abstract Increasingly researchers are finding associations between the microbiome and human diseases such as obesity, inflammatory bowel diseases, HIV, and so on. Determining what microbes are significantly different between conditions, known as differential abundance (DA) analysis, and depicting the dependence structure among them, are two of the most challeng- ing and critical problems that have received considerable interest.
    [Show full text]
  • Analytic Inference in Finite Population Framework Via Resampling Arxiv
    Analytic inference in finite population framework via resampling Pier Luigi Conti Alberto Di Iorio Abstract The aim of this paper is to provide a resampling technique that allows us to make inference on superpopulation parameters in finite population setting. Under complex sampling designs, it is often difficult to obtain explicit results about su- perpopulation parameters of interest, especially in terms of confidence intervals and test-statistics. Computer intensive procedures, such as resampling, allow us to avoid this problem. To reach the above goal, asymptotic results about empirical processes in finite population framework are first obtained. Then, a resampling procedure is proposed, and justified via asymptotic considerations. Finally, the results obtained are applied to different inferential problems and a simulation study is performed to test the goodness of our proposal. Keywords: Resampling, finite populations, H´ajekestimator, empirical process, statistical functionals. arXiv:1809.08035v1 [stat.ME] 21 Sep 2018 1 Introduction The use of superpopulation models in survey sampling has a long history, going back (at least) to [8], where the limits of assuming the population characteristics as fixed, especially in economic and social studies, are stressed. As clearly appears, for instance, from [30] and [26], there are basically two types of inference in the finite populations setting. The first one is descriptive or enumerative inference, namely inference about finite population parameters. This kind of inference is a static \picture" on the current state of a population, and does not take into account the mechanism generating the characters of interest of the population itself. The second one is analytic inference, and consists in inference on superpopulation parameters.
    [Show full text]
  • Sampling and Evaluation
    Sampling and Evaluation A Guide to Sampling for Program Impact Evaluation Peter M. Lance Aiko Hattori Suggested citation: Lance, P. and A. Hattori. (2016). Sampling and evaluation: A guide to sampling for program impact evaluation. Chapel Hill, North Carolina: MEASURE Evaluation, University of North Carolina. Sampling and Evaluation A Guide to Sampling for Program Impact Evaluation Peter M. Lance, PhD, MEASURE Evaluation Aiko Hattori, PhD, MEASURE Evaluation ISBN: 978-1-943364-94-7 MEASURE Evaluation This publication was produced with the support of the United States University of North Carolina at Chapel Agency for International Development (USAID) under the terms of Hill MEASURE Evaluation cooperative agreement AID-OAA-L-14-00004. 400 Meadowmont Village Circle, 3rd MEASURE Evaluation is implemented by the Carolina Population Center, University of North Carolina at Chapel Hill in partnership with Floor ICF International; John Snow, Inc.; Management Sciences for Health; Chapel Hill, NC 27517 USA Palladium; and Tulane University. Views expressed are not necessarily Phone: +1 919-445-9350 those of USAID or the United States government. MS-16-112 [email protected] www.measureevaluation.org Dedicated to Anthony G. Turner iii Contents Acknowledgments v 1 Introduction 1 2 Basics of Sample Selection 3 2.1 Basic Selection and Sampling Weights . 5 2.2 Common Sample Selection Extensions and Complications . 58 2.2.1 Multistage Selection . 58 2.2.2 Stratification . 62 2.2.3 The Design Effect, Re-visited . 64 2.2.4 Hard to Find Subpopulations . 64 2.2.5 Large Clusters and Size Sampling . 67 2.3 Complications to Weights . 69 2.3.1 Non-Response Adjustment .
    [Show full text]
  • Sampling Handout
    SAMPLING SIMPLE RANDOM SAMPLING – A sample in which all population members have the same probability of being selected and the selection of each member is independent of the selection of all other members. SIMPLE RANDOM SAMPLING (RANDOM SAMPLING): Selecting a group of subjects (a sample) for study from a larger group (population) so that each individual (or other unit of analysis) is chosen entirely by chance. When used without qualifications (such as stratified random sampling), random sampling means “simple random sampling.” Also sometimes called “equal probability sample,” because every member of the population has an equal probability (chance) of being included in the sample. A random sample is not the same thing as a haphazard or accidental sample. Using random sampling reduces the likelihood of bias. SYSTEMATIC SAMPLING – A procedure for selecting a probability sample in which every kth member of the population is selected and in which 1/k is the sampling fraction. SYSTEMATIC SAMPLING: A sample obtained by taking every ”nth” subject or case from a list containing the total population (or sampling frame). The size of the n is calculated by dividing the desired sample size into the population size. For example, if you wanted to draw a systematic sample of 1,000 individuals from a telephone directory containing 100,000 names, you would divide 1,000 into 100,000 to get 100; hence, you would select every 100th name from the directory. You would start with a randomly selected number between 1 and 100, say 47, and then select the 47th name, the 147th, the 247th, the 347th, and so on.
    [Show full text]
  • Target Population” – Do Not Use “Sample Population.”
    NCES Glossary Analysis of Variance: Analysis of variance (ANOVA) is a collection of statistical models and their associated estimation procedures (such as the "variation" among and between groups) used to test or analyze the differences among group means in a sample. This technique is operated by modeling the value of the dependent variable Y as a function of an overall mean “µ”, related independent variables X1…Xn, and a residual “e” that is an independent normally distributed random variable. Bias (due to nonresponse): The difference that occurs when respondents differ as a group from non-respondents on a characteristic being studied. Bias (of an estimate): The difference between the expected value of a sample estimate and the corresponding true value for the population. Bootstrap: See Replication techniques. CAPI: Computer Assisted Personal Interviewing enables data collection staff to use portable microcomputers to administer a data collection form while viewing the form on the computer screen. As responses are entered directly into the computer, they are used to guide the interview and are automatically checked for specified range, format, and consistency edits. CATI: Computer Assisted Telephone Interviewing uses a computer system that allows a telephone interviewer to administer a data collection form over the phone while viewing the form on a computer screen. As the interviewer enters responses directly into the computer, the responses are used to guide the interview and are automatically checked for specified range, format, and consistency edits. Cluster: a group of similar people, things or objects positioned or occurring closely together. Cluster Design: Cluster Design refers to a type of sampling method in which the researcher divides the population into separate groups, of similarities - called clusters.
    [Show full text]
  • Finite Population Correction Methods
    Finite Population Correction Methods Moses Obiri May 5, 2017 Contents 1 Introduction 1 2 Normal-based Confidence Interval 2 3 Bootstrap Confidence Interval 3 4 Finite Population Bootstrap Sampling 5 4.1 Modified Resample Size. .5 4.2 Population and Superpopulation Bootstrap . .6 5 Simulation Study 8 6 Results and Discussion 9 6.1 Results: Coverage Rate and Mean Width . .9 6.2 Discussion . 14 7 Improvement and Future Work 15 8 References 15 1 Introduction One application of inferential statistics is to use a simple random sample of size n from a population to learn about the characteristics of such population. A very common inference is that of the population mean. The sample mean is typically used as a point estimate for the population mean. The uncertainty in using a point estimate is addressed by means of confidence intervals. Con- fidence intervals provide us with a range of values for the unknown population mean along with the precision of the method. For the parametric approach, the central limit theorem allows us to construct t-based confidence intervals for large sample sizes or symmetric populations. Over the years, nonparametric computer-intensive bootstrap methods have become popular for constructing confidence intervals as well. 1 The central limit, the standard error of the sample mean and traditional bootstrap methods are based on the principle that samples are selected with replacement or that sampling is done without replacement from an infinite pop- ulation. In most research surveys, however, sampling is done from a finite population of size N. When we sample from an infinite population or sample with replacement; then selecting one unit does not affect the probability of se- lecting the same or another unit.
    [Show full text]
  • 06 Sampling Plan For
    The Journal of Industrial Statistics (2014), 3 (1), 120 - 139 120 A Resource Based Sampling Plan for ASI B. B. Singh1, National Sample Survey Office, FOD, New Delhi, India Abstract Annual Survey of Industries (ASI), despite having the mandates of self-compilation of returns by the units selected for the survey, most of the units require the support and expertise of the field functionaries for compilation. Responsibility of the survey for central sample including the census units rests with the Field Operations Division (FOD) of National Sample Survey Office (NSSO). The new sampling plan for the ASI envisages uniform sampling fraction for the sample units for the strata at State X district X sector X 4 digit NIC level, irrespective of the number of population units in each of the strata. Many strata have comparatively smaller number of population units requiring larger sampling fraction for better precision of estimates. On the other hand, a sizeable number of Regional Offices having the jurisdiction over a number of districts usually gets large allocation of sample units in individual strata beyond their managerial capacity with respect to availability of field functionaries and the work load, leading to increased non sampling errors. A plan based on varying sampling fraction ensuring a certain level of significance may result less number of units in these regions however still ensuring the estimates at desired precision. The sampling fraction in other strata having less number of population units could be increased so as to enhance the precision of the estimates in those strata. The latest ASI frames of units have been studied and a suitable sampling fraction has been suggested in the paper.
    [Show full text]
  • Chapter 4 Stratified Sampling
    Chapter 4 Stratified Sampling An important objective in any estimation problem is to obtain an estimator of a population parameter which can take care of the salient features of the population. If the population is homogeneous with respect to the characteristic under study, then the method of simple random sampling will yield a homogeneous sample, and in turn, the sample mean will serve as a good estimator of the population mean. Thus, if the population is homogeneous with respect to the characteristic under study, then the sample drawn through simple random sampling is expected to provide a representative sample. Moreover, the variance of the sample mean not only depends on the sample size and sampling fraction but also on the population variance. In order to increase the precision of an estimator, we need to use a sampling scheme which can reduce the heterogeneity in the population. If the population is heterogeneous with respect to the characteristic under study, then one such sampling procedure is a stratified sampling. The basic idea behind the stratified sampling is to divide the whole heterogeneous population into smaller groups or subpopulations, such that the sampling units are homogeneous with respect to the characteristic under study within the subpopulation and heterogeneous with respect to the characteristic under study between/among the subpopulations. Such subpopulations are termed as strata. Treat each subpopulation as a separate population and draw a sample by SRS from each stratum. [Note: ‘Stratum’ is singular and ‘strata’ is plural]. Example: In order to find the average height of the students in a school of class 1 to class 12, the height varies a lot as the students in class 1 are of age around 6 years, and students in class 10 are of age around 16 years.
    [Show full text]
  • Piazza Chapter on "Fundamentals of Applied Sampling"
    1 Chapter 5 Fundamentals of Applied Sampling Thomas Piazza 5.1 The Basic Idea of Sampling Survey sampling is really quite remarkable. In research we often want to know certain characteristics of a large population, but we are almost never able to do a complete census of it. So we draw a sample—a subset of the population—and conduct research on that relatively small subset. Then we generalize the results, with an allowance for sampling error, to the entire population from which the sample was selected. How can this be justified? The capacity to generalize sample results to an entire population is not inherent in just any sample. If we interview people in a “convenience” sample—those passing by on the street, for example—we cannot be confident that a census of the population would yield similar results. To have confidence in generalizing sample results to the whole population requires a “probability sample” of the population. This chapter presents a relatively non-technical explanation of how to draw a probability sample. Key Principles of Probability Sampling When planning to draw a sample, we must do several basic things: 1. Define carefully the population to be surveyed. Do we want to generalize the sample result to a particular city? Or to an entire nation? Or to members of a professional group or some other organization? It is important to be clear about our intentions. Often it may not be realistic to attempt to select a survey sample from the whole population we ideally would like to study. In that case it is useful to distinguish between the entire population of interest (e.g., all adults in the U.S.) and the population we will actually attempt to survey (e.g., adults living in households in the continental U.S., with a landline telephone in the home).
    [Show full text]
  • Estimating and Comparing Richness with Incidence Data and Incomplete Sampling
    Statistics & Operations Research Transactions Statistics & Operations Research SORT 41 (1) January-June 2017, 3-54 © Institut d’Estad´ısticaTransactions de Catalunya ISSN: 1696-2281 [email protected] eISSN: 2013-8830 www.idescat.cat/sort/ Thirty years of progeny from Chao’s inequality: Estimating and comparing richness with incidence data and incomplete sampling Anne Chao1,∗ and Robert K. Colwell2,3,4 Abstract In the context of capture-recapture studies, Chao (1987) derived an inequality among capture frequency counts to obtain a lower bound for the size of a population based on individuals’ capture/non-capture records for multiple capture occasions. The inequality has been applied to obtain a non-parametric lower bound of species richness of an assemblage based on species incidence (detection/non-detection) data in multiple sampling units. The inequality implies that the number of undetected species can be inferred from the species incidence frequency counts of the uniques (species detected in only one sampling unit) and duplicates (species detected in exactly two sampling units). In their pioneering pa- per, Colwell and Coddington (1994) gave the name “Chao2” to the estimator for the resulting species richness. (The “Chao1” estimator refers to a similar type of estimator based on species abundance data). Since then, the Chao2 estimator has been applied to many research fields and led to fruitful generalizations. Here, we first review Chao’s inequality under various models and discuss some re- lated statistical inference questions: (1) Under
    [Show full text]
  • Abundance-Based Similarity Indices and Their Estimation When There Are Unseen Species in Samples
    Biometrics 62, 361–371 DOI: 10.1111/j.1541-0420.2005.00489.x June 2006 Abundance-Based Similarity Indices and Their Estimation When There Are Unseen Species in Samples 1, 2 2 3 Anne Chao, ∗ Robin L. Chazdon, Robert K. Colwell, and Tsung-Jen Shen 1Institute of Statistics, National Tsing Hua University, Hsin-Chu 30043, Taiwan 2Department of Ecology and Evolutionary Biology, University of Connecticut, Storrs, Connecticut 06269-3043, U.S.A. 3Department of Applied Mathematics, National Chung Hsing University, Tai-Chung 402, Taiwan ∗email: [email protected] Summary. A wide variety of similarity indices for comparing two assemblages based on species incidence (i.e., presence/absence) data have been proposed in the literature. These indices are generally based on three simple incidence counts: the number of species shared by two assemblages and the number of species unique to each of them. We provide a new probabilistic derivation for any incidence-based index that is symmetric (i.e., the index is not affected by the identity ordering of the two assemblages) and homogeneous (i.e., the index is unchanged if all counts are multiplied by a constant). The probabilistic approach is further extended to formulate abundance-based indices. Thus any symmetric and homogeneous incidence index can be easily modified to an abundance-type version. Applying the Laplace approximation formulas, we propose estimators that adjust for the effect of unseen shared species on our abundance-based indices. Simulation results show that the adjusted estimators significantly reduce the biases of the corresponding unadjusted ones when a substantial fraction of species is missing from samples.
    [Show full text]
  • Chapter 8, Sampling Designs: Random Sampling, Adaptive And
    CHAPTER 8 SAMPLING DESIGNS - RANDOM SAMPLING, ADAPTIVE AND SYSTEMATIC SAMPLING (Version 4, 14 March 2013) Page 8.1 SIMPLE RANDOM SAMPLING ....................................................................... 325 8.1.1 Estimation of Parameters ................................................................... 328 8.1.2 Estimation of a Ratio ........................................................................... 334 8.1.3 Proportions and Percentages............................................................ 337 8.2 STRATIFIED RANDOM SAMPLING ................................................................ 341 8.2.1 Estimates of Parameters ..................................................................... 343 8.22 Allocation of Sample Size .................................................................... 348 8.2.2.1 Proportional Allocation ................................................................ 348 8.2.2.2 Optimal Allocation ........................................................................ 350 8.2.3 Construction of Strata ......................................................................... 356 8.2.4 Proportions and Percentages............................................................. 359 8.3 ADAPTIVE SAMPLING .................................................................................... 360 8.3.1 Adaptive cluster sampling .................................................................. 361 8.3.2 Stratified Adaptive Cluster Sampling ................................................ 365 8.4 SYSTEMATIC
    [Show full text]