Analyzing Complex Sample Survey Data Using SAS®, SPSS®, STATA®, and SUDAAN® Arlene B
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Python for Economists Alex Bell
Python for Economists Alex Bell [email protected] http://xkcd.com/353 This version: October 2016. If you have not already done so, download the files for the exercises here. Contents 1 Introduction to Python 3 1.1 Getting Set-Up................................................. 3 1.2 Syntax and Basic Data Structures...................................... 3 1.2.1 Variables: What Stata Calls Macros ................................ 4 1.2.2 Lists.................................................. 5 1.2.3 Functions ............................................... 6 1.2.4 Statements............................................... 7 1.2.5 Truth Value Testing ......................................... 8 1.3 Advanced Data Structures .......................................... 10 1.3.1 Tuples................................................. 10 1.3.2 Sets .................................................. 11 1.3.3 Dictionaries (also known as hash maps) .............................. 11 1.3.4 Casting and a Recap of Data Types................................. 12 1.4 String Operators and Regular Expressions ................................. 13 1.4.1 Regular Expression Syntax...................................... 14 1.4.2 Regular Expression Methods..................................... 16 1.4.3 Grouping RE's ............................................ 18 1.4.4 Assertions: Non-Capturing Groups................................. 19 1.4.5 Portability of REs (REs in Stata).................................. 20 1.5 Working with the Operating System.................................... -
TSP 5.0 Reference Manual
TSP 5.0 Reference Manual Bronwyn H. Hall and Clint Cummins TSP International 2005 Copyright 2005 by TSP International First edition (Version 4.0) published 1980. TSP is a software product of TSP International. The information in this document is subject to change without notice. TSP International assumes no responsibility for any errors that may appear in this document or in TSP. The software described in this document is protected by copyright. Copying of software for the use of anyone other than the original purchaser is a violation of federal law. Time Series Processor and TSP are trademarks of TSP International. ALL RIGHTS RESERVED Table Of Contents 1. Introduction_______________________________________________1 1. Welcome to the TSP 5.0 Help System _______________________1 2. Introduction to TSP ______________________________________2 3. Examples of TSP Programs _______________________________3 4. Composing Names in TSP_________________________________4 5. Composing Numbers in TSP _______________________________5 6. Composing Text Strings in TSP_____________________________6 7. Composing TSP Commands _______________________________7 8. Composing Algebraic Expressions in TSP ____________________8 9. TSP Functions _________________________________________10 10. Character Set for TSP ___________________________________11 11. Missing Values in TSP Procedures _________________________13 12. LOGIN.TSP file ________________________________________14 2. Command summary_______________________________________15 13. Display Commands _____________________________________15 -
Towards a Fully Automated Extraction and Interpretation of Tabular Data Using Machine Learning
UPTEC F 19050 Examensarbete 30 hp August 2019 Towards a fully automated extraction and interpretation of tabular data using machine learning Per Hedbrant Per Hedbrant Master Thesis in Engineering Physics Department of Engineering Sciences Uppsala University Sweden Abstract Towards a fully automated extraction and interpretation of tabular data using machine learning Per Hedbrant Teknisk- naturvetenskaplig fakultet UTH-enheten Motivation A challenge for researchers at CBCS is the ability to efficiently manage the Besöksadress: different data formats that frequently are changed. Significant amount of time is Ångströmlaboratoriet Lägerhyddsvägen 1 spent on manual pre-processing, converting from one format to another. There are Hus 4, Plan 0 currently no solutions that uses pattern recognition to locate and automatically recognise data structures in a spreadsheet. Postadress: Box 536 751 21 Uppsala Problem Definition The desired solution is to build a self-learning Software as-a-Service (SaaS) for Telefon: automated recognition and loading of data stored in arbitrary formats. The aim of 018 – 471 30 03 this study is three-folded: A) Investigate if unsupervised machine learning Telefax: methods can be used to label different types of cells in spreadsheets. B) 018 – 471 30 00 Investigate if a hypothesis-generating algorithm can be used to label different types of cells in spreadsheets. C) Advise on choices of architecture and Hemsida: technologies for the SaaS solution. http://www.teknat.uu.se/student Method A pre-processing framework is built that can read and pre-process any type of spreadsheet into a feature matrix. Different datasets are read and clustered. An investigation on the usefulness of reducing the dimensionality is also done. -
1 Computing Variances from Data with Complex Sampling Designs: A
Computing Variances from Data with Complex Sampling Designs: A Comparison of Stata and SPSS North American Stata Users Group March 12-13, 2001 Alicia C. Dowd, Assistant Professor Univ. Mass. Boston, Graduate College of Education Wheatley Hall, 100 Morrissey Blvd. Boston MA 02125 [email protected] 617 287-7593 phone 617 287-7664 fax Michael B. Duggan, Director of Enrollment Research Suffolk University 8 Ashburton Place Boston MA 02108 [email protected] 617 573-8468 phone 617 720-0970 fax 1 Introduction The National Center for Education Statistics (NCES) is responsible for collecting, analyzing, and reporting data related to education in the United States and other countries (U.S. Department of Education, 1996, p. 2). Among the surveys conducted by the NCES, several pertain to postsecondary schooling and outcomes and are of interest to higher education researchers. These include Beginning Postsecondary Students (BPS), Baccalaureate and Beyond (B&B), National Postsecondary Student Aid Study (NPSAS), the National Study of Postsecondary Faculty (NSOPF), and the Integrated Postsecondary Education Data Set (IPEDS). With the exception of IPEDS, these surveys are conducted using complex survey designs, involving stratification, clustering, and unequal probabilities of case selection. Researchers analyzing these data must take the complex sampling designs into account in order to estimate variances accurately. Novice researchers and doctoral students, particularly those in colleges of education, will likely encounter issues surrounding the use of complex survey data for the first time if they undertake to analyze NCES data. Doctoral programs in education typically have minimal requirements for the study of statistics, and statistical theories are usually learned based on the assumption of a simple random sample. -
Kwame Nkrumah University of Science and Technology, Kumasi
KWAME NKRUMAH UNIVERSITY OF SCIENCE AND TECHNOLOGY, KUMASI, GHANA Assessing the Social Impacts of Illegal Gold Mining Activities at Dunkwa-On-Offin by Judith Selassie Garr (B.A, Social Science) A Thesis submitted to the Department of Building Technology, College of Art and Built Environment in partial fulfilment of the requirement for a degree of MASTER OF SCIENCE NOVEMBER, 2018 DECLARATION I hereby declare that this work is the result of my own original research and this thesis has neither in whole nor in part been prescribed by another degree elsewhere. References to other people’s work have been duly cited. STUDENT: JUDITH S. GARR (PG1150417) Signature: ........................................................... Date: .................................................................. Certified by SUPERVISOR: PROF. EDWARD BADU Signature: ........................................................... Date: ................................................................... Certified by THE HEAD OF DEPARTMENT: PROF. B. K. BAIDEN Signature: ........................................................... Date: ................................................................... i ABSTRACT Mining activities are undertaken in many parts of the world where mineral deposits are found. In developing nations such as Ghana, the activity is done both legally and illegally, often with very little or no supervision, hence much damage is done to the water bodies where the activities are carried out. This study sought to assess the social impacts of illegal gold mining activities at Dunkwa-On-Offin, the capital town of Upper Denkyira East Municipality in the Central Region of Ghana. The main objectives of the research are to identify factors that trigger illegal mining; to identify social effects of illegal gold mining activities on inhabitants of Dunkwa-on-Offin; and to suggest effective ways in curbing illegal mining activities. Based on the approach to data collection, this study adopts both the quantitative and qualitative approach. -
Data Workflows with Stata and Python
In [1]: from IPython.display import IFrame import ipynb_style from epstata import Stpy import pandas as pd from itertools import combinations from importlib import reload In [2]: reload(ipynb_style) ipynb_style.clean() #ipynb_style.presentation() #ipynb_style.pres2() Out[2]: Data Workflows in Stata and Python (http://www.stata.com) (https://www.python.org) Data Workflows in Stata and Python Dejan Pavlic, Education Policy Research Initiative, University of Ottawa Stephen Childs (presenter), Office of Institutional Analysis, University of Calgary (http://ucalgary.ca) (http://uottawa.ca/en) (http://socialsciences.uottawa.ca/irpe- epri/eng/index.asp) Introduction About this talk Objectives know what Python is and what advantages it has know how Python can work with Stata Please save questions for the end. Or feel free to ask me today or after the conference. Outline Introduction Overall Motivation About Python Building Blocks Running Stata from Python Pandas Python language features Workflows ETL/Data Cleaning Stata code generation Processing Stata output About Me Started using Stata in grad school (2006). Using Python for about 3 years. Post-Secondary Education sector University of Calgary - Institutional Analysis (https://oia.ucalgary.ca/Contact) Education Policy Research Initiative (http://socialsciences.uottawa.ca/irpe-epri/eng/index.asp) - University of Ottawa (a Stata shop) Motivation Python is becoming very popular in the data world. Python skills are widely applicable. Python is powerful and flexible and will help you get more done, -
Gretl User's Guide
Gretl User’s Guide Gnu Regression, Econometrics and Time-series Allin Cottrell Department of Economics Wake Forest university Riccardo “Jack” Lucchetti Dipartimento di Economia Università Politecnica delle Marche December, 2008 Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.1 or any later version published by the Free Software Foundation (see http://www.gnu.org/licenses/fdl.html). Contents 1 Introduction 1 1.1 Features at a glance ......................................... 1 1.2 Acknowledgements ......................................... 1 1.3 Installing the programs ....................................... 2 I Running the program 4 2 Getting started 5 2.1 Let’s run a regression ........................................ 5 2.2 Estimation output .......................................... 7 2.3 The main window menus ...................................... 8 2.4 Keyboard shortcuts ......................................... 11 2.5 The gretl toolbar ........................................... 11 3 Modes of working 13 3.1 Command scripts ........................................... 13 3.2 Saving script objects ......................................... 15 3.3 The gretl console ........................................... 15 3.4 The Session concept ......................................... 16 4 Data files 19 4.1 Native format ............................................. 19 4.2 Other data file formats ....................................... 19 4.3 Binary databases .......................................... -
Handbook on Precision Requirements and Variance Estimation for ESS Households Surveys
ISSN 1977-0375 Methodologies and Working papers Handbook on precision requirements and variance estimation for ESS households surveys 2013 edition Methodologies and Working papers Handbook on precision requirements and variance estimation for ESS household surveys 2013 edition Europe Direct is a service to help you find answers to your questions about the European Union. Freephone number (*): 00 800 6 7 8 9 10 11 (*)0H The information given is free, as are most calls (though some operators, phone boxes or hotels may charge you). More information on the European Union is available on the Internet (http://europa.eu). Cataloguing data can be found at the end of this publication. Luxembourg: Publications Office of the European Union, 2013 ISBN 978-92-79-31197-0 ISSN 1977-0375 doi:10.2785/13579 Cat. No: KS-RA-13-029-EN-N Theme: General and regional statistics Collection: Methodologies & Working papers © European Union, 2013 Reproduction is authorised provided the source is acknowledged. Acknowledgments Acknowledgments The European Commission expresses its gratitude and appreciation to the following members of the ESS1 Task Force, for their work on Precision Requirements and Variance Estimation for Household Surveys: Experts from the European Statistical System (ESS): Martin Axelson Sweden — Statistics Sweden Loredana Di Consiglio Italy — ISTAT Kari Djerf Finland — Statistics Finland Stefano Falorsi Italy — ISTAT Alexander Kowarik Austria — Statistics Austria Mārtiņš Liberts Latvia — CSB Ioannis Nikolaidis Greece — EL.STAT Experts from European -
Introduction to Stata
Introduction to Stata Christopher F Baum Faculty Micro Resource Center Boston College August 2011 Christopher F Baum (Boston College FMRC) Introduction to Stata August 2011 1 / 157 Strengths of Stata What is Stata? Overview of the Stata environment Stata is a full-featured statistical programming language for Windows, Mac OS X, Unix and Linux. It can be considered a “stat package,” like SAS, SPSS, RATS, or eViews. Stata is available in several versions: Stata/IC (the standard version), Stata/SE (an extended version) and Stata/MP (for multiprocessing). The major difference between the versions is the number of variables allowed in memory, which is limited to 2,047 in standard Stata/IC, but can be much larger in Stata/SE or Stata/MP. The number of observations in any version is limited only by memory. Christopher F Baum (Boston College FMRC) Introduction to Stata August 2011 2 / 157 Strengths of Stata What is Stata? Stata/SE relaxes the Stata/IC constraint on the number of variables, while Stata/MP is the multiprocessor version, capable of utilizing 2, 4, 8... processors available on a single computer. Stata/IC will meet most users’ needs; if you have access to Stata/SE or Stata/MP, you can use that program to create a subset of a large survey dataset with fewer than 2,047 variables. Stata runs on all 64-bit operating systems, and can access larger datasets on a 64-bit OS, which can address a larger memory space. All versions of Stata provide the full set of features and commands: there are no special add-ons or ‘toolboxes’. -
Approaches to Imputing Missing Data in Complex Survey Data
Introduction Offerings Examples Results Conclusions Ending Approaches to imputing missing data in complex survey data Christine Wells, Ph.D. IDRE UCLA Statistical Consulting Group July 27, 2018 Christine Wells, Ph.D. Imputing missing data in complex survey data 1/ 28 Introduction Offerings Examples Results Conclusions Ending Three types of missing data with item non-response Missing completely at random (MCAR) Not related to observed values, unobserved values, or the value of the missing datum itself Missing at random (MAR) Not related to the (unobserved) value of the datum, but related to the value of observed variable(s) Missing not at random (MNAR) The value of the missing datum is the reason it is missing Each variable can have its own type of missing data mechanism; all three can be present in a given dataset Most imputation techniques only appropriate for MCAR and MAR data Christine Wells, Ph.D. Imputing missing data in complex survey data 2/ 28 Introduction Offerings Examples Results Conclusions Ending Different approaches to imputing missing complex survey data Stata: multiple imputation (mi) (and possibly full information maximum likelihood (FIML)) SAS: Four types of hotdeck imputation Fully efficient fractional imputation (FEFI) 2 stage FEFI Fractional hotdeck Hotdeck SUDAAN: Four methods Cox-Iannacchione weighted sequential hotdeck (WSHD) Cell mean imputation Linear regression imputation Logistic regression imputation Christine Wells, Ph.D. Imputing missing data in complex survey data 3/ 28 Introduction Offerings Examples Results Conclusions Ending Handling imputation variation Stata Multiple complete datasets SAS Imputation-adjusted replicate weights (not with hotdeck) BRR (Fay), Jackknife, Bootstrap Multiple imputation (only with hotdeck) SUDAAN Multiple versions of imputed variable (WSHD only) Christine Wells, Ph.D. -
Statistical Software
Statistical Software A. Grant Schissler1;2;∗ Hung Nguyen1;3 Tin Nguyen1;3 Juli Petereit1;4 Vincent Gardeux5 Keywords: statistical software, open source, Big Data, visualization, parallel computing, machine learning, Bayesian modeling Abstract Abstract: This article discusses selected statistical software, aiming to help readers find the right tool for their needs. We categorize software into three classes: Statisti- cal Packages, Analysis Packages with Statistical Libraries, and General Programming Languages with Statistical Libraries. Statistical and analysis packages often provide interactive, easy-to-use workflows while general programming languages are built for speed and optimization. We emphasize each software's defining characteristics and discuss trends in popularity. The concluding sections muse on the future of statistical software including the impact of Big Data and the advantages of open-source languages. This article discusses selected statistical software, aiming to help readers find the right tool for their needs (not provide an exhaustive list). Also, we acknowledge our experiences bias the discussion towards software employed in scholarly work. Throughout, we emphasize the software's capacity to analyze large, complex data sets (\Big Data"). The concluding sections muse on the future of statistical software. To aid in the discussion, we classify software into three groups: (1) Statistical Packages, (2) Analysis Packages with Statistical Libraries, and (3) General Programming Languages with Statistical Libraries. This structure -
The Use of PSPP Software in Learning Statistics. European Journal of Educational Research, 8(4), 1127-1136
Research Article doi: 10.12973/eu-jer.8.4.1127 European Journal of Educational Research Volume 8, Issue 4, 1127 - 1136. ISSN: 2165-8714 http://www.eu-jer.com/ The Use of PSPP Software in Learning Statistics Minerva Sto.-Tomas Darin Jan Tindowen* Marie Jean Mendezabal University of Saint Louis, PHILIPPINES University of Saint Louis, PHILIPPINES University of Saint Louis, PHILIPPINES Pyrene Quilang Erovita Teresita Agustin University of Saint Louis, PHILIPPINES University of Saint Louis, PHILIPPINES Received: July 8, 2019 ▪ Revised: August 31, 2019 ▪ Accepted: October 4, 2019 Abstract: This descriptive and correlational study investigated the effects of using PSPP in learning Statistics on students’ attitudes and performance. The respondents of the study were 200 Grade 11 Senior High School students who were enrolled in Probability and Statistics subject during the Second Semester of School Year 2018-2019. The respondents were randomly selected from those classes across the different academic strands that used PSPP in their Probability and Statistics subject through stratified random sampling. The results revealed that the students have favorable attitudes towards learning Statistics with the use of the PSPP software. The students became more interested and engaged in their learning of statistics which resulted to an improved academic performance. Keywords: Probability and statistics, attitude, PSPP software, academic performance, technology. To cite this article: Sto,-Tomas, M., Tindowen, D. J, Mendezabal, M. J., Quilang, P. & Agustin, E. T. (2019). The use of PSPP software in learning statistics. European Journal of Educational Research, 8(4), 1127-1136. http://doi.org/10.12973/eu-jer.8.4.1127 Introduction The rapid development of technology has brought remarkable changes in the modern society and in all aspects of life such as in politics, trade and commerce, and education.