DOCSLIB.ORG

Singapore Math’ Program for American Schools a REPORT of FINDINGS from a RANDOMIZED CONTROL TRIAL

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Singapore Math’ Program for American Schools a REPORT of FINDINGS from a RANDOMIZED CONTROL TRIAL AN EMPIRICAL EDUCATION REPORT Assessing Impacts of Math in Focus, a ‘Singapore Math’ Program for American Schools A REPORT OF FINDINGS FROM A RANDOMIZED CONTROL TRIAL November 30, 2012 Andrew P. Jaciw Whitney Hegseth Boya Ma Garrett Lai Empirical Education Inc. Acknowledgements We are grateful to the people in Clark County School District for their assistance and cooperation in conducting this research. The research was sponsored by Houghton Mifflin Harcourt which provided Empirical Education Inc. with independence in reporting the results. ABOUT EMPIRICAL EDUCATION INC. Empirical Education Inc. is a Palo Alto, California-based research company that provides rigorous and independent evidence to inform school system decisions. The company brings its expertise in research, data analysis, engineering, and project management to customers that include the US Department of Education, educational publishers, foundations, leading research organizations, and state and local education agencies. ©2012 Empirical Education Inc. Assessing Impacts of Math in Focus, a ‘Singapore Math’ Program for American Schools A Report of Findings from a Randomized Control Trial Reference for this report: Jaciw, A. P., Hegseth, W., Ma, B., & Lai, G. (2012, November). Assessing Impacts of Math in Focus, a ‘Singapore Math” Program for American Schools: Findings from an RCT. (Empirical Education Rep. No. Empirical_MIF121130-FR1-Y1-O.1). Palo Alto, CA: Empirical Education Inc. Table of Contents Introduction ............................................................................................................ 1 Methods ................................................................................................................... 2 EXPERIMENTAL DESIGN ..................................................................................................... 3 How the Sample was Identified ....................................................................................... 4 Randomization .................................................................................................................... 4 What Factors May Moderate the Impact of MIF? .......................................................... 5 What Factors May Mediate Between MIF and the Outcome? ...................................... 5 How Large a Sample Do We Need? ................................................................................. 6 How Small an Impact Do We Need? ............................................................................... 6 How Much Variation is there between Grade-Level Teams? ........................................... 6 How Much Value Do We Gain From a Pretest and other Covariates? ........................... 7 Are There Subgroups of Particular Interest? ................................................................... 8 How Much Confidence Do We Want to Have in our Results? ....................................... 8 Sample Size Calculation for This Experiment ................................................................ 8 SITE DESCRIPTION ................................................................................................................ 9 Table 1. Demographics of Clark County School District ............................................ 9 HOUGHTON MIFFLIN HARCOURT MATH IN FOCUS ................................................. 9 Training/Professional Development ................................................................................ 9 Math in Focus Materials .................................................................................................... 10 Expectations of Implementation ..................................................................................... 11 Control Materials .............................................................................................................. 11 SCHEDULE OF MAJOR MILESTONES ............................................................................. 12 Table 2. Research Milestones .................................................................................... 12 DATA SOURCES AND COLLECTION.............................................................................. 12 Class Rosters and Demographic Data ............................................................................ 13 Achievement Measures .................................................................................................... 13 The Stanford Achievement Test ..................................................................................... 13 The Nevada Criterion-Referenced Test .......................................................................... 14 Testing Schedule............................................................................................................. 14 Program Implementation Measures .............................................................................. 15 Table 3. Implementation Data Collection Schedule for the MIF Study .................... 15 Teacher Background Form.............................................................................................. 15 Teacher Training Observations ...................................................................................... 16 Classroom Observations ................................................................................................. 16 Focus Groups .................................................................................................................. 16 Teacher and Principal Surveys ....................................................................................... 16 Table 4. Survey Participation Rates .......................................................................... 17 Teacher Background ....................................................................................................... 17 Conditions for Math Instruction .................................................................................... 18 Extent of Program Implementation and Implementation Fidelity ................................. 18 Comparison of Classroom Practices between MIF and Control Groups ........................ 18 Teacher Satisfaction with MIF ....................................................................................... 19 FORMATION OF THE EXPERIMENTAL GROUPS ........................................................ 19 Baseline Sample................................................................................................................. 19 Table 5. Characteristics of the Study Sample based on Rosters Received (baseline sample) ...................................................................................................................... 20 Analytical Samples ........................................................................................................... 21 Sample Sizes, Attrition, and Equivalence Tests ............................................................ 21 Table 6. Numbers of Units in the Experimental Groups and Attrition over Time .. 22 SAT 10 Problem Solving ................................................................................................ 22 Table 7. Characteristics of Study Sample (Analytical Sample for SAT 10 Problem Solving) ..................................................................................................................... 23 SAT 10 Procedures ......................................................................................................... 24 Table 8. Characteristics of Study Sample (Analytical Sample for SAT 10 Procedures) ................................................................................................................ 25 CRT ................................................................................................................................ 26 Table 9. Characteristics of Study Sample (Analytical Sample for CRT) .................. 26 REPORTING ON THE IMPACT OF MIF ........................................................................... 27 Setting Up the Statistical Equation ................................................................................. 27 Program Impact .............................................................................................................. 27 Handling Missing Data ................................................................................................. 28 Covariates and Moderators at the Student Level ........................................................... 29 Teacher Level Outcomes and Potential Mediators ......................................................... 29 Fixed and Random Effects .............................................................................................. 30 Exploratory Investigations .............................................................................................. 31 Reporting the Results ....................................................................................................... 31 Effect Sizes ...................................................................................................................... 31 Estimates ........................................................................................................................ 31 p values ........................................................................................................................... 32 Results .................................................................................................................... 32 IMPLEMENTATION RESULTS .........................................................................................
Load more

Recommended publications
  • Introduction to Singapore Math
    INTRODUCTION TO SINGAPORE MATH Welcome to Singapore Math! The math curriculum in Singapore has been recognized worldwide for its excellence in producing students highly skilled in mathematics. Students in Singapore have ranked at the top in the world in mathematics on the Trends in International Mathematics and Science Study (TIMSS) in 1993, 1995, 2003, and 2008. Because of this, Singapore Math has gained in interest and popularity in the United States. Singapore Math curriculum aims to help students develop the necessary math concepts and process skills for everyday life and to provide students with the ability to formulate, apply, and solve problems. Mathematics in the Singapore Primary (Elementary) Curriculum cover fewer topics but in greater depth. Key math concepts are introduced and built-on to reinforce various mathematical ideas and thinking. Students in Singapore are typically one grade level ahead of students in the United States. The following pages provide examples of the various math problem types and skill sets taught in Singapore. At an elementary level, some simple mathematical skills can help students 3. Addition Number Bond (double and single digits) understand mathematical principles. These skills are the counting-on, counting- back, and crossing-out methods. Note that these methods are most useful when 2 + 15 the numbers are small. 5 10 1. The Counting-On Method Used for addition of two numbers. Count on in 1s with the help of a picture or = 2 + 5 + 10 Regroup 15 into 5 and 10. number line. = 7 + 10 7 + 4 = 11 = 17 +1 +1 +1 +1 4. Subtraction Number Bond (double and single digits) 7 8 9 10 11 12 – 7 2 10 2.
    [Show full text]
  • Kindergarten | Curriculum Guide
    KINDERGARTEN | CURRICULUM GUIDE At The Epstein School, students experience an exceptional education led by specialized STEAM and Hebrew language programs. The school prepares confident lifelong learners grounded in their unique Jewish identities. We look forward to helping your student learn and grow this year. ENGLISH LANGUAGE ARTS The Kindergarten Language Arts curriculum focuses on meeting individual reading and writing needs, providing students the time and support needed to become readers and writers. Reading focuses on developing decoding skills and fluency, while fostering the ability to read for meaning. Students enjoy reading aloud, shared reading, and guided reading experiences. They develop reading skills at their own pace to meet their individualized goals. Through the Writer’s Workshop program, students learn to generate ideas and take them from the initial stages of writing through to publication. Students learn to communicate effectively, work cooperatively, and attentively listen to acquire and understand new information. CRITICAL THINKING QUESTIONS WE WILL EXPLORE: • Who am I as a reader? • Why do I read and write? • How does becoming a stronger reader help me become a better writer? Over the course of the year, students will develop the following skills: READING: • Know and apply grade-level phonics and word analysis skills in decoding words, demonstrating basic knowledge of one-to-one letter-sound correspondences. • Demonstrate understanding of spoken words, syllables and sounds by producing rhyming words and blending and segmenting syllables. • Demonstrate understanding of the organization and basic features of print. • Read common high-frequency words by sight. • Read emergent-reader texts with purpose and understanding. • With prompting and support, ask and answer questions about key details in text.
    [Show full text]
  • Singapore Math Fact Sheet
    SINGAPORE MATH FACT SHEET 1. SINGAPORE MATH 1980s To address students’ difficulties with word problems and low achievement in Mathematics, the Curriculum Development Institute of Singapore (CDIS) now known as the Curriculum Planning & Development Division (CPDD), developed the Model Method which advocates the Concrete-Pictorial-Abstract approach. In this approach, students are provided with the necessary learning experiences and meaningful contexts, using concrete manipulatives and pictorial representations to help them learn abstract mathematics. 1982 First published in 1982 as part of the national curriculum in Singapore, the Primary Mathematics series was the only mathematics series used in Singapore primary schools till 2001. It was written and developed by members of a project team put together by the Ministry of Education, Singapore and co-published by Marshall Cavendish Education. 1990s–2000s The mathematics curriculum was revised in 1990. Mathematical problem solving became central to mathematics learning and importance was placed on processes in mathematics learning. This resulted in the Mathematics Framework, which became another important feature of Singapore education. It explicates the intention of mathematics education – to go beyond the basic acquisition of concepts and skills, and enable students to develop an understanding of mathematical thinking, problem-solving strategies and an appreciation for mathematics in everyday life. The framework was introduced to primary and lower secondary in 1990, and has undergone curriculum reviews in 2000 and 2003 to reflect the rapid changes in a highly competitive and technologically driven world. This framework was extended to all levels in 2003. 2009 The Singapore Model Method for Learning Mathematics, a monograph to serve as a resource book on the Model Method will be launched in April 2009.
    [Show full text]
  • At LA School, Singapore Math Has Added V
    Los Angeles Times: At L.A. school, Singapore math has added value http://www.latimes.com/news/local/la-me-math9mar09,1,5891523,print.story http://www.latimes.com/news/local/la-me-math9mar09,0,1449785.story From the Los Angeles Times At L.A. school, Singapore math has added value By Mitchell Landsberg Los Angeles Times Staff Writer March 9, 2008 Here's a little math problem: In 2005, just 45% of the fifth-graders at Ramona Elementary School in Hollywood scored at grade level on a standardized state test. In 2006, that figure rose to 76%. What was the difference? If you answered 31 percentage points, you are correct. You could also express it as a 69% increase. But there is another, more intriguing answer: The difference between the two years may have been Singapore math. At the start of the 2005-06 school year, Ramona began using textbooks developed for use in Singapore, a Southeast Asian city-state whose pupils consistently rank No. 1 in international math comparisons. Ramona's math scores soared. "It's wonderful," said Principal Susan Arcaris. "Seven out of 10 of the students in our school are proficient or better in math, and that's pretty startling when you consider that this is an inner-city, Title 1 school." Ramona easily qualifies for federal Title 1 funds, which are intended to alleviate the effects of poverty. Nine of every 10 students at the school are eligible for free or reduced-price lunches. For the most part, these are the children of immigrants, the majority from Central America, some from Armenia.
    [Show full text]
  • Reforming Mathematics Education Dr. Barry Fagin Professor Of
    Reforming K-12 Mathematics Education Dr. Barry Fagin Professor of Computer Science USAFA (opinions are mine, not USAFA’s) What’s the problem? 8th grade math scores, IAEEA 2000 Report 700 600 500 400 300 200 100 0 y n a a a A ia n ca re a i ri S n ra ri o p ss ysi a U a rke I f p u la lg u A a Ja a m T g R u o th in M B R u S o S 1. Singapore 2. Korea 3. China 13. Australia 4. Hong Kong 2. Czechoslovakia 5. Japan 3. Finland 1. Moldova 6. Belgium 4. Malaysia 2. Thailand 7. Netherlands 5. Bulgaria 3. Israel 8. Slovak Rep. 6. USA 4. Tunisia 9. Hungary 7. England 5. Macedonia 10.Canada 8. New Zealand 6. Turkey 11.Slovenia 9. Lithuania 7. Jordan 12.Russia 10.Italy 8. Iran 11.Cyprus 9. Indonesia 12.Romania 10.Chile 11.Philippines 12.Morocco 13.South Africa % CSAP Advanced or Proficient (5th grade) 100 90 80 70 60 W 50 H 40 B 30 20 10 0 2001 2002 2003 % CSAP Advanced or Proficient (8th grade) 100 90 80 70 60 W 50 H 40 B 30 20 10 0 2001 2002 2003 % CSAP Advanced or Proficient (10th grade) 100 90 80 70 60 W 50 H 40 B 30 20 10 0 2001 2002 2003 Class of 2005 100 90 80 70 60 W 50 H 40 B 30 20 10 0 8th (2001) 9th (2002) 10th (2003) What’s the cause? Widespread adoption of curricula that: • Emphasize process over content • De-emphasize math facts • Embrace constructivism • Encourage calculator use in early grades • Encourage group work How did this happen? Open letter of protest published in Post, Carter elected DOE forms expert signed by > 200 panel to identify mathematicians and DOE created noteworthy math scientists programs Reagan elected, Secretary
    [Show full text]
  • Learning from Singapore Math // Steven Leinwand and Alan L
    Learning from Singapore Math // Steven Leinwand and Alan L. Ginsburg 3/25/08 11:04 PM November 2007 | Volume 65 | Number 3 Making Math Count Pages 32-36 Learning from Singapore Math The United States could benefit from looking at five elements driving the program's success. Steven Leinwand and Alan L. Ginsburg As the United States strives to improve student performance in mathematics, it is not surprising that the small country of Singapore— with its highly regarded mathematics program familiarly known as November 2007 Singapore Math—has attracted so much attention. After all, Singapore students have the enviable record of scoring first in the world in mathematics proficiency on the past three Trends in International Mathematics and Science Studies (TIMSS), soundly beating their U.S. counterparts. But this world-class performance did not happen by accident. It is proof that taking a few crucial actions can pay rich dividends in terms of significantly raising student achievement. In fact, Singapore's mathematics and science achievement in the early 1990s was comparable to the consistently mediocre achievement of the United States (International Association for the Evaluation of Educational Achievement, 1988). However, the country's poor performance served as the impetus for concerted national efforts that have resulted in its current success in mathematics. Of course, all international comparisons need to be made with great care, given the vast cultural, governmental, and demographic differences among countries. In the case of Singapore and the United States, however, these differences are often overstated. Some claim that Singapore's student population is not as diverse as that of the United States.
    [Show full text]
  • 3 Reasons Why Singapore Math Is NCTM Recommended
    3 Reasons Why Singapore Math Curriculum is Recommended by the NCTM web.archive.org/web/20100211050856/http://www.learningthings.com:80/articles/Singapore-Math-Recommended-by- NCTM.aspx Math education in U.S. schools has been broken for many years but now a fix is available. Students in U.S. high schools have been consistently scoring near the bottom of the list of countries participating in International math tests. Among the 30 nations participating in the 2006 PISA test, only 4 nations had lower test scores. The 2006 results were about the same as the results from the 2003 PISA tests. In other words, U.S. students are near the bottom, barely above developing nations, and showing no signs of moving up. By contrast, these same math tests consistently show Asian nations scoring at the top. In the 2003 Trends in International Mathematics and Science Study (TIMSS), Singapore ranked number 1 followed by South Korea and Hong Kong. In the 2006 PISA tests, Asian countries took 4 of the top 10 spots. In the U.S., math standards are set at the state level and curriculum choices are made by local school districts. States and local districts rely on guidelines provided by the National Council for Teachers of Mathematics (NCTM). Based on the research and theories of education "experts", the NCTM published 1989 guidelines which embraced new 'reform math' curriculums. Rather than helping achieve higher test scores, these programs caused many districts to achieve lower test scores. The following programs are examples: • 'Everyday Mathematics' (Bell, 1988-1996) • 'Connected Mathematics' (Lappan et al, 1991-1997).
    [Show full text]
  • Alan Ginsburg U.S. Department of Education*1 Steven Leinwand
    SINGAPORE MATH: CAN IT HELP CLOSE THE U.S. MATHEMATICS LEARNING GAP? Alan Ginsburg U.S. Department of Education*1 Steven Leinwand American Institutes for Research Presented at CSMC’s First International Conference on Mathematics Curriculum, Novermber 11-13, 2005 On the 2003 Trends in International Mathematics and Science Study (TIMSS; Mullis, Martin, Gonzalez, and Chrostowski, 2004), fourth- and eighth-grade students from Singapore achieved the top average scores in mathematics. This paper compares the Singapore and U.S. primary mathematics system to explore what the United States can learn from the Singapore system of elementary mathematics education that may help improve the mathematics performance of U.S. students. It also identifies a few areas where the U.S. mathematics system may be preferred to Singapore’s system. Before proceeding with the Singapore-United States comparisons, we need to address three misimpressions about the Singapore primary mathematics system. First, many experts (National Academy of Sciences, 2005) believe that U.S. primary students already perform well on international mathematics assessments and that the focus of U.S. mathematics reform should be on the upper grades. This common perception is based on published reports showing U.S. students scoring above the international average on grade 4 TIMSS, but falling considerably below the average at age 15 on the OECD Program for International Student Assessment (PISA; NCES, 2005). But many industrialized European countries that outscore the United States on PISA do not participate in TIMSS. When the United States is compared against the 12 industrialized countries that participate in both TIMSS and PISA, its rank is consistently mediocre on both assessments — 8th on grade 4 TIMSS and 9th on grade 8 TIMSS and PISA, age 15.
    [Show full text]
  • Singapore Math® WWC Intervention Report
    What Works Clearinghouse™ U.S. DEPARTMENT OF EDUCATION WWC Intervention Report A summary of findings from a systematic review of the evidence Primary Mathematics Updated December 2015 Singapore Math® This intervention report presents findings from a systematic review ofSingapore Math® conducted using the What Works Clearinghouse (WWC) Procedures and Standards Handbook, version 3.0, and the Primary Mathematics review protocol, version 3.1. No studies of Singapore Math® that fall within the scope of the Primary Mathematics review protocol meet WWC group design standards. Because no studies meet WWC group design standards at this time, the WWC is unable to draw any con- clusions based on research about the effectiveness or ineffectiveness of Singapore Math® on the achievement of primary students in kindergarten through grade 8. Research that meets WWC design standards is needed to determine the effectiveness or ineffectiveness of this intervention. Program Description1 Singapore Math® is a collection of mathematics curricula developed by Singapore’s Ministry of Education and pri- vate textbook publishers for use in Singapore schools. Singapore Math® is comprised of Kindergarten Mathemat- ics, Primary Mathematics for students in grades 1–6, and Dimensions Mathematics for students in grades 7–8. The program is centered on problem solving, emphasizes computational skills, and focuses on conceptual understand- ing and strategic thinking. With these three components, Singapore Math® aims to provide more in-depth coverage of a relatively smaller number of topics than typical mathematics textbooks. Singapore Math® emphasizes problem- based development of mathematical concepts and uses concrete illustrations to show how to solve multistep problems. The content framework covers topics in increasingly advanced detail in successive grades.
    [Show full text]
  • Singapore Math Overview with Common Core Connections
    Singapore Math Overview with Common Core Connections Richard Bisk Professor Mathematics Department Worcester State University [email protected] Dr. Richard Bisk - [email protected] Warnings about the presenter He talks ahead of his slides. He may have too many slide; so he might skip over a few. They will be posted on the website. He will talk about the Common Core tomorrow too. Dr. Richard Bisk - [email protected] Singapore Books in the U.S. Three versions, all published by Marshall Cavendish Education: a. Primary Math: US Edition California Standards Edition Common Core Edition c. Math In Focus – HMH Adaptation of “My Pals are Here” Dr. Richard Bisk - [email protected] My Career • Trained as a mathematician. • Worked entirely at teaching colleges and universities. • Many students (25-50%) unprepared for college level math courses. • Few (<10%) prepared for calculus. Dr. Richard Bisk - [email protected] College Readiness Why do many students come to higher education with significant mathematical weaknesses that limit their career options? Weak foundation that goes back to elementary and middle school. Led to an interest in working with K-8 teachers and their students. Content based PD is my passion. Use books from Singapore because the math is so clear and coherent. Why the interest in Singapore? a. TIMSS Studies - 1995, 1999, 2003, and 2007, 2011. b. National Math Panel Report - 2008 c. Common Core State Standards Initiative (CCSSI) - 2010 Dr. Richard Bisk - [email protected] TIMSS – 2011 Grade 4 Grade 8 Singapore 606 South Korea 613 South Korea 605 Singapore 611 Hong Kong 602 Taiwan 609 Taiwan 591 Hong Kong 586 Japan 585 Japan 570 InstructionNorthern Ireland in Singapore562 is Russiain English 539 Belgium 549 Israel 516 Finland 545 Finland 514 England 542 United States 509 Russia 542 England 507 International 500 International 500 Dr.
    [Show full text]
  • The Impact of Singapore Math on Student Knowledge and Enjoyment in Mathematics Jenny Taliaferro Blalock Louisiana Tech University
    Louisiana Tech University Louisiana Tech Digital Commons Doctoral Dissertations Graduate School Fall 2011 The impact of Singapore Math on student knowledge and enjoyment in mathematics Jenny Taliaferro Blalock Louisiana Tech University Follow this and additional works at: https://digitalcommons.latech.edu/dissertations Part of the Elementary Education Commons, and the Science and Mathematics Education Commons Recommended Citation Blalock, Jenny Taliaferro, "" (2011). Dissertation. 357. https://digitalcommons.latech.edu/dissertations/357 This Dissertation is brought to you for free and open access by the Graduate School at Louisiana Tech Digital Commons. It has been accepted for inclusion in Doctoral Dissertations by an authorized administrator of Louisiana Tech Digital Commons. For more information, please contact [email protected]. THE IMPACT OF SINGAPORE MATH ON STUDENT KNOWLEDGE AND ENJOYMENT IN MATHEMATICS by Jenny Taliaferro Blalock, B.S., M.S. A Dissertation Presented in Partial Fulfillment of the Requirements for the Degree Doctor of Education COLLEGE OF EDUCATION LOUISIANA TECH UNIVERSITY November 2011 UMI Number: 3492479 All rights reserved INFORMATION TO ALL USERS The quality of this reproduction is dependent upon the quality of the copy submitted. In the unlikely event that the author did not send a complete manuscript and there are missing pages, these will be noted. Also, if material had to be removed, a note will indicate the deletion. UMI" Dissertation Publishing UMI 3492479 Copyright 2012 by ProQuest LLC. All rights
    [Show full text]
  • Administering and Implementing the Singapore Mathematics Curriculum at a Learning Center Hannah Colette Reaume Walden University
    Walden University ScholarWorks Walden Dissertations and Doctoral Studies Walden Dissertations and Doctoral Studies Collection 1-1-2011 Administering and Implementing the Singapore Mathematics Curriculum at a Learning Center Hannah Colette Reaume Walden University Follow this and additional works at: https://scholarworks.waldenu.edu/dissertations Part of the Curriculum and Instruction Commons, and the Science and Mathematics Education Commons This Dissertation is brought to you for free and open access by the Walden Dissertations and Doctoral Studies Collection at ScholarWorks. It has been accepted for inclusion in Walden Dissertations and Doctoral Studies by an authorized administrator of ScholarWorks. For more information, please contact [email protected]. Walden University COLLEGE OF EDUCATION This is to certify that the doctoral study by Hannah Reaume has been found to be complete and satisfactory in all respects, and that any and all revisions required by the review committee have been made. Review Committee Dr. Tom Cavanagh, Committee Chairperson, Education Faculty Dr. Kathleen Maury, Committee Member, Education Faculty Dr. Karen Hunt, University Reviewer, Education Faculty Chief Academic Officer Eric Riedel, Ph.D. Walden University 2013 Abstract Administering and Implementing the Singapore Mathematics Curriculum at a Learning Center by Hannah Colette Reaume MA, Piedmont College, 2009 BS, Piedmont College, 2008 Doctoral Study Submitted in Fulfillment of the Requirements for the Degree of Doctor of Education Teacher Leadership Walden University December 2013 Abstract A learning center in the southeastern part of the United States used the Singapore mathematics curriculum (SMC) to support student learning of a wide range of mathematics skills. However, a study had yet to be conducted to gain an understanding about the administration and implementation of the program.
    [Show full text]