®
DECEMBER | 2008 |AN0. 29 I RnewsMaking Research Relevant
At Clinton Global Initiative, AIR Pledges to Help Millions of Needy Children
AIR Pledges to Help Millions of Needy Children ...... 1
Comparing Math Skills of Students in U.S. Cities to International Peers ...... 1
Boost to Student Safety, Well- Being in Cleveland ...... 1
Message From the President Former President Clinton thanks leading donors. AIR President Sol H. Pelavin stands to the right of Gene Sperling, head and CEO ...... 2 of the Center on Universal Education, who holds a declaration recognizing the donors. AIR Develops Toolkit About Evidence-Based Health Care ... 3 AIR, as part of its mission to help the disadvantaged, ■ Work with Deworm the World and other partner
Austin Officials on AIR’s Math made two major commitments at the Clinton Global organizations to treat 10 million school-age chil - Benchmarking Study ...... 8 Initiative (CGI) annual meeting in New York in September dren, in 19 developing countries, who are infected
Conducting School Crime and 2008 that will improve the lives of millions of children with parasitic worms. Safety Surveys ...... 10 around the world. ■ Expand access to quality basic education for The Impact of Two Professional AIR has made a commitment to: thousands of disadvantaged children in Haiti. Development Interventions for Reading Teachers ...... 11 Continued on page 4 Enter Jovem Project: Improving the Lives of Youth in Brazil ... 12
South Korean Delegation Study Compares Cleveland Welcomes Learns About the U.S. Student Math Achievement of AIR Plan to Boost Assessment System ...... 12 AIR’s TechMatrix ...... 14 Students in 11 Major Student Safety, Well- States Challenged in U.S. Cities to Their Being and Implementing NCLB ...... 15
U.S. Education Secretary Visits International Peers Achievement AIR Zambia Sites ...... 16 Educators often ask: We are competing against schools AIR is joining in an ambitious effort to implement a wide- Osher, Garet Named AIR Vice around the world, so how good is good enough in terms ranging reform plan to improve the quality of public Presidents ...... 16 of student achievement? Now, using a ground-breaking schools in Cleveland by reducing violence, promoting the Staff in the News… ...... 17 method developed by an AIR researcher, Dr. Gary Phillips, mental health of students and improving conditions for Making Research Relevant… 18 educators in 11 U.S. cities are able to see how well learning and teaching. students are doing in 4th and 8th grade mathematics U.S. Commissioner of The reform strategy, which stems from a six-month audit Education Statistics Mark when compared to their international peers. by AIR of conditions in the city’s schools, has generated Schneider Joins AIR as Vice President ...... 20 Continued on page 5 Continued on page 9
American Institutes for Research ® ■ www.air.org 2 A Message From the President and CEO
As I reviewed the stories in this Yet another story illustrates how we connected with Cleveland issue, it struck me that their community leaders through a study intended to improve common theme is “AIR connects.” conditions for learning and teaching in the city’s public schools. At AIR, we strive to make sure that Spurred on by dramatic incidents of violence in the schools, the the best science achieves the best mayor and school district asked AIR to conduct a six-month social outcomes. However, we audit and suggest steps to improve the social and emotional recognize that AIR cannot achieve these outcomes on its own. learning of students. Although the report was critical of current Therefore we constantly seek ways to connect with individuals practices, its recommendations — issued and discussed at a and groups to meet old and emerging challenges. press conference that included AIR’s lead researcher — were hailed by the mayor and district as information needed for For example, we worked with the Council of the Great City improvement, as well as by the Cleveland Plain Dealer , which in Schools to release an AIR report at its annual conference. The an editorial endorsed a decision by local foundations to help study breaks new technical ground, for the first time comparing fund the ongoing participation of AIR in the reform efforts. the math achievement of students in our nation’s urban schools with that of their peers around the world. Superintendents from Finally, in September I was privileged to represent AIR at the three large districts participated as panelists in the report’s annual meeting of the Clinton Global Initiative. There, I spent release, the council’s executive director moderated the panel several days connecting with leaders of the nonprofit sector and more than 70 individuals attended the session from around the world, discussing how our organizations can demonstrating the interest that urban educators have in work together on major improvement efforts. I was pleased to learning how they compare with the world — and how they can announce at the meeting two significant AIR commitments in use this report to plan for and benchmark their future progress. the international arena: to help improve the education system in Haiti and to reduce the incidence of intestinal worms in A second story reviews findings from one of the first rigorous, students around the world. large-scale studies to examine the impact of professional development on teacher knowledge and practice as well as on I hope you find all of our articles of interest. And please student achievement. Once issued, the Scientific Evidence in connect with me by sending questions or comments to Education Forums, an AIR project, helped connect the findings [email protected] . of this report with more than 80 staff from congressional offices, representatives of state and local education agencies, leaders from national education organizations and the press at a public event in Washington, D.C. The Institute of Education Sciences funded the study and the forum. Sol H. Pelavin
Sol H. Pelavin Steve Fleischman Larry McQuillan President & CEO Vice President Director of Communications Public Affairs and (202) 403-5119 Communications [email protected]
AIR’s purpose is to conduct and apply behavioral and social science research to improve people’s lives and well-being, with a special emphasis on the disadvantaged. It is a nonpartisan, not-for-profit organization that provides research and technical assistance domestically and internationally in the areas of health, education and workforce productivity.
Corporate Headquarters: 1000 Thomas Jefferson Street, NW, Washington, D.C. 20007. Phone: (202) 403-5000.
American Institutes for Research ® ■ www.air.org AIR Researchers Develop a Communications 3 Toolkit to Help Organizations Provide Information About Evidence-Based Health Care As growth in health care costs continues to outstrip AIR researchers: growth in both wages and other sectors of the economy, ■ Conducted interviews with employers and experts purchasers and policymakers are turning to evidence- in the field. based approaches to health care decision-making. These ■ approaches hold the promise of improving the quality of Held focus groups with employees. care while reducing — or at least stemming the rise of — ■ Developed and tested messages through cognitive health care costs. During the past decade, health care interviews with consumers and a Web-based sur - professionals began to embrace the principles of vey with union and non-union employers. evidence-based health care, i.e., making clinical care ■ Conducted a survey with more than 1,500 employ - decisions based on explicit scientific evidence. ees in collaboration with NBGH. Increasingly, consumers are being encouraged to apply similar principles to their health care decisions.
In response to this need, AIR researchers have developed a Web-based toolkit that helps large firms and organizations communicate with employees and members about health care decisions. The Communication Toolkit: Using Information to Get High Quality Care is based on AIR’s rigorous study of the challenges involved in disseminating information about evidence-based health care.
The purpose of this project was to determine how to translate the concepts and practices of evidence-based decision-making into information that consumers can understand and use. With funding from the California Based on the findings, the researchers developed a Web- HealthCare Foundation, AIR developed materials that based communication toolkit that includes: support employers and unions to help consumers apply evidence to their health care decision-making. These ■ A collection of “workforce materials” that compa - materials are hosted on the Web site of the National nies and unions can download and adapt for their Business Group on Health (NBGH), a nonprofit own use. The documents cover four main topic organization devoted exclusively to providing large areas: understanding the basics of health care quality, cost and quality, tips for getting good qual - employers with practical solutions to health care ity care and help in using the Internet to find issues. Members of NBGH provide health care coverage health information. for more than 50 million U.S. workers, retirees and their families. Continued on page 5
American Institutes for Research ® ■ www.air.org 4 At Clinton Global Initiative, AIR Pledges to Help Millions of Needy Children
Continued from page 1
Both commitments were made under the auspices of CGI, created by the William J. Clinton Foundation to create and implement innovative solutions to some of the world’s most pressing challenges. The Washington Post noted that the CGI gathering brought “together hundreds of corporate chiefs, heads of state, humanitarians and celebrities” to commit to actions addressing international health care, education and anti-poverty initiatives.
During a session at which then-presidential candidates Barack Obama and John McCain addressed the conference, former President Bill Clinton invited AIR President and CEO Sol Pelavin on stage in recognition of AIR’s commitment to school health and deworming. At AIR also committed to expand basic education in Haiti another major session, President Clinton cited AIR and its under a project funded by the U.S. Agency for work in education in Haiti. International Development. Programme Hatien d’Appui a la Reforme de L’Education (PHARE) will provide technical AIR is a key partner of Deworm the World, which is assistance and training to strengthen the capacity of moving its secretariat (formerly in London) to AIR’s Haiti’s Ministry of Education and Professional Training to corporate headquarters. Other participants in the effort prepare teachers and help increase the access of Haitian include Feed the Children, the United Nations World Food youth to quality basic education. In addition to Program and the World Bank. strengthening the Ministry of Education, AIR also will Parasitic worms stunt children’s physical and cognitive provide direct services at the school level to improve the growth. Evidence shows that deworming can quality of instruction. PHARE also will encourage the substantially boost school attendance and generally Haitian business community and Haitians living in the improve children’s abilities to learn, grow and thrive. United States and other countries to support and manage school improvement projects. AIR will provide logistical and technical support to the secretariat and technical and policy guidance, capacity PHARE also will provide scholarships to students from the building and training to ministries of education and most disadvantaged families and communities in nongovernmental organizations implementing school conflict-vulnerable and environmentally fragile areas health and deworming programs. such as Gonaives, Saint-Marc, Les Cayes, Petit Goâve, Port-au-Prince, Cap Haitien, Limbé and Montrouis. The deworming activities will help children in Afghanistan, Bangladesh, Central African Republic, Dr. Bradford Strickland, who coordinated AIR’s Democratic Republic of the Congo, Ethiopia, Indonesia, participation during the CGI and served as a facilitator Kenya, Lao People’s Democratic Republic (or Laos), Mali, for the education portion of the annual meeting, will Mauritania, Mozambique, Philippines, Rwanda, Sudan, direct AIR’s participation in both the deworming and South Sudan, Tanzania, Uganda, Yemen and Zambia. Haiti commitments.
American Institutes for Research ® ■ www.air.org AIR Researchers Develop a Communications 5 Toolkit to Help Organizations Provide Information About Evidence-Based Health Care
Continued from page 3
■ A guide to help employers use the toolkit. It ■ An annotated list of links and resources for includes practical suggestions for communicating employers on topics such as health care quality more effectively with employees about evidence- and health literacy. based concepts and explains the features of the NBGH maintains the toolkit on its Web site in a publicly toolkit. accessible area. The toolkit was released in July 2008 and ■ A report that summarizes the study’s findings a month later was NBGH’s most-requested content Web about the challenges employers face when com - page with 1,704 views. The toolkit can be found online at municating with employees. http://businessgrouphealth.org/benefitstopics/et_ communications.cfm.
Study compares Math Achievement of Students in 11 Major U.S. Cities to Their International Peers
Continued from page 1
“If you are a student today preparing to compete for a placed higher than the international average at grade 4 and job, the good jobs will not go to the best in your grade 8. However, the nation’s performance overall was graduating class - they will go to the best in the world,” significantly lower than that of Singapore, Hong Kong, said Phillips. Although the results of the AIR-funded Taipei, Japan and the Flemish portion of Belgium at grade study are mixed, they do provide a starting point for 4; for grade 8, the nation’s students also had fallen behind urban educators to meet this challenge. the Republic of Korea, the Netherlands and Hungary.
For example, fourth-grade and eighth-grade students in Phillips presented his findings on October 23, 2008, at the Austin, Boston, Charlotte, Houston, New York and San Diego annual fall conference of the Council of the Great City are performing on par or better in mathematics than their Schools in Houston. He served as the acting commissioner peers in many countries. However, students in Atlanta, of the National Center for Education Statistics (NCES) Chicago, Cleveland, the District of Columbia and Los Angeles within the U.S. Department of Education from 1999 to are performing below the international average. Overall, U.S. 2002 and is nationally known for his expertise in large- student performance in mathematics falls off from the scale assessments and complex surveys. elementary to middle school grades and remains behind “Large urban cities are intimately connected to the many industrialized nations, particularly Asian nations . nations of the world,” said Phillips. “Large international Phillips reported that when comparing students who are corporations locate their businesses in our cities, foreign “proficient” on two math benchmarks, the United States students attend our schools, and our own businesses
Continued on page 6
American Institutes for Research ® ■ www.air.org 6 Study Compares Math Achievement of Students in 11 Major U.S. Cities to Their International Peers
Continued from page 5
export goods and services to foreign nations. Large urban cities need to know how their students stack up against their peers in the nations with which we do business.”
The findings have generated widespread attention among school leaders, the business community and policymakers. Drew Scheberle, senior vice president of education and talent development for the Greater Austin Chamber of Commerce, was quoted by the Austin American-Statesman newspaper as saying, “Our companies compete globally with Taiwan, Russia and Europe. This is the most helpful information that’s ever been made available about the kind of talent you get in Austin.”
Peter Gorman, superintendent of Charlotte-Mecklenburg Schools, issued a statement noting that “while this report confirms we’re headed in the right direction, it doesn’t mean we have all students performing at high levels. We have to keep raising the bar — and closing the gap — for all students.” “The urban school chiefs in the 11 large school districts that Chester E. Finn, Jr., president of the nonprofit Thomas B. were examined recognize the global nature of educational Fordham Foundation and former assistant secretary for expectations and the importance of having reliable external research and improvement at the U.S. Department of data against which to judge their performance and hold Education, said Phillips “applied an ingenious analytic themselves accountable,” Phillips said. “They should be technique” that produced solid results. Greg Toppo, an commended for their visionary goal of trying to benchmark education reporter for USA Today , wrote about Phillips’s their local performance against tough national standards. study and noted, “What he found is eye-opening.” The purpose of this report is not to treat math achievement The report, Counting on the Future: International as an Olympics sport, but rather to help create international Benchmarks in Mathematics for American School benchmarks for the future.” Districts , uses comparisons to the overall average of 24 Overall, the United States and the 11 districts fall in the countries’ achievement at grade 4, and to 45 countries’ middle of the international rankings at grades 4 and 8 — achievement at grade 8. It also looked at comparisons but some of the nations included are developing with the average of 10 Organization for Economic Co- countries with few resources, taking part in their first operation and Development (OECD) countries at grade 4, international large-scale assessment. When compared and with 12 OECD countries at grade 8. The 11 districts with “peer” OECD countries, the United States and the 11 voluntarily participated in the 2007 National Assessment districts are seen to have lower rankings. of Educational Progress (NAEP) Trial Urban District Assessment (TUDA) in Mathematics. Read the reaction of Austin officials on Page 8.
American Institutes for Research ® ■ www.air.org 2007 NAEP Grade 4 Math Proficiency in 7 Countries and 11 U.S. Cities, Compared With 2003 TIMSS International 7 Average, by Percentage Proficient.
Percent 0 20 40 60 80
Singapore 66 Japan 53 Charlotte 44 Austin 40 United States 39 Boston 36 Russian Federation 35 San Diego 34 New York City 28 New Zealand 27 Houston 27 International TIMSS Average 22 Slovenia 20 Los Angeles 19 Chicago 16 Atlanta 15 Washington, D.C. 14 Cleveland 10 Phillipines 3
2007 NAEP Grade 8 Math Proficiency in 7 Countries and 11 U.S. Cities, Compared With 2003 TIMSS International Average, by Percentage Proficient.
Percent 0 20 40 60 80
Singapore 73 Japan 57 Charlotte 34 Austin 34 United States 31 Boston 27 Russian Federation 27 San Diego 24 New York City 22 New Zealand 22 Houston 21 International TIMSS Average 21 Slovenia 19 Los Angeles 14 Chicago 13 Atlanta 11 Washington, D.C. 8 Cleveland 7 Phillipines 2
American Institutes for Research ® ■ www.air.org 8 Austin Officials Offer Their Perspective on AIR’s International Mathematics Benchmarking Study By Pascal D. Forgione Jr., Ph.D., Superintendent, Austin Independent School District and Lisa Schmitt, Ph.D., Administrative Supervisor, Department of Program Evaluation, Austin Independent School District.
AIR has produced an interesting and important study that allows us to think about where American school districts stand in comparison to students around the world. Several aspects in particular are noteworthy about this report:
■ First, the value of seeing district performance in the larger, global context;
■ Second, the importance of using accurate reporting countries (or 16 percent) outperformed our students in of data so that interpretations of differences Austin. between groups are correct; We are particularly pleased to see how well our 8th- ■ Third, the encouraging findings for Austin based on grade students measure up to the global community. We this report; and were outranked by only 5 of 45 comparison countries (or ■ Finally, the important next steps for Austin and for 11 percent). In addition, our students outperformed the this type of research in the future. students from 36 nations, or more than three-quarters of participating countries around the world, including the In Austin, we have long promoted the value of U.S. population. benchmarking ourselves against others in Texas and around the country. We often examine our performance Although we in Austin have enjoyed good relative relative to other major urban districts in Texas and standing as evidenced by a variety of data sources, we nationally to assess how our students are performing recognize that we must not fall down on the job. We relative to their peers. have to continue pushing for improvement with efforts like our current high school redesign work, our new These new comparisons provide an additional context for middle school improvement initiatives and teacher our work and help us benchmark how well we are quality initiatives, including Disciplinary Literacy and preparing our students for participation in the global Professional Learning Communities in secondary grades. economy. We are able to see beyond the United States to determine how our students stack up against their We must find ways to increase the drive for achievement international peers. within our staff, students and parents so that everyone feels that sense of urgency and passion toward academic We are pleased to see that Austin grade 4 students in achievement. mathematics perform well relative to students in other nations. Here Austin outranked more than half of the To read the full commentary by Dr. Forgione and Dr. countries studied and was no different than another third Schmitt, visit the News page of the AIR Web site at of them. However, we note that 4 of the 25 comparison www.air.org .
American Institutes for Research ® ■ www.air.org Cleveland Welcomes AIR Plan to Boost Student 9 Safety, Well-Being and Achievement
Continued from page 1 broad support among Cleveland’s civic and community The audit found strengths along with weaknesses and leaders. “gaps” in the city’s education and mental health services, and offered a strategy that builds upon existing strengths The Cleveland Metropolitan School District and Cleveland to address the depth and complexity of what is needed Mayor Frank Jackson asked AIR to conduct the audit for improvement. AIR, with support from the Cleveland following an incident in 2007 in which a 14-year-old Foundation and the George Gund Foundation, is working high school student shot two teachers and two students with the city and the school district to implement the at a downtown school and then took his own life. AIR’s recommendations. report, which was released in August 2008, focuses on steps the schools and the community can take to support “Schools cannot do this work alone,” said Dr. David Osher, the social and emotional learning of students by a vice president at AIR who is leading the effort. “Many improving the school environment. Cleveland students, families and educators confront daily the impacts of poverty, environmental toxins and trauma. Fortunately, they live, attend school and work in a city rich in human and cultural capital and good will.”
The report’s recommendations, which would be implemented over the next five years, include:
■ Freeing up guidance counselors and school psy - chologists so they have more time to counsel stu - dents, while recruiting graduate students who have backgrounds in social work and school psychology to assist them.
■ Eliminating or modifying rules and procedures that are counterproductive, such as reassigning “prob - lem students” to other schools.
■ Training school administrators, teachers and securi - ty staff to use positive approaches to discipline rather than reactive and punitive actions, to devel - op student social and emotional competence and to better understand and communicate with the students.
■ Developing an early warning and intervention sys - tem to identify potential mental health issues.
Continued on page 10
American Institutes for Research ® ■ www.air.org 10 Cleveland Leaders Welcome AIR Plan to Boost Student and Teacher Safety, Well-Being and Academic Performance
Continued from page 9
■ Engaging with parents and caregivers to help The newspaper continued, “Osher’s goal is to ‘put fluoride them understand the important role they play in the water,’ upstream, long before a child might be in supporting their children’s education and tempted to turn his school or neighborhood into a killing well-being. zone. Osher recently gathered human service agencies
The Cleveland Plain Dealer newspaper, in an October 13, and school officials together — a feat in itself, according 2008 editorial, noted the enormity of the task facing the to one participant. And he has asked the media to keep city. “Here, a third party, David Osher, managing research the heat on and hold everyone accountable. We’re glad scientist for American Institutes for Research, may prove to oblige.” effective,” it said. “Osher, who wrote the insightful report on the mental health needs of Cleveland’s youngsters, is The full report, Cleveland Metropolitan School District back to help the district implement some of his Human Ware Audit: Findings and Recommendations , is recommendations.” available at www.air.org .
Conducting School Crime and Safety Surveys
Crime in schools is a major concern for educators, students, school personnel and others participating in policymakers, administrators and parents. Understanding school activities. the scope of student victimization, as well as factors Members of AIR’s team support the School Crime associated with it, is an essential step in developing Supplement (SCS) to the National Crime Victimization solutions to address the issues concerning school crime Survey and the School Survey on Crime and Safety and violence. (SSOCS). The most recent SCS was released on October AIR experts support the efforts of the National Center 21, 2008. It is a household survey of 12- to 18-year-olds for Education Statistics (NCES) to collect, report, that takes place biennially in January through June. The analyze and disseminate statistical data regarding the SSOCS is a survey of public schools conducted biennially frequency, seriousness and nature of violence affecting in March through May. AIR staff support all aspects of the surveys, including questionnaire development, sample design, quality assurance of all data files, data analysis, producing data products and reports, developing incentive and informational materials about the survey and responding to specific data requests.
AIR invests extensive resources to ensure that questionnaires reflect the constantly evolving trends in all aspects of school crime. Questionnaires can be found at the Crime and Safety Surveys portal on the NCES Web site: http://nces.ed.gov/programs/crime .
American Institutes for Research ® ■ www.air.org AIR Researchers Examine the Impact of Two 11 Professional Development Interventions for Reading Teachers AIR researchers have conducted one of the first rigorous Within each district that participated, one of three efforts to examine the impact of teacher professional approaches was used: development (PD) on a large scale. The U.S. Department ■ One intervention provided teachers with an inten - of Education commissioned the study to help determine sive eight-day series of institutes and seminars. The the best use of federal funds for professional program was based on the Language Essentials for development under the No Child Left Behind Act. Teachers of Reading and Spelling program, or LETRS, which aims to build teachers’ knowledge of literary concepts and research-based instructional practices.
■ The second intervention supplemented the institute series with 60 hours of in-school coaching for teachers, provided by the Consortium on Reading Excellence.
■ Under the third approach, a group of control schools participated in their districts’ regular PD program (usually less than 24 hours per year).
Both external interventions had a positive impact on teachers’ knowledge of scientifically based reading instruction and some impact on teacher instructional practices. However, neither approach significantly increased student test scores.
Specific study findings include: Dr. Michael Garet, an AIR vice president, served as the ■ Teachers in schools receiving PD interventions study director and Dr. Stephanie Cronen served as the scored significantly higher on the teacher knowl - deputy director for The Impact of Two Professional edge test than teachers in control schools. Development Interventions on Early Reading Instruction and Achievement , which was released by the Institute of ■ Teachers who received the PD interventions were Education Sciences (IES) in September, 2008. more likely than teachers in control schools to demonstrate specific strategies in their teaching A total of 90 schools, 270 teachers and 5,500 students that students can use to decode and compre - within six school districts took part in the study, which hend text. examined both teacher and student outcomes. AIR, along with colleagues at MDRC and REDA International, Inc., ■ The PD interventions did not significantly affect used a sophisticated randomized trial design to study the two other teacher outcomes that were emphasized effects of two research-based PD programs for second- grade reading teachers. Continued on page 12
American Institutes for Research ® ■ www.air.org 12 AIR Researchers Examine the Impact of Two Professional Development Interventions for Reading Teachers
Continued from page 11
during the interventions: the extent to which when teachers were no longer receiving the PD teachers guided students in practicing specific interventions. reading skills, and the extent to which teachers Exploratory analyses were conducted to suggest why differentiated instruction based on the needs of the impact of the PD on teachers’ knowledge and students in their classrooms. practice did not translate into an impact on student ■ The PD interventions did not have a significant achievement. “There is some indication that the PD effect on student achievement. Students in treat - interventions may not have had a large enough impact ment schools did not score significantly higher on on teacher outcomes to produce a detectable impact on a reading test than students in control schools. student achievement,” said AIR’s Garet. “The design of ■ The in-school coaching in addition to the institute the study did not permit a definitive test of this series did not produce a significantly greater impact hypothesis.” on teacher methods than the institute series alone. Copies of the executive summary and the full report are ■ No significant effects on teacher or student out - available on AIR’s Web site, www.air.org , and on the IES comes were observed one year after the treatment, Web site, http://ies.ed.gov/ncee/pubs/20084030.asp .
Professional development (PD) for teachers is a topic that generates much interest among policymakers, researchers and educators. A PD article by AIR authors was the most frequently read online article in the American Educational Research Journal at the end of 2007. Dr. Michael Garet, Dr. Beatrice Birman and Dr. Kwang Suk Yoon wrote “What Makes Professional Development Effective? Results From a National Sample of Teachers.”
AIR’s Enter Jovem Project: Improving the Lives of Disadvantaged Youth in Brazil AIR’s Enter Jovem project has helped thousands of state capitals and providing training for more than disadvantaged youth in Brazil find jobs since its founding in 4,100 youth. The instruction includes developing skills 2003, and its success has been recognized in recent months in information and communication technology, through new grants from the Motorola Foundation and U.S. entrepreneurship, resume writing and preparation for Agency for International Development (USAID), and visits employment interviews. from Secretary of State Condoleeza Rice and USAID The Enter Jovem project model has been adopted by the Administrator Henrietta Fore. Pernambuco state government’s office of Special The Enter Jovem program has focused on providing job- Secretary of Youth and Employment as part of its related skills to youth in the states of Bahia and strategy to increase the employment rate of Pernambuco, by establishing community centers in the disadvantaged youth.
Continued on page 13
American Institutes for Research ® ■ www.air.org In April 2008, the Motorola Foundation awarded AIR a As the Enter Jovem project expands, it will target public 13 $100,000 grant to support the program, and USAID schools in the state of Bahia. Additionally, a new English- provided matching funding. language component will be introduced to support the Bahia state government’s “English For All” project — a two- USAID Administrator Fore signed a memorandum of year undertaking that promotes learning English as a tool understanding with the Bahia Education Secretariat in for competing in the global economy. The joint program, June indicating the U.S. Government’s commitment to which will be fully implemented in 2010, targets 10 schools support the Enter Jovem project for another two years. and will reach at least 1,000 students and 40 teachers.
In an indication of the project’s impact on the lives of During her visit, Secretary Rice said, “What I am most Brazilian youth, both Secretary of State Rice and USAID impressed by today is these wonderful young people I Administrator Fore made separate visits this year to meet have met. In every conversation, I see that they are with project participants. people who are better off in their lives.”
South Korean Delegation Visits AIR to Learn About the U.S. Student Assessment System A three-member delegation from the South Korean National Assembly visited AIR recently to learn about the student assessment system in the United States.
The delegation, headed by Representative Choung Byoung-gug, consisted of members of the Grand National Party of Korea, some of whom are affiliated with the Science and Education Committee of the National Assembly. Representative Choung served as a head of public relations planning during the presidential campaign for President Lee Myung-bak.
South Korea is currently in the process of creating a Dr. Jon Cohen, a vice president and director of the national system that will identify the educational Assessment Program at AIR, presented an overview to achievements of elementary, middle and high school the delegation. Dr. Gary Phillips explained how students. Currently, the country does not have a system education assessment works in the United States and to evaluate student learning progress. The new described how AIR has developed and implemented assessments that meet the highest standards for assessment would be used as a tool to measure the accuracy, quality and fairness. Selina Tolosa gave a trends in students’ achievements across the country. demonstration of online testing and reporting, placing During its visit to AIR, the delegation learned methods to emphasis on the security of the testing and how develop and utilize new assessment methods. AIR experts results are immediately available. Eugenia Kim described the rigorous processes that take place to explained the score reports that AIR produces and how successfully design, create, administer, score and analyze they are used to help develop meaningful strategies to assessments, as well as how best to convey data to support academic improvement and excellence for all parents and educators. students.
American Institutes for Research ® ■ www.air.org 14 AIR’s TechMatrix Allows Educators and Parents to Compare Technological Learning Tools for All Students, Including Those With Special Needs AIR experts in October 2008 unveiled a major upgrade to user-friendly matrix is produced for the 13 relevant the TechMatrix Website, a powerful, user-friendly products. The user can use the matrix to compare the database designed and developed by AIR to provide products’ features, click on specific product names to learn educators and parents with evidence-based information more, bookmark the search results, and share the results they can use to compare a broad range of learning and with others through a “Send to a Friend” feature. assistive technology products designed for all students, The TechMatrix has been featured in eSchool News as especially those with special needs. “Site of the Week” and in Education Week’s Digital This online tool, located at www.techmatrix.org , draws Directions. upon the expertise of AIR scientists and researchers who operate two nationally-recognized technical assistance centers: the National Center for Technology Innovation (NCTI) and the Center for Implementing Technology in Education (CITEd). Both centers are funded by the Office of Special Education Programs (OSEP) at the U.S. Department of Education.
Under the new upgrade, users now have access to a broad range of more than 235 products and tools. The TechMatrix, which was made possible through grants “The TechMatrix enables users to better understand the from OSEP and the NEC Foundation of America, allows current learning and assistive technology tools and how users not only to compare evidence-based products, but they can be used to support students, particularly those also to read about the research on which the with disabilities,” explained AIR’s Dr. Tracy Gray, who comparisons are based. serves as director of NCTI and CITEd. The TechMatrix reflects AIR’s focus on developing and Students with special needs may struggle in the areas of providing individuals with the 21st Century skills reading, writing, mathematics, or access to technology. needed to address the increasingly important role of The TechMatrix allows users to conduct searches for technology. NCTI strives to advance learning products within these specific subjects, by teachers’ opportunities for all students – especially those with instructional goals, or by program names or features. disabilities – by fostering technology innovation, while Users receive customized search results within seconds. CITEd supports education agencies through the The continuously updated tool provides a tailored report identification of evidence-based practices and comparing the features of those items that meet the innovative online technical assistance tools, and search criteria. provides direct technical assistance.
For example, an educator or parent might search for For additional information visit www.nationaltechcenter.org products to enhance the learning for a student who is to learn about NCTI and www.cited.org to learn about struggling with math. Within three seconds, a customized, CITEd.
American Institutes for Research ® ■ www.air.org AIR Study Finds That States Face Challenges in 15 Implementing NCLB’s Requirement to Help Low-Performing Schools Only one-third of state education officials say their “High-quality state assistance is an important piece of departments have adequate capacity to help improve low- the school improvement puzzle.” performing schools as required by the No Child Left Behind The online survey was designed to study states’ capacity Act (NCLB), according to a survey of all 50 states by AIR. to develop and deploy systems of support for schools The survey findings are contained in two AIR Research identified for improvement under NCLB. To provide Briefs — “Help Wanted: State Capacity for School support commensurate with the challenges facing low- Improvement” and “State Systems of Support Under performing schools, state education agencies need NCLB: Design Components and Quality Considerations.” adequate capacity — including infrastructure, professional resources and political support. The study, conducted with a grant from the Bill & Melinda Gates Foundation, found that states — which Respondents were state officials, from all 50 states, with were already struggling with shrinking budgets — were primary responsibility for their state’s system of support constrained to design their NCLB support systems around for schools and districts identified for improvement. The what they thought they could accomplish. This leaves findings include: open the question of whether the supports provided were State officials were more likely to report limitations to those needed by schools. their capacity than strengths. Only 16 states gave overall “As NCLB is being considered for reauthorization, these positive responses to questions about their capacity to findings suggest that lawmakers should consider ways to support low-performing schools. increase state capacity to develop systems of support,” State officials generally perceived the expertise within their said Dr. Kerstin Le Floch, the lead author of both briefs. education agencies to be a strength, but reported lower levels of expertise regarding English language learners. State Reports of “Strengths” and “Constraints” Concerning State Education Agency Capacity to Support Low-Performing Schools, 2007–08 More than half of states (31) reported that staff expertise was a strength; however, 19 states identified expertise Number of state 39 education agency staff 7 related to English language learners as a specific constraint State funding for 36 to their abilities, and 11 reported similar weaknesses with school improvement 10 expertise related to special education. Federal funding for 27 school improvement 17 Technology to support 19 Three-quarters of respondents (36 states) indicated that school improvement 22 a lack of state funding for school improvement was a Expertise in issues related to 19 English language learners 21 constraint, and 27 states reported that a lack of federal Expertise in issues related to 19 funding constrained their capacity as well. curricular topics 24 Expertise in issues related to 11 States with the most capacity limitations had more special education 29 Support from 18 schools identified for improvement. An average of 19 state legislature 14 percent of schools was identified for improvement last Support from 8 state governor 17 year in states with limited capacity, compared with 15
Constraint 0510 15 20 25 30 35 40 45 percent in all other states. One state official responded Strength Number of States simply, “The problems are many and we are few.”
American Institutes for Research ® ■ www.air.org 16 U.S. Secretary of Education Margaret Spellings Visits AIR Project Sites in Zambia This fall, U.S. Secretary of Education Margaret Spellings visited AIR’s CHANGES2 program in Zambia, learning about the program’s efforts to improve health and education and speaking to students and teachers about their futures.
CHANGES2, which stands for “Community Health and Nutrition, Gender and Education Support 2,” is funded by CHANGES2 has worked to establish an HIV/AIDS prevention the U.S. Agency for International Development (USAID) program within the college curriculum. She delivered an and aims to strengthen teachers’ professional skills and inspiring message to the student teachers as she spoke prevent HIV/AIDS. The program supports the Ministry of about their role in Zambia’s future, emphasizing the Education’s expansion of school health and nutrition importance of education in every society of the world. activities and empowers students, teachers and During subsequent discussions with the secretary, student community members to improve education, gender teachers spoke of their appreciation for the materials and equity and health in schools and communities. support provided by USAID and AIR.
During her visit, Secretary Spellings spoke with CHANGES2 Secretary Spellings also engaged in a discussion with advisors and learned about the program’s teacher training scholarship students about the importance of for community school teachers, the School Health and CHANGES2’s support in helping the students stay in Nutrition Program, School–Community Partnerships and school and achieve their goals. HIV/AIDS prevention education. The U.S. Embassy in Zambia reported in a press release that Secretary Spellings addressed the student teachers and Secretary Spellings “was clearly impressed by what she saw, faculty of David Livingston College of Education, where saying she ‘was struck by how much we have in common.’”
David Osher and Michael Garet Named AIR Vice Presidents Dr. David Osher and Dr. Michael Garet have been named development of several centers, including the Training AIR vice presidents in recognition of their numerous and Technical Assistance Center for Safe and Drug Free contributions to project development and leadership, as Schools and the National Evaluation and Technical well as for the intellectual leadership they have Assistance Center for Education of Children Who Are demonstrated in their respective fields over the course Neglected, Delinquent or At-Risk. Dr. David Osher of their distinguished careers. “We value their Garet is nationally renowned for his expertise in contributions, insights and dedication,” said AIR examining the effectiveness of teacher professional President and CEO Sol H. Pelavin. development and for the design and analysis of large Osher is recognized globally as an expert in the areas of scale educational studies that involve experimental and social emotional learning and youth development, quasi-experimental designs. His work focuses on the conditions for learning, as well as school and community professional development of teachers in reading, interventions for children and youth dealing with mental mathematics and science, and curriculum reform in health issues. He has been instrumental in the school mathematics. Dr. Michael Garet
American Institutes for Research ® ■ www.air.org Staff in the News… 17
Dr. Harold Doran has been appointed to serve a three- Dr. Enis Dogan gave a presentation on “Stakeholders’ year term on the U.S. Department of Education’s National perceptions of university admissions exams in Technical Advisory Committee. The committee advises Turkey” during the Sixth Conference of the International the department on complex technical issues involving Test Commission in Liverpool, United Kingdom. the design and implementation of state standards, Stacey Bielick presented a paper at the Seventh assessments and accountability systems. International Conference on Social Science Methodology, Dr. George Bohrnstedt has been selected by the National held in Naples, Italy. The paper was entitled “Using Seed Research Council to serve as the chair of the Committee on Samples to Estimate Response Propensity Among a Low Advancing Social Science Theory: The Importance of Incidence Population.” Common Metrics. The committee is part of the council’s Dr. Anestine Hector-Mason gave a presentation at the Division of Behavioral and Social Sciences and Education. National Center for Developmental Education’s fourth Dr. Howard Everson has been selected as a member of the international conference in San Juan, Puerto Rico. She Fellows Program of the American Educational Research discussed the transition of adult English language Association (AERA). The newly created program honors learners from adult basic education programs to “education researchers with substantial research developmental reading and writing. accomplishments” and recognizes “excellence in research.” Dr. Terry Salinger moderated the fall meeting of the He will be formally inducted during a ceremony at AERA’s National Adolescent Literacy Coalition (NALC), which was annual conference next April in San Diego. held at George Washington University in Washington, D.C. Dr. Libi Gil participated in a four-day conference jointly She is chair-elect of the NALC steering committee. hosted by the Aspen Institute and NewSchools Venture Dr. Kelley Krokos gave a presentation at the annual Fund in an effort that brought together education meeting of the Personnel Testing Council of Metropolitan entrepreneurs and innovators. Participants in the Washington on “Improving Job Performance for High Risk invitation-only gathering discussed education reform Jobs.” She discussed using both traditional and efforts, insights, issues and visions. nontraditional tools to improve the performance of Dr. Kathleen Perez-Lopez gave a presentation on individuals involved in jobs where error may cause the “Applying Image Texture Measures to Describe loss of life and property. Segregation in Agent-Based Modeling” at the second Steve Fleischman gave a presentation on “User Driven World Congress on Social Simulation. The conference Research in Education: A Key Element in Promoting was hosted by George Mason University. Evidence-Based Education” before a plenary session of a Nebeyou Abebe has been elected to the Governing conference of the Division of Empirical Research in Council of the Metropolitan Washington Public Health Education of the German Educational Research Association Association. The organization promotes personal, public in Muenster, Germany. The conference was sponsored by and environmental health. the German Federal Ministry for Education and Research.
American Institutes for Research ® ■ www.air.org 18 Making Research Relevant…
Supporting a Pandemic Influenza Campaign. The AIR’s partners include the National Indian Child Welfare National Center for Health Marketing of the Centers for Association, the Center for the Study of Social Policy, Disease Control and Prevention (CDC) has awarded AIR a Georgetown University’s National Technical Assistance contract to provide technical, professional and Center for Children’s Mental Health, and the Louis de la management assistance to sustain, enhance and expand Parte Florida Mental Health Institute at the University of a campaign by the U.S. Department of Health and Human South Florida. Services (HHS) aimed at encouraging local leaders to Fighting Child Labor in Nicaragua. AIR has been awarded increase awareness and preparations for dealing with a grant by the U.S. Department of Labor to reduce child possible outbreaks of pandemic influenza. labor in Nicaragua by providing educational and training In 2007, HHS launched “Take the Lead: Working Together opportunities for at-risk youth and by raising public to Prepare Now,” a campaign to encourage local leaders awareness of children’s rights and the importance of — including health care providers, employers and faith- education. The project will directly benefit some 10,000 based and civic leaders — to raise awareness of pandemic children, by either removing them from exploitive child influenza among the people they influence and to labor or preventing them from falling into such a situation. encourage citizens to prepare for a possible outbreak. Evaluating the National K–12 Physical Education AIR will evaluate the effectiveness of the campaign, Grant Program. The U.S. Department of Education has conduct an analysis of existing campaign materials and asked AIR to conduct the first comprehensive, develop new messages, recruit new partner organizations, independent evaluation of the Carol M. White Physical encourage participation in the campaign by local Education Program, which provides federal grants to local organizations and individuals, and develop new outreach education agencies and community-based organizations strategies. to initiate or enhance physical education programs.
Establishing a Child Welfare Center for U.S. Western The project will evaluate the design, implementation and States and Territories. AIR has been selected to create outcomes associated with the grants that are issued the Child Welfare Technical Assistance Implementation during the 2009 fiscal year. Using a quasi-experimental Center, which will support child welfare services in nine design, researchers will compare the student health western states and several U.S. territories. The contract outcomes for schools and organizations that receive was awarded by the Children’s Bureau, Administration for federal grants with outcomes from similar programs that Children, Youth and Families, within the U.S. Department did not receive grants. of Health and Human Services. Helping Combat Birth Defects and Developmental The center will support Alaska, Arizona, California, Disabilities. The Centers for Disease Control and Hawaii, Idaho, Nevada, Oregon and Washington, as well Prevention’s (CDC) Division of Birth Defects and as American Samoa, the Commonwealth of Northern Developmental Disabilities has awarded AIR a contract to Mariana Islands, the Federated States of Micronesia, provide creative services that will deliver important Guam, the Marshall Islands and the Republic of Palau. health messages to pregnant women and raise awareness
American Institutes for Research ® ■ www.air.org 19
and change attitudes about individuals who have AIR also will assist the Center for Substance Abuse disabilities or chronic diseases. Treatment (CSAT) in overseeing the nation’s opioid treatment system. The project includes Web Under the award, AIR will assist the division’s Prevention development, meeting support, data analyses and Research Branch in using scientific and audience- development of treatment guidelines. AIR also will help focused research on up to 15 topics — such as the link develop the first national system for reporting opioid between smoking during pregnancy and birth defects — treatment-related deaths. to shape messages and materials that inform and motivate individuals to action. AIR also will partner with Assisting Adult English Language Learners. The Office of the Hispanic Communications Network to ensure that Vocational and Adult Education of the U.S. Department of new Spanish-language materials reach key audiences. Education has awarded AIR a contract for the Transitioning Also, digital storytelling on achieving well-being will be English Language Learners project. The goals of the project featured on CDC’s Web site. are to review the literature on effective strategies and programs that meet the needs of English language learners, Assisting the KnowledgeWorks Foundation’s High to identify promising program practices and to use this School Initiative. The KnowledgeWorks Foundation has information in reports that will provide guidance on renewed a contract with AIR to continue reviewing three promoting effective approaches. school districts participating in the foundation’s Ohio High School Transformation Initiative, which is aimed at The project will serve as a foundation for setting future reorganizing large, comprehensive high schools into department priorities aimed at improving adult education services. small schools. Hosting a Technology Camp for Pakistani Students. AIR is identifying practices and policies that impact Twenty-six Pakistani students between the ages of 14 progress in Canton, Columbus and Toledo school and 16 participated in a two-week technology camp districts. hosted by AIR’s Links to Learning: Education Support to Helping the Substance Abuse and Mental Health Pakistan (ED-LINKS) Student Exchange Program. The Services Administration. The Substance Abuse and students — 14 boys and 12 girls — learned a broad range Mental Health Services Administration (SAMHSA) has of skills, from using computers and digital cameras to awarded AIR two major contracts to continue assisting making movies, designing Web sites, creating 3-D with the vital work the federal agency performs. animation, and producing a Webcast.
AIR will provide support for the Children’s Mental Health The program is part of the U.S. Agency for International Initiative Technical Assistance Center. The work includes Development (USAID)-funded ED-LINKS project. The providing research and assisting states and local entities project takes a comprehensive look at education reform in developing and implementing a broad array of services in Pakistan — with a focus on improving the math, to improve outcomes for children who have serious science and computer skills of students in middle and emotional issues. lower secondary schools.
American Institutes for Research ® ■ www.air.org 20 U.S. Commissioner of Education Statistics Mark Schneider Joins AIR as Vice President
Mark Schneider, the Commissioner of Education Statistics at the U.S. applied to the field of school choice. At the time, he was a distinguished Department of Education since 2005, joined AIR as a vice president in professor of political science and chair of the Department of Political October. He will lead special initiatives in the Education, Human Science at the State University of New York at Stony Brook, which he Development, and the Workforce Division, including expanding AIR’s joined as an assistant professor in 1974. In 2004, he began his work as presence in the area of postsecondary education and improving state deputy commissioner of the National Center for Education Research, longitudinal data systems. and he was appointed by President Bush to serve as commissioner of the National Center for Education Statistics in 2005. Schneider served as commissioner of the National Center for Education Statistics, Institute of Education Sciences, from 2005 until October 2008. “We are delighted to have someone with Mark Schneider’s experience and expertise joining the American Institutes for Research,” said AIR President He is the author of numerous scholarly books and articles on urban and CEO Sol Pelavin. “He has done a great job as commissioner, and I am politics, public policy and a broad range of education issues, including sure he will continue his record of accomplishments with AIR.” charter schools, consumer choice and the relationship between school “Mark is a welcome addition to our staff,” said AIR Senior Vice President facilities and academic outcomes. David Myers, director of the Education, Human Development, and the Schneider said of his decision to join AIR, “I’ve always been impressed Workforce Division. “His rich background in developing and applying with the quality of work at AIR. The atmosphere is collegial and cordial, research to make it relevant in everyday life is a perfect fit for what we and it’s a wonderful place to work.” do and what we believe in.”
Schneider’s work in the field of education policy began when he was Schneider is known for his commitment to solid, unbiased research developing models of entrepreneurial change and realized they could be methods that lead to evidence-based educational policy decisions. AIR®news American Institutes for Research 1000 Thomas Jefferson Street, NW Washington, D.C. 20007-3835 www.air.org
Making Research Relevant
American Institutes for Research ® ■ www.air.org