Fiscal Year 2002 Performance and Accountability Report

Home , Inertial Stellar Compass, Redi (crater)

National Aeronautics and Space Administration

The NASA Vision To improve life here To extend life to there To find life beyond.

The NASA Mission To understand and protect our home planet To explore the universe and search for life To inspire the next generation of explorers …as only NASA can. Contents

NASA Vision and Mission Part I: Management’s Discussion and Analysis Transmittal Letter 6 Message From the Administrator 8 Reliability and Completeness of Financial and Performance Data 9 Federal Managers’ Financial Integrity Act Statement of Assurance Overview 13 Mission 13 Organizational Structure 15 Highlights of Performance Goals and Results 53 Actions Planned to Achieve Key Unmet Goals 53 Looking Forward 55 Analysis of Financial Statements 55 Systems, Controls, and Legal Compliance 56 Integrity Act Material Weaknesses and Non-Conformances 58 Additional Key Management Information 58 The President’s Management Agenda 71 Management Challenges and High-Risk Areas

Part II: Performance 84 Summary of Annual Performance by Strategic Goals Performance Discussion 87 Space Science 99 Earth Science 109 Biological and Physical Research 117 Human Exploration and Development of Space 123 Aerospace Technology Supporting Data 133 Space Science 145 Earth Science 173 Biological and Physical Research 185 Human Exploration and Development of Space 193 Aerospace Technology 209 Manage Strategically Crosscutting Process 219 Provide Aerospace Products and Capabilities Crosscutting Process 223 Generate Knowledge Crosscutting Process 225 Communicate Knowledge Crosscutting Process

Part III: Financial 233 Letter From the Chief Financial Officer Financial Statements and Related Auditor’s Reports 236 Financial Overview 238 Financial Statements 239 Auditor’s Reports NASA Office of Inspector General Summary of Serious Management Challenges Other Agency-Specific Statutorily Required Reports 246 Inspector General Act Amendment Reports 246 Audit Followup 246 Audit Reports With Disallowed Costs and Recommendations 247 Audit and Inspection Reports Pending Final Action

Acronyms PART I

Management’s Discussion and Analysis

Transmittal Letter Message From the Administrator

I am pleased to present the NASA Fiscal Year 2002 Performance and Accountability Report. Over the past year, we began to implement significant changes that will greatly improve NASA’s management, while continuing to break new ground in science and technology. We made excellent progress in implementing the President’s Management Agenda. As the Office of Management and Budget reported in its FY 2002 midsession review on progress implementing the President’s Management Agenda, “NASA is leading the government in its implementation of the five government-wide initiatives.” We received an unqualified audit opinion on our FY 2002 financial statements. We achieved the vast majority of our performance goals, furthering each area of our mission: To understand and protect our home planet In FY 2002, we investigated solar flares to help explain and predict damage the Sun causes to communications systems and power grids on Earth. We documented changes to the Earth’s ice mass that affect the oceans, ocean ecosystem food chains, and the climate. Our observations from space enhanced efforts to track and predict the spread of West Nile Virus. We advanced technologies that may by the end of this decade double weather forecast accuracy and refine hurricane prediction capabilities. We helped the U.S. Forest Service use our satellite data to determine how best to mobilize scarce firefighting resources. Our aeronautics research continued to make progress in ensuring that air travel is not only safer, but also quieter and cleaner. Our researchers demonstrated a new device that monitors the air for bacterial spores and may help detect biohazards such as anthrax. To explore the universe and search for life During FY 2002, our Mars Odyssey spacecraft went into orbit around the Red Planet. At the Martian north and south poles, the spacecraft detected vast amounts of water ice—so much ice that, if thawed, it would fill Lake Michigan twice. This confirmed that our near- est neighbor has abundant supplies of one of the key elements needed for life. We also discovered new planets in other solar systems, including a Jupiter-sized planet that is about as far from its parent star as Jupiter is from our Sun. This suggests that there may be Earth- like planets as well in such systems. We investigated other space mysteries. For the first time, astronomers tracked the life cycle of x-ray jets from a deep-space black hole. In a fitting culmination to his decades of work in exploring cosmic x-ray sources, NASA-sponsored researcher Riccardo Giacconi won the Nobel Prize in Physics. Investigating other exploration modes, we demonstrated technologies to make planetary rovers more autonomous, able to respond to unexpected events, replan their course, and even improvise science experiments when opportunities arise. Further enhancing our space science capabilities, the Space Shuttle Columbia (STS-109) completed a spectacular servicing mission to the Hubble Space Telescope. Making one of the best astronomical observatories ever built even better, the crew installed new solar panels, an improved central power unit, and a new camera that increased Hubble’s “vision” tenfold. They even revived a disabled infrared camera. Hubble rewarded these efforts with stunning data and images including new measurements of the age of the universe based on observations of the oldest stars. The Shuttle continued its superb safety record. In addition to the Hubble mission, we flew three other Shuttle missions in FY 2002, delivering crew, supplies, and assembly pieces to the International Space Station. Although we had originally planned for seven flights in FY 2002, we delayed three flights because of propulsion system safety concerns. The vig- ilant, diligent work that went into discovering and repairing tiny cracks in the propellent lines was just one example of NASA employees constantly making the difference that keeps our operations safe.

6 NASA FY 2002 Performance and Accountability Report FY 2002 was the second year of continuous, permanent human habitation of the International Space Station. As the Station’s size and capabilities grew, so did the amount of scientific research it hosts. Astronaut Peggy Whitson came on board as the Station’s first Science Officer to coordinate efforts of the Station’s international research teams. To inspire the next generation of explorers During FY 2002, we made progress toward creating an Education Enterprise to coordinate all of our education and outreach activities. We also announced that Barbara Morgan will become NASA’s first Educator Astronaut, flying on STS-118 next November. NASA’s education and outreach work will not only enhance U.S. education and the scientific and technical literacy of our citizens, it will also help build the future workforce our Nation needs to remain a leader in science and technology. . . . as only NASA can In FY 2002, we comprehensively changed our structure and management philosophy to reflect the concept of “One NASA,” focusing all of NASA’s elements on achieving our new Vision and Mission. This is a robust, flexible, research-driven philosophy that maximizes our efficiency in meeting Agency goals. One example of this is the new Integrated Space Transportation Plan. It systematically coordinates all of our space transportation investments to support science-driven exploration and continue safe, reliable access to the Space Station. Similarly, we rigorously assessed Space Station research and adjusted our investments to focus on the highest priority research. In FY 2003, we will continue assembly of the International Space Station nearing completion of the U.S. core, conducting new research there and on the Shuttle, sending rovers and other exploratory spacecraft to Mars, and launching spacecraft to better monitor the Earth. We are facing a very exciting period of challenges, changes, and expanding scientific accomplishment. I hope that as you read this report, you will share my pride in and enthusiasm for NASA’s FY 2002 achievements.

Sean O’Keefe NASA Administrator

Part I • Administrator’s Message 7 Reliability and Completeness of Financial and Performance Data

The performance data in this report indicate the extent to which NASA achieved the performance measures that we specified in the FY 2002 Revised Final Performance Plan. These performance measures help gauge how well we met our goals. Experience has taught us that measuring performance in a cutting-edge research and development environment is a challenging process. Most of our projects are complex multiyear efforts with inherently unpredictable outcomes and timelines. Therefore, many of our goals are not specific because we work in the realm of discovery and the unknown. Finding measures that are concrete yet clearly linked to goals is often difficult. As we are strongly committed to explaining to the Administration, Congress, and the U.S. public the progress we are making toward our goals, we regularly attempt to improve our performance measures. The FY 2002 Revised Final Performance and Accountability Report reflect such efforts in several program areas. We hope that the new performance measures provide a clearer link between quantifiable results and ambitious long-term goals. In addition, I am pleased to state that for the FY 2004 Performance Plan, which is included in the new Integrated Budget and Performance Document, we have redesigned performance measures Agency-wide to better relate to outcomes. This in-depth effort eclipses the ad hoc work that individual program areas conducted previously to devise better measures. Future reports will benefit from this effort. Outcomes and measures in future performance plans will be refined and made more concise and quantifiable. With regard to completeness and accuracy, the FY 2002 report makes a conscientious effort to provide all pertinent data that are available, to ensure that they are reliable, and to identify the few deficiencies that exist. The financial data contained in this report are presented fairly, as attested to by the independent public accountant that rendered an unqualified audit opinion on the FY 2002 financial statements.

Sean O’Keefe NASA Administrator

NASA’s decades-long efforts are recognized with the Nobel Prize in Physics A NASA-funded researcher, Riccardo Giacconi (left) of Johns Hopkins University, was the co-recipient of the 2002 Nobel Prize in Physics “for pio- neering contributions to astrophysics, which have led to the discovery of cosmic x-ray sources.” Giacconi discovered the first x-ray stars and the x- ray background in the 1960s. In 1976, Giacconi and Harvey Tananbaum of the Harvard-Smithsonian Center for Astrophysics submitted a proposal letter to NASA to initiate the study and design of a large x-ray telescope. In 1977, work began on the program, which was then known as the Advanced X-ray Astrophysics Facility, and in 1998 renamed the Chandra X-ray Observatory. With NASA, he also detected sources of x-rays that most astronomers now consider to contain black holes. Giacconi said that receiving the award confirms the importance of x-ray astronomy. “I think I'm one of the first to get the Nobel prize for work with NASA, so that's good for NASA and I think it’s also good for the field,” she said.

8 NASA FY 2002 Performance and Accountability Report Federal Managers’ Financial Integrity Act Statement of Assurance

With reasonable assurance, I certify that NASA complies with the management controls prescribed by the Federal Managers’ Financial Integrity Act. However, based on NASA’s review of its financial systems, until NASA’s Integrated Financial Management Program Core Accounting System is fully implemented during FY 2003, our financial management systems do not substantially comply with Federal financial management system requirements and applicable Federal accounting standards. In FY 2002, we downgraded the single material weakness we had identified in the FY 2001 Accountability Report to a significant area of management concern that we will monitor internally. This material weakness pertained to International Space Station cost management. To address this issue, I appointed the NASA Deputy Administrator to chair NASA’s Internal Control Council and lead it in reforming how we track preventive and corrective actions for management control deficiencies. The Council vigorously monitored the actions we took to address this material weakness. The Integrity Act Material Weaknesses and Non-Conformances section of this report further describes these corrective actions. We will continue to track internal corrective actions, and International Space Station Program and budget officials will continue to report to the Council at regular progress meetings in FY 2003. In response to discussions held at the November 2002 Internal Control Council and external audit findings, I have chosen to report one material weakness for corrective action in 2002. I have agreed that internal control deficiencies in the reporting and valuation of property, plant, and equipment, and materials meet the criteria for material weakness prescribed by the Federal Managers’ Financial Integrity Act. The description of property, plant, and equipment, and materials reporting in this report provides a summary of corrective actions already taken and those scheduled for continuing reviews and corrective action. With regard to other management issues, a comprehensive discussion of how we are addressing major management challenges is included in the Management Challenges and High-Risk Areas section of this report. Financial systems conformance is described in Part III.

Sean O’Keefe NASA Administrator

Part I • Statement of Assurance 9

Overview

Mission To understand and protect our home planet To explore the universe and search for life To inspire the next generation of explorers . . . as only NASA can.

Organizational Structure NASA has revised its organizational structure. This report NASA Headquarters and the Centers have distinct, com- reflects the previous structure that was in place two years plementary roles. Headquarters sets policy and program ago when we developed the FY 2002 Revised Final direction. It has responsibility for communications with the Performance Plan. In addition to describing that structure Administration and Congress, and is the focal point for to provide context for this report’s performance informa- accountability with external entities. It leads the develop- tion, this discussion briefly notes our new structure. A ment of the budget, the strategic and performance plans, more detailed description of the new structure is available and the performance reports. Headquarters consists of the in the 2003 Strategic Plan and the FY 2004 Integrated Office of the Administrator, the Enterprises, the Office of Budget and Performance Document. Inspector General (OIG), and support offices that coordi- The structure in place in FY 2002 entails five Enterprises nate Agency-wide functions. The Office of the responsible for our activities: Space Science, Earth Administrator oversees policy implementation, administra- Science, Biological and Physical Research, Human tion, and program management. The Enterprises set Exploration and Development of Space, and Aerospace specific program direction; they are responsible for Technology. Space Science manages the Hubble Space NASA’s main lines of business. They oversee and coordi- Telescope and missions to other planets. Earth Science is nate the work of the NASA Centers nationwide (including responsible for increasing knowledge of Earth as a plane- the Jet Propulsion Laboratory). The Centers are responsible tary system. Biological and Physical Research uses the for carrying out most of the program work. Although each space environment as a laboratory to make discoveries in has unique strengths, they collaborate as “One NASA.” microgravity conditions. Human Exploration and Development of Space is responsible for the Space Shuttle and the International Space Station, space com- As part of the new structure that will be evident in subse- munications, and expendable launch vehicles. Aerospace quent reports, NASA has established a sixth Enterprise— Technology achieves advances in the capabilities and Education—devoted to sharing the results of our work safety of civil aviation and improves our access to space. and inspiring the next generation of explorers, scientists, Supporting these Enterprises are four Crosscutting and engineers. In addition, this new structure renames Processes essential to the success of our programs: they Human Exploration and Development of Space as the are Manage Strategically, Generate Knowledge, Space Flight Enterprise. Finally, the new structure substi- Communicate Knowledge, and Provide Aerospace tutes for the Crosscutting Processes described above a dif- Products and Capabilities. Part II of this report describes ferent means of accounting for fundamental processes these activities. required for program success across NASA. Institutionally, NASA is composed of Headquarters in Washington, DC, nine Field Centers nationwide, and the The new Strategic Plan and the FY 2004 Integrated Jet Propulsion Laboratory, a Federally Funded Research Planning and Budget Document, both issued along with and Development Center operated under contract by the this report in February 2003, include the new structure California Institute of Technology. The private sector and new performance measures. We will work to ensure assists with NASA’s program activities under contract. NASA also conducts cooperative work with other U.S. continuity between this FY 2002 Performance and agencies and international organizations. Our workforce Accountability Report and performance measures in of public servants and contractors is our greatest plans and reports that reflect the new structure. This strength—a skilled, diverse group of scientists, includes establishing linkages between specific annual engineers, managers, and support staff. They are commit- performance goals in this FY 2002 Performance and ted to achieving NASA’s mission safely, efficiently, and Accountability Report and the new annual performance with integrity. goals to provide useful trend data.

Part I • Mission and Organizational Structure 13 National Aeronautics and Space Administration

Office of the Administrator

Aerospace Sean O’Keefe, Administrator Safety Frederick D. Gregory, Deputy Administrator Advisory Courtney Stadd, Chief of Staff and White House Liaison Panel James L. Jennings, Associate Deputy Administrator for Institutions and Asset Management Michael A. Greenfield, Associate Deputy Administrator for Technical Programs NASA Theron M. Bradley, Jr., Chief Engineer Advisory Council Vacant, Chief Technologist Patrick A. Ciganer, Program Executive Officer for Integrated Financial Management Inspector Richard S. Williams, Chief Health and Medical Officer General Paul A. Strassmann, Chief Information Officer (Acting)

Robert W. Cobb Shannon W. Lucid, Chief Scientist

Headquarters Operations Chief Equal Human General Procurement Office Financial Opportunity Resources Counsel Officer Programs Timothy M. Sullivan Director (Acting) Vacant Dorothy Vicki A. Novak Paul G. Pastorek Thomas S. Luedtke Chief Financial Hayden-Watkins Assistant General Counsel Assistant

Officer Assistant Administrator Administrator Administrator

External Management Small and Legislative Public Security Relations Systems Disadvantaged Affairs Affairs Management Business and Utilization Safeguards

John D. Jeffrey E. Sutton Ralph C. Charles T. Glenn Mahone David A. Saleeba Schumacher Assistant Thomas, III Horner, III Assistant Assistant Assistant Administrator Assistant Assistant Administrator Administrator Administrator Administrator Administrator

Space Education Safety and Aerospace Space Biological Earth Flight Mission Technology Science and Physical Science Assurance Research

William F. Adena Williams Bryan D. Jeremiah F. Edward J. Mary E. Kicza Ghassem R. Readdy Loston O’Connor Creedon Weiler Associate Asrar Associate Associate Associate Associate Associate Administrator Associate Administrator Administrator Administrator Administrator Administrator Administrator

• Lyndon B. Johnson • Ames Research • Jet Propulsion • Goddard Space Space Center Center Laboratory * Flight Center Jefferson D. G. Scott Hubbard Charles Elachi Alphonso V. Diaz Howell, Jr. • Dryden Flight • John F. Kennedy Research Center Space Center Kevin L. Petersen Roy D. Bridges, Jr. • Langley • George C. Research Center Marshall Space Delma C. * Jet Propulsion Laboratory Flight Center Freeman, Jr. is a contractor-operated facility. Arthur G. (Acting) Stephenson • John H. Glenn • John C. Stennis Research Center Space Center at Lewis Field William W. Donald J. Parsons, Jr. Campbell January 17, 2003

14 NASA FY 2002 Performance and Accountability Report Highlights of Performance Goals and Results

METHODOLOGY difficulty distinguishing colors and to allow the codes to remain meaningful even in black-and-white. The The NASA 2000 Strategic Plan includes strategic goals that Performance Data section in Part II provides charts using NASA must achieve in order to accomplish our mission. these codes to show not only how well we performed on Supporting each strategic goal are several strategic objec- each annual performance goal during FY 2002 but also tives. The Performance section (Part II) of this report lists whether any trends are emerging over time. the strategic goals and objectives (from the September 2000 Strategic Plan) upon which our FY 2002 work was based. For the following summary of results for the Agency as a whole and by Enterprise, we have combined the four rat- NASA undertakes many activities to achieve the strategic ing categories described previously into two. We have goals and objectives included in our Strategic Plan. The combined annual performance goals rated green steps toward these goals and objectives appear in an annu- (achieved) and those rated blue (exceeded) into a single al performance plan. We report our progress in achieving group of positive results; we call this “Achieved or the steps specified in this annual plan by means of an Exceeded” and designate it with the color green. annual performance report. All of these documents—the Similarly, we combined red results rated (failed) and yel- Strategic Plan, annual performance plan, and performance low (failed but achievement anticipated within the next report—are Congressionally required. This year, the annu- fiscal year) into a single “Not Achieved” category and al performance report is combined with another designate it with the color red. Also included are per- Congressionally mandated report to constitute the formance ratings for fundamental supporting activities FY 2002 Performance and Accountability Report. called Crosscutting Processes. To measure performance, both the annual plan and the annual report use the same basic unit: the annual Specific results for all of NASA’s annual performance performance goal. Lower-level measures called indicators goals and indicators are detailed in the Performance sec- help determine whether we have met each annual tion (Part II). In the Annual Performance Goals Trends performance goal. Because much of our work relies on charts, annual performance goals for which no activities discovery and innovation, many of our performance occurred in previous years are designated with the code indicators are activities that have never been performed “N/A.” A blank space indicates an annual performance before or whose chances of success are difficult to goal that did not exist in previous years. estimate. For this reason, we sometimes set annual performance goal achievement equal to the achievement of a certain proportion of indicators. While we may not SUMMARY OF RESULTS expect to achieve all of the indicators or even know which of them will bear the most important results, we know As the chart on the following page shows, the Agency that in achieving most of them, we will have made achieved excellent results in FY 2002, with 89 percent of significant progress toward accomplishing our annual our annual performance goals in the “Achieved or performance goal. Exceeded” category and only 11 percent in the “Not Achieved” category. Our performance marks a distinct To rate our success, we assign a color code shown in the upward trend from FY 2001, when we achieved or exceed- table below. This year, we have added shapes to the color ed 79 percent of the annual performance goals and failed code to make the code accessible to people who have to achieve 21 percent.

Performance Assessment Codes

Code Definition

Significantly exceeded annual performance goal Achieved annual performance goal Failed to achieve annual performance goal, progress was significant, and achievement is anticipated within the next fiscal year Failed to achieve annual performance goal, completion within the next fiscal year is not anticipated, and target may be infeasible or unachievable N/A No longer applicable

Part I • Highlights of Goals and Results 15 Agency Level Annual Performance Goal Results

11%

Percent Achieved or Exceeded Percent Not Achieved

89%

Enterprise and Crosscutting Processes Annual Performance Goal Results

100%

80%

60%

40% Percentage

20% Percent Achieved or Exceeded

Percent Not Achieved 0% Space Earth Biological Human Aerospace Manage Generate Communicate Provide Science Science and Physical Exploration Technology Strategically Knowledge* Knowledge Aerospace Research and Products Development and of Space Capabilities Enterprises / Crosscutting Processes

* Not in FY 2002 Revised Final Performance Plan

PERFORMANCE HIGHLIGHTS Space Science The following are highlights of NASA’s FY 2002 efforts One of NASA’s most important functions is to search for to achieve key goals grouped by Enterprise, strategic goal, life beyond Earth—in terms of our vision, “to find life strategic objective, and annual performance goal. Part II beyond.” This effort has profound consequences: both a of this report contains the rest of NASA’s FY 2002 per- fuller understanding of the universe and our place in it formance data. Because the Crosscutting Processes repre- and more information on the nature and potential forms of sent activities and not outcomes, they are included only life itself. Another key space science activity is looking in Part II. far ahead and far back in space and time to increase

16 NASA FY 2002 Performance and Accountability Report human understanding of the universe’s beginnings and its both complement and test the Hubble observations of the ultimate fate. Closer to home and with more immediate rate of star formation in these early galaxies. effect on our everyday lives is the study of the Sun and The Far Ultraviolet Spectroscopic Explorer (FUSE), how it interacts with Earth. The Sun provides energy and along with Hubble, has given astronomers their best comfort but also poses threats to spacecraft and to power glimpse yet at the ghostly cobweb of helium gas that and communications systems. Investigating solar activi- underlies the universe’s structure. Such observations help ties and how they affect our planet helps us better under- confirm theoretical models about how matter in the stand and avoid these hazards. Major achievements of expanding universe condensed into a web-like structure. NASA in FY 2002 advanced all of these lines of effort. This structure, which arose from small gravitational insta- Highlights are described below. The remainder of our per- bilities seeded in the chaos just after the Big Bang, fills formance measures and results are in the Performance even the voids between galaxies and traces the architec- section (Part II). ture of the universe back to very early times. Strategic Goal 1. Science: chart the evolution of Data from the 2-Micron All Sky Survey (2MASS) space- the universe, from origins to destiny, and under- craft have been used to make what is to date the most stand its galaxies, stars, planets, and life accurate determination of the galaxy luminosity function. Because the near-infrared light collected in the 2MASS Strategic Objective 3. Learn how galaxies, stars, comes from the oldest, smallest stars, this infrared lumi- and planets form, interact, and evolve nosity function represents the galaxy mass distribution, a Annual Performance Goal 2S3. Earn external review fundamental quantity that is a key element in models of rating of green, on average, on making progress in the fol- structure growth and galaxy evolution. lowing research focus areas: Observe the formation of The Chandra X-ray Observatory has produced an x-ray galaxies and determine the role of gravity in this process; image of unprecedented resolution of a major galaxy establish how the evolution of a galaxy and the life cycle of stars influence the chemical composition of material merger that shows two faint x-ray sources near its center. available for making stars, planets, and living organisms; These two x-ray sources could be massive black holes, observe the formation of planetary systems and charac- perhaps destined to merge into an even more massive terize their properties; and use the exotic space environ- black hole, with possible consequences for the galaxy’s ments within our solar system as natural science labora- near-term evolution. By tracing the very hot gas in these tories and cross the outer boundary of the solar system to energetic, dynamic systems, x-ray observations provide a explore the nearby environment of our galaxy. crucial new view of the behavior of galaxies in a major The NASA space science effort achieved a rating of merger, and Chandra observations provide a sensitivity green for this annual performance goal. We re-evaluat- and resolution never before possible. In a related discov- ed our approach to our strategic goals and objectives ery, Hubble observations of ultra-luminous infrared and revised our annual performance measures for 2002. galaxies have shown most to harbor double, multiple, or Therefore, a one-to-one match with previous years is complex nuclei, highlighting the importance of mergers not possible. in the galaxy-building process. Indicator 1. Demonstrate significant progress toward the For the focus area “establish how the evolution of a galaxy goal, as determined by external expert review and the life cycle of stars influence the chemical composition of material available for making stars, planets, and living organisms,” we achieved the following: Results. For the focus area “observe the formation of galaxies and determine the role of gravity in this process,” Hubble provided images of the intricate structure of the we achieved the following: interstellar medium and of the influence of star formation, massive stellar winds, and supernovae on galactic-scale Observations by the Hubble Space Telescope suggest that chemistry and kinematics. In addition, early-release data the cosmic star formation rate may have been more suggest that Hubble’s new wide-field Advanced Camera for intense at early cosmic times than was previously sus- Surveys will certainly meet and likely exceed expectations pected, peaking less than 1 billion years after the Big for image quality and sensitivity. Bang. This result is important for the understanding of the early assemblage of galaxies. The installation of the The 2MASS survey provides an ideal database for study- Advanced Camera for Surveys on Hubble and the revival ing large-scale interstellar structures within our own of its near-infrared camera and multiobject spectrometer galaxy. Its wavelength coverage and depth allow studies with the cryocooler provide a substantial increase in capa- of molecular cloud environments with unprecedented bilities for such galaxy evolution studies. Unfortunately, detail, from low-density cloud edges to the densest the delay in the launch of Space Infrared Telescope regions where stars are actually being formed. This allows Facility has kept us from getting very important data the radial structure of precollapse molecular cores to be about older stellar populations. Such observations will determined for several regions.

Part I • Highlights of Goals and Results 17 Observations of the Orion Nebula Cluster by the Chandra Scientists made significant advances, both theoretical and X-ray Observatory have revealed the commonality of observational, in understanding magnetic field reconnec- intense x-ray flux early on in the formation of solar sys- tion, the basic process responsible for explosive energy tems. Of particular interest in very young solar-type stars releases in solar flares, coronal mass ejections, and is flare activity 30 to 300 times as intense as the most Earth’s magnetosphere. Although this process is universal extreme such events on our own Sun. This suggests a sub- and important in the fundamental physics of laboratory stantially higher proton flux that may explain current plasmas and astrophysics, it is, perhaps, best studied in the meteoric abundance patterns. Sun’s atmosphere and Earth’s magnetopause. New observations, enabled in part by the capabilities of NASA Chandra has provided the best, highest resolution x-ray instruments on the four-spacecraft European Space image yet of two Milky Way-like galaxies in the midst of Agency Cluster mission, have proven very powerful when a head-on collision. Since all galaxies—including our combined with our current theoretical understanding. own—may have undergone mergers, particularly in their These new data indicate that some of the characteristics youth, this provides insight into how the universe came to (geometry, scale, and electromagnetic fields) of reconnec- look as it does today. Chandra X-ray Observatory obser- tion events seen in space are consistent with those expect- vations show an explosive release of energy from the cen- ed from theory and simulations. On the other hand, some tral regions of the merger, a superwind that appears to be parameters, such as the electric field tangent to the mag- fueled by the birth of hundreds of millions of new stars. netopause, appear to be at least an order of magnitude For the focus area “observe the formation of planetary smaller than suggested by some simulations. This result is systems and characterize their properties,” we achieved important because the rate of electromagnetic energy con- the following: version is proportional to the magnitude of this tangential electric field. These observations are driving rapid Scientists have analyzed images from Hubble’s infrared progress in understanding the reconnection process. camera and studied the dust disk structure around the star Observations made by the Ulysses, Voyager, and Wind TW Hydrae to search for planets. A ripple feature is seen spacecraft are providing new information on the physical in the disk some 85 astronomical units from the parent and chemical characteristics of the interstellar medium. star, but no planet is seen down to the size of 10 Jupiters at Ulysses measurements of interstellar pickup ions and distances beyond 50 astronomical units. Further observa- Voyager observations of solar wind slowing are now giv- tions are planned. ing a reliable measure of the local density of neutral inter- The FUSE spacecraft is providing evidence about the life- stellar hydrogen. Voyager and Wind observations of time and composition of gas in such disks, which are the anomalous cosmic ray sodium, magnesium, silicon, and sites of planet formation. Results from the disk around the sulfur significantly exceed what is expected from an inter- nearby star Beta Pictoris suggest that either there is much stellar neutral source, suggesting the presence of other less gas left in this 12-million-year-old disk than previous- extended sources of pickup ions in the outer heliosphere, ly thought, or that dust is distributed very nonuniformly. such as Kuiper Belt objects. The Imager for Observations of the star 51 Ophiuchi suggest that it is a Magnetopause-to-Aurora Global Exploration (IMAGE) young version of Beta Pictoris and may, at only 300,000 spacecraft has made the first observations of the neutral years old, contain planetesimals (small planetary building component of the solar wind. These observations, along blocks) with a different chemical composition from our with Ulysses measurements, permit us to assess the mech- solar system. anisms by which interplanetary dust creates the neutral solar wind and estimate the amount and size distribution of Infrared images from the Keck Observatory of a disk dust in the inner solar system. around Beta Pictoris reveal an important clue to the configuration of dust confined to a solar-system-sized Data Quality. Mission data accurately reflect perform- region close to the star: the dust orbits in a plane that is ance and achievements in FY 2002. NASA’s Space offset by about 14 degrees from that of the outer disk. Science Advisory Committee evaluated progress toward Moreover, the offset is in the opposite direction from that this annual performance goal. of a larger scale warp detected previously by the Hubble. Data Sources. NASA’s Space Science Advisory This double warp could be evidence of one or more unseen Committee delivers its findings directly to NASA man- planets. It is among the strongest evidence yet that disks agement. Minutes of their meetings are located at around stars are where planets form. http://spacescience.nasa.gov/adv/sscacpast.htm. For the focus area “use the exotic space environments Performance outcomes are reported through normal mis- within our solar system as natural science laboratories sion reviews and are verified and validated by the program and cross the outer boundary of the solar system to executive or program scientist. For descriptions of all explore the nearby environment of our galaxy,” we space science missions that support this objective and achieved the following: example data, see http://spacescience.nasa.gov/missions/.

18 NASA FY 2002 Performance and Accountability Report Indicator 2. Obtain expected scientific data from 80 per- acid environment, the Rio Tinto, Spain, and the active cent of operating missions supporting this goal (as identi- microbes at extreme pressures. The Rio Tinto is very acidic fied and documented by Associate Administrator at begin- (pH 2) and contains high concentrations of heavy metals, ning of fiscal year) an environment where scientists expected eukaryotic cells to be scarce. However, more than half of the cells were The operating missions that support this goal are the eukaryotic, and several new eukaryotic lineages were Microwave Anisotropy Probe, the FUSE, the Submillimeter found. Furthermore, the fact that some microbes are viable Wave Astronomy Satellite (SWAS), and Hubble. Each at extreme pressures, well above 1,000 times the Earth’s mission achieved its data collection and operation efficiency atmospheric pressure at sea level, expands by an order of levels. Each mission obtained expected scientific data in magnitude the range of habitable zone conditions that we FY 2002, operating with very few unplanned interruptions. think may exist in the solar system. The FUSE spacecraft experienced a serious problem with its pointing system in December 2001. The problem For the focus area “determine the general principles gov- interrupted science operations for 7 weeks until a heroic erning the organization of matter into living systems and engineering effort successfully restored the mission the conditions required for the emergence and mainte- to productivity. nance of life,” we achieved the following: Data Quality. Mission performance data accurately For the first time, irradiation of ices deposited under inter- reflect achievements in FY 2002. stellar conditions has demonstrated the synthesis of mole- Data Sources. Performance assessment data are retrieved cules capable of self-assembly, forming protocells. Several from normal project management reporting and are verified recent laboratory studies have also reinforced the feasibil- and validated by the program executive or program scien- ity of the single-stranded biomolecule RNA (ribonucleic tist. For descriptions of the space science missions that acid) to function both as a catalyst and as an information support this objective, see http://spacescience.nasa. molecule—reinforcing the concept of an RNA world pre- gov/missions/. ceding our current biological machinery of DNA (deoxynucleic acid) and proteins. In a related discovery, very similar protocells were found in the Tagish Strategic Objective 6. Probe the evolution of life on Lake meteorite. Earth, and determine if life exists elsewhere in our solar system In another research area, scientists found that proteins are Annual Performance Goal 2S6. Earn external review capable of self-replication and have chiral-selective behav- rating of green, on average, on making progress in the fol- ior (that is, left-handed proteins replicating preferentially). lowing research focus areas: Investigate the origin and It has been a longstanding mystery that all life on Earth early evolution of life on Earth, and explore the limits of life uses only left-handed proteins and right-handed sugars, in terrestrial environments that might provide analogues although both chiralities have equal probability. This is the for conditions on other worlds; determine the general first experimental evidence of a system of proteins prefer- principles governing the organization of matter into living entially selecting a single chirality. systems and the conditions required for the emergence and maintenance of life; chart the distribution of life-sus- For the focus area “chart the distribution of life-sustain- taining environments within our solar system, and search ing environments within our solar system, and search for for evidence of past and present life; and identify plausi- evidence of past and present life,” we achieved the fol- ble signatures of life on other worlds. lowing result: The NASA space science effort achieved a rating of green The Mars Global Surveyor continued to find intriguing for this annual performance goal. We re-evaluated our features such as gully systems that suggest the presence approach to our strategic goals and objectives and revised of water in the recent past. The Mars Odyssey spacecraft our annual performance measures for 2002. Therefore, a began its mapping orbit in February 2002 and already has one-to-one match with previous years is not possible. found saturated water ice at latitudes higher than Indicator 1. Demonstrate significant progress toward the 60 degrees, matching predictions about where near-sur- goal, as determined by external expert review face ice is expected to be stable. Evidence for the presence of near-surface water from measurements by the Results. For the focus area “investigate the origin and early Odyssey neutron and gamma-ray experiments suggest evolution of life on Earth, and explore the limits of life in that life-sustaining environments may have been present terrestrial environments that might provide analogues for on Mars in the past (or may still be present). conditions on other worlds,” we achieved the following: For the focus area “identify plausible signatures of life on The NASA Research and Analysis Program supported other worlds,” we achieved the following: studies that led to major advances in knowledge about the limits of life on Earth. These include the surprisingly high There has been significant progress in understanding the eukaryotic-cell (cells with a nucleus) biodiversity in a very potential contribution of microorganisms to Earth’s early

Part I • Highlights of Goals and Results 19 biosphere. This understanding is a necessary precursor to Data Sources. Performance assessment data are developing a catalogue of recognizable global obtained from normal project management reporting biosignatures to advance the astronomical search for signs and are verified and validated by the program executive of life in other planetary systems. For example, microbial or program scientist. For descriptions of the space mats release hydrogen or methane into the atmosphere. science missions that support this objective, see http:// This increases the loss of hydrogen to space, thereby spacescience.nasa.gov/missions/. contributing to the oxidation of our atmosphere. Strategic Objective 7. Understand our changing Recent investigations in the biogenicity of some features Sun and its effects throughout the solar system in the Martian meteorite ALH84001 and in the purported microfossils formed on Earth 3.5 billion years ago have Annual Performance Goal 2S7. Earn external review challenged our concepts of what constitutes a biomarker. rating of green, on average, on making progress in the fol- The controversy revolves around how reliably we can rec- lowing research focus areas: Understand the origins of ognize biogenic magnetite, the potential fractionation of long- and short-term solar variability; understand the carbon through abiotic processes, and the potential of effects of solar variability on the solar atmosphere and heliosphere; and understand the space environment of alternate isotopes such as iron to also serve as biomarkers. Earth and other planets. A controversy over whether these ancient rocks contain The NASA space science effort achieved a rating of green fossils that indicate life has the potential to change our for this annual performance goal. We re-evaluated our paradigm of the origin of life on Earth. The current para- approach to our strategic goals and objectives and revised digm is that the rapid appearance of life on Earth once it our annual performance measures for 2002. Therefore, a became possible, as reflected in the geological record of one-to-one match with previous years is not possible. Earth’s earliest history, indicates that the origin of life is a very likely event and that life could be expected to arise as Indicator 1. Demonstrate significant progress toward the quickly on other planets that have similar conditions. If the goal, as determined by external expert review controversy were resolved against the features being fos- Results. For the focus area “understand the origins of long- sils of life, then this powerful argument for the early and and short-term solar variability,” we achieved the following: easy development of life would disappear. Solar physicists have resolved the longstanding question Data Quality. The mission data and science outcomes of what holds sunspots together against disruptive mag- accurately reflect performance and achievements in netic and turbulent forces. Solar and Heliospheric FY 2002. NASA’s Space Science Advisory Committee Observatory (SOHO) scientists measured the intense evaluated progress toward this annual performance goal. winds beneath active regions on the Sun and found, below the surface, a planet-size region of in-rushing plasma that Data Sources. NASA’s Space Science Advisory Com- clamps a sunspot’s magnetic field in place. The strong mittee delivers its findings directly to NASA management. magnetic field cools the solar atmosphere and the cooler Minutes of their meetings are located at http://space- material sinks. The sinking material both deflects the hot science.nasa.gov/adv/sscacpast.htm. rising plumes of gas from below and pulls in gas from the Performance outcomes are reported through normal mis- surrounding area, driving winds at speeds of up to 5,000 sion reviews and are verified and validated by the program kilometers per hour. They also found that the cool dark executive or program scientist. For descriptions of all part of a sunspot is much shallower than previously space science missions that support this objective and thought. Sunspots and active regions are the source of example data, see http://spacescience.nasa.gov/missions/. most solar disturbances that affect Earth and most variable solar radiance. The SOHO mission is a joint activity of the Indicator 2. Obtain expected scientific data from 80 per- European Space Agency and NASA. cent of operating missions supporting this goal (as identi- NASA’s newest solar telescope, the Reuven Ramaty High fied and documented by Associate Administrator at begin- Energy Solar Spectroscopic Imager (RHESSI), has been ning of fiscal year) observing solar x-rays and gamma rays in the solar atmos- Results. The operating missions supporting this goal are phere since February 2002. Unexpected events occurred Mars Global Surveyor and Mars Odyssey. Each mission on April 21 when RHESSI detected a strong flare bright- obtained all expected scientific data during FY 2002, oper- ening in the higher energy gamma rays and x-rays well ating normally with very few unplanned interruptions. before another NASA satellite, the Transition Region and Coronal Explorer (TRACE), detected ultraviolet light Data Quality. The mission data and science outcomes from the same flare. Scientists believe that the emission accurately reflect performance and achievements in associated with hotter material was created before the FY 2002. NASA’s Space Science Advisory Committee ultraviolet emission that is associated with lower tempera- evaluated progress toward this annual performance goal. tures. This implies a downward cascade of energy rather

20 NASA FY 2002 Performance and Accountability Report than a heating that raises temperature over time in these atmosphere meet—until now a missing link in our largest explosions in the solar system. understanding of the chain of processes that connect the Sun and the Earth. We are now able to observe the com- SOHO mission researchers have found other, gentler wind pletion of the flow of energy, which starts at the center patterns, more like terrestrial trade winds, 12,000 kilome- of the Sun and is finally deposited in the Earth’s atmos- ters below the solar surface. One of the steadiest patterns phere. One example of the resulting new science is a flows from the equator toward the poles at about 60 kilo- study in which scientists used the synergy between two meters per hour. However, after analyzing data from 1996 spacecraft (RHESSI and TRACE) to determine the to 2002, they found that this pattern unexpectedly reversed direction of solar flare energy cascade. At the other end direction at high latitudes of the northern hemisphere in of the chain, combining of spacecraft data from IMAGE 1998. This phenomenon may be related to the asymmetry and TIMED with ground-based instrument data has observed in solar activity between the hemispheres in most shown a strong correlation between the amount of struc- 11-year sunspot cycles and suggests effects of the new ture in the aurora and the amount of energy deposited in solar cycle organizing itself below the visible surface of the atmosphere. the Sun. Data Quality. The mission data and science outcomes For the focus area “understand the effects of solar vari- accurately reflect performance and achievements in ability on the solar atmosphere and heliosphere,” we FY 2002. NASA’s Space Science Advisory Committee achieved the following: evaluated progress toward this annual performance goal. Puzzling and persistent asymmetries between the Sun’s Data Sources. NASA’s Space Science Advisory north and south polar regions have been recorded for some Committee delivers its findings directly to NASA man- time by ground-based observatories. Then, during the last agement. Minutes of their meetings are located at solar minimum, we found a clear north-south asymmetry http://spacescience.nasa.gov/adv/sscacpast.htm. in the galactic cosmic ray intensity measured by the Ulysses spacecraft and in the 1-astronomical-unit helios- Performance outcomes are reported through normal mis- pheric magnetic field recorded by the Wind spacecraft. We sion reviews and are verified and validated by the program have inferred that this same north-south asymmetry occurs executive or program scientist. For descriptions of all in the solar open magnetic field strength at several solar space science missions that support this objective and radii. Based on Ulysses’s solar wind composition meas- example data, see http://spacescience.nasa.gov/missions/. urements, all these observations point to a stronger open Indicator 2. Obtain expected scientific data from 80 per- magnetic field in the southern solar hemisphere than in the cent of operating missions supporting this goal (as identi- northern hemisphere. Finding the causes and origin of this fied and documented by Associate Administrator at begin- north-south asymmetry will be an important step in our ning of fiscal year) understanding of fundamental processes on the Sun. Results. Supporting missions are SOHO; TRACE; A very large coronal mass ejection and its associated flare RHESSI; Ulysses; Voyager; the Advanced Composition on July 14, 2000, produced effects throughout the solar Explorer (ACE); the Solar, Anomalous, and atmosphere and heliosphere. Analysis of these data during Magnetospheric Particle Explorer (SAMPEX); Polar; FY 2002 provided a new understanding of the effects of Fast Auroral Snapshot Explorer (FAST); IMAGE; and rapid solar variations. TIMED. Each mission obtained all expected scientific For the focus area “understand the space environment of data in FY 2002, operating normally with very few Earth and other planets,” we achieved the following: unplanned interruptions. New observations of the plasmas surrounding Earth using Data Quality. Mission performance data accurately the IMAGE spacecraft have revealed much stronger con- reflect achievements in FY 2002. nections between the ionosphere and magnetosphere than Data Sources. Performance assessment data are collect- expected. The energy transport from the solar wind ed through normal project management reporting and are through the magnetosphere to the ionosphere is immedi- verified and validated by the program executive or pro- ate. The ionosphere reacts by ejecting ions up the mag- gram scientist. For descriptions of the space science mis- netic field lines into the magnetosphere creating a ring sions that support this objective, see http://spacescience. current that, at times, encircles the Earth. As these ions nasa.gov/missions/. reenter the atmosphere, they further perturb the ionosphere, changing the configuration of the plasma environ- Strategic Objective 8. Chart our destiny in the ment around the Earth. solar system The Thermosphere, Ionosphere, Mesosphere Energetics Annual Performance Goal 2S8. Earn external review and Dynamics (TIMED) spacecraft provided data of rating of green, on average, on making progress in the fol- exceptional quality on the region where space and the lowing research focus areas: Understand forces and

Part I • Highlights of Goals and Results 21 processes, such as impacts, that affect habitability of charging; identifying conditions in the solar wind and Earth; develop the capability to predict space weather; magnetosphere that are responsible for the strong vari- and find extraterrestrial resources and assess the suitabil- ability in the relativistic electron flux in Earth’s magne- ity of solar system locales for future human exploration. tosphere; and developing new models and software tools The NASA space science effort achieved a rating of blue for evaluating near-real-time geomagnetic cutoffs. for this annual performance goal. We re-evaluated our For the focus area “find extraterrestrial resources and approach to our strategic goals and objectives and revised assess the suitability of solar system locales for future our annual performance measures for 2002. Therefore, a human exploration,” we achieved the following result: one-to-one match with previous years is not possible. Indicator 1. Demonstrate significant progress toward the Mars Odyssey observations indicate the presence of water goal, as determined by external expert review near the surface of Mars, a potential resource for future explorers. Both Odyssey and the Mars Global Surveyor Results. For the focus area “understand forces and have identified potentially suitable sites for in-depth sur- processes, such as impacts, that affect habitability of face exploration, a necessary step for possible future Earth,” we achieved the following: human exploration.

Between October 1, 2001, and July 1, 2002, scientists dis- Data Quality. The mission data and science outcomes covered and catalogued 78 near-Earth objects with diame- accurately reflect performance and achievements in ters greater than 1 kilometer. Almost all of these discover- FY 2002. NASA’s Space Science Advisory Committee ies were made through search efforts supported by the evaluated progress toward this annual performance goal. Near-Earth Object Observations Program. The total estimated population is about 1,000 to 1,100 objects, of which more than 600 have been discovered and catalogued. NASA is on schedule to catalog 90 percent of near-Earth objects greater than 1 kilometer in diameter by 2008. For the focus area “develop the capability to predict space weather,” we achieved the following: Measurements by the SAMPEX satellite show that, during large solar-particle events, the geomagnetic cutoff for entry of energetic particles into the magnetosphere is often highly variable. These changes correlate well with changes in geomagnetic activity. The SAMPEX satellite shows that the actual cutoffs generally fall below calculated values and that the Earth’s polar cap is larger than expected. During large solar-particle events, the radiation dose on satellites such as the Station will be several times greater than previously expected. The global ultraviolet imager on the TIMED spacecraft obtained images of equatorial plasma depletions. The images enable surveys of the extent and the distribution of large-scale plasma depletions. The depleted plasma structures are important because they significantly perturb, and even completely disrupt, electromagnetic signal propagation. In addition to causing abrupt communication outages, this phenomenon can also significantly affect global- positioning-system-based navigation systems. NASA finds convincing evidence of ice on Mars The Living With a Star Targeted Research and This artist’s rendering portrays instruments aboard NASA’s Mars Technology Program supports a wide-ranging set of the- Odyssey spacecraft detecting ice-rich layers in the soil of Mars. oretical and empirical modeling designed to provide the Measurements by the gamma ray spectrometer instruments indicate that the upper 3 feet of soil contain an ice-rich zone with an ice abun- framework for predicting space weather. Noteworthy dance of 20 to 50 percent by mass. These ice-rich areas surround both studies include applying new methodologies for calculat- the north and south polar regions of Mars down to latitudes of about 60 ing and forecasting satellite drag; modeling the effects of degrees. The instruments detect the signature of hydrogen, indicating solar energetic particles and galactic cosmic rays on water ice, to a depth of about 3 feet. Scientists do not know whether or how deep the ice-rich zone continues below that depth. The view of the cloud condensation in the stratosphere; characterizing spacecraft in this artist’s rendering is not to scale, as the observations the plasma environment responsible for spacecraft are obtained from an orbital altitude of 250 miles.

22 NASA FY 2002 Performance and Accountability Report Data Sources. NASA’s Space Science Advisory • Mars Reconnaissance Orbiter ’05 Development: Committee delivers its findings directly to NASA man- Select payload and initiate development agement. Minutes of their meetings are located at • Solar Terrestrial Relations Observatory Development: http://spacescience.nasa.gov/adv/sscacpast.htm. Have contracts in place for start of spacecraft and Performance outcomes are reported through normal mis- instrument detailed design and fabrication sion reviews and are verified and validated by the program executive or program scientist. For descriptions of all Other projects: space science missions that support this objective and • Swift Gamma Ray Burst Explorer Development: example data, see http://spacescience.nasa.gov/missions/. Complete build-up of spacecraft subsystems • Full-sky Astrometric Mapping Explorer (FAME) Indicator 2. Obtain expected scientific data from 80 per- Development: Conduct Confirmation Review cent of operating missions supporting this goal (as identified and documented by Associate Administrator at begin- • Galaxy Evolution Explorer (GALEX) Development: ning of fiscal year) Complete environmental testing • Comet Nucleus Tour (CONTOUR) Development: Results. There were no space-based operating missions Complete environmental testing substantially dedicated to supporting this goal in FY 2002. However, some operating missions have contributed to • Mercury Surface, Space Environment, Geochemistry research in this area (see indicator 1). Future space mis- and Ranging Mission Development: Conduct Critical sions are expected. Design Review • Solar-B Development: Conduct the Pre-Environmental Strategic Objective 9. Support of Strategic Plan Review for the U.S.-provided Extreme Ultraviolet science objectives; development/near-term future Imaging Spectrometer investments (Supports all objectives under the • Planck Development: Complete the High-Frequency Science goal) Instrument flight detectors Annual Performance Goal 2S9. Earn external review rating of green on making progress in the following area: Results. For the 15 development programs and projects, design, develop, and launch projects to support future 12 milestones were successfully completed. GALEX research in pursuit of Strategic Plan science objectives. development did not complete its environmental testing, and Planck development did not complete the High- The NASA space science effort achieved a rating of green Frequency Instrument flight detectors. We determined for this annual performance goal. We re-evaluated our before its scheduled confirmation review that the FAME approach to our strategic goals and objectives and revised mission should be terminated; therefore, we did not hold our annual performance measures for 2002. Therefore, a the review. Highlights of FY 2002 performance follow: one-to-one match with previous years is not possible. During the March Hubble Space Telescope Servicing Indicator 1. Meet no fewer than 75 percent of the devel- Mission 3B, astronauts installed Advanced Camera for opment performance objectives for major programs/proj- Surveys and Solar Array 3. The camera has increased ects, supported by completion of performance objectives Hubble’s optical capacity tenfold, producing breathtak- in majority of other projects ingly clear and detailed images. Already, the revitalized Major programs/projects: Hubble has allowed astronomers to peer more deeply into • Hubble Space Telescope Development: Begin system the universe, initiating a flurry of discoveries. test of the Cosmic Origins Spectrograph (COS) The Solar Terrestrial Relations Observatory Develop- • Hubble Space Telescope Development: Advanced ment mission has contracts in place for spacecraft and Camera for Surveys and Solar Array 3 will be ready instrument detailed design, and activities are proceeding for flight and installation on Servicing Mission 3B toward critical design review. This mission will obtain • Space Infrared Telescope Facility Development: simultaneous (stereo) images of the Sun, using two space- Complete integration and test of spacecraft and pay- craft with identical instruments to study coronal mass load ejections as they travel toward Earth. • Stratospheric Observatory for Infrared Astronomy The Mars Exploration Rover mission completed critical Development: Complete installation of the forward design phase and started assembly, test, and launch oper- pressure bulkhead ations in March 2002. Twenty-eight new scientists partic- • Gravity Probe-B Development: Initiate flight vehicle ipated in the field integrated design and operations test— integration and test a field test to maneuver the rover. • Mars Exploration Rover ’03 Development: Initiate The Mars Reconnaissance Orbiter mission selected assembly, test and launch operations process instruments for the mission early in the fiscal year. The

Part I • Highlights of Goals and Results 23 preliminary design review and nonadvocate review were are verified and validated by the program executive also completed successfully, and the mission received for- or program scientist. For descriptions of the space science mal approval to proceed to implementation phase. missions that support this objective, see http:// spacescience.nasa.gov/missions/. The CONTOUR spacecraft achieved its FY 2002 metric; however, it suffered an in-space anomaly, and there has Strategies and Resources to Achieve Goals been no contact since. The FAME mission, as stated above, was terminated. During spacecraft thermal vacuum testing NASA’s space science effort works closely with the larger for GALEX, the attitude and power electronics software scientific community to articulate science goals that failed, which caused the environmental testing to slip. The directly support the Agency’s scientific research mission. Planck mission experienced problems in fabricating the We also establish goals for flight programs, technology bolometers, and we transferred the fabrication of the development, and education and public outreach. These detector blocks to the Jet Propulsion Laboratory. goals are the framework for formulating and managing the space science program. The space science goals to key Data Quality. Mission performance data accurately activities table shows the relationships among strategic reflect achievements in FY 2002. goals, strategic objectives, and key activities. Data Sources. Performance assessment data are The space science resource estimates table gives budget retrieved from normal project management reporting and authority figures for FY 1999 to FY 2002. Funding for the

Mapping Goals and Objectives to Key Space Science Activities

Strategic Goal Strategic Objective Key Activity

Science: chart the evolution Understand the structure of the universe, from its Operating Missions, Supporting Research of the universe, from origins to earliest beginnings to its ultimate fate and Technology destiny, and understand its galaxies, stars, planets, Explore the ultimate limits of gravity and energy Operating Missions, Supporting Research and life in the universe and Technology Learn how galaxies, stars, and planets form, Operating Missions, Supporting Research interact, and evolve and Technology Look for signs of life in other planetary systems Operating Missions, Supporting Research and Technology Understand the formation and evolution of the Operating Missions, Supporting Research solar system and the Earth within it and Technology Probe the evolution of life on Earth, and Operating Missions, Supporting Research determine if life exists elsewhere in our solar and Technology system Understand our changing Sun and its effects Operating Missions, Supporting Research throughout the solar system and Technology Chart our destiny in the solar system Operating Missions, Supporting Research and Technology Support of Strategic Plan science objectives; Space Infrared Telescope Facility, Hubble development/near-term future investments Space Telescope Development, Gravity (Supports all objectives under the Science goal) Probe B, Stratospheric Observatory for Infrared Astronomy, Solar-Terrestrial Relations Observatory, Gamma Ray Large Area Telescope, Payloads, Explorers, Discovery and Mars Surveyor

Technology/Long-Term Acquire new technical approaches and Supporting Research and Technology Future Investments: develop capabilities. Validate new technologies in space. new technologies to enable Apply and transfer technology innovative and less expensive research and flight missions

Education and Public Share the excitement of space science Space Infrared Telescope Facility, Hubble Outreach: share the discoveries with the public. Enhance the quality Space Telescope Development, Gravity excitement and of science, mathematics, and technology Probe B, Stratospheric Observatory for knowledge generated by education, particularly at the pre-college level. Infrared Astronomy, Solar-Terrestrial scientific discovery and Help create our 21st century scientific and Relations Observatory, Gamma Ray Large improve science education technical workforce Area Telescope, Payloads, Explorers, Discovery, Mars Surveyor, Operating, Missions, and Supporting Research and Technology

24 NASA FY 2002 Performance and Accountability Report first nine programs supports mission development (for spacecraft and the scientific analysis of data returned from example, pre-launch funding). Funds for our operating those and previous missions ($522 million); basic research, missions are combined into one line, as post-launch oper- including theoretical and laboratory studies, and the devel- ations are much less resource-intensive than development. opment of new scientific instruments ($253 million); and Supporting Research and Technology includes the launch of scientific payloads on suborbital rockets and scientific research activities (for example, data analysis, high-flying balloons ($42 million). Progress toward objec- theory, and modeling), as well as early technology devel- tive 9 was made by developing missions that will extend opment and studies for missions that are not yet ready to our knowledge in the future ($1.295 billion). proceed into development. Results in a single year for any particular project (for Cost-Performance Relationship example, Hubble) rely on investments made over many In achieving the strategic goals shown on the mapping years, and are usually only a fraction of the total invested Space science goals to key activities table, during in all years on that project. FY 2002, NASA incurred research and development We spent about 16 percent of the FY 2002 space science expenses for the programs as follows. Essentially 100 budget on achieving strategic goal 2, our space science tech- percent of resources went to research and development, nology goal. Progress resulted from investments in new and of this total about 35 percent was spent on basic technologies and beginning to design future missions. The research and 65 percent on development. No resources New Millennium Program ($42 million) focuses on flight- were expended on applied research. For a description of testing (in space) brand-new technologies that we can then the three research categories and a summary of NASA’s use with confidence in future science missions. Our other total research and development expenses, see the technology programs ($356 million) invest in early design “Required Supplementary Stewardship Information— activities for future missions and overcoming technology Stewardship Investments: Research and Development” challenges to enable those mission designs to work. schedule in Part III. The NASA space science education and public outreach Budget-Performance Relationship program is cost-effective and highly leveraged. Each space About 84 percent of the FY 2002 space science budget science mission or research program directs 1 to 2 percent supported the achievement of strategic goal 1, the space of its budget toward these activities. This is highly consis- science effort’s science goal. We made progress toward tent with the Space Act’s requirement that NASA broadly achieving the first eight strategic objectives associated with disseminate its results. Beyond this, the program has a this goal through operation of more than 25 scientific modest investment in infrastructure, a small pool of funds Resource Estimates of Key Space Science Activities Budget Authority (in $ Millions) Key Activity FY 1999 FY 2000 FY 2001 FY 2002*

Space Infrared Telescope Facility 120 123 118 132

Hubble Space Telescope Development 160 184 180 170

Gravity Probe B 61 50 41 54

Stratospheric Observatory for Infrared Astronomy 58 42 43 38

Solar-Terrestrial Relations Observatory 0 0 0 59

Payloads 29 15 40 50

Explorers 205 123 141 123

Discovery 124 150 213 217

Mars Surveyor 228 249 430 428

Operating Missions 117 79 123 175

Supporting Research and Technology 916 1,148 966 1,039

Institutional Support/Other 101 31 26 417

Total 2,119 2,194 2,321 2,902

*Beginning in FY 2002, Institutional Support is included in each Enterprise. FY 2002 reflects September Operating Plan.

Part I • Highlights of Goals and Results 25 for individual investigator grants, and support for a few Data Quality. Peer-reviewed publication is the most special projects. relied-upon assessment of the validity of a scientific accomplishment. We are fortunate in obtaining substantial additional support from external partners. For example, major museum Data Sources. The December 2001 issue of the Journal exhibits often result from NASA contributions of content, of Geophysical Research published the map (Bales et al.). technical expertise, and modest funding in partnership Indicator 2. Provide the first record of changes and vari- with a host museum, other agencies, and/or private donors ability in extent of Greenland ice sheet surface melt over who provide the design, fabrication, and major funding. the 21 years, 1979-1999, and submit for publication The program philosophy is for NASA to provide technical content derived from space science missions and our sci- Results. NASA sponsored the analyses, which showed entific expertise while external partners provide the major that the Greenland ice sheet melt rate increased from funding, development, and educational expertise. 1979 to 1999 and was accompanied by warmer temperatures. This increased rate occurred on the western side of Earth Science the ice sheet. A journal published the paper. In FY 2002, we demonstrated our commitment and abili- Data Quality. Peer-reviewed publication is the most ty to improve life here on Earth. Detecting and under- relied-upon assessment of the validity of a scientific standing large-scale changes on Earth, using advanced accomplishment. satellite data to better manage water resources and miti- Data Sources. The paper (Abdalati and Steffen) gate flood damage, and assisting firefighters to more appeared in the December 27, 2001, issue of the Journal of quickly mobilize resources to combat wildfires are just a Geophysical Research—Atmospheres. few examples of how our FY 2002 Earth science work helped us understand and protect our home planet. Indicator 3. Produce the first map of Antarctic ice sheet Highlights of these activities are described below. The margin change, 1997-2000, covering key regions of the remainder of our goals, objectives, and achievements are Antarctic coastline and submit this for publication discussed in Part II. Results. We produced the first map of the Antarctic ice margin change by comparing the results from the Strategic Goal 1. Observe, understand, and model RADARSAT Antarctic Mapping Mission (RAMM) in 1997 the Earth system to learn how it is changing, and with the Modified Antarctic Mapping Mission in 2000. the consequences for life on Earth Some areas showed expanding ice, while others experi- Strategic Objective 1. Discern and describe how enced little or no change; still others, such as the Larsen ice the Earth is changing shelf, experienced dramatic reductions in ice cover.

Annual Performance Goal 2Y5. Increase under- Data Quality. Peer-reviewed publication is the most standing of change occurring in the mass of the relied-upon assessment of the validity of a scientific Earth’s ice cover by meeting at least three of four accomplishment. performance indicators. Data Sources. A paper (Jezek et al.) published in Annals NASA achieved the annual performance goal with a rat- of Glaciology in August 2002 compared changes in ice ing of green. We made progress in understanding mass sheet margin. National Geographic also highlighted mar- changes of the Greenland and Antarctic ice sheets. We gin changes in a map in their supplement to the February compiled 20 years of accumulation and melt rates from 2002 issue. satellite and field measurements. Mapping Antarctica revealed changes in the margins and ice streams and iden- Indicator 4. Define parameters for separating post- tified growth and wastage areas. glacial rebound from ice mass changes based on Gravity Recovery And Climate Experiment (GRACE) In addition, NASA improved our ability to separate grav- and ICESat observations ity and elevation change signals when determining the growth or shrinkage of the Earth’s ice sheets. This Results. We analyzed the parameters needed for separat- advance will assist in our upcoming Ice, Cloud, and Land ing post-glacial rebound from elevation data even before Elevation Satellite (ICESat) mission. launching ICESat by using a theoretical basis. Results indicate that combining gravity and elevation change Indicator 1. Submit for publication the first Greenland ice measurements increase the accuracy of estimates of ice sheet accumulation rate and its inter-annual variability thickness changes. maps for the period 1975-98 Data Quality. Peer-reviewed publication is the most Results. A peer-reviewed journal published the accumu- relied-upon assessment of the validity of a scientific lation rate and its associated maps in December 2001. accomplishment.

26 NASA FY 2002 Performance and Accountability Report Data Sources. The Journal of Geophysical Research— structure, and patterns. This information technology Solid Earth published a paper by Wahr and Velicogna technique identified earthquake risk in California, suc- describing the accuracy possible when combining ICESat, cessfully forecasting the location of three earthquakes GRACE, and GPS data. greater than magnitude 5.

Strategic Objective 2. Identify and measure the pri- The Solid Earth and Natural Hazards Program funded the mary causes of change in the Earth system Bawden et al. study, which integrated the Southern California Integrated GPS Network and InSAR strain Annual Performance Goal 2Y9. Increase observations for the Los Angeles basin with well pumping understanding of the Earth’s surface and how it is data and fault geology. The study identified components of transformed and how such information can be used to strain related to aquifer withdrawal and tectonically related predict future changes by meeting at least four of five strain. The study changed our view of strain estimates with- performance indicators. in the basin and identified human-caused sources of strain. NASA achieved the annual performance goal with a Data Quality. Peer-reviewed publication is the most rating of green. The Shuttle radar topography mission, relied-upon assessment of the validity of a scientific which provided accurate topography in FY 2000, will accomplishment. expand available Satellite Radar Interferometry (InSAR) surface change measurements. Global topography maps Data Sources. Some examples of relevant journal pub- called Digital Elevation Models (DEM) will advance lications include: gravity, hydrological, wind stress, and similar models. Rundle, J.B., K. F. Tiampo, W. Klein, and J.S. Sa Martins, In FY 2002, the station design for Global Positioning Self-organization in leaky threshold systems: The influ- System (GPS) monitoring of volcanoes provided tangible ence of near-mean field dynamics and its implications for cost reductions. InSAR is the highest priority for the Solid earthquakes, neurobiology, and forecasting. Earth and Natural Hazards Program, according to the Solid Earth Science Working Group report. The synergy Tiampo, K.F., J. B. Rundle, S. McGinnis, S.J. Gross, W. with geodetic GPS in monitoring high-resolution Klein, Mean Field Threshold Systems and Phase subsidence clearly demonstrated this. Multiyear InSAR Dynamics: An application to Earthquake Fault systems, averaging showed unexpected, never-before-seen Europhysics Letters, in press. deformation in the eastern Mojave Desert. Fixed-network GPS observations revealed periodic displacements in the Indicator 3. Continue providing the DEM of the Earth for Puget Sound/Cascadia trench region. The observation of scientific studies and practical applications periodic silent earthquakes was also a major revelation. Results. NASA achieved the indicator. Shuttle radar Indicator 1. Begin 5-year assessment of utility of complet- topography data processing is proceeding according to ed Southern California Integrated GPS Network in under- schedule. NASA’s Jet Propulsion Laboratory provided the standing tectonic activities National Imagery and Mapping Agency with North and South America DEM and other Department of Defense Results. NASA began to assess the Southern California (DOD) high-priority information. Integrated GPS Network (SCIGN) for its applicability to natural hazards. NASA developed the GPS technology NASA made selected DEM available in two categories: within its global geodetic network and Solid Earth limited access to principle investigators only and public Science Program. access. A U.S. DEM at 30-meter resolution map is available to the public. This map and other data are available Data Quality. Peer-reviewed publication is the most from the EROS data center. NASA also made available relied-upon assessment of the validity of a scientific high-resolution (30 meter) maps to the U.S. Geological accomplishment. Survey (USGS) for a volcano hazards response. Data Sources. The network homepage provides infor- Data Quality. The Shuttle radar topography data exceed- mation about this project and a list of relevant publications ed specifications by a factor of two or better. Vertical at http://www.scign.org/. errors appeared to be on the order of 5 to 10 meters and Indicator 2. Perform a new integrated earthquake risk horizontal accuracy appeared to be 15 meters or better. assessment of the Los Angeles basin based on continued measurement of accumulated strain in the southern Data Sources. Project studies using global geodetic pro- California region vided these error estimates. Shuttle radar topography data, links, and data policy are available at http://www.jpl.nasa. Results. The Rundle et al. and Tiampo papers, cited gov/srtm/. The EROS data center is also supporting the dis- below, showed how to determine earthquake potential tribution of Shuttle radar topography data products in coop- using an integrated model based on occurrence, fault eration with NASA.

Part I • Highlights of Goals and Results 27 Indicator 4. Evaluate the utility of single-frequency GPS array technology for assessing volcanic deformation processes Results. Single-frequency, or L1-only, receivers, proved not to be a cost-effective approach to GPS geodesy. University Navigation Signal Timing and Ranging Global Positioning System Consortium, a nonprofit organization that supports and promotes Earth science by advancing high-precision geodetic and strain techniques, is studying options to convert existing L1 sites to dual-frequency operation because of advancing commercial dual-frequency receiver technology and resultant cost advantages. Data Quality. The data quality was good, but registered a factor of 2 to 10 times noisier than a standard dual- frequency GPS geodetic receiver. High sampling rates (less than 1 per second) proved not accurate enough. Data Sources. Information on the L1 network and relevant links to data is available at http://www. unavco.ucar.edu/science_tech/dev_test/receivers/ l1.html and http://charro.igeofcu.unam.mx/defnet/GPS_ volcanoes.html. Indicator 5. Characterize and model topographic evolution processes in at least two major tectonically active regions of the world and publish results Results. The study areas characterized and modeled included the southern California region and the Andes. The southern California studies described how the faults, which deform the region, take up strain to form the significant features of the region. The Central Andes study used existing models, GPS measurements, geology, and other geophysical data sets. Data Quality. Peer-reviewed publication is the most relied-upon assessment of the validity of a scientific accomplishment. NASA maps the world with unprecedented precision Data Sources. Publications about the southern These images show exactly the same area: Kerguelen Island in the southern Indian Ocean. The top image was created using the California region included: best global topographic data set previously available, the U.S. Geological Survey’s GTOPO30. In contrast, the more detailed Peltzer, G., F. Crampe, S. Hensley, P. Rosen, November bottom image was generated with data from the Shuttle Radar 2001: Transient strain accumulation and fault interaction Topography Mission, which collected enough measurements to in the Eastern California shear zone, Geology, volume 29, map 80 percent of the Earth’s landmass. no. 11, 975-978. For parts of the globe, Shuttle Radar Topography Mission measurements are 30 times more precise than previous topographical Smith, B. and D. Sandwell, Coulomb stress accumulation information, according to NASA scientists. Mission data will be a along the San Andreas Fault System, Bulletin of the welcome resource for national and local governments, scientists, Seismological Society of America, submitted May 2002. commercial enterprises, and members of the public. The applications are as diverse as earthquake and volcano studies, flood control, transportation, urban and regional planning, Strategic Goal 2. Expand and accelerate the real- aviation, recreation, and communications. The data’s military ization of economic and societal benefits from applications include mission planning and rehearsal, modeling, Earth science, information, and technology and simulation. Strategic Objective 1. Demonstrate scientific and technical capabilities to enable the development of Annual Performance Goal 2Y23. Provide regional practical tools for public and private-sector decision-makers with scientific and applications products decision makers and tools.

28 NASA FY 2002 Performance and Accountability Report NASA achieved the annual performance goal with a rating MODIS data from the Terra satellite and the Hyperion of green. We prepared a strategy to solve practical prob- and Advanced Land Imager instruments on the Earth lems facing the U.S. and the Earth. We identified 12 nation- Observer–1 satellite. al applications on which to focus the future program. We Data Sources. References are available at http:// partnered with Federal agencies and national organizations eospso.gsfc.nasa.gov/earth_observ.html, on the Earth to apply the results of NASA research and development in Observatory Web site at http://earthobservatory.nasa.gov, remote sensing (observations) and science modeling (pre- and the Rapid Response Team Web site at http://rapidfire. dictions) to the partner agency’s needs for improved man- sci.gsfc.nasa.gov/products_rr.html. agement or policy decision-making. Partner agencies include the U.S. Department of Agriculture (USDA), the Aviation—NASA collaborated with the FAA and the Environmental Protection Agency (EPA), the National Radio Technical Commission for Aeronautics to establish Oceanic and Atmospheric Administration (NOAA), FAA, guidelines for using remote sensing solutions (including and the Federal Emergency Management Agency. Intelligence Reform Interferometric Synthetic Aperture Radar (IFSAR), lidar, and Shuttle radar topography). The Indicator 1. Conduct Program Planning and Analysis guidelines addressed terrain databases for aviation activities that result in the identification of five worldwide. The International Civil Aviation Organizations potential demonstration projects where user needs is considering using the guidelines as the basis for an match NASA Earth Science Enterprise science and international standard. NASA supported the FAA and technology capabilities NOAA in monitoring volcano plumes and predicting Results. NASA’s participation in these meetings led to global transport of related aerosols. NASA continued to development of 12 national priority applications areas: (1) assist the FAA in evaluating, verifying, and validating the energy forecasting, (2) agricultural competitiveness, (3) use of sounding measurements provided by remote carbon management, (4) aviation safety, (5) homeland sensing satellites for aviation weather prediction. security, (6) community growth management, Data Quality. The SC193 Working Group of the Radio (7) community disaster preparedness, (8) public health, Technical Commission for Aeronautics developed the ter- (9) coastal management, (10) biological invasive species, rain specifications. NASA’s Jet Propulsion Laboratory (11) water management and conservation, and (12) air provided continuous monitoring of volcanoes and reports quality management. information to the National Weather Service. Data Quality. The Program Planning and Application Data Sources. SC193 Working Group minutes, reports, process involved representatives from academia, science, and guidelines are available through the RTCA Web site at industry, and policy sectors considered experts in http://www.rtca.org. Volcano plume assessments are avail- their fields. able through both the Jet Propulsion Laboratory at Data Sources. Information on the 12 national applica- http://www.jpl.nasa.gov/earth/natural_hazards/volca- tions is located at http://esnetwork.org. noes_index.html and the Earth Observatory site at http://earthobservatory.nasa.gov. Research at Langley The National Academy of Sciences report, “Putting Research Center supported advanced weather prediction; Science to Work and the U.S. Global Climate Change references are available at http://www.esnetwork.org and Program FY 2001: Our Changing Planet,” provided guid- in the August 2002 issue of Earth Observation Magazine. ance on applications where NASA results show potential to help decision makers. Public Health—NASA is working with the Centers for Disease Control and Prevention’s (CDC) National Center Indicator 2. Develop two new joint demonstration projects for Environmental Health to benchmark NASA’s Earth with the user community Observation System (EOS) data products and models of Results. NASA established three joint projects: wildfires, environmental indicators and parameters associated with aviation, and public health. disease initiation and transport. The data will be used as inputs in the CDC’s Environmental Health Tracking Wildfires—NASA is supporting the U.S. Forest Service in Network, a first-of-its-kind public health decision support benchmarking the capacity to use real-time access to system designed to collect and analyze human environ- Moderate Resolution Imaging Spectroradiometer mental exposure information. State and local public health (MODIS) data and other NASA provided measurements departments nationwide began demonstration projects for fire management. using the network. Data Quality. The Rapid Response Team is comprised of Data Quality. NASA Earth science observations and pre- NASA, the MODIS science team, the University of dictions are being evaluated for assimilation into the Maryland, the U.S. Forest Service, the Earth Science CDC’s tracking network, especially data products from the Information Partnership, and Global Observations for Advanced Spaceborne Thermal Emission and Reflection Forest and Land Cover Dynamics. The team used the Radiometer and MODIS sensor systems. These data

Part I • Highlights of Goals and Results 29 products will be evaluated on their capacity to provide use- wildfire management, supporting access to MODIS for fire ful measures of human environmental exposure to State management. NASA supported the USDA with plans for and local health departments. using remote sensing measurements in assessing the carbon sequestration capacity of the land and oceans, in sup- Data Sources. Data sources and linkage processes is port of the Administration’s direction that USDA, available at http://www.cdc.gov/nceh. Actual databases Department of Energy, and EPA develop a carbon manage- are not available for public view because they contain con- ment and trading approach. We provided the USDA fidential medical information. Foreign Agriculture Service with direct access capacity to use Earth-observing satellites to assist global crop assess- Strategic Goal 3. Develop and adopt advanced ments. NASA worked with the EPA on aerosol monitoring technologies to enable mission success and serve and associated science research to understand the process- national priorities es of global and regional transport mechanisms. Strategic Objective 3. Partner with other agencies Data Quality. The following professional documents to develop and implement better methods for describe the collaborations that took place. using remotely sensed observations in Earth system monitoring and prediction Data Sources. Information about this indicator appeared in Solid Earth and Natural Hazards Working Group Report Annual Performance Goal 2Y28. Collaborate with other Federal and international agencies in developing and located at http://solidearth.jpl.nasa.gov/report.html and implementing better methods for using remotely sensed Earth Observation Magazine at http://www.eomonline.com. observations. Indicator 2. Demonstrate enhanced interoperability and NASA achieved a rating of green. We expanded the use interconnectivity of international remote sensing informa- of remote sensing data through Federal partnerships with tion systems and services through NASA’s participation in USGS, USDA, EPA, and with international partnerships the Committee on Earth Observation Satellites (CEOS) with the Central American Commission on Environment Working Group on Information Systems and and Development. NASA worked with the USGS to Services (WGISS) accelerate use of our results for predicting volcanoes and Results. The CEOS Working Group on Information for monitoring land subsidence, biological invasive Systems and Services collaborated on two international species, the transfer of the EO–1 satellite to the opera- science initiatives, the Coordinated Enhanced tional community, and the Landsat Data Continuity Observing Period and the core sites work of the CEOS Mission. Results will also support the Federal Working Group on Calibration and Validation, aug- Geographic Data Committee. NASA provided the U.S. menting both projects’ information systems require- Department of Agriculture solutions to wildfire manage- ments. NASA’s contributions included the International ment, carbon management, precision agriculture, and Directory Network and a data-search-and-order capa- global crop assessment and prediction. EPA collabora- bility of selected international sites. NASA monitored tion focused on Earth observations and predictions to network performance among CEOS agency sites and support air quality management. With the Central led a task team investigating new technology and its American Commission on Environment and potential applications to WGISS initiatives. NASA also Development, the focus consisted of mesoscale biologi- coordinated the production of an online video to cal corridor monitoring and assessment for sustainable demonstrate WGISS capabilities at the World Summit ecosystem management in Central America. on Sustainable Development. Indicator 1. Continue to take advantage of collaborative relations with USGS, USDA and EPA to promote Data Quality. Participating organizations, not the CEOS the use of remotely sensed data and information to WGISS, monitor data quality. accomplish U.S. strategic scientific, environmental and Data Sources. A description of WGISS activities, par- economic objectives ticipants, events and pointers to more information on the Results. The Agency has continued collaborations with WGISS subgroups and task teams is located at Federal agencies including the USGS, USDA, and EPA. http://wgiss.ceos.org. NASA and USGS are working to improve our ability to Indicator 3. Demonstrate enhanced mission coordination predict volcanic events by using InSAR measurements and complementarity of remote sensing data through acquired on the Shuttle radar topography mission to moni- NASA’s participation in the CEOS Working Group on tor conditions leading to volcanic eruptions. In the field of Calibration and Validation land subsidence monitoring, our agencies demonstrated the use of change detection using Shuttle radar topography Results. NASA participated in the CEOS Working Group data to compare current elevations with USGS elevation on Calibration and Validation. We contributed to the data produced earlier. NASA and the USDA collaborate on Optical Subgroup and the Chemistry Subgroup at a

30 NASA FY 2002 Performance and Accountability Report technical remote sensing level, as well as at the Plenary Supercomputing Program, an Advanced Technology ini- workgroup calibration and validation level with presenta- tiative identifies and invests in critical instrument, space- tions of future sensing strategies. craft, and information system technologies. Data Quality. Scientific working groups are reliable Development and Operations makes possible continuous, assessors of the validity of scientific activities. global observations from satellite-borne instruments. We have an integrated slate of spacecraft and in situ measure- Data Sources. An international Web site is maintained ment capabilities; data and information management sys- with information on the meeting calendar, membership, tems to acquire, process, archive, and distribute global subgroups, documentation and reports, and the main data; and research and analysis projects to convert data CEOS Plenary organization and meetings. It may be into knowledge about Earth. These satellites are driving a reached at http://www.wgcvceos.org/. new era of data collection, research, and analysis for Indicator 4. Demonstrate the establishment of an agreed which both the national and international Earth science international approach to an integrated global observing community has been preparing in the last decade. strategy for the oceans and the terrestrial carbon cycle NASA pursued a targeted research program focused on through participation in the Integrated Global Observing specific science questions. We make research strategies Strategy - Partners that lead to definitive scientific answers and to effective Results. The oceans and terrestrial carbon observing applications for our Nation. plans received approval and peer-reviewed journals pub- Research topics fall into three main categories: forcings, lished them. responses, and the processes that link the two, including Data Quality. Peer-reviewed publication is the most feedback mechanisms. The approach is particularly rel- relied-upon assessment of the validity of a scientific evant to climate change, a major Earth Science-related accomplishment. challenge facing our Nation and our world. Data Sources. An article describing this plan is Cihlar, Our questions focus the research and development of our Josef, R. et al., 2002. Initiative to Quantify Terrestrial observational programs, analysis, modeling, and Carbon Sources and Sinks. EOS, Transactions, American advanced technology activities: How is the Earth system Geophysical Union 83(1):1, 6-7. changing, and what are the consequences for life on Earth? How is the global Earth system changing? What Strategies and resources to achieve goals are the primary causes of change in the Earth system? NASA’s Earth science effort funds more than 1,500 sci- How does the Earth system respond to natural and entific research tasks nationwide. Foreign-funded scien- human-induced changes? What are the consequences of tists from 17 nations work with U.S. researchers. The changes in the Earth system for human civilization? How researchers develop Earth system models from Earth sci- can we predict future changes in the Earth system? ence data, conduct laboratory and field experiments, run We will measure results in terms of the progress made aircraft campaigns, and develop new instruments, all of toward answering these questions and extending the result- which expand our understanding of Earth. As we launch ing knowledge, data, and technology to serve society. the first series of EOS satellites, more resources are going While these questions will be answered over years, the toward research and analysis of the new data. FY 2002 activities focused on the forces acting on the The Earth science goals to key activities table shows the Earth system and its responses. NASA is pleased to play a relationships among strategic goals, strategic leadership role in research and development of space-based objectives, and key activities. The Earth science solutions to exploring and understanding our home, Earth. resource estimates table gives budget authority figures Cost-Performance Relationship for FY 1999 to FY 2002. In achieving the strategic goals shown in the mapping The Applications and Education Program bridges our Earth science goals to key activities table, during FY 2002, research, analysis, and mission science investments. We NASA incurred research and development expenses for seek to demonstrate new remote sensing data products the programs as follows. All of the resources went to for industry and regional and local decision makers. We research and development, and of this total approximately also educate non-traditional Earth science customers, 37 percent of resources was spent on basic research, 7 per- such as State, county, and regional managers and cent on applied research, and 56 percent on development. decision makers. For a description of the three research categories and a The Advanced Technology Program helps develop key summary of NASA’s total research and development technologies to enable future science missions. In addi- expenses, see the “Required Supplementary Stewardship tion to our baseline technology program that includes the Information—Stewardship Investments: Research and New Millennium Program, Instrument Incubator, and Development” schedule in Part III.

Part I • Highlights of Goals and Results 31 Mapping Goals and Objectives to Key Earth Science Activities

Strategic Goal Strategic Objective Key Activity

Observe, understand, and Discern and describe how the Earth is changing Development and Operations model the Earth system to (EOS, Earth Explorers), learn how it is changing, and Earth Science Research the consequences for life on Earth Identify and measure the primary causes of change in the Development and Operations Earth system (EOS, Earth Explorers), Earth Science Research Determine how the Earth system responds to natural and Development and Operations human-induced changes (EOS, Earth Explorers), Earth Science Research Identify the consequences of change in the Earth system for Development and Operations human civilization (EOS, Earth Explorers), Earth Science Research Enable the prediction of future changes in the Earth system Development and Operations (EOS, Earth Explorers), Earth Science Research

Expand and accelerate the Demonstrate scientific and technical capabilities to enable Applications and Education realization of economic and the development of practical tools for public and private- societal benefits from Earth sector decision makers science, information, and technology Stimulate public interest in and understanding of Earth Applications and Education system science and encourage young scholars to consider careers in science and technology

Develop and adopt advanced Develop advanced technologies to reduce the cost and Advanced Technology technologies to enable mission expand the capability for scientific Earth observation success and serve national priorities Develop advanced information technologies for processing, Advanced Technology archiving, accessing, visualizing, and communicating Earth science data Partner with other agencies to develop and implement better Applications and Education methods for using remotely sensed observations in Earth system monitoring and prediction

Resource Estimates of Key Earth Science Activities Budget Authority (in $ Millions) Key Activity FY 1999 FY 2000 FY 2001 FY 2002*

Development and Operations 974 970 911 801

Earth Science Research 252 286 350 339

Applications and Education 83 84 114 95

Advanced Technology 104 95 100 102

Institutional Support/Other 1 8 10 255

Total 1,414 1,443 1,485 1,592

*Beginning in FY 2002, Institutional Support is included in each Enterprise. FY 2002 reflects September Operating Plan.

Budget-Performance Relationship Earth system. NASA brings the vantage point of space to bear on these problems and with it the ability to integrate NASA’s budget for Earth science was $1.59 billion in observations with research and modeling to generate FY 2002. These resources enable NASA to carry out its knowledge products needed by decision-makers. three strategic goals. For this investment, NASA and its partners have made considerable progress in understand- With deployment of the EOS now underway, we are ing the Earth system. NASA’s Earth Science satellites, identifying organizations with the appropriate informa- research, and technology development are the Nation’s tion infrastructure to apply NASA’s Earth science results principal assets for studying patterns of change in the to help manage forest fires, coastal environments, and

32 NASA FY 2002 Performance and Accountability Report agriculture, infectious disease effects, aviation safety, Indicator 1. Prepare a Station research investigation on and hurricane forecasting. colloidal physics

The potential socioeconomic benefits of many of these Results. We prepared an experiment on fundamental applications are significant. For example, by minimizing physical properties of colloids, which are micron or sub- unnecessary emergency evacuation measures, improved micron, spherical particles, suspended in a liquid medium. hurricane predictions could provide as much as The experimental hardware arrived on the Station via the $40 million in cost savings for the Nation for each event. Shuttle (STS-100) and returned on STS-111. Researchers The value to our agriculture industry of an accurate finished nearly 80 percent of the experiment before hard- El Niño forecast is estimated at $320 million per year. ware issues halted work. Project engineers believe the fail- Similarly, improved weather forecasting can save as much ure was caused by a radiation event that damaged a mem- as $8 million for individual energy companies by enabling ory module that held the computer startup sequence. utilities to better plan for anticipated energy requirements. Data Quality. NASA’s Biological and Physical Research Our understanding of the Earth system is growing rapid- Advisory Committee evaluated progress toward this annu- ly, as is our technological capability to make new obser- al performance goal. While the committee cannot yet vations and turn them into useful information products. access the published results on this indicator, the commit- The next 20 years will be even more exciting for Earth tee received a briefing on the interim progress. science, and will witness the evolution of a global envi- Data Sources. Information is available at http:// ronmental monitoring capability that will enable region- spaceresearch.nasa.gov/research_projects/ros/pcs.html. al- and local-scale decisionmaking for a whole host of economic and societal endeavors. Indicator 2. Maintain a peer-reviewed research program in complex systems physics and chemistry We are giving our Nation a new window for looking at our home planet from the vantage point of space and use Results. Complex systems physics and chemistry the knowledge gained to benefit our Nation and society research was the fastest growing area in the Physical at-large in unprecedented ways. Sciences Research Program fluid physics discipline. It consisted of the subdisciplines of colloid science, complex fluids, and granular flows. Researchers explored the Biological and Physical Research behavior of fluids and complex systems using the special A key factor in improving life on Earth and extending it characteristics of microgravity in space. into space is a better understanding of how the ele- In FY 2002, fluid physics had 118 investigations. ments—living and inanimate—crucial to our lives Complex systems physics and chemistry research behave on Earth and in space. The conditions of space, accounted for 38 percent of those investigations, the particularly microgravity, allow us to examine funda- largest percentage of the total within the fluid mental phenomena—flame, cells, molecules—more physics subdisciplines. closely and accurately than on Earth. We bring what we learn back to Earth to improve our terrestrial lives. NASA funded 37 of the 202 research proposals received. Compiling data about the behavior of matter and organ- Thirty-two percent of these grants were in the complex isms in space will allow humans to live healthily and pro- systems area. ductively in space. Research in complex systems dominated early Station utilization in the physical sciences. Eight peer-reviewed Strategic Goal 2. Use the space environment as a investigations were developed for a variety of facilities laboratory to test the fundamental principles of including Expedite the Processing of Experiments to physics, chemistry, and biology Space Station (EXPRESS) rack, the Microgravity Science Glovebox, and the Light Microscopy Module in the Strategic Objective 1. Investigate chemical, biolog- Fluids Integrated Rack. ical, and physical processes in the space environment, in partnership with the scientific community Data Quality. NASA’s Biological and Physical Research Advisory Committee evaluated progress toward this Annual Performance Goal 2B4. Earn external review annual performance goal. rating of green or blue by making progress in the following research focus areas as described in the associated Data Sources. The source of information for this goal is indicators. Advance the scientific understanding of com- the 2002 Office of Biological and Physical Research plex biological and physical systems (OBPR) Taskbook located at http://research.hq.nasa. gov/code_u/nra/current/NRA-01-OBPR-08/index.html. The Biological and Physical Research Advisory Committee rated progress on this annual performance goal Annual Performance Goal 2B5. Earn external review as green. This goal was new in FY 2002. rating of green or blue by making progress in the following

Part I • Highlights of Goals and Results 33 research focus areas as described in the associated indi- proteins and 378 samples for 5 investigators. STS-111 cators: Elucidate the detailed physical and chemical delivered a STES/PCAM assembly containing 10 pro- processes associated with macromolecular crystal growth teins and 378 samples for 8 investigators. and cellular assembling processes in tissue cultures Another set of protein crystallization experiments consid- NASA’s Biological and Physical Research Advisory ered three-dimensional tissue cultures. Cells associate Committee rated progress on this annual performance goal in complex, three-dimensional groupings to form living as blue, or substantially exceeding planned performance. tissue. When researchers try to replicate this natural This goal was new in FY 2002. growth in ground-based laboratories, they find that the Indicator 1. Maintain a peer-reviewed research program cultivated cells form flat, thin specimens. Because these in macromolecular and cellular biotechnology specimens do not accurately represent cell behavior, they are of limited use to researchers. On the other hand, cells Results. The biotechnology discipline maintained the grown in microgravity grow three dimensionally and program, supporting about 50 investigations in cellular more closely resemble cells found in living bodies. The and macromolecular biotechnology. These numbers Cellular Biotechnology Operations Support System pro- accounted for 83 percent of the investigations in the disci- vides the first on-Station hardware dedicated to cultivat- pline compared with 83 percent in FY 2001. We started 23 ing cells which is used by multiple investigators to investigations in cellular biotechnology and 20 in macro- accomplish their scientific objectives. molecular biotechnology in FY 2002, all based on the peer-reviewed process, of which 29 represent new work. Cellular biotechnology experiments were completed on Station research Expeditions 3, 4, and 5. Among the cells Data Quality. NASA’s Biological and Physical Research grown on orbit were ovarian cancer cells, colorectal can- Advisory Committee evaluated progress toward this annu- cer cells, immune system cells, and liver cells. Analysis of al performance goal. these cells is under way. One Station experiment used Data Sources. The indicator data came from human tonsil tissue to model human immuno-deficiency the FY 2002 OBPR Research Taskbook located at virus. Human tonsil tissue that is used to grow the virus on http://research.hq.nasa.gov/taskbook.cfm. It will be avail- the ground in NASA-developed bioreactors exhibits able to the public by February 28, 2003. deficits in immune signaling. The space experiments used the same tonsil tissue to determine the effect of micro- Indicator 2. Prepare Station research investigations in gravity. These experiments will further explain the mech- protein crystallization and three-dimensional tissue culture anisms involved in the generation and synthesis of anti- Results. NASA conducts protein crystallization bodies. There is suggestive evidence that humans in space experiments in space to improve our understanding of the may exhibit the beginnings of a decline in immunity. structures of important proteins. That new understanding Data Quality. NASA’s Biological and Physical Research can help improve medical therapies or be used in other Advisory Committee evaluated progress toward this annu- applications. One example is the protein thaumatin. al performance goal. Thaumatin is a protein isolated from a West African plant. It is 2,000 to 3,000 times sweeter than sucrose, or sugar, Data Sources. Information on biotechnology research is and is an approved sweetener or flavor enhancer in Japan, available at the following Web sites: http://spaceresearch. the European Union, and the United States. A detailed nasa.gov/research_projects/ros/pcgstes.html and http://space understanding of the atomic structure of thaumatin may research.nasa.gov/research_projects/ros/ pcgegn.html. aid the development of artificial sweeteners. Thaumatin Increment 3 and 4 investigation abstracts are located at crystals obtained from the Enhanced Gaseous Nitrogen http://spaceresearch.nasa.gov/research_projects/ros/ Dewar on stage 2A.2b/3A and on stage 5A/5A.1 diffracted cboss.html and http://spaceresearch.nasa.gov/research_ to a higher resolution than any crystals ever grown on the projects/ros/cbosspast.html, respectively. ground. The space-grown crystals provided 50 percent more data than the best ground-grown crystals. Obtaining Strategic Objective 2. Develop strategies to maxi- improved crystals on two separate stages aboard the mize scientific research output on the Station and Station demonstrated the reproducibility of our results. other space research platforms In FY 2002, three Shuttle missions delivered protein crystallization experiments to the Station. STS-108 Annual Performance Goal 2B10. In close coordination with the research community, allocate flight resources to delivered the Single-locker Thermal Enclosure achieve a balanced and productive research program. System/Protein Crystallization Apparatus for Microgravity (STES/PCAM), which included 8 proteins NASA’s Biological and Physical Research Advisory and 753 samples (455 were solution optimizations Committee rated progress on this annual performance samples) for 5 investigators. STS-110 delivered the goal as green. This performance goal was new in Enhanced Gaseous Nitrogen Dewar, containing 10 FY 2002. Station research continued according to plan.

34 NASA FY 2002 Performance and Accountability Report We made substantial progress in prioritizing research and Results. The biological and physical research effort did conducted an extensive review to better define research not begin procurement activities for a nongovernmental management options. Although NASA did not begin pro- organization for Station research. In light of extensive curement activities leading to a nongovernmental organi- restructuring of Station development and a reprioritization zation for Station research as required on several indica- of planned Station research, the Agency chose to revali- tors, we merited a score of green because we made sub- date research requirements for the Station and to conduct stantial progress toward creation of an appropriate model an extensive review process to define Station utilization. for Station research management. Data Quality. NASA’s Biological and Physical Research Indicator 1. Assume management responsibility for the Advisory Committee evaluated progress toward this annu- Station research budget al performance goal.

Results. The biological and physical research effort Data Sources. The status of this effort will be updated assumed management responsibility for the Station on the following Web site as appropriate: http://space research budget and initiated quarterly reviews of relevant [email protected]. research capability development. Indicator 3. Coordinate scientific community participation Data Quality. NASA’s Biological and Physical Research in the definition of Station research Advisory Committee evaluated progress toward this annual performance goal. Results. We coordinated scientific participation in the definition of Station research through the Research Data Sources. NASA’s initial operating plan letter of Maximization and Prioritization Task Force, completion February 15, 2002, established the change in management of a National Research Council report on Station responsibilities. research, and through an open and competitive research Indicator 2. Begin procurement activities leading to a announcement process. nongovernmental organization for Station research Data Quality. NASA’s Biological and Physical Research Advisory Committee evaluated progress toward this annual performance goal.

Data Sources. The data sources are the Research Prioritization and Maximization Task Force report and a prepublication copy of the report of the National Research Council’s Task Group on Research on the Station.

Indicator 4. Balance resource allocations and flight opportunities through a Partner Utilization Plan

Results. We maintained a baseline partner utilization plan in FY 2002.

Data Quality. NASA’s Biological and Physical Research Advisory Committee evaluated progress toward this annual performance goal.

NASA improves the study of cell growth with microgravity Data Sources. The baseline partner utilization plan Human cell tissue research that could contribute to the study of cancer is available at http://iss-www.jsc.nasa.gov/ss/issapt/ and other diseases kept the Expedition 4 crew busy aboard the rpwg/01_01_ 17_PUP_Approved_by_SSUB.xls. International Space Station. Cell research using the Cellular Biotechnology Operations Support System is one of the most crew- intensive experiments. It requires injecting cells into 32 containers of Indicator 5. Prepare peer-reviewed and commercial nutrient solution, incubating them, and then periodically removing nutri- research investigations for execution on STS-107 ent solution for analysis and re-injecting fresh growth fluid. At the end of the experiment, the crew must stop growth and inject a preservative Results. Despite schedule slips for STS-107, NASA pre- into the cell containers. pared peer-reviewed and commercial research investiga- Cells grown on this mission include human renal cells, blood cells, and tions. The complete suite of experiments is located at tonsillar cells. In microgravity, cells can be cultivated into healthy, three- http://spaceresearch.nasa.gov/sts-107/index.html. dimensional tissues that retain the form and function of natural, living tissue. On Earth, studying normal growth and replication of human cell tis- Data Quality. NASA’s Biological and Physical Research sue outside living organisms is difficult, because most cells cultivated outside the body form flat, thin specimens that limit insight into the way Advisory Committee evaluated progress toward this annu- cells work together. al performance goal.

Part I • Highlights of Goals and Results 35 Data Sources. A review of about 80 STS-107 mission Data Quality. NASA’s Biological and Physical Research experiments is available at http://spaceresearch.nasa.gov/ Advisory Committee evaluated progress toward this annu- sts-107/index.html. al performance goal.

Indicator 6. Conduct early research on the Station Data Sources. Commercial space centers provided data, either directly or through their various reports such as pro- Results. Preceding indicators show preliminary results posals, business operating plans, and annual reports. The from Space Station experiments. NASA conducted more figures for FY 2002 are still estimates because the cooper- than 50 investigations in FY 2002, using 5 research racks. ative agreement year for the commercial centers ends on The Human Research Facility rack 1 supported human life October 31. Information about the centers is available at sciences investigations. It contained a mass spectrometer, http://spd.nasa.gov. ultrasound equipment, portable computer, workstation, and cooling stowage drawer. EXPRESS rack 1, activated on Indicator 2. Maintain a ratio of non-NASA funding to STS-100, supported two continuously powered acceleration NASA funding of not less than 3 to 1 during FY 2002 measurement experiments: the Microgravity Acceleration Measurement System and the Space Acceleration Results. The ratio of non-NASA funding to NASA fund- Measurement System. EXPRESS rack 2, activated in ing was about 1.4 to 1 in FY 2002; however, this ratio FY 2001, supported experiments such as colloids in space reflects an accounting change. Because of a change in the and zeolite crystal growth. EXPRESS rack 4, which we budget structure, NASA now includes funding for Station activated in August, supported the storage freezers, ARC- research equipment development as part of its contribu- TIC 1 and 2. EXPRESS rack 5 supported commercial tion. This change results from NASA’s efforts to improve research experiments. NASA activated the Microgravity management and accountability in Station research. If the Science Glovebox during Expedition 5 to support the ratio were calculated using the budget structure in place Solidification Using a Baffle in Sealed Ampoules experi- when this indicator was established, the ratio would be ment and Pore Formation and Mobility Investigation. very close to 3 to 1. In effect, the existing ratio was maintained as required by the indicator. NASA tracks this esti- Data Quality. NASA’s Biological and Physical Research mated ratio as a measure of the strength of commercial Advisory Committee evaluated progress toward this annu- participation in space research. NASA has firm figures for al performance goal. its expenditure, but is still collecting reports of funding by Data Sources. Reports on Station research are available commercial partners. The ratio will be reported in its final at http://spaceresearch.nasa.gov. form by January 15, 2003. Data Quality. NASA’s Biological and Physical Research Strategic Goal 3. Enable and promote commercial Advisory Committee evaluated progress toward this annu- research in space al performance goal. Strategic Objective 1. Provide technical support Data Sources. Commercial space centers provided for companies to begin space research progress data through reports such as proposals, business Strategic Objective 2. Foster commercial research operating plans, and annual reports. Information about the endeavors with the Station and other assets Commercial space centers is available at http:// spd.nasa.gov. Annual Performance Goal 2B11. Engage the commercial community and encourage non-NASA investment Indicator 3. Ensure that one of the 39 product lines cur- in commercial space research by meeting at least three of rently under investigation is brought to market, available four performance indicators. for commercial purchase, in FY 2002 In FY 2002, NASA’s Biological and Physical Research Results. Not one but two products came to market. The Advisory Committee rated progress on this annual per- Space Rose fragrance product that the Wisconsin Center formance goal as green. NASA met its performance for Space Automation and Robotics and its partner, targets for commercial research in space in FY 2001, International Flavors and Fragrances, discovered on FY 2000, and FY 1999. STS-95 appeared in a second product this fiscal year. Indicator 1. Maintain or increase non-NASA investment in Commercial center affiliate Flow Simulation Services commercial space research during the FY 2002 transition began marketing its Arena-flow software to the metal cast- from a Shuttle-based to a Station-based program ing manufacturing industry; it also has future applications in food and pharmaceutical production and in aerosol drug Results. Non-NASA investment to the commercial space delivery. NASA’s partners also made progress in several centers remained steady compared with FY 2001, record- other research areas including bacterial growth research ing a negligible 0.3 percent drop. and research on a drug to control bone loss.

36 NASA FY 2002 Performance and Accountability Report Data Quality. NASA’s Biological and Physical Research overcome limitations of gravity and enables new scien- Advisory Committee evaluated progress toward this tific discoveries. The program’s on-orbit focus includes annual performance goal. fundamental research, creating a knowledge base for future mission technologies, and returning tangible value Data Sources. International Flavors and Fragrances from investment in space. The ground-based program reported the marketing of the fragrance to NASA through supports experimental, theoretical, and numerical models their partners at the Wisconsin Center for Space that develop the foundation for the on-orbit program. Automation and Robotics. The Solidification Design Center reported Arena-flow’s marketing to NASA. Fundamental Space Biology. The Fundamental Biology Program, representing 11 percent of the major Commercial space centers provided data in the form of program budget, studies biological processes through on- proposals, business operating plans, and annual reports. orbit and ground-based research. The microgravity envi- Information about the centers is available at ronment of space offers an unparalleled environment for http://spd.nasa.gov. research on cell growth, tissues, and biology. Our Indicator 4. Enable at least 10 new, active industrial research has led to new strategies for probing disease partnerships to be established with the space product processes and developing medical countermeasures, and development commercial space centers has advanced our knowledge of cellular processes. Results. We gained 35 new industrial partners in Space Product Development. The Space Product FY 2002, easily surpassing our goal of 10. The companies Development Program had the smallest budget at 4 per- involved were active in a variety of fields including cent. It provides commercial researchers access to space technology development, human-interest proteins, paper for development of new or improved products and servic- products, education, and computer systems. Companies es for use on Earth. NASA and industry fund the commer- must give permission for their names to be available. cial space centers that perform biotechnology, agribusi- Otherwise, the information is proprietary. ness, and materials research. The commercial product goals include improved crop development, enhanced refin- Data Quality. NASA’s Biological and Physical Research ing processes for better fuel efficiency, improved drug Advisory Committee evaluated progress toward this annu- development, improved drug production rates, and al performance goal. advanced materials for hip or knee replacements that are more durable and less likely to be rejected by the body. Data Sources. Commercial space centers provided data, either directly or through reports such as proposals, busi- Cost-Performance Relationship ness operating plans, and annual reports. Information In achieving the strategic goals shown in the mapping about the centers is available at http://spd.nasa.gov. biological and physical research goals to key activities table, during FY 2002, NASA incurred research and Strategies and Resources to Achieve Goals development expenses for the programs as follows. All of The biological and physical research resource estimates the resources went to research and development, and of table gives budget authority figures for FY 1999 to this total approximately 29 percent was spent on basic FY 2002. research, 58 percent on applied research, and 13 percent on development. For a description of the three research In FY 2002, NASA’s biological and physical research categories and a summary of NASA’s total research and effort officially took over management and funding development expenses, see the “Required Supplementary responsibility for the Station Research Capabilities. This Stewardship Information—Stewardship Investments: increased the overall budget by 107 percent. Research and Development” schedule in Part III. Bioastronautics. Bioastronautics represented 15 per- Budget-Performance Relationship cent of the budget. It includes the Countermeasures and Advanced Human Support Technology Programs. The NASA’s budget for biological and physical research was Countermeasures Program identifies ways to prevent or $824 million in FY 2002. This includes funds to develop reduce the risks associated with living in space. The research equipment, support commercial space centers, Advanced Human Support Technology Program develops and provide grants to investigators for ground and flight new technologies and next-generation systems for research. In selecting investigations and projects to sup- humans in space. port—and ultimately for access to space—NASA follows peer-review processes to ensure the competitiveness and Physical Sciences Research. Physical Sciences quality of the research. NASA engages in substantial Research (previously the Microgravity Research cooperation with the National Institutes of Health and Program) represented 28 percent of the budget. other Federal Government entities with overlapping inter- Combining cutting-edge experimental facilities with ests in space research. NASA’s biological and physical long-duration access to low-Earth orbit allows NASA to research focuses on those investigations that require

Part I • Highlights of Goals and Results 37 Mapping Goals and Objectives to Key Biological and Physical Research Activities

Strategic Goal Strategic Objective Key Activity

Conduct research to enable Conduct research to ensure the health, safety, and Bioastronautics* safe and productive human performance of humans living and working in space habitation of space Conduct research on biological and physical processes to Physical Sciences Research enable future missions of exploration and Fundamental Space Biology

Use the space environment Investigate chemical, biological, and physical processes in Physical Sciences Research as a laboratory to test the the space environment, in partnership with the scientific and Fundamental Space fundamental principles of community Biology physics, chemistry, and biology Develop strategies to maximize scientific research output Space Product Development on the Station and other space research platforms

Enable and promote Provide technical support for companies to begin space Space Product Development commercial research in space research Foster commercial research endeavors with the Space Product Development Station and other assets Systematically provide basic research knowledge to Space Product Development industry

Use space research Advance the scientific, technological, and academic All opportunities to improve achievement of the Nation by sharing our knowledge, academic achievement and capabilities, and assets the quality of life Engage and involve the public in research in space. All

* In the FY 2002 structure, Bioastronautics was funded as separate elements: Biomedical Research and Countermeasures and Advanced Human Support Technology.

Resource Estimates of Key Biological and Physical Research Activities Budget Authority (in $ Millions) Key Activity FY 1999 FY 2000 FY 2001 FY 2002* Bioastronautics 85 87 100 120

Physical Sciences Research 114 109 130 228

Fundamental Space Biology 41 38 40 92

Space Product Development 15 14 14 32

Multi-User System and Support** 0 0 0 165

Institutional Support/Other 9 27 29 187

Total 264 275 313 824 *Beginning in FY 2002, Institutional Support is included in each Enterprise. FY 2002 reflects September Operating Plan. **Multi-User System and Support is a new category developed when the International Space Station Research Capabilities was transferred to Biological and Physical Research.

access to space or that are required to ensure a safe human Research Maximization and Prioritization Task Force presence in space. Thus, a primary output of the Nation’s recommended a series of priorities for Station research by investment in NASA’s biological and physical research is discipline. The task force review, based on past performance facilitating human presence in space. This presence in these disciplines as presented by NASA, as well as enables significant research outcomes as described above National Research Council progress reports, recommended as well as the pursuit of other national priorities. directions for our biological and physical research. NASA is applying these priorities to maximize return on resources. NASA recently requested that a NASA Advisory Council The Agency’s FY 2004 budget request is a first step in this task force review the Station research plan to recommend process, with planning expected to continue through priorities for maximizing return on research investment. The development of the FY 2005 budget request.

38 NASA FY 2002 Performance and Accountability Report Human Exploration and Development Data Quality. Mishap data accurately reflect perform- of Space ance, reflect achievements accomplished in FY 2002, and align with planned performance. To conduct space-based research that can improve life on Data Sources. Data were obtained from Program Earth, and to seek other forms of life far beyond Earth, we Requirements Control Board directives and the host must be able to safely travel into space and live there. The Center’s Program Management Council. Shuttle provides safe human access to space and the capability for launch and in-orbit repair of spacecraft that require Indicator 2. Achieve an average of eight or fewer flight human intervention. The Station provides an orbiting labo- anomalies per Space Shuttle mission. ratory where humans from many nations together conduct a Results. There were five flight anomalies on STS-108, multitude of precedent-breaking experiments, including eight on STS-109, seven on STS-110, and four on those that investigate how we withstand and adapt to space STS-111. This yields an average of six flight anomalies in conditions. The following are highlights of our FY 2002 FY 2002, well under the goal but slightly higher than the efforts to achieve key goals. The remainder of our goals, average in FY 2001. None of these flight anomalies hin- objectives, and achievements are discussed in Part II. dered mission success. Data Quality. Flight anomaly data accurately reflect per- Strategic Goal 2. Enable humans to live and work formance achievements in FY 2002. The reporting of both permanently in space individual and average mission results is consistent with reporting of past annual performance indicators. Strategic Objective 1. Provide and make use of safe, affordable, and improved access to space Data Sources. Data were obtained from Program Requirements Control Board directives and the Host Annual Performance Goal 2H6. Assure public, flight Center Program Management Council. crew, and workforce safety for all Space Shuttle operations. Strategic Objective 2. Operate the Station to The Space Shuttle Program continues its outstanding safe- advance science, exploration, engineering, ty record. Overall safety has steadily increased; since and commerce 1992, we have reduced estimated risks during launch by 80 percent and in-flight anomalies by 70 percent. The Annual Performance Goal 2H11. Demonstrate Space safety of the Space Shuttle Program team nationwide is Station Program progress and readiness at a level sufficient equally important. The program’s workplace is far safer to show adequate readiness in the assembly schedule. than the industry average and continues to improve. In FY 2002, NASA completed three missions to the Current safety performance for recorded injuries is 75 per- Station. Two other flights were delayed until early cent better than the industry average. We have enhanced FY 2003 because of Shuttle and ground-support equip- Kennedy Space Center security since the recent terrorist ment issues. Two of the completed missions were science attacks. The security enhancement involved the land, sea, missions, delivering experiments and racks of scientific and air assets of several Federal agencies. Daily contact equipment. The third NASA mission delivered the inte- between NASA test directors and payload integration grated truss segment and the mobile transporter that has managers and the willingness of the entire Kennedy team become the manipulator servicing system. For this per- to embrace the necessary changes eased the integration of formance goal, we earned a rating of green. the enhancements into Shuttle and payload processing operations. Other FY 2002 safety measures included Indicator 1. Conduct monthly status reviews to show matu- repairing a cracked hydrogen vent line on the mobile rity and preparation of flight readiness products. launch platform and small cracks on the orbiter’s main Maintaining 80 percent of defined activities are within propulsion system fuel flow liners. We earned an overall scheduled targets (green). rating of green for this performance goal. Results. The Space Station Program conducts progress reviews on the first Friday of every month and issues a Indicator 1. Achieve zero type A or B Mishaps in FY 2002. flight-readiness summary at the quarterly Program Management Councils. In FY 2002, more than 80 percent Results. There were no type A or B mishaps for the Space of the defined activities met scheduled targets. Shuttle Program this fiscal year. Type A mishaps are those that result in property, facilities, or equipment damages of Data Quality. A flight-readiness summary chart shows $1 million or more or in the death of a person. Type B the flight status of missions for the entire performance mishaps are those that result in property, facilities, or equip- period and product maturity and resolution of issues for ment damages between $250,000 and $1 million or in the planned missions more than 2 years from now. Given permanent disability of one or more persons, or the hospi- Station complexity and the number of integration tasks talization of three or more persons. This is a new indicator. required, significant cost, schedule, and technical

Part I • Highlights of Goals and Results 39 challenges have occurred, but workarounds and efficien- and further efforts to safely and effectively transfer civil cies have maintained the schedule. service positions and responsibilities to private industry. Data Sources. A flight-readiness summary for upcom- This is the first year for this metric. We achieved the per- ing flights is available under the annual performance goal formance indicators for extending the space flight 2H11 link at http://iss-www.jsc.nasa.gov/ss/issapt/pmo/ operations contract and developing privatization options. gprametrics.htm. In keeping with the terminology used in the President’s Management Agenda (PMA), future performance plans Annual Performance Goal 2H12. Successfully com- will refer to this activity as competitive sourcing. Our rat- plete 90 percent of the Station-planned mission objectives. ing for this performance goal is green. The Space Station Program completed 90 percent of the Indicator 1. Negotiate an extension of the Space Flight primary mission objectives during the three flights Operations Contract (SFOC) by the end of the fiscal year. launched during FY 2002. The objectives are set in the mission objectives letters for each flight, which include Results. The Government unilaterally exercised the first two utilization flights (UF1 and UF2) and the 8A two-year contract option on August 1, 2002. Bilateral assembly flight. During the UF1 flight, failure of a hose negotiations continue for additional changes to the con- prevented the crew from demonstrating the ability to tract. We expect to complete this contract change in transfer oxygen. The crew later accomplished the task on October 2002. flight 8A. Despite this setback, we earned an overall rating Data Quality. Space flight operations contract data accu- of green for this performance goal. rately reflect FY 2002 performance. Indicator 1. Achieve 90 percent on-orbit mission success Data Sources. The performance data were obtained for planned Station assembly and logistics activities on the from normal program reporting and from Mod 806 of Shuttle flights scheduled for FY 2002. This indicator is NASA contract NAS9-20000 dated August 1, 2002. determined from the sum total of the successfully accom- Indicator 2. Develop criteria and establish options with plished primary mission objectives divided by the total private industry on Shuttle privatization that assure con- number of mission objectives per year. tinued safe operation of the Space Shuttle. Engage aero- Results. The Space Station Program continues to exceed space contractor community in evaluation of options. 90 percent of its primary mission objectives. It also Results. A RAND Corporation-led task force of private- completed several get-ahead tasks during FY 2002 for sector business specialists identified business models suit- future missions. As noted in annual performance goal able for competitive sourcing of Shuttle operations, defined 2H11 above, despite many technical challenges, NASA requirements for success of each potential business model, was able to complete primary mission objectives because and evaluated the strengths and weaknesses of each model. of training, innovative workarounds, redundant or robust Among the task force’s findings are the following: system designs, and contingency planning. • Safe operations must remain the top priority. Data Quality. The data come from postflight reports, which document tasks completed during each flight. In •The transfer of civil service personnel to a private sec- addition to the mission primary objectives, the reports tor company has limited viability. identify the added tasks and the get-ahead tasks. There are •Market demand for the Shuttle exists, but is very limited. no data limitations. •Liability concerns affect Space Shuttle Program asset ownership, but not operations. Data Sources. The data are provided at URL http:// iss-www.jsc.nasa.gov/ss/issapt/pmo/gprametrics.htm •The Space Shuttle Program remains structured as a under the 2H12 link. They include postflight review development program that is not conducive to inde- reports for both UF1 and UF2 and the 8A assembly flight. pendent operation by a private firm. The study also found a tight linkage among the Shuttle, the Strategic Goal 3. Enable the commercial Station, and Space Launch Initiative Programs. Any major development of space decision in one program could profoundly affect the others. Strategic Objective 2. Foster commercial endeav- Further, a decision on the future of the Space Shuttle ors with the Station and other assets Program could significantly alter the options available for future human space exploration, not to mention potential Strategic Objective 3. Develop new capabilities for military space requirements. Each model comes with numer- human space flight and commercial applications ous strengths, weaknesses, and hurdles. We are reviewing all. through partnerships with the private sector A decision on a course of action is expected in February 2003.

Annual Performance Goal 2H21. Continue imple- Data Quality. Competitive sourcing data accurately mentation of planned and new Shuttle privatization efforts reflect performance and achievements in FY 2002.

40 NASA FY 2002 Performance and Accountability Report The Station also provides a platform for long-term observation of the Earth’s surface and atmosphere. Experience gained from using the Station will guide the direction of space exploration, which is crucial to our mission to explore, use, and enable the development of space for human enterprise.

The Station is in its final phase of assembly. With the key components provided by Canada, Russia, and the United States currently in orbit, the Station is already the most capable spacecraft ever deployed. We will continue to deploy the U.S. components through early 2004, after which components will primarily come from our partner nations. With the elements on orbit already exceeding performance expectations and with most of the remaining U.S. hardware now in final preparation at the launch site, vehicle design and development risk has largely been retired.

NASA identified potential Space Station Program cost overruns in FY 2002. We took steps to contain costs by limiting future growth while keeping core functionality. Note that budget reductions since FY 2001 reflect not only cost con- tainment, but also development activities coming to an end and the transfer of research funds beginning in FY 2002 to the Biological and Physical Research Enterprise.

Space Shuttle. The Shuttle, the most versatile launch vehicle ever built, is a science laboratory, a taxi and delivery van, a repair shop, and essential to the assembly and operational support of the Station. The Shuttle Program also launches numerous cooperative and reimbursable NASA upgrades the world’s most famous “eye in the sky” payloads owned by foreign governments and internation- In March 2002, the versatile Shuttle was a repair shop. Here, the Hubble al agencies. The primary goals of the program are to fly Space Telescope is docked in the bay of Shuttle Columbia. During this safely, meet the flight manifest, improve customers’ sup- space walk, Astronauts James Newman and Michael Massimino port, and improve the system. Reducing program costs at removed the Faint Object Camera to accommodate the new Advanced the same time is a continuing imperative. The program Camera for Surveys. Compared to the previous capability, this new camera covers twice the area and offers twice the sharpness. It is up to budget is stable and represents a continued restrained fis- five times more sensitive to light. By April, Hubble was treating the world cal approach. Vendor loss, high failure rates of aging to the most spectacular views of the universe yet. components, high repair costs of Shuttle-specific devices, and negative environmental impacts continue to pose sig- Data Sources. The performance data were obtained nificant challenges. from normal program reporting. The Space Shuttle Launch Services. The Launch Services Program pro- Competitive Sourcing Task Force report is available at vides two services: Payload Carriers and Support pro- http://www.rand.org/scitech/stpi/NASA/. vides technical expertise, facilities, and capabilities for payload buildup, test, and checkout and for integrating Strategies and resources to achieve goals and installing payloads into the launch vehicle. The human exploration and development of space goals Expendable Launch Vehicle Mission Support provides to key activities table shows the relationships among technical oversight of launch services, mission analysis, strategic goals, strategic objectives, and key activities. and feasibility assessments for NASA payload customers. It also identifies and makes available secondary payload International Space Station. The Station is a perma- opportunities. This budget is stable. nent human habitat in low-Earth orbit. It is a laboratory for basic and applied research into the limits of human Space Operations. Space Operations provides com- performance in space; the secrets of cell and develop- mand, tracking, and telemetry services between ground mental biology, plant biology, human physiology, com- facilities and flight vehicles, research and development to bustion science, materials science, and physics; and the adapt emerging technologies to NASA operational uncharted territories of space industry and commerce. requirements, and spectrum management for all NASA

Part I • Highlights of Goals and Results 41 missions. Reliable electronic communications are essen- upgrades that will improve Shuttle operations and prevent tial to the success of every NASA flight mission. obsolescence into the next decade. These efforts met performance and cost goals. The human exploration and development of space resource estimates table gives budget authority figures for To ensure the continued technical competence of its FY 1999 to FY 2002. especially skilled workforce, the Space Shuttle Program continued to explore a variety of changes in the way it Cost-Performance Relationship operates the Shuttle. One approach is competitive In achieving the strategic goals shown in the mapping sourcing—a key component of the President’s human exploration and development of space goals to key Management Agenda. The challenge is determining activities table, during FY 2002, NASA incurred research whether new arrangements can achieve greater safety and and development expenses for the programs as follows. reliability at a lower cost. Competitive sourcing could Nine percent of total resources were spent on research and reduce the number of NASA civil servants in operations. development, with the remaining 91 percent spent on other If contractor staff prove to be less expensive while equally expenses. Of the research and development resources, safety-conscious and reliable, this could free up resources about 64 percent were for basic research and for research and development. While this would not affect 36 percent for applied research; no resources went to devel- current Shuttle Program budgets, a private organization opment. For a description of the three research categories with greater flexibility to make business decisions that and a summary of NASA’s total research and development increase efficiency could reduce future cost growth. We expenses, see the “Required Supplementary Stewardship are revising the Integrated Space Transportation Plan, Information—Stewardship Investments: Research and which will provide an orderly transition from the Shuttle Development” schedule in Part III of this report. to a future vehicle. Budget-Performance Relationship The Space Shuttle Program continues its outstanding record of safety and customer support. Shuttle safety per- NASA’s human exploration and development of space formance has steadily increased in the past decade. Since effort continues to demonstrate safe, reliable performance 1992, estimated risks during launch have fallen 80 per- in support of Agency objectives, providing space trans- cent, and the number of Shuttle problems in flight has portation, accommodations, and other flight support at a dropped by about 70 percent. significantly lower annual cost than that of a decade ago. This helps us maximize funding for research. Shuttle Space Station Program annual funding requirements con- annual operations costs, including a continuing upgrades tinue to decline, reflecting the transition from a develop- effort that will safely carry the program into the next ment program to an operational one. Performance prob- decade, are roughly 40 percent less, and Space lems in FY 2001 resulted in major program changes and Communications costs roughly 50 percent less, than they content reductions, resolved through an aggressive plan were in the early 1990s. that radically changed program and financial management. In FY 2002, Congress appropriated $96 million less The Space Shuttle Program successfully completed four of than the President’s FY 2002 budget request. Yet the pro- seven flights planned for FY 2002. Safety concerns with gram is still on schedule for U.S. Core Complete in early orbiter main propulsion flow liners caused us to delay 2004 (adjusted for Shuttle launch delays) and began three flights until FY 2003. Because development costs for FY 2003 with unencumbered reserves. these flights are incurred over multiple years, there were no significant savings in FY 2002. The shift will result in In focusing on the U.S. Core Complete configuration and minor increases to budget requirements in later years. The working to resolve financial and management deficien- four missions accomplished in FY 2002 were fully suc- cies, the Space Station Program has developed sound doc- cessful, increasing research returns from the Station and umentation and cost-estimating techniques. Two inde- Hubble. These research returns would be impossible with- pendent review teams have now validated the Station life out the unique capabilities of the Shuttle to provide human cycle. NASA lacks previous significant experience in interaction in the delivery, assembly, and servicing of operating a space station. As cost estimates continually orbital systems. Given the reduced flights, the launch cost grew, other Agency programs were affected. The sound per pound for a pro rata share of the Shuttle Program in cost projections and management controls implemented FY 2002 would be twice that of the Titan IV, which has in FY 2002 will allow the Agency to make decisions with comparable lift capability. However, since there is no other greater confidence. system in the world that could have accomplished the Space Communications continued to provided reliable, Shuttle’s FY 2002 missions, it is not possible to assess high quality, cost-effective command, tracking, and price competitiveness. telemetry data services between the ground facilities and Cost plans, conducted by NASA, were maintained for flight mission vehicles at an annual cost of about half that development efforts and safety and supportability of a decade ago.

42 NASA FY 2002 Performance and Accountability Report Mapping Goals and Objectives to Key Human Exploration and Development of Space Activities

Strategic Goal Strategic Objective Key Activity

Explore the space frontier Invest in the development of high-leverage technologies Technology and to enable safe, effective, and affordable human/ robotic Commercialization Initiative* exploration* Conduct engineering research on the International Space Technology and Station to enable exploration beyond Earth orbit* Commercialization Initiative* Enable human exploration through collaborative robotic Launch Services missions Define innovative human exploration mission approaches* Technology and Commercialization Initiative* Develop exploration/commercial capabilities through Technology and private sector and international partnerships* Commercialization Initiative

Enable humans to live and Provide and make use of safe, affordable, and improved Space Shuttle, Launch work permanently in space access to space Services Operate the Station to advance science, exploration, Space Station engineering, and commerce Ensure the health, safety, and performance of humans Transferred to the Biological living and working in space and Physical Research Enterprise Meet sustained space communications and data systems needs while reducing costs Space Operations

Enable the commercial Improve the accessibility of space to meet the needs of Space Station, development of space commercial research and development Launch Services** Foster commercial endeavors with the Station and Space Station other assets Develop new capabilities for human spaceflight and Space Shuttle, Technology commercial application through partnerships with the and Commercialization private sector Initiative*

Share the experience and Engage and involve the public in the excitement and the Technology and benefits of discovery benefits of—and in setting the goals for—the exploration Commercialization Initiative* and development of space* Provide significantly more value to significantly more Space Station people through exploration and space development efforts Advance the scientific, technological, and academic Office of Space Flight, achievement of the Nation by sharing our knowledge, Technology and capabilities, and assets Commercialization Initiative*

*Denotes strategic objectives that do not have annual performance goals because of a general funding reduction and the cancellation of the Technology and Commercialization Initiative **Formerly called Payload and ELV (Expendable Launch Vehicle)

Resource Estimates of Key Human Exploration and Development of Space Activities Budget Authority (in $ Millions) Key Activity FY 1999 FY 2000 FY 2001 FY 2002*

Space Station 2,300 2,338 2,128 1,721

Space Shuttle 2,998 3,000 3,119 3,270

Launch Services 71 80 90 91

Space Operations 566 496 522 482

Institutional Support/Other 111 69 114 1,162

Total 6,046 5,983 5,973 6,726

*Beginning in FY 2002, Institutional Support is included in each Enterprise. FY 2002 reflects September Operating Plan.

Part I • Highlights of Goals and Results 43 In acquiring expendable launch vehicle launch services, we Indicator 2. Model high error probability contexts continued highly successful oversight that has resulted in and solutions 98 percent reliability. That is 3 percentage points above the predicted design reliability for these vehicles. In FY 2002, Results. We completed the initial matching of modeling all five NASA-managed launches were successful. This errors and results to full-mission simulations. We complet- avoided costs that would have accrued due to lost research ed and evaluated a simulation plan. This work was not results and the need for replacement spacecraft. completed in FY 2002, but, as it is of importance to the goal, the work will be continued and is expected to be completed in FY 2003. Aerospace Technology Data Quality. Mission performance data accurately NASA’s aerospace technology research improves life here reflect activities in FY 2002. on Earth in many ways, including making air travel safer and more convenient while reducing air and noise pollu- Data Sources. Performance assessment data are from tion. Moreover, this work advances NASA’s efforts to normal management reporting and are verified and vali- extend life beyond Earth by supporting development of bet- dated by program managers. ter access to space. In FY 2002, aerospace technology Indicator 3. Demonstrate loss of control and recov- efforts also helped enhance NASA’s programs to find life ery models beyond Earth by applying technology development to future space science programs. Results. An enhanced control and recovery simulation characterizes aircraft behavior under adverse and upset Strategic Goal 1. Revolutionize Aviation—Enable conditions. The simulation incorporates data from static the safe, environmentally friendly expansion and dynamic wind-tunnel tests for large angles of attack of aviation and sideslip and mathematical models of adverse and upset conditions. The results of this research will improve Strategic Objective 1. Increase Safety—Make a aircrew training for upset recovery and simulations for safe air transportation system even safer accident investigations. Annual Performance Goal 2R1. Complete the interim progress assessment utilizing the technology products of Data Quality. Mission performance data accurately the aviation safety program as well as the related aerospace reflect achievements in FY 2002. base research and technology efforts and transfer to indus- Data Sources. Performance assessment data are from try an icing CD-ROM, conduct at least one demonstration of an aviation safety-related subsystem, and develop at normal management reporting and are verified and vali- least two thirds of the planned models and simulations. dated by program managers. We met this annual performance goal by delivering a pilot Indicator 4. Flight demonstrate forward-looking turbu- training program, by demonstrating several safety-related lence warning systems subsystems, including the Aviation Weather Information Results. A research radar turbulence-warning system Program’s forward-looking turbulence detection system, with real-time hazard estimation algorithms has demon- and by completing the planned models and simulations. strated its promise to improve turbulence detection and For this performance goal, we achieved a rating of green. hazard estimation. In 20 flights conducted from 2000 Indicator 1. Complete a general aviation pilot survey through 2002 and with 43 turbulence encounter files collected, the system showed a probability of detecting severe Results. We developed two versions of the general avia- turbulence more than 30 seconds ahead of time at 81 per- tion pilot questionnaire: one for fixed-wing aircraft and cent and a nuisance alarm rate of 11 percent. We based our one for rotorcraft, both with emphasis on weather-related radar turbulence algorithms on current commercial radar safety issues. We analyze and send data from the surveys detection instruments for transport aircraft so that they to the air traffic management and air carrier decision-mak- could be used to retrofit those radar systems. ers. Through the surveys, pilots can report and raise issues regarding the national air system, and air traffic manage- Data Quality. Mission performance data accurately ment has the data to ensure that changes introduced to the reflect achievements in FY 2002. system are producing expected improvements. We compared the turbulence-warning system data with Data Quality. Mission performance data accurately true winds and loads, which were calculated from instru- reflect achievements in FY 2002. ments readings taken when the aircraft reached the site of the predicted turbulence. The survey pool includes corporate pilots, flight instructors, air medical operators, etc. We receive about 670 Data Sources. Performance assessment data are from completed surveys per month for a completion rate normal management reporting and are verified and vali- approaching 70 percent. dated by program managers.

44 NASA FY 2002 Performance and Accountability Report NASA develops new international aviation weather information network The international Aviation Weather Information Network (AWIN) provides critical information about potentially hazardous in-flight weather conditions. Before AWIN, pilots relied on preflight weather briefings and occasional in-flight pilot reports, but up to the minute forecasts in the cockpit were unavailable. NASA developed AWIN in partnership with the FAA, industry, and university researchers.

Indicator 5. Demonstrate a national aviation weather We helped flight test Honeywell’s broadcast-only, VDL information network (AWIN) capability (very high frequency (VHF) data link) Mode 2 ground stations and airborne receivers in one of our general aviation Results. Through cooperative agreements with industrial research aircraft. We consulted with ARNAV Systems in partners, we demonstrated four graphical weather displays evaluating its two-way VHF data link technologies. The for transport and general-aviation aircraft: (1) Honeywell’s FAA has selected both of these systems for its Flight Weather Information Network (with in-service evaluations Information Services Datalink policy. United Airlines’ in- by United Airlines) showed its ability to mitigate turbu- service evaluations of Honeywell’s Weather Information lence. (2) The Rockwell Enhanced Weather Radar system Network transport system included the first approved use demonstrated the display of uplinked weather service data of true Internet Protocol to a Federal Aviation Regulation combined with onboard radar data on a graphical weather 121 flight deck via sky phone technology. The crew used information system. (3) ARNAV Systems’ Weather Hazard a Skyphone, commonly found on commercial transport Information System for general-aviation aircraft showed aircraft for passenger telephony, with a dial up modem to the usability of its displays in both retrofit and new cockpit provide low-data-rate digital transfer of graphical weather installations. (4) Honeywell’s graphical weather informa- information. As mentioned in the results for indicator 5, tion for general aviation demonstrated its beneficial effect because of these collaborations with industry we reached on the pilot decision-making. For all of these technologies, our demonstration goal a year earlier than planned. we consulted with the developers during the design or testing phases and in some cases provided the research aircraft Data Quality. Mission performance data accurately for the tests. Overall, our collaboration with industry reflect achievements in FY 2002. allowed us to reach the target of demonstrating six Data Sources. Performance assessment data are from graphical weather display technologies a year earlier normal management reporting and are verified and vali- than planned. dated by program managers. Data Quality. Mission performance data accurately Indicator 7. Validate structural crash analysis tools reflect achievements in FY 2002. Results. A NASA Technical Memorandum entitled “Best Data Sources. Performance assessment data are from Practices in Crash Modeling and Simulation” describes normal management reporting and are verified and vali- experiences in developing dynamic finite-element crash dated by program managers. models, model execution, analytical predictions, test-data analysis, filtering procedures, and test-analysis correla- Indicator 6. Demonstrate a national AWIN data tion. This tool enables first-time users to avoid common link capability pitfalls in crash modeling. From the best practices, the authors generated models with dynamic finite-element Results. Four digital communications technologies codes (enhanced by the vendor for better crash simula- demonstrated in-flight the dissemination of graphical tion). The report includes examples of work that has been weather information to aircraft cockpit displays. Flight reviewed, evaluated, and presented to other Government demonstrations included the following: agencies, including the FAA and Army, and private

Part I • Highlights of Goals and Results 45 industry. The authors used both qualitative and quantita- the training program. Most not only praise the quality of tive test-analysis correlations to evaluate the crash models. the training, but also have incorporated it into their train- The efficiencies documented could reduce costs for users ing programs. 10 to 25 percent. Data Quality. Mission performance data accurately Data Quality. Mission performance data accurately reflect achievements in FY 2002. reflect achievements in FY 2002. Data Sources. Performance assessment data are from Data Sources. Performance assessment data are from normal management reporting and are verified and vali- normal management reporting and are verified and validated by program managers. dated by program managers. The basis for the information contained in the training pro- Indicator 8. Complete an interim integrated program is flight and wind-tunnel studies of the effects of ice gram assessment accretion on lifting surfaces, NASA-developed computer codes that predict aircraft response to ice accretion, and Results. Our most recent assessment of the Aviation NASA pilot experience. For more information about the Safety Program shows it to be on track for developing icing research program, see http://icebox.grc.nasa.gov/. technologies that, when fully implemented, can reduce the fatal accident rate. During the assessment, we determined Indicator 10. Develop a methodology for the design and the technical development and implementation risk for verification of task driven human automation systems synthetic-vision systems, weather accident prevention, Results. Researchers developed a mathematical proce- system-wide accident prevention, and accident mitigation dure for verifying the correctness of the interfaces (dis- products. We also determined the safety benefit, using risk plays, etc.) between humans and automation products on as a metric, for selected synthetic vision and system-wide the flight deck of an aircraft. They focused on whether accident prevention products. The assessment showed the information provided in cockpit displays, user manuals, technical risk to be significantly lower today than it was and training was adequate to perform tasks. Researchers during a previous assessment and that implementation risk developed a systematic methodology and algorithm for has progressed. generating displays. Designers of aviation and air-traffic Data Quality. Mission performance data accurately control systems can use the methodology to ensure that reflect achievements in FY 2002. Technical development human-automation interfaces are free of design errors. risk assessment considered technology advancement, sta- Data Quality. Mission performance data accurately tus, complexity, and dependencies. Implementation risk reflect achievements in FY 2002. considered certification impacts, dependencies, market penetration, and market impacts. Data Sources. Performance assessment data are from normal management reporting and are verified and vali- Data Sources. Performance assessment data are from dated by program managers. normal management reporting and are verified and validated by program managers. For more information about the methodology, see “On Abstractions and Simplifications in the Design of Human- Indicator 9. Develop and distribute a CD-ROM self-paced Automation Interfaces,” NASA/TM-2002-21397. icing training module for pilots Indicator 11. Complete validation of new perceptual Results. We developed a self-paced, computer-based measurement tools for evaluating display effectiveness as training program that presents student and professional it supports human performance pilots with operational information and tools to detect and avoid ice and minimize exposure to it. The training pro- Results. Researchers developed and validated six new gram describes the effects of icing on aircraft perform- tools for studying the sensory and motor actions of a ance, control upsets (wing and tail stalls), and recovery human operator (pilot or controller) when interacting with procedures. Ice-accretion images, pilot testimonials, ani- the displays and controls of aviation and air-traffic-control mation, case studies, and interactive demonstrations sup- systems. A new experimental methodology and perform- plement the information. Interactive exercises help users ance metric called oculometrics uses eye movement to test their understanding of the key points. This training estimate an operator’s perceptual and cognitive state. program complements the earlier instructor-led icing Oculometrics can be used to monitor air-traffic-control training released in videotape in 2000. NASA collaborat- performance and to train general-aviation pilots in see- ed with the FAA, Air Line Pilots Association, and and-avoid scenarios. A software-based, real-time virtual University of Oregon for this production. Organizations, audio rendering system called Sound Lab, allows including U.S. and European airline operators, Cessna researchers to study spatial hearing in virtual simulations. Aircraft Co., Transport Canada, United Express, Ohio A text readability metric predicts the effect of a textured Civil Air Patrol, and the U.S. Army Safety Center, received background on the readability of transparent text. This tool

46 NASA FY 2002 Performance and Accountability Report is already improving new displays using text and symbols the information technology research into the Computing, overlaid on maps and images with textured backgrounds. Information, and Communications Technology Program Metrics and models of range and closure perception pre- (which focuses its efforts on the pioneer technology inno- dict human performance during tasks that require depth vation goal), this work was deemed not of significant pri- perception and control. A computational model, designed ority to warrant its continuation. for use in a virtual environment (for example, an airport tower) as experienced through a head-mounted display, Data Quality. Not applicable. predicts motion artifacts. A technique anticipates head Data Sources. Not applicable. motion to reduce latency (the time it takes the computer to display the correct image after it detects head motion) in Indicator 14. Assess the electromagnetic impact on critical virtual environment applications. flight control hardware through physics-based modeling of electromagnetic fields Data Quality. Mission performance data accurately reflect achievements in FY 2002. Results. A three-dimensional, physics-based computa- Data Sources. Performance assessment data are from tional electromagnetic code provides an accurate, safe, normal management reporting and are verified and vali- and cost-effective method for assessing the effect of light- dated by program managers. ning and other electromagnetic interference on aircraft structures and avionics systems. The code is a hybrid For more information about psychological and physiolog- finite-element/finite-difference transient code from the ical stressors and factors, see http://vision.arc.nasa. Parallel Scientific Computing Institute at Uppsala gov/PPSF/. University in Uppsala, Sweden, and the Royal Institute of Indicator 12. Generate initial model for flight crew sched- Technology in Stockholm, Sweden. The code solved the uling assistant based on sleep and circadian cycles problem, a structured, finite-difference Cartesian grid with 1 billion cells constructed for a Saab 2000 aircraft, on a Results. Researchers developed a bio-mathematical massively parallel computer cluster at NASA Langley. model and algorithm to predict flight crew alertness and performance during commercial long-haul flights. Data Quality. Mission performance data accurately Researchers gathered sleep and circadian (or 24-hour) reflect achievements in FY 2002. rhythm variables and light measurements of pilots at vari- Data Sources. Performance assessment data are from ous times throughout long-haul flights. The model is a first normal management reporting and are verified and vali- step in developing a software-based program that will help dated by program managers. commercial airlines predict the effect of acute sleep loss, cumulative sleep loss, and circadian rhythm disruption on Indicator 15. Develop concepts for advanced sensory flight crew behavior, performance, and alertness. materials and for embedding sensors into aerospace struc- Commercial airlines will be able to use the Scheduling tural materials Assistant software to plan flight crew schedules and to help minimize fatigue-related problems during long haul flights. Results. We developed prototype inductor piezoelectric sensors that can be embedded in structural materials and a Data Quality. Mission performance data accurately new concept for coupling to embedded optical fiber sen- reflect achievements in FY 2002. sors. Compared with traditional surface-mounted sensors, Researchers assured model quality by integrating data col- embedded sensors offer numerous advantages. These lected over many years in tightly controlled laboratory include protection of the sensors from damage, integration experiments and field studies conducted by leading of the sensors during manufacture rather than as costly researchers in the fatigue and modeling fields. add-ons, and avoidance of material surface modification. Data Sources. Performance assessment data are from In addition, several concepts for embedding integral vehi- normal management reporting and are verified and vali- cle health monitoring sensors into aerospace structural dated by program managers. materials have been developed, and some preliminary tests have been performed. If successful, these concepts will For more information about NASA’s research on fatigue enable the development of embedded sensors in future countermeasures, see http://olias.arc.nasa.gov/zteam/. aerospace vehicles. Indicator 13. Demonstrate prototype technologies for an The novel fiber-optic concept results in significant reduc- aviation safety information system tion in complexity and 50-percent cost reduction for Results. No research was conducted to support this indi- embedding sensor systems into aerospace structural cator. As planned in FY 2000, this indicator was support- materials. The concept also has the potential to ed by activities in the information technology program. As benefit aircraft safety by reducing catastrophic failure of a result of FY 2001 replanning activities to integrate all of the airframe.

Part I • Highlights of Goals and Results 47 Data Quality. Mission performance data accurately methodologies and tools to manage the technology portfo- reflect achievements in FY 2002. lio actively to support a full-scale development decision. Data Sources. Performance assessment data are from Data Sources. Performance assessment data are from nor- normal management reporting and are verified and vali- mal management reporting and are verified and validated dated by program managers. by program managers. For further information about our activities, see http://sli.msfc.nasa.gov/. Strategic Goal 2. Advance Space Transportation— Indicator 2. Conduct interim architecture review to estab- Create a safe, affordable highway through the air lish the candidate space transportation architectures and into space Results. The SLI has completed its first milestone review, Strategic Objective 1. Mission Safety—Radically resulting in a reduced number of candidates for the sec- improve the safety and reliability of space ond-generation reusable space transportation system. The launch systems initial architecture technology review analyzed and evalu- Annual Performance Goal 2R6. NASA’s investments ated competing architectures and technologies against emphasize thorough mission needs development, NASA and commercial mission requirements. requirements definition, and risk reduction effort leading to commercially owned and operated launch systems to Data Quality. Mission performance data accurately meet NASA needs with commercial application where reflect achievements in FY 2002. possible. The annual performance goal is to complete risk Data Sources. Performance assessment data are from reduction and architecture reviews to support design and demonstration decisions. normal management reporting and are verified and validated by program managers. For more information about We achieved a rating of green for this annual performance the reviews, see the initial architecture technical goal by successfully completing the risk-reduction and review press release at http://www1.msfc.nasa.gov/ architecture reviews and the using those reviews to identi- NEWSROOM/news/releases/2002/02-108.html. fy the most viable architectures and technology investments. Although the Space Launch Initiative (SLI) treats Strategic Objective 2. Mission Affordability— safety and cost as separate elements, the risk reduction Create an affordable highway to space review covered both. Therefore, the results for indicators 1 and 2 of annual performance goals 2R6 and 2R7 are Annual Performance Goal 2R7. NASA’s investments the same. emphasize thorough mission needs development, requirements definition, and risk-reduction effort leading Indicator 1. Conduct risk reduction review to commercially owned and operated launch systems to meet NASA needs with commercial application where Results. The SLI regularly conducts risk-reduction reviews possible. The annual performance goal is to complete to determine if the program is ready to proceed to the next risk-reduction and architecture reviews and initial development phase. We reviewed every program element, hardware demonstrations to support design and including all technology projects and the Architecture demonstration decisions. Definition Office. All reviews were completed in March We met this annual performance goal by successfully 2002. Ongoing monthly and quarterly reviews monitor the completing the risk reduction and architecture reviews and program’s overall state of health. The monitoring allows the by the using these reviews to identify the most viable program manager to redirect or even cancel project architectures and technology investments. We achieved a activities as needed to optimize performance. rating of green for this performance goal. Although the Data Quality. Mission performance data accurately strategic launch initiative treats safety and cost as separate reflect achievements in FY 2002. elements, the risk reduction review covered both. Therefore, the results for indicators 1 and 2 of annual per- The performance data regularly collected and assessed formance goals 2R6 and 2R7 are the same. directly correlates to program work breakdown structure elements, which, in turn, correlate to specific program and Indicator 1. Conduct risk reduction review project goals. These data include resource-loaded logic Results. See annual performance goal 2R6, indicator 1. schedules, cost performance reports (earned value management), and financial reports. Project offices assess Data Quality. See annual performance goal monthly data using analysis tools for earned-value man- 2R6, indicator 1. agement. As a crosscheck, the program office independ- Data Sources. See annual performance goal 2R6, ently assesses these data and may adjust priorities, indicator 1. reallocate resources, or take other appropriate action to ensure that risk-reduction investment is sound. The Indicator 2. Conduct interim architecture review to estab- program developed a risk and cost plan based on lish the candidate space transportation architectures

48 NASA FY 2002 Performance and Accountability Report Results. See annual performance goal 2R6, indicator 1. Data Sources. Performance assessment data are from normal management reporting and are verified and vali- In addition, the program added RP (hydrocarbon) propul- dated by program or project managers. The project office sion investments, guidance for a study of booster jet- maintains the board minutes and tracks the closure of all back propulsion, realigned the airframe project to discrepancies and action items. accelerate metallic tank development, and reduced the avionics investments. Indicator 5. Demonstrate reaction transfer molded polymer matrix composite with 550 degrees Fahrenheit Data Quality. Mission performance data accurately use temperature reflect achievements in FY 2002. Results. This effort was deferred as a result of a repriori- Data Sources. Performance assessment data are from tization that required work to be performed in other pro- normal management reporting and are verified and vali- gram areas. Polymer matrix composite development is dated by program managers. important to the goal, however, and we expect to complete this indicator in FY 2003. Indicator 3. Demonstrate advanced adhesives for nonautoclave composite processing Data Quality. Not applicable.

Results. A new class of high-flow adhesives, Data Sources. Not applicable. phenylethynyl terminated imides, which can be processed using only a vacuum bag and oven, has demonstrated Strategies and resources to achieve goals excellent adhesive strengths. The tensile-shear strength The aerospace technology goals to key activities table for titanium-to-titanium bonds was 6,200 pounds per shows the relationships among strategic goals, strategic square inch at 350 degrees Fahrenheit and for composite- objectives, and key activities. In FY 2002, the Aerospace to-composite bonds, 2,300 pounds per square inch at the Research and Technology Program consisted of five basic same temperature. The goal of this research is to produce research programs and six focused programs. The basic a strong, high-strength adhesive that does not require the research programs develop advanced concepts, physics- use of an autoclave (or high-pressure furnace). The based understanding of aerospace phenomena, validated advantage of the nonautoclave processing of large pieces models and design tools, design and manufacturing aids (such as a cyrotank) is that they can be processed at much and processes, and aerospace and multidiscipline technolo- lower manufacturing cost (that is, space, time, equipment, gies. These programs are not specific to any mission, user, materials, labor, etc.) yet provide comparable perform- vehicle, or other application. By contrast, the focused pro- ance and reusability. grams develop and adapt basic research products for mis- Data Quality. Mission performance data accurately sion and other applications to the point that they are ready reflect achievements in FY 2002. for transfer to a user. The five basic research programs are: Data Sources. Performance assessment data are from normal management reporting and are verified and vali- The Computing, Information, and Communications dated by program managers. Technologies Program develops computing technologies for mission planning and scheduling; aerospace plat- Indicator 4. Complete system requirements review on forms; avionics software; deep-space mission control and rocket-based combined-cycle demonstrator engine monitoring; and space-communications network develop- Results. The system requirements review board for the ment and data analysis. A number of previously inde- rocket-based combined cycle demonstrator engine identi- pendent budget line items, including information technol- fied 135 discrepancies and proposed solutions at its initial ogy base, design for safety, bio-nanotechnology, aero- meeting. The board met in September for final review and space autonomous operations, and intelligent systems, are disposition of all discrepancies. The board also directed now within this program. the project to conduct another review, when work resumes The Vehicle Systems Technology Program develops aero- on the flight-test engine, to consider data generated by the nautics, space transportation, spacecraft, and science sens- ground test engine project. With the completion of this ing systems technologies. Emphasis areas are conceptual activity, the project will proceed with ground test engine design, aerodynamic and structural design and develop- preliminary design. ment, smart materials and structures, flight crew station design, systems design and testing, and third-generation Data Quality. Mission performance data accurately space transportation. reflect achievements in FY 2002. The review board’s database contains the discrepancy item, the proposed solution Aerospace Propulsion and Power Technology Program of the reviewer, developer comments, and the disposition research focuses on maintaining U.S. superiority in of the item. engine technology and ensuring the long-term

Part I • Highlights of Goals and Results 49 environmental compatibility, safety, and efficiency of The Quiet Aircraft Technology Program is developing propulsion systems. It addresses critical propulsion tech- technologies to further reduce noise around airports. The nology needs, including advances in conventional aero- program addresses both mechanical and operations tech- propulsion and unconventional propulsion technologies niques to reduce noise. Achieving the noise reduction goal such as fuel-cell-based propulsion, high-temperature nano- will facilitate the projected growth in air travel while offer- materials, and self-adapting, efficient engine components. ing the potential to reduce the associated noise impact. The Flight Research Program conducts NASA’s atmospheric flight research. The program promotes technology The Second Generation Returnable Launch Vehicle innovation, discovery of new phenomena, and the devel- Program is developing technologies to reduce the techni- opment of new aerospace concepts. The program flight- cal, programmatic, and business risks of developing a tests experimental aircraft and tools to validate them a in safe, reliable, and affordable second generation returnable a realistic environment. launch vehicle. The program will invest in design and development leading to at least two vehicle options for a The Space Transfer and Launch Technology Program mid-decade competition. develops and ground-tests technologies to meet the requirements of future launch systems: lower cost and higher reliability and performance. The program will The aerospace technology resource estimates table gives bring these technologies to a point of readiness levels at budget authority figures for FY 1999 to FY 2002. which NASA missions and industry can adopt them. The six focused programs are: Cost-Performance Relationship The Aviation System Capacity Program supports the strategic objective of “while maintaining safety, double the avia- In achieving the strategic goals shown in the mapping tion system throughput in all weather conditions within 10 aerospace technology goals to key activities table, during years, and triple it within 25 years.” The program develops FY 2002, NASA incurred research and development technology that will enable safe increases in airport capaci- expenses for the programs as follows. All of the resources ty through modernization, air traffic management improve- went to research and development, and of this total more ments, and new vehicles that can reduce congestion. than 99 percent was spent on applied research. Less than half of 1 percent was spent on development, and no The Aviation Safety Program works to improve aviation resources were spent on basic research. For a description of safety as measured by aircraft accident and fatality acci- the three research categories and a summary of NASA’s dents involving weather, controlled flight into terrain, total research and development expenses, see the “Required human-error, and mechanical or software malfunctions. The Supplementary Stewardship Information—Stewardship program emphasizes not only accident-rate reduction, but Investments: Research and Development” schedule in Part also reducing the number of injuries and fatalities in acci- III of this report. dents that do occur. The program works in close partnership with the FAA to implement research results and collabo- rates with the DOD and other Government agencies. Budget-Performance Relationship The Ultra-Efficient Engine Technology Program develops In FY 2002, the aerospace technology programs were engine technologies to enable a new generation of high- separated into two groups: focused technology and base performance, operationally efficient arates. Research and research and technology. The base research and technolo- technology development addresses and economical, reli- gy programs explore technology concepts and each pro- able, and environmentally compatible U.S. aircraft. The gram support a number of goals and strategic objectives. focus is on propulsion components and high-temperature In FY 2002, the aerospace technology effort had $1.5 bil- engine materials. lion budgeted to support the goals and objectives. The The Small Aircraft Transportation System Program devel- base research and technology programs (Aerospace ops new operating capabilities for small aircraft. One such Vehicle Systems Technology, Aerospace Propuylsion and capability is a precision guidance system that will work for Power, Flight Research, and Rotorcraft) accounted for 28 virtually any small airport “touchdown zone.” The objec- percent of the budget to support all of the goals and objective is to facilitate use of underutilized airports (such as tives through concept exploration. The revolutionize avi- those without control towers) and underutilized airspace ation goal accounted for 18 percent of the budget as sup- (such as the low-altitude, nonradar airspace below 6,000 ported by the Aviation System Capacity, Aviation Safety, feet). Such technologies could create alternatives for Ultra Efficient Engine Technology, Small Aircraft addressing the nation’s unmet transportation demand, Transportation System, and Quiet Aircraft Technology which reveals itself in increased highway congestion and Programs. The advanced space transportation goal airport delays. accounted for 37 percent of the budget and was

50 NASA FY 2002 Performance and Accountability Report Mapping Goals and Objectives to Key Aerospace Technology Activities

Strategic Goal Strategic Objective Key Activity

Revolutionize Aviation— Increase Safety—Make a safe air Aviation Safety Technology; Computing, Information, Enable the safe, transportation system even safer and Communication Technology; Propulsion and environmentally friendly Power; Vehicle Systems Technology expansion of aviation Reduce Emissions—Protect local Ultra-Efficient Engine Technology, Propulsion and air quality and our global climate Power, Vehicle Systems Technology Reduce Noise—Reduce aircraft Quiet Aircraft Technology, Propulsion and Power, noise to benefit airport neighbors, Vehicle Systems Technology the aviation industry, and travelers Increase Capacity—Enable the Aviation System Capacity; Computing, Information, and movement of more air passengers Communication Technology; Vehicle Systems with fewer delays Technology Increase Mobility—Enable people Small Aircraft Transportation System, Vehicle Systems to travel faster and farther, Technology anywhere, anytime

Advance Space Mission Safety—Radically improve Second Generation Returnable Launch Vehicle; Transportation—Create a the safety and reliability of space Computing, Information, and Communication safe, affordable highway launch systems Technology; Space Transfer and Launch Technology through the air and into space Mission Affordability—Create an Second Generation Returnable Launch Vehicle l; affordable highway to space Computing, Information, and Communication Technology; Propulsion and Power; Vehicle Systems Technology; Space Transfer and Launch Technology Mission Reach—Extend our reach Propulsion and Power, Space Transfer and Launch in space with faster travel times Technology

Pioneer Technology Engineering Innovation—Enable Computing, Information, and Communication Innovation—Enable a rapid, high-confidence, and cost Technology; Flight Research; Propulsion and Power; revolution in aerospace efficient design of revolutionary Vehicle Systems Technology; Space Transfer and systems systems Launch Technology Technology Innovation—Enable Computing, Information, and Communication fundamentally new aerospace Technology; Propulsion and Power; Vehicle Systems system capabilities and missions Technology; Space Transfer and Launch Technology

Commercialize Technology— Commercialization—Facilitate the Aviation Safety Technology; Aviation System Capacity; Extend the commercial greatest practical utilization of Ultra-Efficient Engine Technology; Small Aircraft application of NASA NASA know-how and physical Transportation System; Quiet Aircraft Technology; technology for economic assets by U.S. industry Second Generation Returnable Launch Vehicle; benefit and improved quality Computing, Information, and Communication of life Technology; Flight Research; Propulsion and Power; Vehicle Systems Technology; Space Transfer and Launch Technology

Space Transportation Utilize NASA’s Space Second Generation Returnable Launch Vehicle Management—Provide Transportation Council in commercial industry with the combination with an External opportunity to meet NASA’s Independent Review Team to future launch needs, including assure Agency-level integration human access to space, with of near- and far-term space new launch vehicles that transportation investments promise to dramatically reduce cost and improve safety and reliability. (Supports all objectives under the Advance Space Transportation Goal) supported by the Second Generation Reusable demonstrate based on an established schedule and finan- Launch Vehicle and Space Transfer and Launch cial resources. The progress of each program was moni- Technology Programs. tored quarterly by an Agency status review and by a yearly independent implementation review. These reviews did In FY 2002, the aerospace technology effort assessed its not identify any management issues that would jeopardize progress to the goals by rigorous evaluation of the pro- the deliverables within the established schedule and cost. gram deliverables against the program plans. For each The FY 2002 activities and technologies that were neces- focused program, a program commitment agreement sary to demonstrate progress toward the strategic goals specified the performance and what the program would were accomplished within the allocated budget.

Part I • Highlights of Goals and Results 51 Resource Estimates of Key Aerospace Technology Activities Budget Authority (in $ Millions) Key Activity FY 1999 FY 2000 FY 2001 FY 2002*

Aviation System Capacity 54 63 68 94

Aviation Safety 21 64 71 86

Ultra-Efficient Engine Technology 0 68 48 50

Small Aircraft Transportation System 0 0 9 16

Quiet Aircraft Technology 0 18 20 20

Second Generation Reusable Launch Vehicle 0 0 272 465

Aerospace Vehicle Systems Technology 138 149 152 157

Aerospace Propulsion and Power 75 78 85 95

Computing, Information, and Communication 67 74 118 195

Space Transfer and Launch Technology 64 95 77 70

Space Base NASA Research Announcement 0 0 40 40

Flight Research 64 71 83 82

Rotorcraft 27 27 32 13

Institutional Support/Other 829 418 329 1,166

Total 1,339 1,125 1,404 2,549

*Beginning in FY 2002, Institutional Support is included in each Enterprise. FY 2002 reflects September Operating Plan.

Data Verification and Validation sory committees established under the Federal Advisory Committee Act, including the NASA Advisory Council and NASA is committed to ensuring that its performance data the Aerospace Safety Advisory Panel and their subcommit- are reliable and verifiable. Data credibility is crucial to our tees. Hundreds of science, engineering, and business experts efforts to manage for results and to be accountable. on these committees provide external input on management, Therefore, we evaluate our performance in developing and programs, strategic plans, and performance. Advisory com- providing products and services at all levels, from the mittees explicitly review and evaluate performance data, Agency level to individual program and project levels. integrating quantitative output measures and taking into Each level is responsible for monitoring and reporting account considerations of safety, quality, results, and risk. results. Whenever performance fails to meet plan, we iden- NASA presented much of the results described in this report tify strategies for reengineering and continual improve- to these advisory committees for review. NASA also relies ment. In cases where performance poses a major concern, on periodic evaluations from specially convened panels of we conduct special evaluations and institute targeted miti- experts and from external organizations such as the National gation programs. We then carefully examine the results of Academy of Sciences and the General Accounting Office such programs to guide planning and budget decisions. (GAO). An independent accounting firm, Pricewater- NASA also relies on external reviews. These include an houseCoopers, audited the financial statements. They also extensive peer-review process in which panels of outside obtained an understanding of the design of significant scientific experts ensure that science research proposals are internal controls surrounding the performance measures selected strictly on the merits of the research plan and highlighted in the FY 2002 report. Their findings appear expected results. We rely on a broad, diverse system of advi- in Part III.

52 NASA FY 2002 Performance and Accountability Report Actions Planned to Achieve Key Unmet Goals

Despite a year of many successes, two events adversely the European Space Agency will help provide much of the affected our ability to achieve our goals. One was the loss information we had expected to achieve from CONTOUR. of the CONTOUR mission, the other the decision not to fly In addition, in the future we hope to conduct other missions all of the scheduled Shuttle missions. Fortunately, we will to other comets and primitive bodies. In FY 2003, NASA be able to recover from both of these. The Stardust mission will fly three Shuttle missions that we delayed in FY 2002 and the Rosetta mission that we are conducting jointly with because of safety concerns about the fuel flow liner. Looking Forward

As at every Federal agency, in planning how to achieve caliber is not guaranteed. In recent years, the number of our mission, we at NASA must take into account what we U.S. undergraduate and graduate students in science and think will happen in the future. Some future events and engineering has declined. Further, many graduates in conditions will advance our efforts; others may work these fields come from other countries and return home against us. Some events we can control in whole or in after obtaining their U.S. degrees. At the same time, the part; others are independent of our actions. Some future private sector competes energetically and effectively for events we see already from a distance and so we plan for science and technology graduates; in many areas, the typ- them; others will be a complete surprise. To persevere ical government compensation package fails to match despite them, we need a flexible organization and hardy what the private sector offers. plans that are robust across a range of possible futures. This problem, however, is not unique to NASA; human Adept planning and program management takes all of capital has been named one of the President’s these considerations into account. This entails spotting Management Agenda initiatives. An effort is ongoing trends and assessing their potential effects, preparing for Government-wide to increase human capital flexibilities likely risks and opportunities, and keeping the organiza- and add a range of financial and non-financial hiring tion agile and perceptive enough to meet the future in incentives. NASA’s activities in this area and in the areas whatever form it takes. NASA is working to ensure our of knowledge sharing, mentoring, and leadership devel- ability to do this. Besides building in organizational flex- opment are innovative and wide-ranging. For a detailed ibility, we are preparing for areas where future risks and discussion of our activities in this area, please see the challenges are certain. The most pressing of these in the President’s Management Agenda discussion at the end near term are human capital, obsolescence of plant and of Part I. equipment, security, and launch capability. In addition, while NASA has always conducted outreach In the human capital area, two factors are especially prob- activities to inspire students to study science, mathemat- lematic. First, much of today’s NASA workforce will be ics, and technology, we are now embracing this responsi- eligible to retire in 10 years. This represents a major loss bility even more whole-heartedly. In FY 2002, NASA ini- of institutional knowledge and experience. Our ability to tiated creation of an Education Enterprise to coordinate replace these employees with a workforce of a similar and lead our education initiatives. When asked what they

NASA recruits Mars explorers Newspapers nationwide made the first discoveries from NASA’s 2001 Mars Odyssey mission front-page news: lots of water ice found on the planet. Now students watching public television and NASA-TV and connecting over the Web can interact with some of the researchers who made headlines. They can also explore Mars for themselves, through the amazing images sent back to Earth. Live from Mars! originates from the Mars Student Imaging Facility, at Arizona State University. Supported by NASA’s Jet Propulsion Laboratory, it opened February 22, just days after the first Odyssey science images arrived. Here, Cindy Wurmnest, a sixth grade teacher at Danvers Elementary School and group faculty sponsor is interviewed for a broadcast.

Part I • Actions to Achieve Goals 53 want to be when they grow up, children still frequently say, “Astronaut!” Through our education and human capital initiatives, we intend to both foster this youthful interest in the adventure and mystery of space and to create an environment that will welcome our best students when they are ready to choose a career.

Another significant challenge is security. Since the September 11 terrorist attacks, the need for adequate security has become even more pressing. This encompasses the physical security of NASA’s employees and installations; information technology security; and protection of sensitive data such as export-controlled technical information, industrial proprietary information, and classified information. All three areas were among the major management challenges and high-risk areas noted by recent OIG and GAO reports. NASA addressed each of these in FY 2002. For a detailed discussion, see the Major Management Challenges section, particularly the segments on Information Technology Security, Security of Facilities and Technology, and International Agreements.

Obsolescence of NASA’s infrastructure remains a major and growing challenge. Much of our infrastructure was built in the 1960s during the ramp-up of the Apollo program. Other facilities are even older, dating from World War II. All of these facilities require intensive NASA encourages recycling maintenance, which is complicated by the frequent What would it cost NASA to dismantle two 107-ton turbine engine drivers and 35 tons of associated hardware? Recently, a company removed unavailability of repair parts. We must often alter the equipment free of charge, saving NASA more than $350,000 in buildings to meet changing mission and environ- demolition and restoration costs. After years of searching, NASA’s mental requirements. Glenn Research Center found, through an intermediary, a company will- ing to pay the removal and delivery costs. The photo shows the exca- Our facilities management strategy in the face of this vating company’s 650-ton crane hoisting the equipment onto a trailer. The drivers, which once helped NASA researchers test designs for jet challenge is threefold. First, we are reducing our real engines, had not been used since 1984. property and physical plant holdings. For example, we have established a central demolition fund to demolish availability of small- and medium-class launch vehicles aged facilities that we no longer need, and we are needed for many of our space science and Earth science preparing to conduct a thorough Agency-wide review of payloads. More than 80 percent of launches of NASA’s our holdings to identify further opportunities for scientific and Earth-observing spacecraft in the next 10 reductions. Second, we are putting underutilized years are planned for small (Pegasus class) or medium property to work for the Agency, leveraging its value (Delta II class) launch vehicles. Current launch industry through third-party uses and initiatives such as trends show that the market for this class of service is flat, enhanced-use leasing, and preparing a real property with NASA projected to become the dominant user. Last business plan. Third, we are working to sustain the real year’s report noted that it was unclear whether the vehi- property that we still need. For NASA to remain viable, cles would continue to be available to meet our needs. we must repair critical facilities and maintain them at However, as of the end of FY 2002, NASA was making adequate standards. We are continuing to reduce progress toward awarding a block buy of launch services maintenance costs through programs such as reliability- on 19 Delta II vehicles and expected to award this con- centered maintenance, new technology, and sustainable tract by the end of the calendar year. designs, and pursuing innovative solutions such as third- party financing. This purchase will ensure that we have launch capability for these missions through the end of the decade. We are Another area of near-term concern is launch vehicles. The also working with our DOD counterparts to coordinate OIG raised issues about the Shuttle in its reports. These launch opportunities for our smallest payloads, either as are addressed in the discussion of major management the only payload on existing small launchers and refur- challenges at the end of Part I. In addition to Shuttle bished intercontinental ballistic missiles or as secondary issues, however, there is concern about the continued payloads sharing larger vehicles.

54 NASA FY 2002 Performance and Accountability Report Analysis of Financial Statements NASA’s financial statements were prepared to report the ASSETS, LIABILITIES AND CUMULATIVE Agency’s financial position and results of Agency opera- RESULTS OF OPERATIONS tions. The Chief Financial Officer’s Act of 1990 requires that agencies prepare financial statements to be audited in The Consolidated Balance Sheet reflects total assets of accordance with Government Auditing Standards. While $44.1 billion and liabilities of $4.4 billion for FY 2002. the financial statements were prepared from NASA books Unfunded liabilities reported in the statements cannot be and records in accordance with formats prescribed by liquidated without legislation that provides resources to Office of Management and Budget (OMB), these state- do so. About 79 percent of the assets are Property, Plant, ments are in addition to financial reports, prepared from and Equipment (PP&E), with a net book value of $35.0 the same books and records, used to monitor and control billion. PP&E is property located at NASA installations, budgetary resources. The statements should be read with primarily the Centers, in space, and in the custody of con- the realization that NASA is a component of the U.S. tractors. Almost 69 percent of PP&E consists of assets Government, a sovereign entity. held by NASA, while the remaining 31 percent represents property in the custody of contractors. The net book value NASA received a disclaimer of audit opinion on its of Assets in Space, various spacecraft operating above the FY 2001 financial statements. Federal Accounting atmosphere, constitutes $17.0 billion, or 71 percent of Standards Advisory Board No. 21, Reporting of Errors NASA-owned and NASA-held PP&E. and Changes in Accounting Principles (“FASAB No. 21”), requires that errors discovered in previously Cumulative Results of Operations represents the public’s issued financial statements be corrected by restating the investment in NASA, akin to stockholder’s equity in pri- affected period. If the error occurred prior to the earliest vate industry. The public’s investment in NASA is valued period presented, the cumulative effect should be report- at $35.8 billion. The Agency’s $39.7 billion net position ed as a prior period adjustment. NASA detected certain includes $3.9 billion of unexpended appropriations (unde- errors during 2002 that occurred in prior years and livered orders and unobligated amounts, or funds provid- recorded those errors as if they had occurred in FY 2001. ed but not yet spent). Net position is presented on both the NASA was not able to determine what portion of those Consolidated Balance Sheet and the Consolidated errors related to years prior to FY 2001 and, as a result, Statement of Changes in Net Position. should have been recorded as prior period adjustments to Property, Plant and Equipment, Materials and Cumulative NET COST OF OPERATIONS Results of Operations as of the beginning of FY 2001. Instead, NASA has restated its FY 2001 financial state- The Statement of Net Cost is designed to show separate- ments and has recorded in its balance sheet and statement ly the components of net cost of NASA’s operations for of net cost ($2.8 billion) in adjustments relating to cor- the period. In FY 2002, NASA implemented our mission rections of errors caused primarily by the lack of internal through five strategic Enterprises. Their total net costs in controls surrounding Contractor-Held Property, Plant and FY 2002 were: Human Exploration and Development of Equipment and Materials and NASA-Owned Assets- Space, $6.3 billion; Space Science, $2.8 billion; Earth in-Space and Work In Process. While this action did not Science, $1.5 billion; Biological and Physical Research, remove the disclaimer of audit opinion associated with $720 million; and Aerospace Technology, $2.8 billion. FY 2001 statements, it provided FY 2002 beginning bal- Net cost is the amount of money NASA spent to carry out ances so that NASA’s independent public accountant was programs funded by Congressional appropriations. able to express an unqualified audit opinion on the FY 2002 financial statements. Systems, Controls, and Legal Compliance NASA has a variety of management systems in place. We the Agency’s policies, procedures, and guidelines, provides use the Corrective Action Tracking System (CATS) II to official information for overall governance and control of track, complete, and close all recommended actions that Agency operations. This system is accessible to all employ- result both from audits and from the major management ees and is keyword-searchable. These two automated sys- reviews described below. This automated system gives us a tems work together to provide information throughout current, clear picture of the state of our management NASA on the status of key management actions. actions and controls. In addition, the NASA Online We also have strong management controls. The Internal Directives Information System (NODIS), an electronic Control Council meets quarterly to discuss material document generation system and library containing all of weaknesses and major management challenges facing the

Part I • Analysis of Financial Statements 55 Agency. The Council then agrees on corrective actions for improvements and significant management initiatives these problems and tracks them through to completion. taken by NASA leadership in response to law, the President’s Management Agenda, GAO standards and Signaling our committed approach to management controls, the highest levels of NASA senior management audits, OMB guidance, OIG recommendations, and col- serve on this Council and on the many other Agency laborative efforts to make the vision of “One NASA” a boards and councils that contribute to internal manage- reality. A detailed description of examples of these actions ment controls. External auditors from the OIG and the is included in the final section of Part I of this report, GAO make recommendations to the Agency on a contin- Additional Key Management Information, particularly the uous basis, and we monitor in detail our activities in section on management challenges and high-risk areas. responding to these recommendations. The corrective actions that senior management has imple- With regard to legal compliance with the Federal mented and assessed have significantly improved our Managers’ Financial Integrity Act, NASA is in full com- internal controls. Our goal is to put in place reasonable pliance. The Statement of Assurance is included in the controls, continually examine recommendations for their Message from the Administrator that begins this report. improvement, make sound determinations on corrective Further information on NASA’s compliance with the act actions, and verify and validate the results. This commit- is in the following section, Summary of Integrity Act ment to accountability is evidenced by many control Material Weaknesses and Non-Conformances. Integrity Act Material Weaknesses and Non-Conformances FEDERAL MANAGERS’ FINANCIAL will be tracked and reported internally as prescribed by INTEGRITY ACT “Management Accountability and Control” (OMB Circular A-123). NASA’s 2003 reform initiatives include working The Federal Managers’ Financial Integrity Act requires with the OIG to clarify and define current applicability of agencies to provide an Annual Statement of Assurance the term “material weakness” and renaming and redefining regarding management controls and financial systems. In the term “significant area of management concern.” This FY 2002, NASA strengthened the Agency’s overall man- change also reflects NASA’s responsiveness to reducing agement controls and reduced the single material weak- the Government’s reporting burden per the Reports ness identified in FY 2001, International Space Station Consolidation Act and especially the President’s management, to an internally tracked significant area of Management Agenda message: “To reform government, management concern. Independent reviews and intense we must rethink government.” However, while NASA internal scrutiny by the Internal Control Council and the management has elected not to report at a level below Station management team led to this decision to down- material weakness externally, the OIG may continue its grade the material weakness to a control deficiency. practice of reporting on additional management challenges Based on the recommendations of internal and external and weaknesses, and has provided a new report, which is experts, NASA developed a corrective action plan and the included in Part III. NASA’s FY 2002 efforts to address Station management team completed corrective actions in issues listed in previous reports are discussed in the final accordance with it. NASA has tracked corrective actions section of Part I of this report. on this issue internally and the Council will continue Improving and maintaining management controls in aggressive quarterly tracking. Our corrective actions were response to GAO and the OIG audits requires continued also externally assessed. aggressive oversight by the Council, internal reviews by The 2002 Annual Decision Meeting of the Council Agency managers, and other evaluations such as the con- included a variety of decision-making process changes tinual progress reports that the International Space Station and reforms for 2002 and beyond. In last year’s meeting, management team provided to the OMB throughout NASA elevated the Station from a second-tier significant FY 2002. We are aggressively correcting all management area of management concern to a first-tier material problems reported in the FY 2001 NASA Accountability weakness. In the past, NASA reported both material Report. Among the major corrective actions we completed weaknesses and significant areas of management concern in FY 2002 on previously reported significant areas of in our annual accountability reports. This year, the management concern are Financial Management, Council chair initiated a more accurate implementation of Information Technology Security, Decommissioning of the the Integrity Act report, identifying only new material Plum Brook Reactor Facility, the National Environmental weaknesses and providing the status of corrective actions Policy Act, and Cost Estimating. We will continue to to reduce or close existing material weaknesses. implement and track corrective actions by holding regular progress meetings, systematically assessing results of cor- Significant areas of management concern described in rective actions, and obtaining validated evidence that we previous years will no longer be reported externally but have achieved the intended control results.

56 NASA FY 2002 Performance and Accountability Report MATERIAL WEAKNESS completed all actions to address the task force’s recommendations, Station leadership has undertaken NASA has inadequate management controls for the finan- strong corrective actions and made significant progress, cial reporting of property, plant, and equipment, and resulting in the Council’s determination that the deficien- materials including Assets-in-Space, contractor-held cy level should no longer be classified as material. property, spare parts and assets under fabrication. Significant accomplishments in the Agency’s five-point Regarding Assets-in-Space, various costs were not con- plan to correct Station weaknesses are as follows: sistently capitalized in the period incurred. For contractor-held property reported on the required annual NASA Research Priorities Developed Form (NF) 1018, “NASA Property in the Custody of Contractors,” some contractors incorrectly reported the NASA sponsored an external review and conducted inter- value or classification of NASA-owned property in their nal reviews to develop research priorities for the Station. possession. These errors resulted in erroneous reporting The priorities became the foundation for a research plan of billions of dollars of assets and required reclassifica- that defines how best to implement research on the Station tion of assets between depreciable and non-depreciable. that is consistent with the complexities of continued assembly and operations. The NASA Advisory Committee Working with NASA’s auditors (the OIG and the inde- reviewed the plan and found that NASA has made defini- pendent public accountant with whom they have contract- tive progress in its strategy to conduct scientific research ed) and various NASA contractors, we were able to and gain scientific knowledge beyond the engineering feat revalue and reclassify these assets for NASA’s FY 2002 of Station deployment termed U.S. Core Complete. financial statement presentation. However, because of the multitude of property, plant, and equipment, and materials Accomplishments in Engineering Development reporting weaknesses including contractor-reported errors, and Deployment the independent public accountant is reporting this condi- NASA continued to demonstrate technical excellence in tion as a repeat material weakness on our FY 2002 finan- the development, deployment, and operation of cial statements. To remedy this, we plan to improve our International Space Station systems. NASA delivered the overall guidance on property, plant, and equipment, and 43-foot-long, 13.5 ton, S0 truss; installed the Mobile Base materials. We also plan to increase our training to contrac- System on the Mobile Transporter; replaced the wrist roll tors on NF1018 reporting. joint in the Station’s robotic arm; and deployed the S1 truss with radiators and the Crew Equipment Translation MATERIAL WEAKNESS REDUCTION Aid. Each of these major accomplishments occurred after the task force had issued its report. Continued rising costs and inadequate cost estimating procedures for the International Space Station Program Cost Estimating and Analysis Improvements prompted the Internal Control Council’s November 2001 decision to elevate the Station significant area of manage- The Station is now requirements-driven, based on a solid ment concern to the level of material weakness. The set of defined needs used to develop our improved Council determined that the longstanding cost growth program cost estimate. Two external review teams resulted from underestimating complex program costs validated the program’s internal cost estimate as credible. and consequent schedule erosion. In addition, in The program has also developed a work breakdown November 2001, the Agency received a major independ- structure in alignment with its management approach and ent evaluation of key reforms needed to correct Station budget. This structure provides a clear requirements flow- cost and program deficiencies. down, including cost, schedule, technical performance requirements, and accountability for risk. The program Tasked by the NASA Advisory Council, this external demonstrated strong FY 2002 cost performance, advisory subcommittee, the International Space Station increasing its programmatic reserve level. The program Management and Cost Evaluation Task Force, provided also developed a method to measure cost and schedule recommendations for restoring program management’s performance while integrating formal earned value credibility. This roadmap became the basis of the reporting requirements into its contracts as part of Agency’s corrective action plan that allowed downgrad- program-wide reforms in financial management and ing the Station material weakness to an internally tracked contract consolidation. significant area of management concern. Achievements in Mission and Science Operations In the year since the task force provided its recommendations, the International Space Station Program The program management team coalesced in FY 2002, Management Team has acted in measured fashion to and new leadership implemented definitive cost, sched- address the identified weaknesses, choosing the most rea- ule, and technical requirements that hold people at all lev- sonable strategies and alternative approaches to els accountable. An improved management information implementing the recommendations to achieve desired system will afford NASA decision makers ready access to outcomes. While the program management team has not accurate and timely information. The consolidation of

Part I • Integrity Act Material Weaknesses 57 26 contracts into fewer than 10 is moving aggressively partner’s key concerns and demonstrated their continued toward completion, with draft statements of work for strong support for the planned implementation of the pro- industry comment to be released in October 2002. gram. In the last quarter of FY 2002, NASA continued to make significant progress with the partners through Improvements in International Partner extensive, ongoing coordination and achieved on- Coordination schedule each of the critical milestones established in the At the Heads of Agency Meeting in June 2002, the plan. The partnership is successfully moving toward a International Space Station Partners adopted a new pro- December 2002 Heads of Agency meeting, which is gram action plan for enhancing collaborative research use expected to endorse a strategy for meeting the Station’s of the Station. In October, the partners endorsed an updat- utilization and resource requirements and a process for ed Station assembly sequence that addressed each selecting a Station configuration option.

Additional Key Management Information

NASA mentors future scientists and engineers Alexis Adams, 18, a Huntsville, AL, high school student, works with mentor James Perkins, who leads the Analytical Environmental Chemistry group at NASA’s Marshall Space Flight Center. Adams is participating in the Center’s SHARP (Summer High School Appren-tice- ship Research Program), which helped her discover her love of chemical engineering—and stimulated her decision to pursue it as a career.

PROGRESS IN IMPLEMENTING THE required to achieve green; other agencies are seeking to PRESIDENT’S MANAGEMENT AGENDA adopt NASA’s approach. NASA is fully committed to implementing the President’s Strategic Management of Human Capital Management Agenda. This is a Government-wide effort to improve the way that Government manages in five key NASA’s most valuable asset in accomplishing its mission areas: Human Capital, Financial Management, efficiently, effectively, and safely is the excellence of its e-Government, Competitive Procurement, and Integrated workforce. We must ensure that the Agency continues to Budget and Performance. The OMB uses a red/yellow/ have the scientific and technical expertise necessary to pre- green stoplight rating system to rate agency progress. serve the Nation’s role as a leader in aeronautical and space Green is the best possible rating. The discussion below science and technology, as well as have a cadre of profes- describes our progress in “getting to green.” sionals to address NASA’s financial, acquisition, and business challenges. Today, however, several converging trends The President’s Management Agenda provides the central threaten NASA’s ability to maintain a workforce with the focus for all management reform efforts across the talent it needs to perform cutting-edge work. Agency, including our Freedom to Manage initiatives. NASA has established a highly integrated, disciplined Like other agencies, NASA has an aging workforce with process for getting to green with weekly status reports to many projected retirements. An additional cause for the Administrator by each of our five President’s concern, particularly for a research and development Management Agenda area champions. agency like NASA, is that fewer young people are pursuing studies in math, science, and engineering while NASA is one of a limited number of agencies to have a the demand for such talent is rising in the Government written agreement with the OMB on the specific steps and private sectors. We face skills imbalances, lack of

58 NASA FY 2002 Performance and Accountability Report depth in some critical competencies, and a lack of diver- developing a competency management system as part of sity in the workforce. that capability; increasing use of flexibilities and tools to recruit and retain a highly skilled, diverse workforce; NASA already has many programs, activities, and tools linking students in NASA’s education programs with pro- to address issues of recruitment, retention, training, and jected workforce needs; ensuring that training and devel- workforce development, and in recent years we have opment programs build needed competencies—including received overall high marks from employees in leadership competencies—with greater emphasis on Government-wide surveys. The current environment, knowledge sharing and mentoring; capturing knowledge however, makes it imperative that NASA develop—and and lessons learned in a more effective, systematic way; execute—an integrated, systematic, Agency-wide ensuring that Agency performance management focuses approach to human capital management that will enable on accountability for results; and ensuring that rewards the Agency to work as “One NASA,” safely and effec- and recognition programs link performance to achieve- tively ensuring that the resources entrusted to us are well ment of Agency goals. managed and wisely used. Critical to this is implementation of the Agency’s Strategic Human Capital Plan. The improvement initiatives were briefed to Agency Implementing the plan will permit more effective senior management, and drafts of the Strategic Human deployment of the workforce across programs and proj- Capital Plan and the accompanying implementation plan ects, contribute to NASA’s ability to attract and maintain were vetted with both internal and external customers, a highly skilled, diverse workforce with the competen- stakeholders, and oversight groups—including the cies NASA needs now and in the future, and enhance OMB, OPM, and the Aerospace Safety Advisory Panel. mission success. Successfully implementing the initiatives will greatly enhance NASA’s ability to manage its human capital and Key elements of NASA’s Strategic Human Capital Plan maintain its preeminence as an excellent organization are reflected in NASA’s President’s Management Agenda with a highly motivated, skilled, productive, and Action plan and summarized in the following text, along innovative workforce—and enhance realization of a with specific actions taken in FY 2002. While the OMB “One NASA.” rated NASA red in FY 2002 for strategic management of human capital, the Agency received an assessment of While NASA has addressed human capital in previous green for substantial progress made in this area during strategic and performance plans, our challenge now is to the year. fully integrate the Strategic Human Capital Plan into the Agency’s strategic planning, performance, and budgeting PMA Step to Green 1. Develop and approve an processes, including flow-down through Enterprise and Agency Strategic Human Capital Plan Center strategic and implementation planning. The OMB and GAO have underscored the importance of this next A team of NASA senior managers, led by the Assistant step. We have begun this effort. Once in place, the Administrator for Human Resources and Education and Agency-wide workforce planning and analysis capability comprised of several Enterprise Associate Administrators and competency management system will enhance our and Center directors or their representatives, assessed ability to identify and address workforce needs of specif- Agency management of human capital and identified ini- ic programs. We are also establishing success indicators tiatives to enhance management of this critical resource. to help determine whether the initiatives are achieving Several factors influenced the team’s work: internal and their objectives. external reviews of the Agency’s human capital issues; the Administration’s emphasis on human capital through PMA Step to Green 2. Identify skills gaps in the President’s Management Agenda; Congressional mission-critical areas via an Agency-wide compe- interest in Government-wide human capital challenges; tency management model and nationwide and internal trends that threaten NASA’s ability to maintain a highly skilled workforce. Using NASA’s Agency-wide civil service personnel system per- OMB, Office of Personnel Management (OPM), and forms standard personnel administration, payroll process- GAO standards and tools as guidance, the team estab- ing, and reporting functions. Its capabilities are limited, lished a human capital architecture structured around five however, and it lacks the data required for strategic work- pillars: Strategic Alignment, Strategic Competencies, force management. Much of NASA’s workforce planning Learning, Performance Culture, and Leadership—the last and analysis happens at the Center level. This perpetuates of which provides the foundation for the others. ambiguities in roles and responsibilities, contributes to a stovepipe view of the workforce, and inhibits our ability While the Agency already has many programs to address to track and forecast human capital across programs. A recruitment, retention, and workforce training and devel- more capable Agency-wide system will promote better opment, this internal assessment highlighted areas that analysis, planning, management, and alignment of human merit special emphasis. These are establishing an resources to achieve Agency strategic goals and objec- Agency-wide workforce planning and analysis capability; tives. An integral element of effective workforce

Part I • Implementing the President’s Management Agenda 59 NASA establishes Educator Mission Spe- cialist position NASA is looking forward to putting a teacher in space to serve as a mission specialist. Our first Educator Astronaut is Barbara Morgan. To qualify, candidates must have completed the same rigorous training as astronauts with specialties in engineering, physics, or medicine. After graduating with honors from Stanford University, Morgan’s career included teaching second grade remedial reading and math at Montana’s Flathead Indian Reservation and third grade English and science in Quito, Ecuador. Morgan is shown here with NASA Administrator Sean O’Keefe in the International Space Station Flight Control Room, Mission Control, during the STS-110/8A mission, April 16, 2002. The photograph was taken four days after O’Keefe announced that Morgan would fly on a Space Shuttle mission scheduled for 2004.

planning—necessary for aligning the workforce with the NASA’s FY 2002 Freedom to Manage activities included mission—is the ability to identify existing competencies, a review of internal and external barriers to human capi- those needed, and resulting excesses or gaps. With this tal management. It resulted in actions to enhance flexi- capability, we can focus human resource flexibilities— bility and place human capital management accountabil- including recruitment tools and employee training and ity where it should be—with Center managers. development—on areas of concern to better align the Specifically, NASA Headquarters delegated numerous workforce with our mission. We can also better determine authorities to the Centers, including approval of which competencies we must retain in-house and which Intergovernmental Personnel Assignments, Senior ones we can obtain from industry, academia, and others. Executive Service cash awards, and use of NASA Excepted authority. We also provided mechanisms and In FY 2002, NASA conducted several demonstrations of incentives for hiring nonpermanent employees, reduced our competency management system pilot for representa- the levels of review required for organizational changes, tives from OMB, OPM, GAO, and other Federal agencies. and streamlined the process for Senior Executive Service We received high praise for our work. We developed an staffing. These changes enhance the ability of Center organizational competency dictionary and are developing senior and line managers to respond quickly to recruit- a workforce-level competency dictionary. In FY 2003, we ment and retention opportunities. will link competencies to NASA class codes and reach agreement on which competencies or occupations the In FY 2002, NASA also addressed current and future sci- Agency considers mission-critical. We expect to use ence and engineering recruitment needs by completing a information derived from this exercise to help shape National Recruitment Initiative study. The effort focused recruitment of college hires for the summer of 2003. on new graduates—often referred to as fresh-outs. The More information on our activities to establish an study recommended an agile, flexible hiring model that is Agency-wide workforce planning and analysis capability candidate-centered, maximizes current networks and is contained in the Manage Strategically discussion in forges new relationships to identify highly skilled candi- Part II of this report. dates, and markets NASA as an employer of choice. Several recruitment tools developed from the study PMA Step to Green 3. Increase the use of human appear in the Manage Strategically section in Part II of capital flexibilities to recruit, hire, and retain a this report. In addition to these tools, the Headquarters highly productive workforce Office of Human Resources and Education collaborated with the Office of Public Affairs on Agency recruitment NASA has been aggressive and innovative in using exist- displays for Centers to use at recruitment conferences, job ing authorities and flexibilities. We were one of the first fairs, and other outreach events. NASA’s major program agencies to hire individuals under the Federal Career offices cooperated in designing and developing the dis- Intern Program and to use the Student Loan Repayment plays to ensure that they were compelling and illustrated Program to offer an attractive incentive to prospective NASA’s mission areas and projects. new hires. NASA’s Centers also use available recruitment, relocation, and retention bonus authority, as well as the An issue of considerable concern to NASA is how to superior qualifications appointment authority to attract maintain a pipeline of diverse new talent from which we and retain high-caliber employees. can satisfy future competency needs. The Agency

60 NASA FY 2002 Performance and Accountability Report already has several programs from kindergarten through outside expertise to address skills needs and strengthen postgraduate to encourage students to pursue science, NASA’s mission capability. To address the long-term math, engineering, and technology studies. In FY 2002, need to reverse the shrinking science and engineering NASA began steps to formally make education a core pipeline, the Agency proposed a Scholarship for Service mission area and instituted a more coordinated manage- Program to offer college scholarships to students pursuing ment approach to enhance our reach and performance in degrees in science, engineering, mathematics, and tech- the education arena. The Agency needs, however, a bet- nology in exchange for a service requirement with NASA ter link between these feeder programs and projected after graduation. A provision to permit extension of term workforce requirements. For this reason, NASA devel- appointments up to six years and to allow term employees oped a prototype tracking system in FY 2002 to better to be converted to permanent positions will make such link students in NASA’s education programs to NASA appointments more attractive and hence provide the hiring for future workforce needs. In FY 2003, we will Agency with a more robust labor pool of applicants. Our analyze data from the pilot and revise the data collection ability to reshape our workforce to address skills imbal- system as needed. More importantly, we will incorporate ances will also benefit greatly from proposed enhance- long-term projections of workforce needs into education ments to the buyout and early retirement authorities; these program announcements to better leverage our program authorities will allow us to encourage targeted attrition in offerings to meet our need for highly qualified scientists areas where the need for skills has diminished and to and engineers. recruit and reshape a workforce aligned with current and future mission needs. Finally, to respond quickly and PMA Step to Green 4. Identify new authorities, effectively to changing employment trends and labor mar- tools, and strategies that could improve recruit- ket fluctuations, the streamlined demonstration authority ment, retention, competency, and flexibility of the provides a means to test human resources innovations in NASA civil service workforce a manner that other agencies have used successfully for While NASA makes extensive use of existing personnel more than 20 years. authorities, they are not adequate for reshaping and recon- We are developing several additional legislative propos- figuring NASA’s workforce for the programmatic, tech- als for submission in FY 2004 that will further streamline nological, financial, acquisition, and business challenges hiring processes for scientist and engineering positions; of the future. The authorities’ limitations will become provide a more attractive compensation and benefits more apparent in coming years as NASA’s workforce package to new hires; and improve Senior Executive challenges increase because of several broad trends Service appointment authority to meet short-term including: fewer science and engineering graduates; staffing needs. greater competition for the shrinking pool of technical talent from both traditional private sector technical employ- PMA Step to Green 5. Use human capital tech- ers and newer competitors (for example, the banking and nologies to maximize productivity of human capital entertainment industries); and the loss of corporate In FY 2002, NASA completed rollout of an Agency-wide knowledge as key personnel retire. paperless hiring and competitive promotion system— To address these challenges, in FY 2002 we submitted 11 NASA Staffing and Recruitment System (STARS, FY 2003 legislative proposals to Congress through http://nasastars.nasa.gov/)—to improve the speed of OMB. Many of these enhance authorities that already filling vacancies. Statistics available as of exist; we proposed the enhancements because we found September 1, 2002, show that 32,263 resumes were the authorities insufficiently broad or flexible. The pro- accepted under the new system. Since we enhanced posals represent an integrated set of human resource flex- NASA STARS with new applicant services, Web site vis- ibilities that will allow NASA to address multiple chal- itors increased from 30,000 to more than 80,000 per lenges without jeopardizing important protections or month and a review of the last 3,000 comments on the entitlements in areas of merit principles, equal employ- system’s resume builder feature showed that 99 percent ment opportunity, employee benefits, veterans’ prefer- were satisfied with the builder and application submission ence, and labor relations. process. The time it takes to acknowledge receipt of a resume or job application dropped from an average of 75 To enable NASA to compete more successfully with the days to less than 1 day because we now send applicants private sector to attract and retain an excellent workforce, an automatic e-mail response. In addition to internal the proposals provide for streamlined hiring authorities to Agency awards, NASA STARS has received an OMB allow us to make job offers more quickly, and provisions e-Government award. NASA demonstrated the system to for more flexible and generous financial incentives, such several other Federal agencies. as recruitment, relocation, and retention bonuses. The proposals to provide more flexibility to the Inter- In FY 2002, NASA also completed final rollout of an governmental Personnel Act and create a NASA Industry Agency-wide automated position description manage- Exchange Program will enable the Agency to access ment system. This system permits us to rapidly prepare

Part I • Implementing the President’s Management Agenda 61 and classify position descriptions and automatically gen- employee feedback and utilize data to analyze the pro- erate associated documents. Managers can select position grams’ effect on performance). descriptions from an online library or build position A final report of the team’s findings and recommenda- descriptions by identifying duties and asking the system tions will be published by January 2003. Shortly there- to determine the correct series and grade. To date, man- after, the Office of Human Resources and Education will agers’ perceptions have generally been positive; most collaborate with NASA Enterprises and Centers to devel- regard it as a user-friendly program. op an implementation plan to identify and prioritize In the FY 2001 Performance Report, NASA reported an improvement actions based on their perceived effect on increased variety of technology-based learning opportuni- the workforce. The implementation plan will also call for ties, as well as increased use of technology-based train- assessing the improvements and periodically sharing les- ing. In FY 2002, NASA’s Web-based training system sons learned. (SOLAR) continued to expand and support Agency-wide PMA Step to Green 7. Complete mobility study training requirements. There are now more than and pilot/implement actions to expand develop- 44,000 user accounts on SOLAR. In FY 2002, about ment activities based on study results 26,000 tests were taken on SOLAR—most on information technology security. We must optimize our training and development investment consistent with our mission and priorities—as well PMA Step to Green 6. Link employee rewards, as maximize the benefits to employees. Sharing program recognition, and performance to Agency key goals and business best practices across Centers is essential to the development of both our employees and the organiza- Aligning recognition and awards to an organization’s tion, will foster achievement of “One NASA,” and will goals and expectations is an important strategic tool for help us develop the next generation of the Agency’s proj- managing and aligning employee performance. In the ect and business managers and leaders. past, NASA established honor award medals to address areas perceived as not receiving adequate acknowledge- In FY 2002, NASA initiated a study to measure the ment, utilized all regulatory flexibilities for cash and non- mobility of the workforce; understand the factors that monetary awards, and recognized the executive leader- contribute to or impede mobility and rotational assign- ship of the Agency with bonuses and Presidential Rank ments; and explore opportunities to increase mobility Awards. Each was viewed as a separate and distinct pro- through developmental activities. We deployed a Web- gram. Each focused on effort and activities rather than based survey in mid-July to about 9,000 NASA employ- results, without systematically considering their relation- ees, received more than 4,000 responses, conducted focus ship to one another, their alignment with the Agency’s groups at five Centers, and are now analyzing the data. goals and expectations, their effect on driving individual After the study’s completion in December 2002, we performance, and their relevance to mission success. expect to develop and pilot recommended actions by October 2003. We established an Agency team in FY 2002 to review how recognitions and awards align with the Agency’s PMA Step to Green 8. Establish strategies for performance expectations as they relate to the Agency’s leadership/knowledge management continuity mission and goals. After conducting focus groups, NASA’s leadership training and development programs benchmarking NASA against 13 private companies, vis- are comprehensive. Beginning with the NASA Leader- iting the top five companies, and collecting data to assess ship Model, the Agency has placed emphasis on evaluat- the Agency’s current state, the team concluded that the ing and developing leaders through evaluation instru- alignment is satisfactory. However, the team determined ments, local and distributed learning opportunities, work- that as a strategic management tool the alignment could shops, seminars, conferences, and resident classes. be stronger. In October 2002, the team presented its find- However, we can do more. Given current workforce ings and recommendations to the Incentive Awards demographics, it is paramount that we focus on capturing Board, chaired by the Associate Deputy Administrator and making available the wealth of expertise and experi- and composed of senior management. The board ence that exists across the Agency. Employees in leader- endorsed the team’s four proposed management strate- ship positions should not only pursue their own profes- gies to enhance this alignment: (1) instill more account- sional growth but also share their practical experience ability (for example, leadership commitment and clear with those who will follow them. We must select partici- awards criteria); (2) create additional flexibility for when pants in leadership development programs by thoughtful- and how employees are recognized; (3) educate the ly considering both their leadership potential and the workforce about the Agency’s recognition and awards Agency’s future needs. programs and their relationship to individual employees’ performance and contribution to mission success; and (4) In FY 2002, we established a team to create an Agency- manage data for performance results (for example, seek wide strategy to help Centers use coaching more

62 NASA FY 2002 Performance and Accountability Report effectively to improve performance and enhance mission The Competitive Sourcing Plan submitted to OMB in results. The team conducted an Agency-wide session to June 2002 necessarily addressed only the in-house 13 per- examine coaching approaches and followed up by devel- cent of the budget; the other 87 percent is already per- oping draft guidelines for Agency-wide use. We will pro- formed under contract. The goal of competitive sourcing vide these guidelines shortly to the Centers. as it applies to NASA is to expose certain in-house activities that are not inherently governmental, referred to as NASA began an effort to foster NASA communities of commercial activities, to competition. We examined our practice expressly to capture and communicate project inventory of activities available for competition and knowledge and wisdom resident in NASA. As part of this developed a plan to directly convert them to contractor effort, project management experts gather periodically to performance, capitalize on ongoing contract conversions, share their stories, promoting learning, mentoring, and or compare in-house activities with contractor perform- leadership development. In the past year, NASA conduct- ance. Our plan achieved the President’s Management ed a Project Management Shared Experience session and Agenda’s goals for FY 2002 and FY 2003 by the end of two Masters Forums. Participants from NASA aerospace FY 2002. and non-aerospace projects shared their project management experiences. Many stories are captured in the ASK NASA’s greatest strength in implementing competitive (Academy Sharing Knowledge) magazine, available in sourcing is that, from early in its existence, NASA has print and online at http://appl.nasa.gov/knowledge/ask_ contracted with the private sector for most of the products home.htm. The publication provides a further mechanism and services it uses and hence has a strong tradition of for communicating these lessons. Practitioners have being a wise shopper. NASA’s greatest challenge in adopted new management approaches based on their col- implementing competitive sourcing is that we have leagues’ stories and lessons because of this 18-month already contracted out most of the support service activi- effort. In addition, NASA developed a preliminary knowl- ties that we saw as available for outsourcing. We are now edge-sharing and mentoring plan. After stakeholder considering contracting out even more of the efforts asso- review, this plan will become final in late October 2002. ciated with operating the Shuttle and the Station. Plans include renewed emphasis on effective manage- PMA Step to Green 1. Submit Federal Activities ment of the Agency’s Senior Executive Service. The Inventory Reform (FAIR) Act Inventory to Office of Senior Executive Service was a keystone of the 1978 Management and Budget Civil Service Reform Act and was designed to be a corps NASA prepared a high-quality inventory of its commer- of executives selected for their leadership qualifica- cial and inherently governmental activities. Instead of tions—not their technical expertise. It is a group charged building on the inventories of prior years, NASA initiated with leading the continuing transformation of govern- a bottom-up approach to developing the 2002 FAIR Act ment, which is essential as we implement the President’s inventory. This process included establishing a dedicated Management Agenda at NASA. It is critical that we Agency Competitive Sourcing team and a Competitive appoint, promote, reward, develop, and recognize the Sourcing Review Board composed of senior managers at right executives, for the right reasons, at the right time. In NASA Headquarters. These units provided consistent, the coming year, NASA will study criteria used to make detailed instructions to NASA Centers on how to classify Senior Executive Service appointment decisions; criteria activities as either commercial or inherently governmen- for making the service’s promotion and bonus decisions; tal. This effort resulted in a 70-percent increase in the ways to create communication, collaboration, and cama- number of full-time employees in positions identified as raderie among the Agency’s executive leadership; commercial compared with the 2001 inventory: NASA’s whether the service’s cadre needs additional develop- 2001 inventory identified 4,333 full-time employees as ment; and whether we need additional development and commercial; in 2002 we increased that number to 7,405. succession planning for future leaders at the higher grades That increase means that potentially more NASA activi- of the General Schedule but below the Senior Executive ties will be available for competition. The OMB included Service level. NASA’s inventory in the first notice-of-availability published in the Federal Register in October 2002. Competitive Sourcing The greatest challenge we faced in this activity was NASA sees competition as the tool of choice to ensure overcoming the mindset that every activity that has been that we are getting the best value for the taxpayer. NASA performed by a Government employee is permanently is aggressively applying the pressure of competition to inherently governmental. The FAIR Act inventory is an both the 87 percent of our budget that we contract out and annual event. Now that we have developed a proven the 13 percent that remains in-house. We are proud to process that yields a high-quality product, NASA report that we awarded 78 percent of our contracts anticipates that developing other inventories would be competitively in FY 2002 and we are taking steps to less labor-intensive. However, OMB recently proposed increase that percentage. reissuing Circular A-76, which would have a profound

Part I • Implementing the President’s Management Agenda 63 effect on the inventory process. In any event, NASA will substantially achieve the goals set forth in the President’s continue to refine the inventory process to ensure con- Management Agenda. The OMB approved the Phase I sistent classification of activities as commercial or Plan but recognized it as interim until the Station and the inherently governmental. Shuttle are addressed and included. We expect to submit our final Competitive Sourcing Plan, including Station PMA Step to Green 2. Submit Competitive and Shuttle considerations, in June 2003. Sourcing Plan to Office of Management and Budget PMA Step to Green 5. Office of Management and On June 26, 2002, NASA submitted its first-ever Budget approval of Competitive Sourcing Plan Competitive Sourcing Plan to OMB. To develop the plan, Phase II (50 percent) NASA Headquarters provided uniform guidance to all NASA Centers, each of which then developed its own Our Phase II Plan achieves a 40-percent goal in FY 2007. plan. Headquarters synthesized these. The resulting There are two challenges here. The Phase II Plan will Agency-level plan exceeded OMB’s FY 2003 goal of address competitive sourcing of the Shuttle and the exposing 15 percent of commercial activities to competi- Station. NASA is deliberating those considerations now tion by the end of FY 2002. Rather, it provides for before we present recommendations to the a 19-percent exposure to competition by the end Administration. The political and economic conse- of FY 2003 and a 40 percent exposure by the end of quences of those recommendations will certainly require FY 2007. careful review, which makes it difficult to predict a final With regard to challenges, the plan is an interim one decision date. In addition, the President’s Management because it does not yet include the Station and the Shuttle. Agenda calls for all agencies to aim for goals of 50 per- NASA is carefully studying both programs for potential cent. Depending on the outcome of the Shuttle and competitive opportunities. Further, the President’s Station competitive sourcing considerations, that goal Management Agenda asked for all agencies to strive may not be achievable for NASA because so many of our toward a 50 percent goal. That may not be attainable for activities are already done under contract. NASA, given the great extent of outsourcing that NASA already performs. In any case, we will continue to moni- PMA Step to Green 6. Begin implementation of tor progress against the plan and include the Shuttle and Office of Management and Budget-approved the Station in it as soon as key decisions are made on Competitive Sourcing Plan (Phase I) those programs. By the end of FY 2002, we had successfully converted PMA Step to Green 3. Office of Management and 749 of the 874 full-time employees (86 percent) in Phase Budget approval of Fair Act Inventory I from the public to private sector. During the nonselec- The OMB accepted the inventory that NASA submitted tive downsizing of the Federal workforce in the 1990s, and included it in the first round of notices of availability NASA developed a skills imbalance that weakened our they published in the Federal Register. It took concerted core competencies—our ability to fulfill our basic mis- effort to obtain OMB approval; when OMB suggested sion. We were unable to correct this problem because of increasing the number of commercial activities in the personnel ceilings. Our solution was to rebalance the inventory, we improved the quality of the inventory workforce by reducing personnel strength in noncore process. The proportion of commercial activities in the activities and substituting core activities. Therefore, our resulting inventory exceeded OMB’s expectation. NASA Competitive Sourcing Plan weighs more toward out- will use the same inventory process next year, applying sourcing noncore activities. The Centers are on schedule refinements from lessons learned. to complete Phase I as planned. NASA Headquarters will monitor their progress. PMA Step to Green 4. Office of Management and Budget approval of Competitive Sourcing Plan Phase I (15 percent) PMA Step to Green 7. Begin implementation of Office of Management and Budget-approved Our Phase I Competitive Sourcing Plan achieved the Competitive Sourcing Plan (Phase II) President’s Management Agenda goal for FY 2003 in FY 2002. The OMB had asked for one, all-encompassing NASA submitted a Phase II Plan that exposes 40 percent plan. Our challenge here was that we knew that key (cumulatively with Phase I) of activities identified as decisions on the Station and the Shuttle would not be potentially commercial to competition in FY 2007. made in time to support the timely submission of the plan. Achieving that goal is a major accomplishment given that Therefore, we developed a plan divided into Phase I NASA from its earliest years has contracted with the (through FY 2003) and Phase II (through FY 2007) to private sector for most of the products and services it accommodate the ongoing decision process and still uses. We have begun implementing the plan.

64 NASA FY 2002 Performance and Accountability Report PMA Step to Green 8. Complete inventory of We must expand our e-Government products and services interservice support agreements to provide information in all practical formats, at all times, to all audiences. We must strengthen our informa- To identify potential opportunities for competition, OMB tion technology infrastructure so that we can provide cut- requested that NASA inventory its Inter-service Support ting-edge services and technologies reliably and securely. Agreements, Federally Funded Research and We must provide online, collaborative environments that Development Centers, University-Affiliated Research support interactions within NASA and between NASA Centers, University Research Engineering and and our industry, academic, and international partners. Technology Institutes, commercial space centers, and With these challenges in mind, NASA has undertaken an similar partnerships. We did so and provided the invento- ambitious set of activities to expand e-Government and ries to OMB. NASA conducted the inventories based on achieve green status on the President’s Management internally developed ground rules; for example, only Agenda scorecard. We participate in e-Government activ- agreements with a value greater than one million dollars ities that span Agency boundaries, including several were included. Any further plans are contingent on OMB Federal e-Government projects coordinated by the approval or discussion of the inventories. President’s Management Council. We are revamping the Agency’s information technology infrastructure to ensure PMA Step to Green 9. Develop Office of Manage- that we can provide secure, highly reliable, and cost- ment and Budget plan for competing interservice effective systems and services to support NASA and our support agreements customers. We are redesigning the Agency’s Web pres- The OMB has approved the inventories; we are now ence to make it easier for users to locate what they need developing the competition plans. quickly. We are analyzing NASA information technology initiatives to identify potential opportunities for stream- NASA’s final Competitive Sourcing plan must include lining and process improvement, and are investigating plans for competing interservice support agreements, other e-Government products and services that could ben- Federally funded research and development centers, uni- efit the Agency. Finally, we are improving our electronic versity-affiliated research centers, university research systems’ security to ensure that NASA’s critical informa- engineering and technology institutes, commercial space tion assets are protected and that electronic transactions centers, and similar partnerships. A significant amount of within NASA and with our customers are private NASA work is being accomplished under these partner- and secure. ship arrangements. A significant amount of NASA work is accomplished under these partnership agreements. In NASA is implementing new features in our President’s addition, we plan to inject greater competition wherever Management Agenda e-Government plan beginning in sizable contract actions are involved (for example, previ- FY 2003. While the new plan will focus on many of the ous sole source awards, exercise of options, and contract same key activities as the previous plan, the new plan extensions). While most of the processes for awarding aligns more closely with the “One NASA” vision and partnerships and contracts already entail competitive goals. This report primarily reflects NASA’s accomplish- practices, only a careful review of all processes will ments in FY 2002 under the previous plan, although in ensure a truly competitive environment. places it also references the new plan.

Expanded Electronic Government PMA Step to Green 1. Achieve internal efficiencies by leveraging technology NASA is a Federal Government leader in providing electronic services to our citizens, business partners, employees, and stakeholders. We were one of the first Federal In FY 2002, NASA outlined plans to improve its common agencies to realize the potential of the Internet in deliver- information technology infrastructure and services. We ing information and services to the public and have con- made a significant effort to assess our network infrastruc- sistently received recognition for the number and variety ture, identify needed improvements, and implement of Web sites and electronic resources that we provide. appropriate technical solutions. Our first step was to cre- NASA has been of particular help to the educational com- ate the NASA Information Systems Services Utility in munity by providing first-rate electronic services and May 2002, to provide a reliable, secure, and low-cost online information to U.S. teachers and students. information infrastructure for all Agency systems and services. In a related effort, we analyzed our wide area To maintain this position of excellence, we must continue and local area networks, electronic messaging systems, to provide superior products and services to our and desktop computer configurations to identify opportu- customers. We must use e-Government to unify and sim- nities to improve services. These analyses will lead to plify access to NASA’s information, helping our cus- detailed action plans that we will implement in FY 2003 tomers locate and use information quickly and efficiently. and beyond.

Part I • Implementing the President’s Management Agenda 65 Strengthening NASA’s infrastructure will give NASA’s our electronic systems and the privacy of the individuals researchers, scientists, project managers, and administra- who use them. NASA takes information security very tive employees the access to technologies needed for seriously, and we continue to emphasize the need to everyday work. Most significantly, it will provide a reli- rapidly identify, track, and resolve all information tech- able backbone for the new Integrated Financial nology security issues. We are committed to protecting Management (IFM) system’s core modules. All of these our relationships with customers, stakeholders, and improvements will allow our researchers and project lead- business partners. ers to focus on program efforts to benefit the Nation PMA Step to Green 3. Improve intergovernmental and humankind. efficiency through collaboration NASA must consider several challenges in pursuing In FY 2002, NASA participated in a number of the these activities. We are a distributed Agency and conduct Federal e-Government initiatives coordinated by the our missions from diverse geographic locations. This President’s Management Council. This included serving makes it both essential and difficult to have a well-func- as a managing partner in the e-Authentication, tioning network. The primary goal of this activity is Recruitment One Stop, Enterprise Human Resources smoothly and seamlessly transitioning the Agency to bet- Management, and Geospatial One Stop initiatives, pro- ter information products and services without adversely viding significant staff and resources to each activity. The affecting mission operations. Federal e-Government community has recognized NASA We will continue improving the Agency’s infrastructure in these four areas for our leadership and expertise. We and services in FY 2003. This includes establishing the also participated in the e-Training initiative, sharing les- Information Mission Control Center. This facility, based sons learned from our experience and benefiting from the on concepts that NASA developed for space travel mis- expertise of other agencies in this area. We continue to sion control, will provide a central interface for NASA’s identify opportunities to participate in the Federal networks and related services. Also planned for FY 2003 e-Government arena. is an Agency-wide messaging system to improve e-mail Implementing these initiatives may cause great changes in services by using a standard approach across NASA. NASA’s business practices. Although the result of these PMA Step to Green 2. Deliver superior information changes is almost certain to be positive, we will have to services to the American citizen make sure to manage change carefully as we introduce new technologies across the Agency. NASA recognizes NASA continued to provide superior information prod- that simply automating an existing process is not suffi- ucts and services to the American citizen in FY 2002. In cient: we must improve operations through constructive addition to maintaining and improving our many public organizational change. Many of the Federal e-Govern- Web sites, we initiated a complete redesign of our main ment initiatives will provide us with an appropriate impe- Web site, the NASA homepage. In late FY 2002, we tus for such change. issued a request for proposals to obtain input on a potential redesign. Many of America’s best and brightest Web NASA will continue participating in the Federal design and marketing experts submitted ideas. We con- e-Government initiatives that are most relevant to our ducted an initial review of the submissions in FY 2002. mission and vision. In addition to the initiatives previous- When completed, the redesign promises to be an inspiring ly identified, we will provide technical leadership in the reflection of NASA’s exciting mission and vision. rollout of an initiative to provide standardized smart identity cards for Government employees. This promises Our redesign will include a new look and feel, a better to be an exciting focus area for NASA and the rest of the search engine, and links to our most useful information. Federal community. We will integrate the Agency’s top Web sites to allow users to readily locate them through search and browse PMA Step to Green 4. Reduce the burden on busi- functions on our main page. Because NASA has been ness through e-Government recognized for our contributions to the educational com- In FY 2002, NASA continued to provide strong support for munity, we will focus on providing information to edu- the Integrated Acquisition Environment and e-Grants activ- cators and students through Web resources targeted ities. We undertook many efforts related to the to them. former. These included a project to centrally register our One of the challenges of e-Government is ensuring that contractors to help build a searchable catalog of Federal NASA can conduct transactions with American citizens in contractors, a Web-based system allowing agencies to col- a secure environment. The OIG identified the implemen- lect and report procurement data electronically, and identi- tation of NASA’s e-Government initiatives as a top fication of opportunities to standardize Federal management challenge in its February 2, 2002, memoran- procurement processes and tools. With respect to dum to the NASA Administrator. Of particular concern to e-Grants, we have worked closely with other agencies to the OIG was NASA’s ability to maintain the security of identify potential ways to standardize the grants application

66 NASA FY 2002 Performance and Accountability Report process. All of these initiatives would benefit our business the complication of completing an Agency design that partners by simplifying the processes and forms required to applies to all 10 Centers while concurrently trying to do business with the Federal Government. implement the pilot locally. Because the pilot will be going live at the start of a new year, there is a time con- A critical challenge that NASA faces in this area is ensur- straint and dependency on closing out the legacy finan- ing the ability of the Agency to interact smoothly with our cial systems that adds schedule risk. business partners. We need to be certain that the decisions we make in adopting new processes and technologies are The core financial module will provide NASA managers compatible with the processes and technologies our with tools to enable them to implement full-cost manage- industry partners use. NASA plans to utilize industry ment and tie programmatic decisions, financial effects, standards such as the use of eXtensible Markup Language and Center infrastructure together to support their deci- (XML) to facilitate interactions between diverse informa- sion process. When the system is complete, NASA deci- tion systems and services. sion makers will have access to integrated financial and business systems, automated processes, and consistent We plan to continue participating in Federal e-Govern- data in real-time. This should improve our ability to ment initiatives to support Government-to-business receive an unqualified opinion on financial statements. transactions. NASA is also investigating the possibility of joining a major aerospace industry e-commerce PMA Step to Green 1b. IFM System implemen- exchange. In early FY 2003, NASA will study the feasi- tation: wave 1 centers bility of using an online exchange to foster relationships We completed developing and testing the core financial and facilitate transactions with the Nation’s leading aero- module of the IFM system in preparation for imple- space and defense companies. This could help streamline menting the module at the wave 1 center (Glenn interactions with our major business partners. Research Center) in October 2002. Because the two Centers are going online at the same time, the challenges Financial Management at the Glenn Research Center mirror those at the pilot Our goal in implementing the financial management ini- center. Initially the Glenn deployment was planned to tiative in the President’s Management Agenda is to estab- follow the pilot center by 4 months. Software problems lish and maintain a single, integrated financial manage- delayed the pilot and now the two Centers are deploying ment system and provide timely, accurate financial data together. Glenn has a shorter overall implementation and reports. NASA is challenged with reengineering our timeline and lacks the advantage of proven procedures. business infrastructure to align with industry best prac- Glenn has the additional challenges associated with tices and implementing enabling technology to provide physical separation from the project team that resides at management information to help us implement our the pilot center. The benefits are the same as those Strategic Plan, provide better decision data and more con- described in step 1a above. sistent information across Centers, and improve efficien- PMA Step to Green 1c. IFMP implementation: cy and effectiveness. NASA’s strategy to accomplish wave 2 centers these aims is to (1) successfully implement our new IFM system and (2) resolve our material weakness and regain Development and testing of the core financial module of a clean audit opinion on our financial statements. the IFM system was conducted in preparation for implementation of the module at the wave 2 centers (NASA PMA Step to Green 1a. Integrated Financial Headquarters, Johnson Space Center, Kennedy Space Management Program (IFMP) core finance at Center, Ames Research Center), scheduled to roll out in pilot center February 2003. The wave 2 centers have the benefit of learning from the rollout at Marshall and Glenn. The soft- We completed developing and testing the core financial ware and procedures for rollout have been demonstrated module of the IFM system in preparation for implement- and there should be fewer implementation issues to ing the module at the pilot center in October 2002. The resolve. They have the added complication of having to go core financial module will give NASA an incredibly live at four Centers concurrently. Their delivery schedules, powerful financial management capability. NASA will data conversion activities and system testing are integrat- be the first Federal agency to utilize the full capability of ed, which means there is a significant codependency. They SAP AG’s financial management system. We anticipate also have to integrate with an existing production system that it will uncover several issues in the areas of full at the first two Centers that adds complexity. Lessons appropriated funding, complex contracting, Federal stan- learned during the implementation of the module at the dard General Ledger, and full-cost management. In addi- pilot center and wave 1 center will assist in the implemen- tion to technical issues, there is a significant tation at wave 2 centers. change-management challenge as standard Agency processes will replace the individual processes now PMA Step to Green 1d. IFMP implementation: employed across our 10 Centers. The pilot center faces wave 3 centers

Part I • Implementing the President’s Management Agenda 67 We developed and tested the core financial module of the problems regarding sampling of accounting data have IFM system in preparation for implementing it at the been resolved and an alternative approach was utilized in wave 3 centers (Dryden Flight Research Center, Goddard FY 2002. NASA management resolved prior year asset Space Flight Center, Langley Research Center, Stennis classification issues and finalized the opening balance Space Center), scheduled to roll out in June 2003. The sheet for the FY 2002 audit. NASA also worked with its challenges at the wave 3 centers are similar to those in auditor to better understand documentation and sampling wave 2 except that wave 3 has the advantage of learning shortfalls experienced during the FY 2001 audit. from six previous Center experiences. There is additional scope in this final wave to integrate the individual centers The above activities addressed and resolved the FY 2001 into a single Agency system. With wave 3, the existing audit issues. Due to the fact that property, plant and Agency-level financial and contractual status (FACS) sys- equipment and materials is still being reported as a material tem will be replaced. The lessons learned during the weakness, NASA must continue to improve overall internal implementation of the module at the pilot center and the controls surrounding these two areas including providing wave 1 and 2 centers will assist in the implementation at property, plant, and equipment and materials training and wave 3 centers. guidance for NASA and contractor property administrators, improve reporting procedures for contractor-held prop- PMA Step to Green 1e. IFMP implementation: erty, and emphasize monitoring and enforcement activities. Interim MIS Erasmus, NASA’s financial dashboard, is a Web-based NASA will make effective use of software solutions pro- system that provides all levels of NASA’s leadership with vided by SAP AG to improve financial statements. In accurate, timely, comparative performance reports on all addition, we will use lessons learned from the FY 2001 major programs and projects using a standard, integrated audit to improve the asset valuation methodology and set of data. In the Erasmus prototype, 16 programs pro- supporting documentation to provide greater assurance vided data for the initial trial. All remaining NASA pro- regarding the capitalized value of property, plant, and grams and their projects are scheduled to begin entering equipment reported on the financial statements. data into the system by the end of October 2002. PMA Step to Green 2b. Audited financial Although programs and projects have reported perform- statements: Closing of FY 2002 General Ledger ance data in the past, different and inconsistent reporting NASA management resolved prior year asset classifica- techniques made evaluating and comparing programs and tion issues and finalized the opening balance sheet for the projects across NASA difficult. This weakness was high- 2002 audit. The FY 2002 General Ledger and subsidiary lighted by the Young Commission in 2001. Erasmus is the data in the Financial and Contract Status system initial step toward meeting significant challenges in pro- have been closed and reconciled. NASA provided gram and project performance reporting. The Erasmus PricewaterhouseCoopers with the detailed transactions system and business principles provide a single, visible for FY 2002 to support the auditor’s selection of a sample repository to report cost, technical, and schedule perform- from which to request documentary evidence. ance across NASA. A consistent taxonomy enables executives and managers to compare key indicators of the health The transition from individual legacy systems at each of programs and projects. NASA Center to one integrated solution will present challenges until the new business process becomes familiar. Erasmus will serve as a pathfinder for a more compre- NASA must maintain the integrity of the financial and hensive reporting and information delivery system to be contractual status database through monthly reconcilia- implemented as part of the IFMP. It will enhance program tions and validation of data inputs. Data sampling will be and project manager’s accountability, allowing them to simpler in the new SAP AG accounting system, which explore the financial reporting information provided by provides an integrated database that has drill-down capa- other managers to discover best practice, cost-saving, and bility. Increased quality-assurance review capabilities will improved resource management opportunities. be available with the new software solution. PMA Step to Green 2c. Audited financial PMA Step to Green 2a. Audited finan- statements: “clean” audit opinion cial statements: resolution of all outstanding FY 2001 issues Actions taken in FY 2002 to obtain NASA’s clean audit opinion include forming an informal audit committee A team drawn from the Office of the Chief Financial (NASA and the OIG) that we plan to formalize at higher Officer, Center finance staff, and technical staff have level in the future. We held biweekly and weekly audit sta- worked with NASA’s auditor, PricewaterhouseCoopers, tus meetings to stay aware of any issues that might arise to address the problems PricewaterhouseCoopers during the audit. The audit process began earlier in the reported in its FY 2001 financial statement audit. The FY 2002 audit cycle. NASA personnel visited centers to

68 NASA FY 2002 Performance and Accountability Report review data and meet with contractors and program office NASA submitted its FY 2004 budget to OMB in full cost personnel. The Defense Contract Audit Agency portion of on September 9, 2002, and briefed them on the full cost the audit plan was revised for FY 2002. NASA personnel background material several days later. We provided the accompanied PricewaterhouseCoopers to Center audit vis- budget and supporting documents through an electronic its. NASA has worked with its auditors to better under- clearinghouse, eBudget. We prepared the full cost budget stand documentation and sampling shortfalls reported in using the existing NASA Budget System database with FY 2001. Completion of the audited financial statements procedural modifications pending availability of a new is in progress and on schedule. database. These accomplishments fulfill the negotiated steps for achieving a yellow rating on this criterion. Integrated Budget and Performance PMA Step to Green 1. Demonstrate Agency-wide NASA has pursued an ambitious plan to integrate its use of full cost budgeting and management budget with its performance plan and its budget formulation process with its performance measurement system. Achieving a green rating for this criterion depends on the NASA brought to this task a key strength: we had already Agency demonstrating by December 2003 that is routine- begun reorganizing the strategic plan, performance plan, ly using full cost budgeting, management, and accounting and budget around 18 budget and program theme areas. procedures. NASA will provide further training to The themes lay the groundwork for integrating budget increase the Agency’s ability to make budget decisions and performance by aligning both with the Agency’s and to manage using full cost considerations. We are also management framework: an activity’s budget is now defining a new automated budget formulation module to directly traceable to the results we expect to achieve from enhance the full cost budgeting process; this will be fully it. The benefits of this approach are twofold. First, it helps available in 2004. NASA’s stakeholders—the American public—understand the value of an investment in a given program. Second, it PMA Step to Green 4. Performance Assessment clarifies to our workforce the specific ways in which their Rating Tool (PART) provided for 20 percent of work supports the Nation’s priorities. “programs/theme areas” per Office of Manage- NASA defined its full cost budgeting, management, and ment and Budget Spring Review accounting approaches in an implementation guide that we have used for planning for the past 2 years. During this The PART is an evaluation tool that OMB is phasing in same period, we used a new Agency-wide budget formu- across the Federal Government. After extensively testing lation process drawing on a single database to collect and the tool, OMB asked the agencies to apply it to selected review budget recommendations from the project level programs to ensure that it properly assesses performance. through the Center, Enterprise, and Agency decision lev- At the spring review, NASA presented its results from a els. We also used this system to produce all budget sub- first application of the tool. NASA subsequently worked mission information. Despite these efforts, OMB’s initial with OMB again on rating the programs with an updated President’s Management Agenda scorecard rated NASA’s version of the tool. The results will be disseminated to status for budget/performance integration as red, or unac- Congress and the public. ceptable: while our efforts were significant, they still fell short of full cost budgeting and management. Since then, The spring review was a challenge because PART is very however, we have made rapid progress, preparing a repre- new. NASA had to identify the process and the officials sentative recast of our FY 2003 budget submission in full responsible for generating the data to be used for the cost and submitting our FY 2004 budget request in assessment. The detailed nature of the tool meant that it full cost. was necessary to disseminate OMB’s success criteria and program management best practices throughout the PMA Step to Green 1. Recast FY 2003 budget in Agency. NASA’s scores improved considerably between full cost the spring review and the September review, demonstrat- While the Enterprises contributed to the Full Cost ing that NASA is meeting this challenge. Implementation Plan developed in 1999 and worked with the Centers to design processes for developing cost pools, The tool will be applied to an additional 20 percent of they had not prepared actively to review their budgets in Federal programs each year until it becomes a standard full cost terms. The Office of the Chief Financial Officer assessment tool for all programs. As OMB refines the tool provided a full cost recast of the FY 2003 budget, tracking based on this year’s feedback, NASA will be able to iden- sheets, and briefings to help the Enterprises transition their tify program management changes needed to continue to budgets to full cost. improve our scores. As we apply the tool to other NASA programs for the first time, maintaining a green status will PMA Step to Green 2. Develop FY 2004 full require us to demonstrate the same high standards of per- cost budget formance we showed in the first 20 percent.

Part I • Implementing the President’s Management Agenda 69 Challenge and Risk Identification General Office of Office of Accounting Inspector Inspector President’s Management Challenge / Office General General Management Risk Area / Initiative Report Letter Letter Agenda 02-182 12-01-2000 02-04-2000 Strategic Human Capital Management O O

Information Technology/ OO Information Technology Security O E-Government Initiatives OO

International Space Station Program Management OO and Development and Support Costs O Integrated Financial Management System O Safety and Mission Assurance O O Launch Vehicles OO Security of NASA Facilities and Technology O

Procurement/Contract Management Weaknesses/ OO O Competitive Sourcing O Cost Estimating O Environmental Management/ National Environmental Policy Act Implementation OO Plum Brook Reactor Decommissioning O

Effectiveness of Faster-Better-Cheaper for Space O Exploration Fiscal/Financial Management OO Program and Project Management O Technology Development O International Agreements O Integrated Budget and Performance O

PMA Step to Green 5. Develop performance we do not expect any of them to jeopardize our ability to budget document concept with Office of maintain that green rating. The greatest challenge was to Management and Budget replace the documents that had been meeting the separate requirements of budgeting and performance measurement NASA’s Integrated Budget and Performance Document with a single document in a timely manner. To do this, we meets the combined requirements of several separate doc- conducted an extensive design, comment, and refinement uments, including the OMB budget submission, the process, working to ensure that the Integrated Budget and President’s Budget of the United States submitted to Performance Document was as finely tuned to the Congress, and the annual performance plan. The OMB requirements as its predecessor documents had been. has reviewed and approved the Integrated Budget and Performance Document concept and the templates for the This resulting document benefits from lessons learned required information. The document goes beyond simply from many disciplines at NASA, including budget formu- putting the budget and the performance plan in the same lation, performance measurement, program management, cover and imposing a similar structure on both docu- risk management, procurement, and strategic planning. ments. Because of the theme approach noted above, a pro- Continuous improvement will fold in the feedback and gram’s budget and the expected performance are on the emerging best practices of these disciplines and the same page along with a clear argument as to why an NASA stakeholder community. For instance, NASA investment in this theme is important and relevant. expects performance measurement to continue to improve Presenting information in this way makes it easier for the every year through feedback from independent reviewers public, Congress, and OMB to see clearly what to expect and new initiatives like the President’s Research and from NASA in the next year. Development Investment Criteria.

We faced many challenges in pursuing a green rating in PMA Step to Green 6. Submit budget through this area. However, once we meet all of these challenges, electronic clearinghouse

70 NASA FY 2002 Performance and Accountability Report After extensive testing through the summer of 2002, the were faced with conflicting deadlines in producing the NASA e-Budget electronic clearinghouse was deployed new Integrated Budget and Performance Document. The for the September 9, 2002, budget submission to OMB. OMB required some of the data in the September time- This clearinghouse provides NASA and OMB a quick, frame, while some of the data—such as program secure, and interactive channel to manage the various narratives—are traditionally submitted in the December documents passed back and forth. The system allows both timeframe. The phased schedule agreed to with OMB organizations to post official materials, check their status, ensured that OMB would have the data when needed. and approve them. NASA expects to finalize the submission of the perform- The benefits of this new approach derive from better ance budget without major difficulties. Two phases communication. The data sharing that must occur is sig- remain. NASA expects the second phase of the submis- nificant. To provide budget guidance and oversight, sion to contain all of the pieces of the document for initial OMB must be able to receive, review, and approve this OMB review. In the third and final phase of the submis- data in a timely manner. Because of its sensitive nature, in sion, NASA expects to submit the final performance the past, the data were often hand-carried between the budget incorporating all OMB guidance to prepare for the organizations. The secure e-Budget clearinghouse offers a submission of the President’s FY 2004 Budget of the solution to this inefficient process. United States to Congress.

The most significant obstacle to achieving a green status PMA Step to Green 8. Submit NASA budget using was security. So long as the budget data are embargoed, performance budget document concept data may be shared only among the NASA budget community and with OMB. While the clearinghouse is con- NASA and OMB expect to use the Integrated Budget and venient, the challenge of safeguarding the information Performance Document as the President’s FY 2004 using a secure Internet site remains. The e-Budget system Budget submission to Congress in February 2003. We complies with all NASA security policies and guidelines, foresee no impediments to achieving a green rating. as well as industry standards for handling Business and NASA and OMB have reviewed and approved the per- Restricted Technology. formance budgeting approach. The phased delivery of the actual document to OMB occurred in a timely manner. No remaining challenges to maintaining a green status We anticipate extensive feedback from Congress on our exist. NASA expects that extending the clearinghouse performance budgeting approach. concept to the IFM Program and the e-Government Program will result in yet more efficiency and efficacy in MAJOR MANAGEMENT CHALLENGES our dealings with OMB. AND HIGH-RISK AREAS PMA Step to Green 7. Submit performance In FY 2002, a major focus at NASA was improving man- budget document to the Office of Management agement. This included many common-sense-based and Budget changes, the Freedom to Manage effort that implemented employee suggestions on how to accomplish work more Because it was a new process and a new product, we efficiently and effectively, and a concerted effort to received permission to provide the Integrated Budget and address specific issues raised by GAO and OIG. Performance Document to OMB in a phased delivery. We provided the first pieces on September 9, 2002, as part of The GAO’s November 2001 report GAO-02-184 “NASA: the budget submission process. This first deliverable Status of Plans for Achieving Key Outcomes and demonstrated that the newly designed and agreed-upon Addressing Major Management Challenges” and the two templates could be filled out and produced. This pilot most recent OIG letters about NASA’s most serious effort included the data for three complete theme areas management challenges (dated December 1, 2000, and and all the data for all development programs Agency- February 2, 2002) call attention to some 17 major wide. The theme areas were the same three that we had management challenges and high-risk areas. In many filled out for PART, making it possible to test and evalu- cases, the reports cite the same or similar issues; the ate both documents together. Providing Integrated Budget following discussion will not double count these. Some of and Performance Document materials on development the issues are the same as or closely related to four of the programs did double duty for another development-pro- five Government-wide President’s Management Agenda gram evaluation form that NASA normally provides to issues discussed above, confirming that while some of OMB every September, the 300B form. NASA’s challenges are unique, we share many of the same challenges facing other agencies. The table above The phased approach mitigated many potential challenges. shows the distribution of these issues among the In meeting the diverse requirements of both the budget for- previously mentioned reports and the President’s mulation and the performance measurement processes, we Management Agenda initiatives.

Part I • Management Challenges 71 The previous section describes in detail NASA’s efforts Procurement/Contract Management in FY 2002 to implement the President’s Management Weaknesses/Competitive Sourcing Agenda initiatives. This discussion will focus on our response to GAO’s and OIG’s findings. Where the Procurement-related issues arose in both of the OIG’s response is identical to our President’s Management reports, the GAO report, and the President’s Management Agenda activities, we will refer the reader to that section Agenda. The GAO identified NASA contract manage- of the report rather than duplicating its discussion. ment as high-risk for two reasons: past delays in imple- While GAO and OIG sometimes make recom- menting the IFM system and its use in full cost account- mendations with which we disagree, the audit process ing, and the continued reliance on undefinitized change overall is healthy, engendering debate and new thinking orders. (Undefinitized change orders are contract modifi- about how to accomplish our mission and leading cations that are likely to increase costs, for which we have ultimately to an Agency that is better able to fulfill not yet fully negotiated the cost; they are mostly used its mission. when schedule is an issue.) Regarding the importance of the IFM system to successful procurement operations, we are pleased to report that Strategic Human Capital Management we are implementing the system according to plan in a phased manner across the NASA centers and expect the With regard to Strategic Human Capital Management, process to be complete in June 2003. More details on GAO cited key elements including strategic planning implementation are in the President’s Management and organizational alignment, leadership continuity and Agenda section on Financial Management, Steps to succession planning, and acquiring and developing Green 1a through 1e. We are also happy to report that we staffs whose size, skills, and deployment meet Agency have reduced the dollar value of undefinitized change needs. Foremost, we addressed these concerns by devel- orders by 98 percent, from $515 million in September oping a Strategic Human Capital Plan and an accompa- 2001 to $9 million as of September 30, 2002. The Station contract has only one undefinitized change order; its dol- nying Strategic Human Capital Implementation Plan. lar value is $1 million. The OIG is also currently review- The preceding section of this report discussing the ing our undefinitized contract actions. In discussions with President’s Management Agenda fully describes this us on this matter, OIG indicated they expect their findings effort. NASA is working to integrate its Strategic to confirm that NASA has made significant progress in Human Capital Plan into the Agency’s strategic plan- this area. ning, performance, and budgeting processes to meet Enterprise, Center, and program objectives. Once in There is also a human capital challenge specifically place, the Agency-wide workforce planning and analysis related to procurement: as the number of procurement capability and competency management system will personnel has declined, procurement obligations have enhance the ability to identify and address workforce remained constant or grown. The challenge is to ensure needs of specific programs. We hope and expect that adequate staffing to perform contracting activities. A these steps will go a long way toward addressing this different GAO review of the status of Agency efforts key GAO issue. recognized that we are taking steps to address our future

NASA managers focus on staff development Belinda Arroyo is the team chief of the Mission Management Office Multi-Mission Deep Space Network Allocation and Planning Team, an organization that makes sure that NASA’s active space missions are allocated adequate time for using the deep space communications network. In addition to supporting 12 active missions, Arroyo’s team is working on another 16 still in development. “It’s a lot of fun to train people and teach them your area of expertise and watch them grow,” she says. “This area introduces you to a lot of different areas because you work not only with teams—like the ground data system team or the sequencing team— but you work across organizations like navigation and mission planning,” she explains. “I think working in the mission management office is a good base for some- body coming in new to a flight project. It gives you a kind of a global view.”

72 NASA FY 2002 Performance and Accountability Report workforce needs and developing an overall workforce dollars are spent. The system will align data and plan that will include the acquisition workforce. The activities across the entire business process—from initial report had positive findings with no recommendations. requirements determination through sourcing, procurement, and asset management. In addition, NASA asked NASA has an estimated 686 employees in the OIG to review our use of Smart Pay purchase cards. procurement workforce. Both the Goddard and Marshall Although the audit is not yet complete, preliminary find- Space Flight Centers are recruiting new employees into ings indicate that controls for the purchase card program this area, and we expect our Intern Program to enhance are generally effective. the NASA workforce. We also established a procurement training and career-development certification program. It Between FY 1993 and FY 2000, the percentage of funds provides our procurement professionals a standardized, available annually for competitive procurement declined consistent, and high-quality training program to facilitate from 81 percent to less than 56 percent. This situation is career development and increase knowledge of the compounded because four NASA contractors account for changing world of acquisition reform. Its combination of nearly 60 percent of our contract dollars. Competitive training and operational experience aims to enhance Sourcing is a President’s Management Agenda initiative business management skills, judgment, ability to deal and, because it is included in that section of this report, with acquisition dilemmas, and interactions with other only a brief mention is needed here. We are addressing procurement staff and contractors. this issue by improving the review process for exercising options on existing contracts (both competitive and sole Another major challenge pertains to outsourcing and source). Before awarding a follow-on contract or exercis- oversight. NASA is increasingly outsourcing its work. At ing an option, we will conduct market and other reviews the same time, we are reducing direct procurement over- to ensure that we are maximizing competition and effi- sight of our prime contractors and subcontractors. ciency. An example of a recent success in this area was a Outsourcing carries considerable risks unless the Agency contract at the Langley Research Center to establish a carefully provides for adequate internal controls for such National Institute of Aerospace. This contract and several functions and the contractors that perform the services. In cooperative agreements had been awarded repeatedly to the past several years, we have worked to strengthen these the same parties for 28 years on a sole-source basis. In internal controls. For example, we instituted a risk-based February 2002, we issued a NASA Research Announce- acquisition management initiative that seeks to integrate ment open to all universities, nonprofits, and consortia risk principles throughout the entire acquisition process. comprised of such entities. As a result, we awarded the Through this initiative, we will thoroughly consider the contract to a new entity in September 2002. implications of programmatic risk when developing an acquisition strategy, selecting sources, choosing contract Another performance issue is to use mechanisms such as type, structuring fee incentives, and conducting contrac- Earned Value Management and Performance Incentive tor surveillance. Fees to provide incentives for better contractor perform- In addition, we are improving surveillance planning and ance. We implemented numerous mechanisms in execution to target more meaningful surveillance to areas FY 2002. For example, we are using the Set Fee Initiative of significant risk. On September 13, 2002, we published to establish the fee on selected contracts. In this initiative, “Government Quality Assurance Surveillance Plan NASA pre-establishes a fee amount or percentage in the (QASP) Guidance” (PIC 02-17), and worked with the contract solicitation rather than having contractors pro- Office of the Chief Engineer to develop NASA pose fee amounts. This allows contractors to focus their Procedures and Guidelines (NPG) 7121, “Procedures and full attention on the technical merits of their proposal Guidelines for Surveillance Planning on NASA rather than trying to decide how much fee to propose, and Programs and Projects;” this document is now undergo- allows NASA to ensure that the fee amount is adequate to ing Agency review. motivate contractor performance. Another mechanism is Award Term Contracting. NASA will conduct a pilot of We are moving rapidly to make more use of electronic this nontraditional method of rewarding contractor per- commerce for procurement, including making purchases formance, in which contractors receive periodic perform- using electronic catalogs; the Internet; and purchase, ance evaluations and scores that earn them contract term fleet, and travel credit cards. However, this poses its own extensions for excellent performance. challenge: ensuring adequate internal controls for such procurements that generally involve fewer paper E-Government Initiatives approvals, less documentation, and less supervision. The IFM deployment (described in detail in the President’s E-Government, or Government’s use of electronic means Management Agenda section on Financial Management of doing business, is both a President’s Management above) will improve internal controls through a central Agenda initiative and a focus of the OIG. In its February repository of procurement information that gives man- 4, 2002, memorandum to the NASA Administrator, the agers accurate insight into where and how procurement OIG identified NASA’s development and implementation

Part I • Management Challenges 73 of e-Government initiatives as one of the Agency’s most employed a first-in, first-out procedure to pay for Agency serious management challenges. The memorandum noted obligations; this did not require the exact monies author- that with the increasing availability of electronic means ized by Congress to be used for the specific activity they for interacting with citizens, businesses, and stakeholders, had approved them for but rather called for making pay- NASA must allocate sufficient resources and manage- ments using funds that had been available longest before ment attention to e-Government. The OIG report also using newly added funds. The OIG also reported that emphasized the importance of security and privacy in pro- NASA had inadequate controls, especially documenta- viding electronic services. We recognize the implications tion, for processing deobligations (reducing the dollar of expanding our existing e-Government products and amount on contracts). services and are taking steps to implement adequate security, privacy, and other internal controls. NASA took issue with the OIG regarding the requirement to match disbursements to obligations, deeming the first- NASA is committed to optimizing use of electronic gov- in, first-out practice to be prudent, practical, and legal. ernment to meet the Congressional mandate to provide The two organizations met in FY 2001 and resolved the for the widest practicable and appropriate dissemination issue, collaborating on revising the Financial of information concerning our activities and the results Management Manual. NASA also agreed to modify the thereof. We already disseminate information about our manual to require adequate documentation for deobliga- programs, missions, and research results to a variety of tion transactions, resolving that issue as well. NASA user communities through our many Web sites and use made the recommended modifications, and the Centers Web-enabled services and systems for electronic interac- are adhering to the revised procedures. We will conduct tions when appropriate. At the same time, we are careful periodic evaluations to ensure that the new procedures to ensure security of our electronic offerings. Our specif- are followed. ic FY 2002 e-Government activities are described in considerable detail in the President’s Management Agenda With regard to the IFMP, in 1989 OMB designated section and thus will not be repeated here. NASA’s accounting systems as high risk because of obso- We continue to look closely at security and privacy issues lescence and lack of standardization. NASA’s financial when rolling out new e-Government initiatives. For exam- management had relied on many decentralized, noninte- ple, we have been a leader in the Federal Government’s e- grated systems characterized by Center-unique policies Authentication initiative. E-Authentication pertains to and procedures. In 1995, NASA established the IFMP to methods to both make sure that an online source or docu- plan, coordinate, and manage all aspects of the work nec- ment is indeed what it claims to be and to provide for reli- essary to streamline and standardize business processes able electronic signature. The initiative will allow citizens and to acquire and implement an integrated financial to interact with Federal agencies in a trusted environment. management system solution throughout NASA. The We will continue to participate in this and other Federal IFMP will improve financial, physical, and human initiatives to share the Agency’s expertise in securely resources management processes throughout the Agency. implementing e-Government services. Lessons learned from previous efforts coupled with Our general strategies for future action are outlined in the extensive benchmarking of successful business system President’s Management Agenda section on Expanding implementations were the basis for a fundamental Electronic Government. They address concerns outlined restructuring of our approach in March 2000. NASA is in the February 2002 OIG memorandum regarding secu- now in the midst of successfully implementing the IFM rity, privacy, and management controls. system across all the Centers. This is described in detail in the President’s Management Agenda section on Financial Fiscal/Financial Management Management. The next major step in the IFM will be the budget formulation module, now in detailed design phase The President’s Management Agenda initiative on at Goddard Space Flight Center. Along with the core Financial Management pertains to two areas of interest to financial module, it will provide NASA managers with the OIG: Fiscal Management and the IFMP. tools to enable them to implement full-cost management In October 2000, Congress requested information from and to consider programmatic decisions, financial the OIG about financial management issues at NASA. impacts, and Center infrastructure together when making The OIG reported problems with obligations (chiefly con- decisions. The core financial module will improve tracts) management. One of these was ensuring that funds NASA’s ability to receive and maintain an unqualified were used for the specific obligations for which they had audit opinion on our financial statements. When the been appropriated. The OIG noted that fiscal law requires program is complete, our financial and business system funds approved by Congress to be used for the specific environment will benefit from Agency-wide integrated purpose intended by the authorizing legislation, matching systems and automated processes producing consistent disbursements with obligations. NASA had instead data in real-time for decision makers.

74 NASA FY 2002 Performance and Accountability Report NASA provides new additions to the International Space Station This image of the Station was recorded on April 17, 2002, by crewmembers onboard the Space Shuttle Atlantis following the undocking of the two spacecraft some 247 statute miles above the North Atlantic. After more than a week of joint operations between the Shuttle and Station crews, 1 Astronaut Stephen N. Frick, pilot, backed Atlantis away to a distance of about 400 feet in front of the Station, where he began a 1 ⁄4-lap fly-around of the Station, newly equipped with the 27,000-pound truss shown here. The S0 truss is the first segment of a truss structure that will ultimately expand the Station to the length of a football field.

Information Technology Security ranked NASA third of 24 Executive Branch agencies in information technology security. The National Security The GAO report and both OIG letters highlighted infor- Agency characterized NASA’s information technology mation technology security as a subject of concern. The security program as mature, and our Incident Response OIG questioned the Agency’s safety from unauthorized Center received the Federal Computer Incident Response network access as NASA becomes ever more reliant on Center Crystal Eagle Award in August 2000 for respon- cyber-communications. The OIG found NASA’s informa- siveness in incident reporting. However, we still regard tion technology security program to be fragmented, lack- information technology security as a significant manage- ing clear lines of authority, policies, guidelines, and ment concern. We received $20 million in much-needed enforcement. The letters cited insufficient plans for sys- supplementary funding for improvements in our cyber- tem-level security and for disaster recovery of mission- antiterrorism posture. We provided information technolo- critical systems, inadequate technical controls at the host- gy security training to 98 percent of all civil service computer level, lack of an information-technology- employees and managers and 97 percent of all civil serv- security-skilled workforce, and inadequate training. ice system administrators, significantly exceeding our training goals. NASA found that information technology security did not constitute a material weakness: first, we have experienced Information technology security requires long-term no perceptible harm to our capital assets or employees. attention. We are setting the performance bar higher each Further, while hostile probes (for example, attempts by year. NASA and OIG will work together to track progress hackers to break into NASA’s electronic systems) in on deficiencies, trends, and projected problems. We FY 2001 increased 130 percent, successful penetrations established a “One NASA” model for information decreased 45 percent. In the same year, the Horn Report technology, upgraded and standardized our information

Part I • Management Challenges 75 technology security architecture, and reduced system and that have been largely endorsed as a roadmap to improve application vulnerabilities using system security plans the Station program management. and a program to scan systems for vulnerabilities. We have deployed intrusion-detection systems and rapid- In FY 2002, we began executing a new management strat- response procedures for attempted break-ins and have egy to achieve high-priority Station objectives within the tested smart cards to control computer and physical Administration’s and Congress’ funding limits. NASA access. Recognizing our expertise and dedication, OMB has briefed the approach to the OMB and to Congress. It designated us as the technology lead for the Federal has five major focus areas (1) The first, most important Cyber-identity Authentication Program. We are also focus is to prioritize our research plans, which are the assisting the Critical Infrastructure Protection Board in foundation for the Station’s end-state configuration. developing an Internet operations center to create an early (2) The next focus is a detailed, single-minded concentra- warning system for global network threats. Information tion on building the U.S. Core Complete configuration. technology security training will expand to include (3) We must also implement a reliable, effective, cost esti- mandatory online courses for users, managers, and mating and management system with a structured, disci- system administrators. We are also making security plined DOD-style independent cost-estimating capability planning a key component of computer systems supported by a stable set of Station requirements. We took development, incorporating risk management into the initial actions to improve our cost-estimating capability, planning process. We are now revising and updating the institute management efficiencies, and realign staff to Critical Infrastructure Protection Plan. Strategies for maximize accountability and performance. We are also future actions include secure e-mail, smart cards, and implementing an outstanding management information secure access control to documents. system. (4) Of great importance is coordinating with our international partners to identify potential growth paths and levels of international involvement. (5) Finally, we International Space Station Program must assess mission and research operations as a whole Management and Station Development because it is not enough to launch all of the components and Support Costs of the Station and its research, we must also safely operate and sustain them.

Station program management and the Station’s develop- NASA is carefully assessing operations to ensure that ment and support costs are other key areas of concern to logistics support is adequate for safety and effectiveness. GAO and OIG. After significant cost growth was identi- Even given the positive steps NASA has taken, we under- fied in early calendar year 2001, the President’s FY 2002 stand the need to demonstrate to the Administration and Budget Blueprint laid the groundwork for attaining cost Congress that we can successfully complete our mission control and regaining the credibility the program needs to within budget before external confidence can be restored. fulfill its potential. Progress in correcting past management deficiencies is monitored by the NASA Internal Control Council chaired The top-level success criteria NASA must achieve to by the NASA Deputy Administrator. Progress will also be restore confidence in its ability to successfully manage evaluated by the Station’s Management and Cost Station are safe, successful execution of U.S. Core Evaluation Task Force on November 13 and 14, 2002. Complete—the minimum Station configuration—within NASA and the OMB are collaborating on success criteria budget and on schedule; maximum allocation of program to restore International Spacer Station Program manage- resources to research, consistent with operational con- ment confidence. straints; and credible requirements, cost estimates, and analyses supporting the potential for expanding research The task force will continue to be involved during the pro- after we achieve U.S. Core Complete. These criteria will gram restructuring, providing subsequent progress evalu- demonstrate that the Space Station Program is well man- ations to NASA through the NASA Advisory Council. aged, research-driven, and affordable. The evaluations, to be conducted at one-year intervals from the date of the initial report (November 1, 2001), To this end, the President’s FY 2002 Budget Blueprint will contribute significantly to the Admin- required an external cost evaluation of the program. istration’s estimate of how well we have met the above Subsequently, an external review team, the International three success criteria. Space Station Management and Cost Evaluation Task Force, was established to perform an independent assess- Safety and Mission Assurance ment of cost and budget and to provide recommendations on how to ensure that the Station can provide maximum Recognizing the importance of safety to NASA’s people benefit to researchers, U.S. taxpayers, and our interna- and mission, OIG has taken a closer look at our Safety tional partners while staying within the Administration’s and Mission Assurance processes. This detailed scrutiny budget request. The task force provided recommendations has identified safety noncompliances at several

76 NASA FY 2002 Performance and Accountability Report Voluntary Protection Program (VPP) at the elite STAR level. High-visibility awareness programs abounded. By the end of FY 2001, two of NASA’s Centers had achieved STAR VPP recognition and were certified by OSHA as being among the best of the best in safety. In 2000 and 2001, NASA experienced the highest Shuttle flight rate in recent history with no significant in-flight anomalies. Safety performance evaluation profile scores, which measure knowledge and attitudes toward safety, improved among managers and employees. Mishap rates declined. The lost-time case rate, which measures the more serious worker injuries, fell from 0.54 in FY 1998 to 0.31 in FY 2001.

In 2002, the Senate unanimously confirmed the former Associate Administrator for Safety and Mission Assurance as NASA’s Deputy Administrator, placing a strong safety advocate at the very highest level of operational decision-making. Three more NASA activities achieved VPP STAR status. NASA’s lost-time case rate fell to 0.25—less than half of its already low FY 1998 level. Other Federal agencies and private sector companies look to NASA as a trailblazer in moving safety from being seen as a sometimes-bothersome requirement to an internalized value that is indeed a part of all operations and decisions.

Although there are still occasional noncompliances at NASA, they are far fewer than is generally expected in such a large organization. Having OIG, NASA NASA Space Shuttles transport crew members and material Headquarters, local inspectors, and third party evaluators to the International Space Station constantly on the lookout for such instances further This photo shows the Space Shuttle Atlantis lifting off from the Kennedy increases the likelihood that they will be found and fixed Space Center on April 8, 2002. Seven astronauts were en route to the before harm occurs. This constant watchfulness is funda- Station for a week of work on the orbital outpost, including the installa- mental to mishap prevention strategy and is a manage- tion of the S0 truss—centerpiece of the station’s main truss. ment strength. Our significant reduction in mishap rates confirms this: NASA’s total case rate of all injuries stands installations. Some of these noncompliances, such as at 0.84—far below the eventual FY 2005 Presidential goal failure to follow established procedures for using plastics, of 1.12 established under the Federal Worker 2000 five- foams, and adhesives, were unknown to management. year safety campaign. Others, such as lifting device deficiencies at Stennis Space Center, were originally identified by routine An organization can never simply check safety off a to-do oversight activities and later validated by the OIG. NASA list and label the action complete. A successful safety agreed with the majority of the OIG’s recommendations, effort must be constantly nurtured. NASA will continue and the Centers that had discrepancies have taken its high-performing safety practices. Using an array of corrective actions. Because of safety concerns related to risk assessment and management processes combined oversight and compliance, the OIG recommended with a deep-rooted belief in management commitment flagging safety as a management concern and giving it and employee involvement, NASA is determined to con- greater attention. tinue progress toward its long-term goal of zero mishaps.

By any measure, NASA has been one of the safest organ- Launch Vehicles izations. Our 1999 Agency Safety Initiative was designed to make our already excellent safety program one of the Launch vehicles are a continuing concern for OIG. In best in the world. Leadership repeatedly emphasized the both of its reports, it recommended that NASA develop a importance of safety. NASA was the first Federal agency pricing policy for Shuttle payloads. The OIG found that to have one of its activities certified by the Department of charges to outside agencies and organizations appeared Labor’s Occupational Safety and Health Administration arbitrary and inconsistent and failed to conform to

Part I • Management Challenges 77 statutory requirements, possibly resulting in significant Safeguards under the direction of an Assistant Administ- undercharges. NASA has taken issue with this finding, rator reporting directly to the NASA Administrator. Also questioning whether the report correctly interprets in FY 2002, NASA requested and received additional pertinent statutes and their applicability to Shuttle funding for much-needed security enhancements as well mission development. Debate between NASA and OIG as an augmentation of 35 full-time civil servants to the continued for some time in FY 2002, resolving some security staff. We created policies and standards to ensure questions but not all of them. At the end of FY 2002, our uniform procedures for granting and controlling access to two organizations met to discuss the outstanding NASA facilities, technology, and information. This has recommendations. At the meeting, NASA’s Audit increased the breadth and depth of security at NASA, pro- Followup Official directed them to meet further to discuss viding necessary tools to defend the Agency’s personnel, these recommendations and return with a final position. A facilities, assets, information, and programs. follow-up meeting is scheduled for the first weeks of FY 2003. It is likely that changes in Agency-wide In response to heightened security requirements follow- financial management will result in a new Agency policy ing the events of September 11, 2001, Congress appropri- that can better address Shuttle pricing. ated security enhancements (human resources, physical/technical countermeasures) and funds for infor- With regard to key follow-up on a past audit, “Follow-up mation technology (computer) security requirements. on Audit of Orbiter Maintenance Down Periods,” the This enabled NASA to make essential security enhance- NASA Administrator announced in early February 2002 ments across all 10 NASA Centers, reducing the Centers’ that future Orbiter Major Modifications would be per- vulnerability to security threats. In addition to increasing formed at Kennedy Space Center. We began these modifi- physical and information technology security, NASA cations on the Shuttle Discovery at the close of FY 2002. instituted centralized critical security functions, a more The following is a summary of findings and recommenda- vigorous counterintelligence and counterterrorism pro- tions of related Shuttle evaluations completed in FY 2002. gram, stricter policies on access procedures and controls, and stronger relationships between security entities and A RAND Corporation business review identified seven NASA programs that affect security. We have implement- potential business models/options for Space Shuttle ed a security and counterterrorism awareness program Program competitive sourcing. Those options are under that leverages daily law enforcement and intelligence review and we anticipate a decision on a course of action in community threat information to further minimize poten- February 2003. A Headquarters-initiated special cost-bene- tial vulnerabilities and threats to NASA’s workforce, fit assessment of the Checkout and Launch Control System mission, and assets. provided an estimate of costs and the likely date the system would be launch-capable. Based on the results, this assessment recommended canceling the system. NASA approved Cost Estimating the cancellation; we will redirect efforts toward supporting During the 1996 reorganization of NASA and the associ- and enhancing the existing Launch Processing System, ated downsizing of the workforce, especially at NASA which continues to meet ongoing Shuttle requirements. Headquarters, the Agency lost a notable portion of its This demonstrated the ability of the new cost-estimating independent cost estimating capability. The situation was function to detect and prevent an investment not in NASA’s compounded by pressures put upon the remaining cost best interest as a prudent program manager. A Cockpit estimating community to estimate missions in the “faster, Avionics Upgrade independent cost estimate was conduct- better, cheaper” mode. This mode saved money and ed this summer; the estimate agreed closely with the cur- brought about efficiencies, but it also ran a real risk of rent NASA funding profile. In addition, the Independent severely underestimating requirements. As a result, Program Assessment Office conducted a Cockpit Avionics NASA suffered through significant and demoralizing cost Upgrade non-advocate review in FY 2002. It found that the overruns on several of the faster, better, cheaper missions. project has made considerable progress in hardware design Various outside observers including the OIG, the GAO, and system and software requirements. While the contrac- the OMB, and others appropriately criticized these tor project management team has been strengthened and outcomes. NASA management recognized that its technical findings/issues from the previous review have all cost analysis capability had eroded and undertook correc- been resolved, there is still concern with the contractor’s tive measures. delivery schedule. During 1999 and 2000, we had established System Security of NASA Facilities and Management Offices at each NASA Center, incorporating Technology the cost estimating function. The offices were valuable for two reasons: One, they afforded some measure of inde- In August 2001, NASA raised the profile of issues per- pendence for cost estimating because they reported taining to security of NASA facilities and technology by directly to the Center directors, not through the project establishing the Office of Security Management and office advocacy chain of command. Second, the offices

78 NASA FY 2002 Performance and Accountability Report generally included a systems analysis capability along this report.) The new systems are designed to provide bet- with cost estimating. The systems analysis helped ensure ter and more real-time financial information and to cast that a project’s requirements had been properly estab- the data in terms of full cost accounting practices so that lished and that the design validly met the requirements. In for the first time we really know the total cost of NASA addition to establishing the offices, we clearly delineated projects. We are revising and improving our criteria for in NPG 7120.5A, “Program and Project Management,” conducting independent reviews. We will have new and many other procedural instructions, the importance of procedures defined by early FY 2003 and ready to incor- independent cost estimating as a key part of the overall porate in revisions to our documented management project-management process. These actions led to the instructions. We are completing a study on the possibili- beginnings of a renewal of the cost analysis discipline ties of privatizing the Shuttle and are adopting the cost- within NASA. benefit and risk analysis approaches used in that study to other key NASA decision-making processes. FY 2002 has seen the advent of what many NASA cost estimators have referred to as a new age in NASA cost Our plans include vigorous, continuous improvement in analysis. The new management team at NASA has dra- cost analysis. We are re-energized to provide the very best matically communicated its interest in and support of cost work possible. We are on track for recruiting the best expert, professional cost estimating within the Agency. and brightest talent for this exciting and challenging dis- The number of cost analysis positions in the Agency is cipline. We have improved cost- and financial-analysis dramatically rising at every Center: 102 positions were tools. While we recognize that cutting-edge research and made available in FY 2002 and 2003. These positions are development activities will always be a tough estimating at higher grade levels than were available before. Budget challenge, the NASA cost-estimating community is unit- resources for cost estimating tools and methodologies are ed in its determination to bring its performance and cred- being provided at levels sufficient to fund needed ibility to exemplary levels. improvements. Today, NASA cost analysts are viewed, more than ever, as a valuable part of each product devel- Environmental Management/National opment team. Their work is highly valued as a critical Environmental Policy Act Implementation parameter in the defining cost-effective missions. The National Environmental Policy Act (NEPA) is the Several more specific improvements bear mentioning. On national charter that established environmental goals and the International Space Station, we completed a major policies to protect, maintain, and enhance the environ- independent cost estimate that formed the basis for the ment. The act mandates that all Federal agencies consid- cost reserves needed over the next 5 years to ensure that er the effects of their actions on the environment as early the program is on a sound financial footing for the first as possible in the planning process and requires agencies time in its history. Independent cost estimates were to (1) gather information about environmental conse- applied to several other projects, which led to either their quences, (2) consider environmental impacts when mak- termination before unacceptable cost growth or their ing decisions, (3) consider alternatives that avoid or redesign to more cost-effective configurations. For exam- reduce adverse impacts, and (4) keep the public informed. ple, NASA cancelled a project to revise Shuttle launch The act requires that NASA integrate environmental qual- software because of unacceptable cost growth. Instead, ity with our primary mission and integrate environmental we are substantially modifying the existing launch soft- review milestones with major NASA decision points. ware system to support the Shuttle until a new transportation vehicle is operational. While such cancellations are In a March 2000 audit, OIG recommended strengthening regrettable, they send a clear signal that NASA means management controls to ensure greater visibility and business about getting its financial house in order. A new more consistent implementation of the act and made spe- cost analysis division at NASA Headquarters has been cific recommendations, several with multiple compo- established to act as gatekeeper for all NASA cost esti- nents. The recommendations generally related to mates before they go forward in the budget. This office (1) expediting update of NASA procedures and guidance also will establish overall strategic direction for NASA’s for implementing NEPA, (2) integrating act requirements cost analysis processes. This division is structured to and status checks into decision-making processes, cooperate closely with other new organizations at (3) correcting deficiencies in 13 specific programs and Headquarters working to correct NASA program projects, and (4) implementing act training for managers. management deficiencies. The Independent Program The OIG found that the deficiencies noted during the Assessment Office at Langley Research Center has been audit could delay, diminish, or preclude missions and administratively reassigned to Headquarters to strengthen related facilities projects. They also could result in NASA its synergy with these efforts. We have totally revised our having to shift scarce staff resources and budget in order financial management information systems. (See the pre- to complete consultation with other agencies and respond vious discussion of the new IFMP in the Financial to public controversy, heightened Congressional interest, Management President’s Management Agenda section of and litigation. The OIG noted compliance with the act as

Part I • Management Challenges 79 a continuing area of management concern in both its plan to the Nuclear Regulatory Commission for approval. December 2000 and its February 2002 letters. The commission approved NASA’s decommissioning plan on March 20, 2002. Funding necessary to complete In response to OIG recommendations, NASA initiated this project is part of NASA’s 5-year plan, although future rulemaking in FY 2001 to update its act implementation funding is contingent on budget and appropriation procedures, issued revised guidance, and integrated act approvals. The decommissioning project is now entering requirements into the Non-Advocate Review process, the implementation phase, with the reactor vessel planned Program Management Council reviews, and other ancil- for segmentation in January 2003. As a result, NASA con- lary guidance. In FY 2002, NASA finished correcting templates removing Plum Brook from the management deficiencies in act compliance for the projects identified concern area at the next Internal Control Council meeting by OIG and provided training to program and project in early FY 2003. offices at several Centers and at Headquarters. NASA added a module to its NASA Environmental Tracking System to track the status of compliance and associated Effectiveness of Faster, Better, Cheaper documents for programs and projects that trigger an The GAO report raised questions about the effectiveness Environmental Assessment or Environmental Impact of the faster, better, cheaper approach for space explo- Statement. Additionally, NASA has asked the academic ration. The concept of faster, better, cheaper traces its grants, budget, and facilities offices and each Enterprise roots to the late 1980s and reflects a strategy to improve to provide an annual list of planned programs and projects performance by streamlining engineering and manage- and to designate a NEPA document manager for each pro- ment practices. At NASA, this theme coincided with a posal. NASA is recommending that compliance with the trend to develop smaller spacecraft needed to perform act remain on the list of management concerns until the more focused research in the wake of discoveries made by updated “Program and Project Management Guide,” NPG large, facility-class instruments. The philosophy also 7120, is published. NASA has amended Center spread within NASA to encompass other programs and Environmental Function reviews to include a review of projects, becoming an Agency-wide strategy of process act compliance. Training for program and project offices improvement. Faster, better, cheaper as an engineering at all Centers will be completed in FY 2003. and management philosophy is slightly more than a decade old now, enough time to evaluate the success of Plum Brook Reactor Decommissioning the new practices that have been put in place within NASA and the contractor community. The Plum Brook Reactor Facility comprises about 27 acres at NASA’s Plum Brook Station near Sandusky, Overall, the philosophy has led to some important inno- OH. The facility contains a 60-megawatt thermal materi- vations. NASA and other Government organizations have als testing and research reactor, a 100-kilowatt mock-up developed numerous new spacecraft that are demonstra- reactor, and other facilities that supported the reactors. bly less expensive than their predecessors. Underpinning Although the reactors are no longer active, the Nuclear the faster, better, cheaper philosophy was a goal to speed Regulatory Commission has determined that it will not the development and infusion of new, high performance reissue NASA’s “possess but do not operate” license. technology. This allows a smaller spacecraft to return This decision effectively mandates that we decommission impressive amounts of scientific data. The Mars the facility. Pathfinder spacecraft was an example of a very successful Discovery-class mission that both demonstrated new Decommissioning the Plum Brook Reactor Facility is a technology and returned valuable scientific data. The pace significant area of concern for NASA. The OIG also noted of developing ever-more-capable spacecraft is accelerat- the problems in its second letter (February 2000) on man- ing and NASA looks forward to new generations of agement issues. Under Nuclear Regulatory Commission spacecraft with improving capabilities. regulations, NASA is terminating its license through decommissioning by 2007. Decommissioning the nuclear NASA has encountered some problems with the imple- reactors is one of NASA’s highest environmental priori- mentation of faster, better, cheaper and we are working ties. The complex planning and execution involve multiple hard to correct them. As GAO correctly points out, it is in organizations and authorities in both the public and private the area of reliability that the shift to faster, better, cheap- sectors. Further, the only identified radioactive waste dis- er has caused the greatest concern; this can be traced to posal site we can use in this effort closes in 2008. three key reasons. First, faster, better, cheaper resulted in smaller spacecraft and more numerous missions. This In FY 2001, the reactor decommissioning team consisting meant that we needed more managers and, importantly, of NASA, the U.S. Army Corps of Engineers, Argonne more reviewers to provide oversight of spacecraft devel- National Laboratories, and several nuclear facility demo- opment projects. NASA also reached outside of the lition and disposal contractors was put in place. The team Agency, placing university-based principal investigators completed the plans and forwarded a decommissioning in charge of projects. This required an unprecedented

80 NASA FY 2002 Performance and Accountability Report level of integrated project management that took a good scientific and technical performance we expect to return, deal of time to perfect. The second reason for a decline in as well as how funds are risks are spread across the broad reliability was the setting of overly aggressive cost spectrum of aerospace programs and projects. targets. Initial success with cost-saving initiatives led to In summary, faster, better, cheaper was an experiment in further reductions that resulted in unacceptable risk being management and engineering that made important contri- taken with individual projects. In short, faster, better, butions. It opened the door to a new generation of space- cheaper led to unrealistic cost targets and a reduction in craft and the proliferation of missions from which we the test and quality measurement efforts needed to assure expect a rich harvest. As a significant departure from pre- success. In a related fashion, the third reason for lowered vious practices, the faster, better, cheaper philosophy has reliability was traced to risk management practices that led to the need for refinement in the way we manage and were not symmetric across the Agency. This resulted in build aerospace systems. The result will be stronger busi- insufficient attention being paid at critical junctures in the ness methods that NASA expects will yield an array of development of some projects. higher performance and higher quality systems. In FY 2002, NASA reviewed the lessons learned from the faster, better, cheaper philosophy and began a process of The remaining three management areas were discussed in culling the positive attributes of the philosophy and incor- OIG’s December 2000 letter but not in its February 2002 porating them in Agency practices. A great deal has been letter, reflecting the significant progress NASA had made written about the effect of faster, better, cheaper and these by the middle of FY 2002. various resources were reviewed and incorporated in Agency planning. Based on careful assessment, faster, International Agreements better, cheaper is no longer being espoused as a NASA With regard to International Agreements, in its December engineering and management philosophy. NASA is com- 2000 letter to the Congress regarding NASA management mitted to the development of spacecraft that demonstrate challenges, the OIG discussed concerns and recommen- higher levels of performance, greater reliability, and dations it had stated in previous reports and management lower development costs. These three goals are not letters regarding foreign national access to technology impossible to achieve simultaneously—they are a reflec- and facilities. NASA has addressed and implemented tion of a commitment to constant product improvement. each of those recommendations over the past 2 years. At the heart of the faster, better, cheaper philosophy was a commitment to constant innovation and the need to The OIG recommended that NASA include guidance in extract the best possible performance from available either a NASA Federal Acquisition Regulations funds. NASA will retain this commitment while balanc- Supplement amendment, Procurement Information ing it with a prudent assessment of risk. Throughout the Circular, or NPG document. The guidance recommended Agency, engineers, and scientists will continue to find that all appropriate NASA contracts require the contrac- new ways to stretch resources to achieve challenging mis- tors to deliver (1) a plan for obtaining any required export sion objectives without a loss of product quality. licenses to fulfill contract requirements, (2) a listing of the contractor licenses obtained, and (3) a periodic report of Space exploration will always involve risk. As an explo- the exports effected against those licenses. The OIG also ration Agency, we expect to experience failure as we recommended that NASA revise its policy to incorporate develop unprecedented spacecraft and send them to unex- the oversight responsibilities of appropriate NASA offi- plored and hostile environments. NASA does not accept, cials for those cases in which NASA or its contractors however, losses that reflect poor product quality. To ensure obtain export licenses on behalf of a NASA program. In the highest quality standards, we have set about revamping February 2000, NASA issued a Federal Acquisition our management and engineering practices to incorporate Regulations supplement notice with general export con- the lessons we have learned. Specifically, we intend to trol guidance to contractors, and in September 2002, we instill greater uniformity in managing risk and to codify issued a Procurement Information Circular. With these these practices Agency-wide. The Agency is revising offi- two issuances, we met the OIG’s specific requirement. cial guidelines for program and project management to Most recently, in October 2002, NASA provided the OIG include the lessons learned from faster, better, cheaper the draft of a new comprehensive document, NPG 2190 activities. We have also begun to relate carefully cost tar- for the NASA Export Control Program, providing guid- gets to the complexity of the mission under development ance, instructions, and responsibilities for NASA employ- and the level of risk deemed acceptable to Agency leader- ees engaged in NASA activities involving the transfer of ship. To relate those decisions to the policymaker, NASA’s commodities, software, or technologies to foreign indi- managers are preparing techniques for communicating viduals or organizations. Agency investments in a portfolio plan. We are also strengthening our ability to perform independent assess- The procedures and guidelines document contains ments of Agency programs and projects. In the future, we several contractor oversight provisions. For example, it expect to be able to communicate more effectively the requires NASA program and project managers to oversee

Part I • Management Challenges 81 NASA-directed contractor export activities, including the appropriate use of license exemptions/exceptions; requires use of NASA-obtained licenses; and requires contractors to provide NASA with copies of relevant export records. In addition, it requires auditors to determine whether contractors using NASA-obtained export licenses or exporting at NASA’s direction are complying with the relevant regulations and record- keeping requirements. The draft document is now undergoing Agency review and approval.

With regard to a specific contractor, the OIG recommended that Boeing establish an export control program and a detailed, company-wide export policy to comply with applicable laws and regulations before using NASA-obtained export licenses for the Space Station Program. The report also recommended that NASA periodically review Boeing’s and its subcontractors’ export control programs to ensure that when they effect exports using NASA-obtained licenses in support of the Space Station Program they do so in accordance with applicable U.S. export laws and regulations. In response, Boeing provided a company-wide export control manual, which export control officials at the Johnson Space Center, the Center with lead responsibility for the program, reviewed. NASA Headquarters export control officials reviewed a copy of Boeing’s Export-Import NASA space technology is used to protect people on Earth Compliance Manual, signed by Boeing’s Vice President from anthrax of Export Management and Compliance. NASA export A technician at KES Science & Technology Inc., in Kennesaw, GA, control officials provided guidelines to the Station pro- assembles the AiroCideTiO2, an anthrax-killing device about the size of gram manager at the Johnson Space Center in May 2001 a small coffee table. The research enabling the invention started at one of 17 NASA Commercial Space Centers—the Wisconsin Center for about use of the International Space Station Special Space Automation and Robotics at the University of Wisconsin- Comprehensive export license by both NASA and its Madison. A special coating technology used in the anthrax-killing inven- contractors. We also note that the NASA Export tion is also being used inside plant growth units on the International Administrator issues direction memoranda for each Space Station. use of NASA-obtained export licenses and requires reports on all NASA and contractor exports that use System in September 2000. All NASA facilities use the those licenses. system to input, track, review, and approve all access by foreign nationals to any of our facilities. The OIG also recommended methods of reviewing and managing foreign national visitors to NASA facilities. Technology Development First, the OIG recommended revising the definition of foreign national in our policy guidance, and revising The December 2000 OIG report reviewed NASA’s tech- existing policy to establish Agency-wide requirements nology development. The report stated that while NASA’s and procedures for obtaining National Agency Checks. emphasis on technology transfer has varied over time and In response, NASA revised the Agency procedures and we have a long tradition of technology development, our guidelines document, NPG 1371.2, to define foreign recent focus on the Shuttle, the Station, and large, low- national as anyone who is not a U.S. citizen, consistent risk science missions resulted in the relatively few new with NASA’s security procedures and guidelines. The space technologies. The OIG has become interested in revised procedures and guidelines also clarify National this because of certain technology-related organizational Agency Check requirements for background investiga- changes at NASA, such as the cancellation of the High- tions of foreign nationals visiting NASA facilities. An Speed Civil Transport, the start of the Station era (open- Agency review is underway for this revised document. ing an opportunity for increased in-space research and technology development), and the consolidation of the The OIG also recommended that NASA develop and commercial aircraft industry. The OIG said that future implement an Agency-wide management information sys- reviews of NASA technology development would address tem to support the our foreign national visitor program. themes related to these items. However, the OIG issued NASA implemented the Foreign National Management no specific recommendations.

82 NASA FY 2002 Performance and Accountability Report PART II

Performance Summary of Annual Performance by Strategic Goals

Annual Performance Goals Percent Percent Not Enterprise Strategic Goals Achieved Achieved

Space Science Goal 1. Science: chart the evolution of the universe, from origins to destiny, and understand its 100 0 galaxies, stars, planets, and life Goal 2. Technology/Long-Term Future Investments: develop new technologies to enable 100 0 innovative and less expensive research and flight missions

Goal 3. Education and Public Outreach: share the excitement and knowledge generated by 100 0 scientific discovery and improve science education

Earth Science

Goal 1. Observe, understand, and model the Earth system to learn how it is changing, and the 91 9 consequences for life on Earth Goal 2. Expand and accelerate the realization of economic and societal benefits from Earth 100 0 science, information, and technology Goal 3. Develop and adopt advanced technologies to enable mission success and serve 71 29 national priorities

Biological and Physical Research Goal 1. Conduct research to enable safe and productive human habitation of space 100 0 Goal 2. Use the space environment as a laboratory to test the fundamental principles of physics, 100 0 chemistry, and biology Goal 3. Enable and promote commercial research in space 100 0 Goal 4. Use space research opportunities to improve academic achievement and the quality of life 100 0

Human Exploration and Development of Space Goal 1. Explore the space frontier 100 0 Goal 2. Enable humans to live and work permanently in space 90 10 Goal 3. Enable the commercial development of space 100 0 Goal 4. Share the experience and benefits of discovery 50 50

Aerospace Technology Goal 1. Revolutionize Aviation—Enable the safe, environmentally friendly expansion of aviation 100 0 Goal 2. Advance Space Transportation—Create a safe, affordable highway through the air and 100 0 into space Goal 3. Pioneer Technology Innovation—Enable a revolution in aerospace systems 100 0 Goal 4. Commercialize Technology—Extend the commercial application of NASA technology 100 0 for economic benefit and improved quality of life Goal 5. Space Transportation Management—Provide commercial industry with the opportunity 100 0 to meet NASA’s future launch needs, including human access to space, with new launch vehicles that promise to dramatically reduce cost and improve safety and reliability. (Supports all objectives under the Advance Space Transportation Goal)

Crosscutting Process Strategic Goals

Manage Strategically. Enable the Agency to carry out its responsibilities effectively, 70 30 efficiently, and safely through sound management decisions and practices Provide Aerospace Products and Capabilities. Enable NASA’s Strategic Enterprises 67 33 and their Centers to deliver products and services to customers more effectively and efficiently Generate Knowledge. Extend the boundaries of knowledge of science and engineering to 100 0 capture new knowledge in useful and transferable media, and to share new knowledge with customers Communicate Knowledge. Ensure that NASA’s customers receive information from the 75 25 Agency’s efforts in a timely and useful form

84 NASA FY 2002 Performance and Accountability Report Performance Discussion

Space Science

MISSION: Discover how the universe began and evolved, how we got here, where we are going, and whether we are alone

PERFORMANCE more distant galaxies that has been focused by the dark matter in the target galaxies. Hubble observed a dark mat- NASA’s space science effort seeks to chart the evolution ter object directly for the first time thereby showing that a of the universe, from origins to destiny, and understand its fraction of dark matter is composed of small, faint stars. galaxies, stars, planetary bodies, and life. We ask basic questions that have eternally perplexed human beings: The Microwave Anisotropy Probe became the first How did the universe begin and evolve? How did we get spacecraft stationed at the Sun-Earth Lagrange 2 point— here? Where are we going? Are we alone? The cumulative a position where gravitational forces of the Earth and Sun performance of our flight programs and basic research nearly cancel each other—when it began operations in allow us to achieve annual performance goals that lead to October 2001. In April 2002, the spacecraft completed the progress toward our long-term objectives. The findings first of eight planned all-sky maps of the cosmic from space probes, robotic explorers, observatories, and microwave background, the most sensitive to date. computer modeling strengthen our quest to answer ques- Scientists will use the data to determine the basic tions that explain our past and that may shape our future. parameters of the physical universe, such as size, shape, matter (including the dark matter) content, and energy Strategic Goal 1. Science: chart the evolution of content, and to determine when the first stars in the the universe, from origins to destiny, and under- universe formed. stand its galaxies, stars, planets, and life Challenges. Dark matter does not emit electromagnetic Space science had a very successful year in pursuit of this radiation; therefore, we detect it only indirectly through strategic goal. We achieved 100 percent of our perform- its influence on its surroundings. It requires extraordi- ance measures. However, we cannot provide trend data narily capable observatories such as the Chandra X-ray for specific measures because we restructured the way we Observatory and the Hubble Space Telescope to meas- measure performance. Many of our former performance ure dark matter’s subtle influences. To unravel dark measures did not represent the scientific outcomes of our matter’s influence on the evolution of galaxies and the programs; instead, they related to technology and flight universe’s structure, these observatories must be able to program development. Although we continue to measure detect the signature of dark matter across the entire uni- important development activities, most of the rewards verse. Frequently, we advance our scientific under- from what we do, and the associated benefits to society, standing by combining NASA’s space-based data with are in our science outcomes. Consequently, we revised data from the largest and most sophisticated ground- our performance measures, incorporating advice from the based observatories. NASA Advisory Committee. Over two-thirds of the content of the universe was Strategic Objective 1. Understand the structure unknown as recently as 1998. The discovery of evidence of the universe, from its earliest beginnings to its for dark energy in 1998, using data from the Hubble and ultimate fate the most powerful ground-based telescopes, has led to a Achievements. The research supporting this objective new paradigm in cosmology. We now believe that a dark seeks to (1) identify dark matter and learn how it shapes energy dominates the universe and creates a pressure galaxies and systems of galaxies and (2) determine the force in the vacuum of space that causes space itself to universe’s size, shape, age, and energy content. grow at an accelerating pace. Within the last few billion years, this mysterious dark energy has overpowered the Critical observations in the search for dark matter were mutually attractive gravitational force of all the matter in made at NASA’s observatories. The Chandra X-ray the universe, and the expansion of the universe that began Observatory instruments provided NASA with views of in the Big Bang is now accelerating (rather than deceler- an elliptical galaxy and offered the most detailed meas- ating, as we believed just a few years ago). Only with urements to date of the dark matter distribution, thereby more sensitive measurements will we be able to further eliminating the entire class of self-interacting dark matter improve our knowledge of the geometry and contents of theories. Chandra observations of the Virgo cluster of the universe. galaxies showed that dark matter is not composed of massive neutrinos. The Hubble Space Telescope measured the Plans. Chandra and Hubble observations will further amount of dark matter in several target galaxies by using define the nature and influence of dark matter. The them as gravitational lenses and observing light from Microwave Anisotropy Probe will complete analysis of its

Part II • Discussion • Space Science 87 Scientists captured the optical afterglow of a gamma-ray burst just nine minutes after the explosion, a result of precision coordination and fast mobilization of ground-based telescopes upon detection of the burst by NASA’s High-Energy Transient Explorer-2 satellite. This satellite, a U.S. collaboration with France and Japan, is the first satellite dedicated to the study of gamma-ray bursts. The satellite’s quick detection allowed scientists to determine a minimum distance between the Earth and the explosion, which has probably created a black hole. Results poured in as 100 telescopes in 11 countries tracked the burst. Using a NASA instrument on the European Space Agency’s XMM-Newton satellite, an international team of scientists saw energy extracted from a black hole for the first time. Using Chandra and XMM-Newton, scientists have found new evidence that light emanating from near a black hole loses energy as it NASA learns more about what dark matter isn’t climbs out of the black hole’s gravitational well. This Scientists say that about 90 percent of the matter in the universe is in some dark, as-yet undetected form that makes its presence finding confirms a key prediction of Einstein’s theory of felt only through gravity. All matter, by virtue of its mass, exerts a general relativity. The observation also may explain the gravitational attraction. Dark matter seems to be the gravitation- origin of particle jets in quasars. al glue holding together galaxies and galaxy clusters, for neither type of cosmic structure has enough visible mass to keep it from The Trans-Iron Galactic Element Recorder scientific bal- flying apart. loon experiment set a new flight record of almost 32 days Using this image of a cluster of galaxies in the Draco constellation, after completing two circuits of the South Pole. It scientists determined that the dark mass in the cluster is about four searched for the origin of cosmic rays, atomic particles times that of normal matter. This implies that dark matter is highly that travel through the galaxy at near light speeds and concentrated and is not noticeably self-interacting. That is, particles of dark matter are not likely to collide with one another like bil- shower the Earth constantly. liard balls and “puff out” or become diffuse throughout the galaxy. According to Dr. Michael Lowenstein of NASA’s Goddard Space Challenges. In order to make progress in achieving this Flight Center, “We still don’t know what dark matter is, but we now strategic objective, scientists must devise innovative have a much better idea of what it isn’t.’’ ways of using the universe as a laboratory. However, unlike laboratory experiments on Earth, the observers first of eight planned all-sky map and determine the size, have no control over the experiment; they are limited to shape, age, and energy content of the universe to better the activities that are taking place in the universe. One of precision than ever before. Development will continue the most difficult challenges is searching through the on future missions to make possible measurements large number of potential targets in the sky (for example, never before available. These include the James Webb galaxies) to find one appropriate for investigating the Space Telescope and the European Space Agency’s ultimate limits of energy and gravity in the universe (for Planck mission. Studies will be undertaken to identify example, a galaxy with a supermassive black hole that is space science investigations that can determine the losing rotational energy). nature of dark energy and what powered the Big Bang. A second challenge is very remote sensing. Since scien- Strategic Objective 2. Explore the ultimate limits tists cannot weigh a distant black hole on a scale or meas- of gravity and energy in the universe ure its distance with a tape measure, they must be increasingly creative in squeezing every bit of information from Achievements. The research supporting this objective the light that cosmic sources emit. Detecting the distant seeks to (1) discover the sources of gamma-ray bursts and sources with sufficient sensitivity requires that telescopes high energy cosmic rays, (2) test the general theory of rel- have larger collecting areas and highly efficient detectors. ativity near black holes and in the early universe and search for new physical laws using the universe as a lab- Plans. We will continue to use our great observatories, oratory, and (3) reveal the nature of cosmic jets and rela- Hubble and Chandra, to study the extremes of nature. We tivistic flows. The following descriptions are highlights of will supplement them with specialized smaller observato- this year’s accomplishments. ries, including the Rossi X-ray Timing Explorer and the Far

88 NASA FY 2002 Performance and Accountability Report Ultraviolet Spectroscopic Explorer. Gravity Probe-B will of the Milky Way. We also used the Hubble’s infrared begin its mission to directly detect the dragging of space- camera to probe the dust disk structure around the young time by a rotating body (the Earth). Development will con- star TW Hydrae to search for the telltale ripple signature tinue on the Gamma-Ray Large Area Space Telescope. of a planet. So far, we have not found it but we are planning further observations. Strategic Objective 3. Learn how galaxies, stars, and planets form, interact, and evolve Challenges. The foremost challenge in meeting this objective is the sheer diversity of phenomena to observe Achievements. The research supporting this objective on all scales—from those as small as the components of seeks to (1) observe galaxy formation and determine a planet’s magnetosphere to the largest structures in the gravity’s role in the process; (2) establish how a galaxy’s universe—and times—from objects almost as old as the evolution and stars’ life cycles influence which chemicals universe to stars that have yet to settle into the relatively are available for making stars, planets, and living organ- stable existence of stars like our Sun. Our approach is isms; (3) observe the formation of planetary systems and necessarily diverse. Each observatory brings different characterize their properties; and (4) use the exotic envi- insights to the physical processes involved. No one instru- ronments in our solar system as natural science laborato- ment can capture the complete picture. ries and cross the solar system’s outer boundary to explore the nearby environment of our galaxy. The fol- A multidisciplinary approach is key to progress. For lowing are highlights of this year’s accomplishments: instance, to investigate the formation of planetary systems, astronomers study the late stages of star formation, Early in the cosmos, the star formation rate may have including the evolution and structure of circumstellar been more intense than we have until now suspected disks, and search directly for planets via the “wobble” and may have peaked less than 1 billion years after the signature of the parent star. In addition, imaging of dust Big Bang. This conclusion, based on Hubble Space disks reveals structures with the telltale signature of Telescope images, helps astronomers understand how orbiting planets. the earliest galaxies may have assembled. More and more astronomers recognize that mergers play a major Plans. High-powered space observatories will advance role in building galaxies: Hubble observations of very progress on this strategic objective: The Space Infrared bright infrared galaxies have shown that most of them Telescope facility will be launched in FY 2003, and the harbor double, multiple, or complex nuclei, likely evi- Stratospheric Observatory for Infrared Astronomy will dence of mergers. begin flying in FY 2005. These two complementary infrared observatories will peer through dust and gas to The large-scale structure of the universe forms a ghostly, observe the formation of stars and planetary systems. At pervasive web of helium gas. This structure arose from the end of the decade, the new James Webb Space small gravitational instabilities and fills even the appar- Telescope will begin observing the first generation of ently empty space between galaxies. The Far Ultraviolet stars and galaxies in the universe. Additional instruments Spectroscopic Explorer satellite, along with the Hubble, will be added to the Hubble Space Telescope to, again, has yielded observations that will help test theoretical extend its vision. models of how matter in the expanding universe condensed into this web-like structure. Already, Hubble’s Strategic Objective 4. Look for signs of life in new survey camera has produced results exceeding other planetary systems expectations. Hubble continues to take breathtaking images of the intricate structure of the interstellar medi- Achievements. The research that supports this goal um, delineating the influence of star formation, stellar seeks to (1) discover planetary systems of other stars and winds, and supernovae on the chemistry and movements their physical characteristics and (2) search for worlds

NASA provides a detailed look at matter leaving a black hole Images like this, obtained from the Chandra X-ray Observatory, have given astronomers their most detailed look to date at the X-ray jet blasting out of the nucleus of M87, a giant elliptical galaxy 50 million light years away in the constellation Virgo. At the extreme left of the image, the bright galactic nucleus har- boring a supermassive black hole shines. Strong electromagnetic forces created by matter swirling toward the supermassive black hole may produce the jet. These forces pull gas and magnetic fields away from the black hole along its axis of rotation in a narrow jet. Inside the jet, shock waves produce high-energy electrons that spi- ral around the magnetic field and radiate. High-speed charged particles such as electrons, emitting radiation while accelerated in a magnetic field, cause this radiation.

Part II • Discussion • Space Science 89 that could or do harbor life. The following are highlights of FY 2002 accomplishments: NASA instrumentation on the Keck telescopes in Hawaii continues to discover planets around nearby stars; the total is now over 100. These discoveries increase understanding of processes that lead to stable planetary systems that could harbor life. A major step in the quest for life outside our solar system is to characterize already- discovered planets. Hubble has made the first direct detection of the atmosphere of a planet orbiting a star outside our solar system. Spectral analysis of the planet as it passed in front of its parent star allowed astronomers to detect the presence of sodium in the planet’s atmosphere. This feat demonstrates the enormous potential of using this technique to study NASA findings allow first chemical analysis of an atmosphere planetary atmospheres and to search for chemical markers outside the solar system of life beyond Earth. Astronomers using the orbiting Hubble Space Telescope have made the first direct detection and chemical analysis of the atmosphere of Challenges. This objective’s principal challenges are a planet outside our solar system. Shown here as an artist’s render- technological. Tantalizing observations—from the ground ing, the planet orbits a yellow, Sun-like star that lies 150 light-years away in the constellation Pegasus. as well as from space—have shown that planetary systems are common and that they exist in very diverse forms. Caltech’s David Charbonneau and Timothy Brown of the National Center for Atmospheric Research used Hubble’s spectrometer to However, the next steps in understanding extra-solar detect the presence of sodium in the planet’s atmosphere. This planets involve direct detection of their light—a unique observation shows the potential of this method to identify the formidable challenge, akin to detecting a firefly next to a chemical makeup of alien planets’ atmospheres and search for the searchlight pointing toward you. There are also theoretical chemical markers of life beyond Earth. “This opens up an exciting new phase of extra-solar planet exploration,” said Charbonneau. challenges in modeling the atmospheres of planets that “[Now] we can begin to compare and contrast the atmospheres of may be very different from those in our solar system. planets around other stars.” However, these differences represent not only a challenge but also a tremendous opportunity to learn about exotic planets that do not exist around our Sun, but could have. The Kuiper Belt is a collection of icy bodies in a region Plans. NASA has a phased approach to the technologies past the orbit of Neptune. In the past year, NASA-spon- and science needed to detect and characterize planets. In sored astronomers discovered Quaoar, the largest Kuiper the near term, nulling technologies will be demonstrated Belt object to date. At its discovery, the astronomers esti- with the Keck Interferometer and the Large Binocular mated Quaoar’s size to be about 750 miles in diameter. A Telescope in Arizona. Research will continue with the Hubble image of Quaoar confirmed the their estimate. Hubble Space Telescope and NASA-funded ground- Some astronomers speculate that Kuiper Belt objects as based observations to detect and characterize extra-solar large as the Earth remain undiscovered. planets; this information will set the science require- Jupiter’s moon Io is the most volcanically active body yet ments for future missions. Later this decade, the Kepler discovered in the solar system. The amount and type of its mission will be launched to discover Earth-sized planets. volcanic activity may shed light on the geological At the end of this decade, the Space Interferometry mis- processes that were at work early in the history of the sion will be launched to survey the solar neighborhood Earth. Our Galileo spacecraft continued its highly pro- for Earth-like planets. All of these activities will culmi- ductive mission by making two close flybys of Io. The nate in the Terrestrial Planet Finder, to be launched in the images showed how quickly volcanic eruptions and next decade. deposits of volcanic material change Io’s surface. During Strategic Objective 5. Understand the formation one of these flybys, Galileo detected a volcanic plume and evolution of the solar system and the Earth approximately 180 miles high, the highest ever seen. within it Challenges. Because they reside in the outermost Achievements. The research that supports this goal seeks fringes of the solar system, Kuiper Belt objects appear to inventory and characterize the remnants of the original extremely faint. It is difficult to find them, difficult to material from which the solar system formed, learn why track them once they have been found, and difficult to the planets in our solar system are so different from each determine their physical characteristics. Most of the other, and learn how the solar system evolved. The follow- objects discovered to date are the larger and closer ones, ing are highlights of FY 2002 accomplishments: simply because they are the brightest, and therefore, eas-

90 NASA FY 2002 Performance and Accountability Report iest to find. However, we must know the true distribution surface has led to the conclusion that the planet was of sizes of Kuiper Belt objects, their true distribution in warmer and wetter at some point in its history and there- space, their compositions, and the nature of cratering on fore may have sustained life. This leads to questions such their surfaces in order to understand the processes— as: How much water was there? For how long? Where did including collisions—that were at work during the forma- it go? The Mars Odyssey discovery may provide at least tion of the solar system. a partial answer to the last question by shedding light on Mars’s modern water inventory. Continuing refinement of Plans. In the near future, the results of recent Kuiper Mars Global Surveyor observations suggesting that mod- Belt discoveries will take studies of the processes and ern outbreaks of liquid water formed gullies has intensi- materials that formed the solar system out of the realm fied interest in subsurface storage of water in confined of inference and into the realm of conclusions based on acquifers, potentially signaling the presence of subsurface hard evidence. From this hard evidence, we may be able reservoirs worthy of exploration. to infer more about similar features around other stars. The search for near-Earth objects (see Objective 8 below) We have also learned a great deal about the range of con- has also brought to light some smaller Kuiper Belt ditions in which life on Earth can thrive. Scientists have objects. Observing such objects with our new Space recently discovered a large variety of eukaryotic Infrared Telescope facility will represent a great leap for- microbes—single cells with nuclei—that thrive in an ward in measuring their size. In addition, close-up obser- extremely acidic environment with a high concentration vations of Pluto and other Kuiper Belt objects from a of toxic heavy metals. Scientists have also discovered flyby mission would yield invaluable data about their microbes that can live under pressures about 1,000 times composition and their cratering and collision histories. A greater than the atmospheric pressure at the Earth’s sur- Pluto and Kuiper Belt mission is a top priority of the face. These discoveries increase by tenfold our estimate recent Decadal Survey of Solar System Exploration con- of the range of conditions under which life might exist in ducted by the National Research Council. the solar system. In September 2003, the Galileo mission will complete its Challenges. The Mars Odyssey experiment that detect- 35th orbit of Jupiter, and the spacecraft will plunge into ed subsurface ice on Mars was able to reliably measure to the planet’s atmosphere. Galileo launched in 1989, a depth of about 1 meter. There remains the question of reached Jupiter in 1995, and since then has returned stun- whether the ice extends to a greater depth, which would ning science data. In July 2004, our Cassini spacecraft mean there would be much more water than has been dis- will enter orbit around Saturn. Six months later, it will covered so far. Another question is the degree to which send the European Space Agency’s Huygens probe into the ice in the Martian soil exchanges with the atmosphere the dense atmosphere of Saturn’s planet-sized moon, and subsurface. This has a direct bearing on the existence Titan. Huygens will sample the physical and chemical of ancient water on Mars. conditions of Titan’s atmosphere and surface, which may be similar to those on the early Earth. For the next four Plans. In 2004, NASA will deploy twin Mars exploration years, Cassini will study all aspects of Saturn—its satel- rovers on the surface of Mars. The rovers will search for lites, rings, and magnetic field. geological evidence of the past action of water. If the Strategic Objective 6. Probe the evolution of life rovers find mineral or chemical evidence of water-laden on Earth, and determine if life exists elsewhere in sediments on Mars, it will be the first direct evidence that our solar system Mars must have harbored persistent liquid water at its surface in the geological past. That information may Achievements. The research that supports this objective suggest experiments the 2009 Mobile Science Laboratory seeks to (1) investigate the origin and early evolution of should undertake to look for organic materials. The life on Earth and explore the limits of life in terrestrial laboratory will analyze Mars’s surface for organic environments that might provide analogs for conditions molecules, isotopic signatures, and other indicators of on other worlds, (2) determine the general principles gov- past biological activity. Before that happens, however, the erning the organization of matter into living systems and 2005 Mars Reconnaissance Orbiter will look for evidence the conditions for the emergence and maintenance of life, of water-laden sediments or active hydrothermal and (3) chart the distribution of life-sustaining environ- processes to help select the site for the mobile science ments within our solar system and search for evidence of laboratory. The orbiter will also carry high-resolution past and present life. The following are highlights of subsurface sounding radar to follow up on the Mars FY 2002 accomplishments: Odyssey findings. It may be able to better define the depth A major achievement in FY 2002 was the Mars Odyssey to which high-latitude water ice deposits extend. mission’s discovery of extensive high-latitude deposits of Depending on the landing site selected, the Mobil Science water ice beneath a thin veneer of dust on Mars. Ample Laboratory may be able to conduct in-situ investigations evidence that liquid water once flowed on the Martian to directly search for subsurface liquid water.

Part II • Discussion • Space Science 91 To better understand and measure features related to life both on Earth and beyond, NASA has started two research and technology programs. Astrobiology Science and Technology for Exploring Planets is a new science-driven effort to enable a new generation of planetary exploration through robotic research in extreme environments. As analogs for planets, extreme Earth environments are venues for cutting-edge astrobiology research and for creating advanced exploration capabilities. The program will develop astrobiology instruments, platforms, and operation procedures. We will use these NASA finds direct evidence of water on Mars in extreme Earth environments to both validate them Using instruments on the Mars Odyssey spacecraft, surprised sci- and to improve our knowledge of life on Earth. The entists have found enormous quantities of buried treasure lying just Astrobiology Science and Technology Instrument under the surface of Mars—enough water ice to fill Lake Michigan twice over. Development program will develop instruments from concept through near-flight ready status. In this image, the deep blue colors show soil enriched by hydrogen. Light blue, green, yellow, and red colors show progressively Strategic Objective 7. Understand our changing smaller amounts of hydrogen. The deep blue areas in the polar regions may contain up to 50 percent water ice in the upper three Sun and its effects throughout the solar system feet of the soil. A layer of carbon dioxide frost (dry ice) hides the Achievement. The research that supports this objec- hydrogen in the far north. Light blue regions near the equator contain slightly enhanced near-surface hydrogen. This hydrogen is, tive seeks to (1) understand the origins of long-and most likely, chemically or physically bound because water ice is not short-term solar variability, (2) understand the effects stable near the equator. of solar variability on the solar atmosphere and heliosphere, and (3) understand the space environment of the direct and immediate link than expected between events Earth and other planets. The following are highlights of in the ionosphere and the magnetosphere. FY 2002 accomplishments: These complement other missions and provide a new For the first time, NASA researchers were able to overview of the entire Sun-Earth system that allows im- observe the flow of energy from the Sun’s interior to its proved characterization of cause-and-effect relationships final deposition in Earth’s atmosphere. To do this we in the flow of energy and matter through the solar system. are using two new observational satellites— Challenges. A magnetic variable star modulates our Thermosphere, Ionosphere, Mesosphere Energetics and solar system and our home planet—a fact that increases in Dynamics, and Ramaty High Energy Solar importance as our increasing use of technology makes us Spectroscopic Imager—with older observing systems to ever more vulnerable to solar disruptions. As we learn provide a new view of Sun-Earth system behavior. more about the elements of the Sun-Earth system, their The Ramaty High Energy Solar Spectroscopic Imager, interconnected nature gains importance. We must make a NASA explorer mission, provided solar x-ray and the best use of existing assets and incorporate new find- gamma-ray images in April 2002 that showed a surpris- ings to provide urgently needed knowledge about the ing result. The emission from the hottest flare material Sun-Earth system. appeared just before the lower temperature brightening Sun-Earth connection science is challenging because con- observed by the Transition Region and Coronal ditions vary rapidly and on fine spatial scales near Earth, Explorer in ultraviolet light. Theorists now need to fig- at the Sun, and in the solar wind. Measurements are ure out an energy release mechanism that would pro- extremely sparse even in the areas of greatest physical duce the highest temperature plasma first. interest, so distinguishing position information from temporal changes requires observations from multiple sen- At the other end of the Sun-Earth connection that same sors and multiple spacecraft. Further, combining and day, the Thermosphere, Ionosphere, Mesosphere understanding these data demand advanced database and Energetics, and Dynamics spacecraft measured the data analysis tools. response of the Earth’s upper atmosphere. The craft provided the first global surveys of the plasma deple- Continued progress requires development of advanced tions that can disrupt communications and navigation mission concepts to expand our knowledge of the system’s systems. Those observations combined with those from physical characteristics and the processes for transmission the Imager for Magnetopause to Aurora Global of energy and matter through it. To achieve the National Exploration spacecraft and other sources show a more Space Weather Research Program’s goals, we will need to

92 NASA FY 2002 Performance and Accountability Report develop better detection hardware and analytic techniques. Solar Anomalous and Magnetospheric Particle Explorer Providing the most useful data demands balanced use of show that the actual geomagnetic cutoffs generally fall assets based on a careful review process. below previously calculated values and that the Earth’s polar cap is larger than we had expected. At these times, Plans. The Sun-Earth connection spacecraft will continue the radiation dose at satellites such as the Station is sev- to study specific topics such as helioseismology—the eral times greater than expected, with impacts for both study of the interior of the Sun. However, we will place humans and equipment on board. more emphasis on using the spacecraft to study the behavior of the Sun-Earth system. Challenges. The near-Earth object survey involves a highly specialized form of astronomy that requires We will continue to formulate and develop missions for searching for extremely faint objects over large portions the Solar Terrestrial Probes and Living With a Star of the sky. Fortunately, large-format electronic imaging Programs. We will continue to pursue new partnerships, detectors that have become available in recent years, com- such as the International Living With a Star Program, and bined with powerful computer software that automates make cost-conscious development choices to augment the search for faint objects in the images, have dramati- both programs. Partnerships are an excellent way to max- cally increased the productivity of these search efforts. imize return for NASA and other organizations. Potential Sun-Earth connection partners include the U.S. Air Force, Improving space weather forecasting requires under- the European Space Agency, the National Oceanic and standing of the interactions of complex systems. This Atmospheric Administration, the National Science new science requires cross-disciplinary coordination of Foundation, and U.S. industries. research at every level, from instrument development, to data collection, to analysis and interpretation. We are planning a new operational program to investigate the heliosphere using existing Agency assets. One possi- Plans. NASA has commissioned a science definition bility is a plasma turbulence investigation to learn how to team to study the feasibility and cost of extending the anticipate space weather effects on the Earth’s magnetosphere and ionosphere more accurately. Strategic Objective 8. Chart our destiny in the solar system Achievements. The research that supports this objective seeks to (1) understand the forces and processes, such as asteroid impacts, that affect the habitability of Earth; (2) develop the capability to predict space weather; and (3) find extraterrestrial resources and assess the suitability of solar system locales for the future of human exploration. The following are highlights of this year’s accomplishments: The effects of asteroid impacts on Earth became evident in the early 1980s when scientists first associated the extinction of the dinosaurs with an asteroid impact. More recently, numerical modeling suggests that impacts by asteroids as small as 1 kilometer in diameter could cause global climate changes, some of which would be globally devastating. At the direction of Congress, NASA supports NASA records Earth’s response to strong solar storms a program to discover 90 percent of the near-Earth objects NASA's Thermosphere, Ionosphere, Mesosphere, Energetics and larger than 1 kilometer by 2008 and to determine their Dynamics spacecraft observed the response of Earth's upper atmos- orbits with sufficient accuracy to predict whether any phere to a series of strong solar storms that occurred in late April 2002, of them pose a threat to Earth. In the past year, scien- providing important new information on the final link in the Sun-Earth tists have cataloged 104 new near-Earth objects larger Connection chain geared toward explaining the physical processes than 1 kilometer; the total number discovered to date connecting the Sun and Earth. is 628. Fortunately, none of these poses a foreseeable Data from the Global Ultraviolet Imager instrument shows intense auro- threat to Earth. ras, indicated in red, occurring over the northern polar region during solar storms and extending much further south than usual. Several data Space weather affects many technological systems. tracks, acquired during multiple spacecraft passes, are superimposed over an Earth image to show the location of the auroras. One of the During large solar particle events, energetic particles questions Sun-Earth Connection scientists are trying to solve is how enter the Earth’s magnetosphere above a highly variable, and why Earth's atmosphere responds differently to various types of but predictable cut-off latitude. Measurements by NASA’s solar storms.

Part II • Discussion • Space Science 93 near-Earth object search to include much smaller objects that are capable of causing regional devastation. However, these objects are much more numerous and much fainter than the objects larger than 1 kilometer we are currently focusing on. The science definition team will estimate the assets needed to detect these small objects; the volume of data that would need to be collected, trans- mitted, and stored; and the magnitude of the computational effort.

The Living With a Star Program will contin- NASA’s new camera captures unprecedented detail ue developing focused missions, conducting its engi- The Advanced Camera for Surveys, the newest camera on NASA’s neering test-bed flight program, and further defining the Hubble Space Telescope, has captured a spectacular pair of galax- data environment. Partnerships within the International ies engaged in a celestial dance of cat and mouse or, in this case, Living With a Star Program will augment what our pro- mouse and mouse, located 300 million light-years away. The image of the merging galaxies shows more detail and more stars than gram can achieve independently. ever before. Strategic Objective 9. Support of Strategic Plan In the galaxy at left, the bright blue patch is a vigorous cascade of science objectives; development/near-term future clusters and associations of young, hot blue stars, whose forma- investments (Supports all objectives under the tion was triggered by the tidal forces of the gravitational interaction between the two galaxies. Streams of material can also be Science goal) seen flowing between the two galaxies. The clumps of young stars Achievement. The American people have chartered in the long, straight tidal tail [upper right] are separated by fainter regions of material. These dim regions suggest that the clumps of NASA to explore our solar system and the universe stars formed from the gravitational collapse of gas and dust that beyond, building and launching missions to achieve ambi- once occupied those areas. Some of the clumps have luminous tious scientific goals. Several highly innovative missions masses comparable to dwarf galaxies in the halo of our own Milky are now in design and fabrication. Once launched and Way Galaxy. operational, we expect them to provide images and data designing, building, and testing these spacecraft, we must that will significantly advance our understanding of our balance the competing goals of scientific capability, reli- solar system and universe and educate and inspire the ability, and cost. We must accept some risk, while learn- next generation of explorers. ing from our mistakes and doing everything reasonable to Highlights for FY 2002 included the successful launch ensure mission success. Managing diverse and complex and start of operations of several missions, including: missions is not a trivial challenge, but our record is over- whelmingly one of success. • Thermosphere, Ionosphere, Mesosphere Energetics and Dynamics, launched in December 2001 to study Plans. After the well-publicized failures of the Mars the highest levels of Earth’s atmosphere and how it Polar Lander and Mars Climate Orbiter missions in late interacts with wind from the Sun 1999, we intensively reviewed our mission design and development processes. We made numerous changes, • The Reuven Ramaty High Energy Solar Spectro- including increasing prelaunch testing requirements scopic Imager, launched in February 2002 to study and making use of independent review teams. Despite solar flares these changes, we will continue to face the challenges •The fourth Hubble Space Telescope servicing mission, noted above, because we must balance the competing completed in March 2002, which multiplied Hubble’s goals of scientific capability, reliability, and cost. power by about a factor of 10. Nevertheless, the long-term trend over the last several decades is one of increasing success, and we will strive In addition, NASA is building and testing over a dozen to continue the trend. other space science missions that we will launch in FY 2003 and 2004. Data from this generation of space- Strategic Goal 2. Technology/Long-Term Future craft will reshape humanity’s understanding of the uni- Investments: develop new technologies to en- verse and our place in it. able innovative and less expensive research and flight missions. Challenges. Building robotic spacecraft to tease out the secrets of the universe will always be challenging. Each New high-technology equipment and materials must be spacecraft is unique and complex, with greater capabili- ready for use in future space science missions, many of ties than its predecessors had, and presents its own set of which are impossible without them. Technology activities technical hurdles to be overcome before launch. In can range from basic research to flight-ready development.

94 NASA FY 2002 Performance and Accountability Report Our research and technology development approach Challenges. In 2002, the New Millennium Program requires that we overcome all major technological hurdles encountered problems due to a lack of available launch before a science mission’s development phase begins. In vehicles. As a result, the Space Technology-5 mission, FY 2002 we achieved 100 percent of our performance previously scheduled for launch in May 2004, will be measures for this strategic goal. delayed at least 6 months.

Strategic Objective 1. Acquire new technical The propulsion technologies recently selected for devel- approaches and capabilities. Validate new tech- opment involve many groups that must coordinate and nologies in space. Apply and transfer technology communicate well. An organizational change may be necessary to ensure this. Achievements. Science theme: Sun-Earth connection— The New Millennium Program flight-validates emerging Plans. Because of the difficulties encountered with technologies. We restructured the program to increase launch availability, NASA is pursuing alternative pro- openness and competition, reduce mission size and cost, curement strategies to obtain the required launch vehicle and ensure that we focus on demonstrating technology for the ST-5 mission and to resolve the issue for future rather than gathering science data. In FY 2002, the Space missions as well. Technology-5 mission proceeded to manufacturing, testing, and integration. This mission will flight-demonstrate The Living With a Star Program will move forward with a miniaturized spacecraft that performs just like larger the Solar Dynamics Observatory and other missions that satellites, but benefits from the cost advantages of small- will observe the Sun and track disturbances originating er size. Its instruments will deliver high-altitude space there. The program will place constellations of small weather data. satellites around the Earth to measure effects here. Scientific theme: Astronomical search for origins— The In-Space Propulsion Program is continuing to During 2002 the James Webb Space Telescope (formerly explore several exciting technologies for future explo- the Next Generation Space Telescope) team selected ration of our solar system. For example, our future robot- TRW, Inc., (now part of Northrop Grumman Corp.) as ic spacecraft may cruise among the planets like sailboats prime contractor. in space or perhaps be propelled from planet to planet by advanced ion engines. Science theme: Solar system exploration—The In-Space Propulsion Program develops new mission technologies Strategic Goal 3. Education and public out- to reduce trip times, increase payload capabilities, and reach: Share the excitement and knowledge reduce propulsion system costs. This year the program generated by scientific discovery and improve selected several propulsion technology proposals for fur- science education. ther development: NASA met its space science education and public outreach performance goals for FY 2002 by satisfying seven out of •Aerocapture uses a planet’s atmosphere, rather than the eight performance objectives for this strategic goal. on-board propulsion, to slow a spacecraft enough to This performance continues a trend of rapid growth in enter orbit around a planet. Carrying less fuel for a space science education and public outreach activities. braking maneuver makes it possible to conduct long- This growth is the outcome of the policy that every NASA term orbital missions instead of planetary flybys. space science research program and flight mission must •Nuclear electric propulsion may eventually greatly include a substantial education and public outreach effort. improve the capability, sophistication, and reach of science missions. Strategic Objective 1. Share the excitement of • Solar sails—thin, lightweight membranes propelled space science discoveries with the public. through space by sunlight—may offer a relatively Enhance the quality of science, mathematics, and inexpensive, propellant-free way to travel through the technology education, particularly at the pre- solar system. college level. Help create our 21st century scientific and technical workforce These awards were openly competed and awarded to researchers from industry, universities, and NASA centers. The extent and breadth of our space science education and public outreach activities in FY 2002 was substantial. We Scientific theme: Structure and evolution of the universe— carried out approximately 330 activities and produced 70 The Gamma-ray Large Area Space Telescope will observe new products during the year. Because many of these thousands of black holes, magnetized pulsars, and gamma- activities were multiple events, the total number of events ray bursts throughout the universe, directly contributing to was 3,700. The events took place in all 50 states, the NASA’s mission to explore the universe. In 2002, the team District of Columbia, and Puerto Rico. Some 350,000 stu- completed the telescope’s preliminary design phase and dents, teachers, and members of the public participated began instrument development. directly in NASA space science education and public

Part II • Discussion • Space Science 95 outreach activities during FY 2002. An additional 6 million people participated in Web activities. The following are highlights of FY 2002 achievements: External evaluations of space science education and public outreach activities indicated that their effect on audiences was very positive. Educators found the number and diversity of NASA space science educational materials impressive, appreciated the hands-on nature of the materials, and reported that their students found the materials exciting and engaging. We received awards for our education and public outreach efforts from the National Science Teachers Association, the National Academy Press, and the American NASA helps students explore Mars Library Association, among others. A group of small, unnamed craters in the Martian southern hemisphere was the first site captured by a group of middle school stu- Our education and public outreach partnerships with dents who operated the camera system onboard NASA’s Mars more than 500 major scientific, government, and educa- Odyssey spacecraft. The acquisition of the image marked the tional institutions or organizations enhanced the effort. In beginning of the Mars Student Imaging Project, a science educa- FY 2002 these partners included major curriculum devel- tion program funded by NASA and its Jet Propulsion Laboratory and operated by the Mars Education Program at Arizona State opers such as the Mid-continent Research for Education University. The project gives thousands of fifth to 12th grade stu- and Learning and the Lawrence Hall of Science; educa- dents the opportunity to do real-life planetary exploration and to tional and scientific professional societies such as the study planetary geology using Odyssey’s visible-light camera. National Science Teachers Association, the Association “It was incredible to watch their faces. They really understood of Science-Technology Centers, and the National and appreciated what they were doing and that they were the Organization of Black Chemists and Chemical Engineers; first people on Earth to see that place on Mars,” said Dr. Philip government agencies and organizations such as the Christensen, the camera system’s principal investigator at Arizona State University. Here, students study Mars images and Smithsonian Institution, the Lawrence Livermore National image processing. Laboratory, and the National Science Foundation; community organizations such as the Girl Scouts, the Boys Program Evaluation and Research Group of Lesley and Girls Clubs of America, and the Civil Air Patrol; more University. This is the first time that such feedback on than 150 museums, science centers, and planetariums; program outcomes and impacts has been available. and more than 75 colleges and universities, including Finding ways to respond to it is the major challenge nearly 30 minority institutions. facing the NASA space science education and public out- The 15 minority institutions first funded in FY 2001 reach program in FY 2003. under the NASA Minority University Education and The feedback led to the following conclusions: Research Partnership Initiative in Space Science to devel- The program should improve the coherence of its edu- op space science capabilities on their campuses continued cation products, review them critically for quality, and to make tremendous progress. In academic programs, the base them more closely on curriculum standards. The 15 minority institutions reported that they have estab- program needs to provide training in education for its lished on their campuses 22 new or redirected space sci- education and public outreach specialists, who are often ence faculty positions, 11 new or revised space science scientists or technologists who have adopted education degree programs, and 66 new or revised space science as a new career. The NASA Space Science Education courses. Notable among these programs was a new sys- Resource Directory needs to be more accessible to edu- tem-wide space science degree program established at the cators from two standpoints: We should advertise it bet- City University of New York that is open to students at ter; and we should make it easier and faster to use with any college within its system. better search options. Challenges. Feedback about the quality of the space sci- Plans. Responding to the feedback received in FY 2002 is ence education and public outreach program and its edu- the major program priority for FY 2003. We will give seri- cational impact on the audiences it serves came during FY ous attention to improving the coherence of the vast array 2002 from three major sources: (1) discussions at the of space science educational resources that we produce Chicago NASA Space Science Education and Public and offer. A working group of the NASA Space Education Outreach Conference, (2) a task force chartered by the Council will examine the idea of establishing a space sci- NASA Space Science Advisory Committee, and (3) the ence curriculum as the foundation for this coherence. We

96 NASA FY 2002 Performance and Accountability Report will also explore options for providing professional devel- the staffing plans being developed by the new NASA opment opportunities for the providers of NASA space education organization. science education and public outreach. We are already developing procedures for evaluating the quality of educa- We will make several improvements in the annual tional materials in the Space Science Education Resource performance goals for FY 2003. The metric that every Directory, making the results of those evaluations mission have a funded education and public outreach available to users, and including audio-visual and hard- program will be revised and clarified to distinguish copy materials in the directory. We will fully implement requirements for stand-alone missions from those for these procedures and will devote attention to publicizing umbrella programs that involve several missions. We will the directory to a wider audience, making it easier to establish performance measures for measuring the locate and use, and adding additional search capabilities. involvement of space scientists in education and public These processes will be integrated wherever possible with outreach. We will delete the measure calling for a space the development of a new NASA-wide education science education and public outreach annual report since Web portal. production of this report is routine. We will add a metric for developing distribution mechanisms for non- We will continue to explore options for acquiring the electronic materials. staff time necessary to review the education and public outreach programs of missions during their development and implementation phases. We will fold these needs into

Part II • Discussion • Space Science 97

Earth Science MISSION: Develop a scientific understanding of the Earth system and its response to natural and human-induced changes to enable improved predection of climate, weather, and natural hazards for present and future generations

NASA seeks to understand the total Earth system and the effects of nature and people on the global environment. This effort is integral to our mission to better understand and protect our home planet. From space, NASA provides information about Earth’s land, atmosphere, ice, oceans, and life that is obtainable in no other way, providing a view of our environment as only NASA can. NASA uses satellite systems to study the interactions among these Earth components to advance Earth-system science. Our research results form the basis of environmental policy and economic investment decisions that serve our society and better life. NASA develops innovative technologies and science- based applications of remote sensing to solve practical societal problems in agriculture and food production, natural hazard mitigation, water resources management, regional planning, and national resource management. We collaborate with other Federal agencies, industry, and State and local governments. We enhance the science, mathematics, and technology education of all NASA tracks ice shelf disintegration Americans. NASA combines the excitement of scientif- Moderate Resolution Imaging Spectroradiometer satellite imagery analyzed at the University of Colorado’s National Snow and Ice ic discovery with the reward of practical contributions to Data Center revealed that the northern section of the Larsen B ice the success of our planet while inspiring the next gener- shelf, a large floating ice mass on the eastern side of the Antarctic ation of explorers. Peninsula, has shattered and separated from the continent. The shattered ice formed a plume of thousands of icebergs adrift in the Weddell Sea. The shelf is now 40 percent the size of its previous Strategic Goal 1. Observe, understand, and model minimum stable extent. For reference, the area lost in this most the Earth system to learn how it is changing, and recent event dwarfs Rhode Island in size. the consequences for life on Earth This is the largest single event in a series of retreats by ice shelves in the peninsula over the last 30 years. The retreats are attributed Using space for cutting-edge research about Earth has to a strong climate warming in the region. become a NASA hallmark. In FY 2002, numerous satellite missions, field campaigns, and data analyses Thus, we can make global environmental observations improved our understanding of Earth. We increased our that were previously not possible. Advances in FY 2002 understanding of Earth’s global carbon cycle, global included discoveries about sea ice, ocean biology, and water cycle, long-term climate variability, atmospheric polar ice sheets. composition, and the planet’s interior and crust. We achieved 20 of 22 performance goals for a 91-percent success rate, and we intend to achieve all our performance Scientists are intrigued with the discrepancy in Arctic and goals in FY 2003. Antarctic ice changes. While Arctic ice decreased by several percent per decade between 1979 and 2000, Antarctic ice increased slightly. Scientists are also studying how the Strategic Objective 1. Discern and describe how Arctic ice’s retreat could significantly affect ocean circu- the Earth is changing lation. In the ocean biology field, combined data sets from Modern observational techniques have revolutionized our two different satellite instruments contribute to our knowl- abilities to explain global phenomena associated with edge of phytoplankton distribution in the oceans. This nature- and human-induced environmental change. Part microscopic organism plays a big part in ocean life and is of our success stems from the accurate data sets we col- the foundation for the marine food chain. Phytoplankton lect, which, in turn, permit us to address changes in Earth play an important role in the exchange of carbon between systems in a quantitative way. NASA’s state-of-the-art, the biosphere and atmosphere. The exchange contributes space-based observational methods extend both our view to the buildup of atmospheric carbon dioxide that can, in of previously observed global environmental parameters turn, affect climate. From space, NASA’s Terra and Aqua and our measurements over a progressively longer period. satellites help scientists investigate the differences on a

Part II • Discussion • Earth Science 99 global scale between living and nonliving organisms in Data from several NASA spacecraft, including Terra, the coastal regions and estimate the capacity for photosynthe- sea-viewing Wide Field-of-view Sensor (SeaWiFS) satel- sis in coastal and oceanic areas. lite, and the Total Ozone Mapping Spectrometer (TOMS) instrument helped establish an unprecedented database In our study of polar ice sheets, we have also used infor- with information on not just aerosol presence but also the mation about ice-covered regions in polar areas, such as nature of the aerosol particle. For example, we were able Greenland and Antarctica, to make quantitative assess- to observe whether the particle absorbs enough solar radi- ments of changes in ice cover, especially at the margins ation to have a net warming or cooling effect on a local between ice sheets and the ocean. This knowledge helps climate, its height, and its interaction with the underlying scientists test climate models and improves our ability to climate. In combination with ground-based data, this assess potentially hazardous changes in sea level and sea information can help scientists understand the influence ice distributions. of atmospheric aerosols on local weather, agricultural Challenges. Providing global data sets presents two productivity, and air quality. major challenges when studying Earth-system variability. First, scientists have to synchronize data from multiple The Landsat satellites and their terrestrial images helped satellite instruments without introducing errors. This chal- scientists study how land use and changes in land cover lenge can be exacerbated because scientific instruments affect regional and local economies. Specifically, satel- degrade in the harsh space environment. Calibrating such lite information used to make observations of crop pro- instruments as they change over time is difficult enough, ductivity, the availability of fresh water, and urban but combining data from two or more instruments that growth throughout the country. In the past year, studies need adjustments increases the uncertainty. Second, scien- focusing on the Mojave Desert, southwestern rangelands, tists have to validate space-based remote sensing measure- and metropolitan and nonmetropolitan Michigan were ments acquired over environmentally harsh areas of the published. These data also feed into studies of how land globe, such as at high latitudes or in tropical forests. Thus, use change can influence the distribution of carbon NASA needs vigorous calibration and validation programs between the atmosphere and biosphere, and thus provide that use airborne simulators of satellite instruments, moor- a basis for future approaches to dealing with carbon ings (underwater instrumentation), and high-performance emissions and uptake. aircraft that can fly over regions of interest coordinated with satellite measurements. Challenges. A major challenge in studying atmospheric aerosols is data integration. For example, the global Plans. NASA will focus on assuring the calibration and aerosol observations use several experimental techniques, validation of data from the Aqua satellite and the integra- including visible/infrared and ultraviolet space-based tion of data between instruments on both the Terra and observations and multiangle observations from a satellite Aqua satellites in FY 2003. We will focus on integrating with nine cameras pointing in different directions. ocean topography data from the Jason satellite and its Ground-based instruments also provided information. predecessor the Topex/Poseidon satellite, as well as Representing what aerosols do in a global climate model atmospheric aerosol and ozone data from the means accounting for these very diverse types of meas- Stratospheric Aerosol and Gas Experiment (SAGE) urements. In addition, given the complexity of atmos- instruments launched in 2001 and 1984. Validation of the pheric aerosols, which can differ by source (for example, Ice, Clouds, and Land Elevation Satellite (IceSat) meas- fossil fuel combustion, biomass burning, and mineral urements of ice sheet elevations will be a major priority. desert dust), and by day, is a major undertaking. Through NASA’s Global Aerosol Climatology Project NASA has The FY 2003 plan structure remains the same as that of taken the first step toward integrating surface, in situ, and FY 2002’s plan. Starting in FY 2004, NASA will develop satellite observations to provide a validated climatology detailed roadmaps that define program elements address- of the atmospheric aerosol content over oceans. ing relevant science questions and the timing of their achievability. These multiyear roadmaps will form the A second challenge is integrating data across multiple basis for future annual performance plans and provide spatial scales. The observations of land cover are made at further insight into longer-term Earth-system research. high spatial resolution, but spatial coverage of a specific Strategic Objective 2. Identify and measure the region is limited to relatively infrequent observations. For primary causes of change in the Earth system example, Landsat satellites cover an area in 16-day intervals. More frequent observations come from lower reso- Achievements. NASA looks at primary drivers of glob- lution data, most notably the Moderate Resolution al change, including distributions of radiatively and Spectror-adiometer instruments that fly aboard the Terra chemically active trace gases and aerosol particles, solar and Aqua satellites. These instruments cover different irradiance, and land cover and land use change. Some par- times of the day (Terra in the morning, Aqua in the after- ticular highlights of FY 2002 included the following: noon). Optimizing the different sources represents a chal-

100 NASA FY 2002 Performance and Accountability Report lenge but provides a unique opportunity to combine the sea surface height measured with the Topex/Poseidon benefits of different instruments. satellite. Additionally, the SeaWinds instrument aboard NASA’s Quick Scatterometer (QuikScat) satellite, which Plans. NASA’s FY 2003 Earth-system activities will gave 3 years of observations of the wind field at the ocean focus on integrating data sets from multiple platforms. In surface that drives ocean circulation, provided the basis particular, we will focus on making Terra and Aqua for another assimilation model. Both help us understand spacecraft data correspond under different cloud condi- how ocean circulation affects climate, including the tions in the later morning versus the early afternoon. We processes by which the Pacific Ocean transitions from an will give attention to ensuring that aerosol observations El Niño to a La Niña state. are rigorously tied to in situ information. Results from in situ measurements of clouds and aerosol particles during Our third accomplishment was in the area of stratosphere- the Cirrus Regional Study of Tropical Anvils and Cirrus troposphere coupling. The exchange of material and ener- Layers—Florida Area Cirrus Experiment off the coast of gy between the Earth’s troposphere and stratosphere has Florida in the summer of 2002 will be used to refine the an important influence on the Earth’s climate. In particu- algorithms from remote sensing. These data may help lar, increases in the amount of water vapor observed in the researchers improve our understanding of how particulate stratosphere over the past two decades represent a signif- matter affects our global environment. icant radiative forcing on the climate system. In FY 2002, NASA’s satellite and theoretical studies improved our Strategic Objective 3. Determine how the Earth knowledge of how water is transported from the tropo- system responds to natural and human-induced sphere into the stratosphere and the role that high-altitude changes cirrus clouds play in this process.

Achievements. Understanding how the Earth system Challenges. Earth-system science researchers are chal- responds to natural and human-induced change is para- lenged to define global parameters for measurements of mount in our efforts to model potential future climate climate phenomena and then to create accurate computer change accurately. One reason the Earth system is so simulations that incorporate those data. Only through complex is the existence of many feedback processes in well-conceived and carefully executed joint satellite and which the response of the Earth to forcing can, in turn, in situ observational campaigns can the best of both meth- represent a forcing to the Earth system. NASA provides ods be combined to reflect the behavior of the Earth sys- the tools needed to characterize and generalize the tem and represent it in global models. processes that will play a large role in determining our Plans. We intend to link satellite capabilities with field planet’s future. Particular areas of substantial advances in campaigns using aircraft and ground-based instruments. FY 2002 include clouds, ocean dynamics, and strato- Anoter major activity will involve coincident airborne sphere/troposphere coupling. observations with the Stratospheric Aerosol and Gas Experiment instrument to study the interplay between A major uncertainty in climate change models is cloud ozone, aerosols, and water vapor in the Arctic region representation because of clouds’ enormous variety in during winter. terms of time, space, and physical properties, such as size, shape, and the density of particles. Improving our under- Strategic Objective 4. Identify the consquences of standing of clouds requires satellite observation and in change in the Earth system for human civilization situ measurements by aircraft of particle distributions and properties. Linking the two observation methods helped Achievements. While Earth science is a global science NASA understand cloud effects on atmospheric radiation and global-scale changes are of great scientific interest, in FY 2002. In particular, data from Terra spacecraft individuals, governments, and industry see changes at helped map the global cloud distribution and the effect on the local and regional levels. Similarly, while changes in atmospheric radiation, especially for previously difficult the mean state of the Earth are important, extreme to observe thin cirrus clouds. The results should allow events such as droughts, floods, and fires may have improvements in the characterization of cloud formation greater influence because of the role that they play in the in climate models. sustainability of ecosystems, communities, and the economy. NASA advances include work in precipitation A second area of accomplishment is in ocean circulation and coastal studies. and dynamics. The Earth’s oceans have been one of the most under sampled regions of the global environment Until recently, we knew surprisingly little about the extent because of the difficulty of making repeated measure- of precipitation over much of the Earth’s surface, espe- ments in the open ocean. Satellites, however, provide a cially in tropical regions over major oceans. These areas way to obtain that repeatability. In FY 2002, the results of have a major effect on several elements of the Earth sys- several years of observations were put into models. tem, including atmospheric circulation and oceanic con- Scientists modeled more than a decade of observations of ditions. Data from several years of operation of the

Part II • Discussion • Earth Science 101 Tropical Rainfall Measuring Mission satellite reduced by Plans. Our plans center on linking satellite observations a factor of 2 the uncertainty in the global rainfall distribu- with local and regional models. In particular regions, we tion in the Tropics, and our knowledge of the variation in can address the issue of interest by using the full wealth precipitation from year to year was dramatically of available data. By linking observational information at enhanced. Further, we used the precipitation data and the different spatial scales, we can combine the benefits of QuikScat ocean surface wind data to improve short-term high resolution with those of frequent coverage and thus prediction models that account for the track, intensity, and produce environmental information that is of greatest use precipitation of tropical cyclones. This knowledge will be to regional and local policy and decision makers. useful in overcoming the challenge of properly represent- Strategic Objective 5. Enable the prediction of ing precipitation in global climate models, a significant future changes in the Earth system obstacle in the past decade. Achievements. NASA melds our knowledge of The coastal regions of the world are becoming ever more Earth-system variability, natural and human- populated, and thus more vulnerable to negative environ- induced forcings, and Earth-system processes to mental influences, such as flooding and beach erosion produce modeling tools and computational systems from storm surges. Coastal regions are also subject to a for environmental prediction. Our contributions to range of other environmental changes. For example, the the Nation’s efforts include new kinds of environ- coasts are affected by pollution, land-use change, and mental data, modeling approaches, and data assim- changes in ocean surface temperatures, currents, and ilation systems that improved modeling capability. height. NASA satellites document natural and human- As a new capability is developed, it is NASA’s goal induced changes along coastal regions and in coral reefs. to transition this capability to operational agencies Data from Landsat, SeaWiFS, and NASA’s Earth within Government, such as the National Oceanic Observer–1 (EO–1) technology satellite are all being and Atmospheric Administration (NOAA). used to map coral reef areas. Data are also used to pro- Particular areas of accomplishment for NASA in vide information on suspended sediments in turbid FY 2002 in the area of environmental prediction coastal waters. The observations help us study local include weather forecasting, seasonal climate prediction, and long-term climate prediction. water pollution. Data from NASA’s Tropical Rainfall Measuring Challenges. Satellite data require scientists to harness Mission and QuickScat satellites are regularly used the full power of satellites at the spatial resolution needed in weather prediction by domestic and foreign to represent local and regional behavior. This includes agencies. Both satellites improve predictions about linking global models to those of a smaller scale and find- hurricanes and other tropical cyclonic systems as ing ways to interweave very high-resolution satellite and they move from the open ocean to coastal regions. airborne observations with lower resolution data. Reducing hurricane-tracking error involves pin- Scientists also must find ways to use new types of obser- pointing smaller regions for evacuation in advance vational capabilities, for instance the hyperspectral infor- of a predicted landfall. Better forecasts have signif- mation available from NASA’s EO–1 satellite. icant societal effects, including cost reductions.

NASA provides three-dimensional hurricane analysis Hurricane Isidore first developed from a tropical dis- turbance north of Venezuela on September 14. Isidore brought 80 mph winds and tremendous rainfall to Cuba and was being watched for possible landfall along the U.S. Gulf Coast. By peeling away the clouds, this image reveals inches of rain falling per hour. Yellow represents areas of at least 0.5 inch, green shows at least 1 inch, and red depicts more than 2 inches. This type of analysis improves forecasts of intensity and storm tracking and assists in recovery efforts following a storm.

102 NASA FY 2002 Performance and Accountability Report Improving seasonal forecasting can help people and gov- tion in climate models and airborne process data to con- ernments make better decisions about a range of environ- struct models of cloud processes and atmospheric ozone mental issues, especially those related to agriculture, chemical processes. The improved models will aid eco- energy, and water resources. NASA’s data and modeling nomic and policy decision makers. efforts are making significant advances. Observations of ocean surface topography are used as experimental input Strategic Goal 2. Expand and accelerate the real- in seasonal weather and short-term climate models, and ization of economic and societal benefits from these models help to show what is happening in the Earth science, information, and technology oceans. Fully linked atmosphere, ocean, and land models provide regular input to national and international model- By working in partnership with other Federal agencies, ing efforts aimed to improve short-term climate predic- NASA continues to address natural threats of highest con- tion. They form the basis for studies of regional effects of cern to our Nation through joint efforts in the areas of transient climate variation, most notably changes associ- wildfire protection, with the U.S. Forest Service, and hur- ated with floods and droughts in North America and the Asian/Australian monsoon regions.

Finally, long-term climate prediction requires, at a minimum, models that include forcing factors for climate change and an understanding of their relative importance. Forcing factors can be any natural or human- induced force acting on the Earth system. NASA created a hierarchy of global climate models using satellite data on climate forcing factors such as solar irradiance, aerosol distributions, land cover and use, and distributions of radiatively active trace gases. The models help address the environmental effect associated with alternative scenarios for reducing greenhouse forcing through potential short-term reductions in emissions of tropospheric methane and black carbon. They also showed that emissions of black carbon may have a regional effect on precipitation distribution and a more global radiative effect. The NASA studies have had a major effect on the climate policy debate in this country.

Challenges. A major challenge is creating multiple climate models that integrate massive amounts of data in a timely fashion to meet our customers’ needs. The combined demands for large amounts of satellite data and very demanding models puts an enormous strain on our available computer resources, and requires scientists to think very creatively about optimizing the output. Although we have made progress with the rate of data assimilation and modeling using massively parallel com- NASA identifies early indicators of climate change putational systems, more must be done to address the QuikScat, a NASA satellite instrument that measures winds, software environment of models, the model designs, and observed a strong typhoon (top) threatening the Philippines, as well the science. A modeling framework that puts the best as a similar tropical cyclone passing along the Australian coast components and investigators’ ideas into one suite of cli- toward Nuomea on March 4, 2002. These unusual phenomena are results of the westerly winds (blowing from Indonesia toward the mate models is needed. American coast) along the equator that started on February 25 (lower). Color in these QuikScat images relates to wind speed; the Plans. NASA’s plans for Earth-system prediction are arrows indicate direction. described in the challenges section. They also include the The reversal of the usual Trade Winds (which normally blow from the more rapid inclusion of newly available global satellite American coast toward Asia) generally triggers Kelvin waves (warm data in our modeling systems. NASA will focus on two surface water that moves along the equator from Indonesia to the cooperative centers, established with NOAA, to assist in coast of Peru) and twin cyclones: a counter-clockwise vortex in the transferring models into operational weather and climate Northern Hemisphere and a clockwise vortex in the Southern Hemisphere. The reversed Trade Winds push warm water from west forecasting, with a special emphasis on assuring that the to east across the Pacific, reaching the American coast in one to two Aqua satellite’s full capabilities will be used for weather months. The increase in frequency and strength of the Kelvin waves and climate models. We will use Terra’s aerosol informa- may lead to El Niño.

Part II • Discussion • Earth Science 103 ricane prediction with the NOAA. In this strategic goal, The challenge is to transition our observations and pre- we achieved two annual performance goals for a 100-per- dictions to practical solutions that will help society. cent success rate. NASA will collaborate with other Federal agencies that can use our scientific and technological results. To facili- Strategic Objective 1. Demonstrate scientific and tate this approach, a few key areas need to be addressed to technical capabilities to enable the development benefit the Nation. of practical tools for public and private-sector NASA and its partners need to share a common architec- decision makers ture for developing and deploying information solutions. Achievements. To accelerate and expand the applica- The Climate Change Science Program Office at the U.S. tion of NASA’s Earth science results, we created the Department of Commerce in support of the Applications Strategy: 2002-2012, which is available at Administration’s Climate Change Research Initiative rec- http://www.earth.nasa.gov/visions. ognizes this approach as important. Second, NASA and its partner agencies need to modify or develop informa- The program initiated activities with partner Federal tion infrastructure between agencies so that our results agencies and national organizations in each of 12 nation- can be incorporated into their decision-support tools. al applications areas. For example, NASA is helping the Finally, we must support the process of benchmarking the U.S. Forest Service with fire management by providing performance of candidate solutions integrated into deci- real-time access to satellite data. We are working with the sion-support tools. FAA and the Radio Technical Commission for Aeronautics to establish guidelines for the use of remote Plans. The Applications Strategy and Applications sensing data in terrain databases that will serve aviation Initiatives are based on partnerships with Federal agen- worldwide. We are working with the Centers for Disease cies to develop three specific systemic solutions: establish Control and Prevention and the National Center for a common architecture in order that other agencies can Environmental Health in a first-of-its-kind public-health apply NASA’s data in their operations, build capacity in decision-support system designed to systematically col- decision-support tools for partner agencies, and validate lect and analyze human environmental exposure informa- and benchmark other agencies use of predictions and tion supported by measurements from Earth-observing observations enabled by NASA research in their decision- systems. In collaboration with the National Imagery and support systems. Mapping Agency, NASA completed 30-meter-resolution digital elevation models of the Western Hemisphere as Strategic Objective 2. Stimulate public interest in part of the Shuttle Radar Topography Mission. These data and understanding of Earth system science and will be used in watershed management, flood remedia- encourage young scholars to consider careers in tion, and ecosystem management. science and technology The activities link NASA’s space-based and airborne Achievements. A record 14 observation platforms observational missions and science predictions to the orbited the Earth in the past year, creating an unprece- partner agency’s decision-support system needs and dented demand for Earth science content, data, and improve management and policy decision-making. expertise, which, in turn, supports the teaching and learning of science and math in the Nation’s education system Challenges. From 2002 through 2012, NASA will and enhances public literacy about science, technology, increase the amount and scope of its remote sensing data. and the environment. The concept of the Earth as a rich

NASA tracks the spread of the West Nile Virus Though not yet proven, scientists believe the West Nile Virus may be spread across the country by infect- ed birds traveling along their migration routes. Mosquitoes, acting as vectors, transmit the virus when feeding on hosts such as birds, livestock, and people. Satellite maps show nationwide temperatures, distributions of vegetation, bird migration routes, and areas pinpointing reported cases. The combined data help scientists predict disease outbreaks by showing where conditions are right for the insects to thrive and where the disease appears to be spreading.

104 NASA FY 2002 Performance and Accountability Report Plans. Next year we will design a system architecture that improves the educational outcomes in a revolutionary rather than an evolutionary manner. The performance metrics for next year will include a description of the architecture; its implementation and associated management will be carried out in concert with the new Office of Education as part of NASA’s core mission for education.

Strategic Goal 3. Develop and adopt advanced technologies to enable mission success and serve national priorities The Advanced Technology Program consists of several project areas established to greatly reduce the risks associated with advanced instrument, measurement system, and information systems technologies that will be used in future science missions and user applications. With these investments, new measurements are attained, and existing measurements enhanced. Project areas range from concept studies to full space-flight demonstrations. Dozens of development efforts are underway at any point in time. NASA involves educators in a “high-impact” expedition As the technologies mature, they are inserted into aircraft The 5-mile wide Iturralde Crater shown in this view of an isolated part of the Bolivian Amazon has a circular feature at the center-left that may science campaigns, space flight missions, and have been caused by a collision with a meteor or comet between ground–information-processing systems. Program suc- 11,000 and 30,000 years ago. In September 2002, NASA launched cess metrics have been chosen to ensure that selection, the second ever expedition to this remote site. development, and adoption of these technologies will Teachers from around the world who are involved with the Teacher as enable or reduce the costs of future science missions and Scientist professional development program helped to design the expe- applications efforts. dition, and one teacher served as an on-site data collector. Bolivian university students also participated in the expedition. “The educational ele- For the past year, these project areas have successfully ment of the expedition is just as important as the science results,” said advanced 41 percent of the technologies in development Goddard engineer Patrick Coronado. “This is one of those experiments that stirs the imagination, where science and technology come head- at least one readiness level. The EO–1 advanced technol- to-head with nature in an attempt to unlock its secrets.” ogy mission successfully demonstrated the use of a lightweight, low-cost, land imager prototype for future and complex system of interconnected components and LandSat instruments. The EO–1 mission also validated a processes not only is a dominant paradigm in Earth sci- scientific quality, next-generation imager allowing scien- ence research but also underlies the core learning goals tists to discern unique spectral information collected as in the national and state education standards in science, 200-plus bands of reflected energy from land scenes as a mathematics, and geography. This underpinning, coupled spacecraft passes overhead. The EO–1 successfully com- with the Earth observations from orbiting satellites, read- pleted 100 percent of its validation objectives for nine ily allows students of all ages to experience Earth science technologies and is now available as a constant on-orbit as a process of inquiry, exploration, and discovery. The high-technology test bed for the users. The technology Earth Science Education Program met its objectives by development component of this goal met or exceeded all continually developing quality curriculum-support mate- of its programmatic assessment metrics. rials, providing educators with compelling teaching tools During this period, the Advanced Technology Program and professional development experiences, supporting reached a level of maturity and productivity that evoked the development of exhibits and learning programs out- accolades from independent reviews held with the side the classroom using multiple media, and training Technology Subcommittee of the Earth Systems Science interdisciplinary scientists to support the study of the and Applications Committee, an external advisory com- Earth as a system. mittee. In this strategic goal, we achieved 5 annual performance goals for a 71-percent success rate. Challenges. Strategic partnerships are essential for NASA to achieve a systemic, scalable, and sustainable Strategic Objective 1. Develop advanced technologies to reduce the cost and expand the capa- program that addresses education needs and influences bility for scientific Earth observation learning. The challenges we face include creating a framework that enables system-wide solutions and opti- The EO–1 mission met its objectives of flight, validating mizing the use of our existing resources. breakthrough technologies for future Landsat missions.

Part II • Discussion • Earth Science 105 Specifically, the EO–1 validated multispectral imaging Six instrument technology projects appeared in the capability for traditional Landsat user communities, FY 2002 Earth System Science Pathfinder-3 round of hyperspectral imaging capability for Landsat research- proposals, with the ultra stable microwave radiometer oriented community needs (with backward compatibili- instrument for measuring sea surface salinity included as ty), a calibration test bed to improve absolute radiometric part of the selected Aquarius mission proposal. The pub- accuracy, and atmospheric correction to compensate for lic will benefit from the success of this technology intervening atmosphere. The EO–1 represents progress through the enabling of new measurements for sea sur- over the previous years as demonstrated by Hyperion and face salinity. Atmospheric Corrector data, which are the first bench- Challenges. Technically, the principal challenges are to mark for non-DOD hyperspectral data. The EO–1 also enable the broad range of new measurements required by validated six other advanced technologies. The public will the science and applications research plans and to benefit from the EO–1 technologies through future improve performance while reducing the cost, volume, enhanced Landsat-type synoptic imaging of the Earth’s mass, and power requirements of the measurement sys- land surface. tems. Programmatically, the challenges are to ensure a short-, mid-, and long-range technology development Following a comprehensive technology readiness assess- plan consistent with the high-priority science and appli- ment of laser-based remote sensing systems, NASA cations needs and to provide it within projected budget. established a focused laser-lidar development program. The program must be robust and responsive to new tech- Laser diodes are critical to the development of future nological discoveries and to science breakthroughs that Earth science laser-based instruments for the global might cause redirection or reprioritization. measurement of ozone, water vapor, winds, carbon diox- The technical challenge requires developing sensor tech- ide, and altimetry and trace gas constituents. Many nology across the electromagnetic spectrum, from ultra- NASA-funded programs experienced issues with laser violet, visible, and infrared to the far infrared, sub mil- diodes that affect future missions and technology devel- limeter, and microwave. There are challenges in both opment. In response, NASA established a Laser Risk new passive and active sensor technologies. Two exam- Reduction Program to coordinate laser development at the ples are space-flight lasers and large deployable Goddard Space Flight Center and the Langley Research microwave antennas. Center. A working team developed a first-ever demonstration for double pulsing of a 2-micron diode-pumped While space-flight lasers have been successfully flown, laser system. This system is a crucial step in developing the technology is relatively new and difficult to replicate. In addition, new power technologies are needed to pro- an eye-safe differential absorption lidar system, which vide the higher power required by new measurements. will measure global carbon dioxide or winds from space. Reliability problems associated with laser diodes remain NASA researchers developed a multikilohertz microlaser a significant challenge. altimeter, which uses high-repetition-rate laser altimetry with photon counting detectors. The instrument will cut To make passive microwave measurements of soil mois- costs and expand our Earth observation abilities. The ture from low-Earth and geostationary orbits, microwave project may be expanded to include a Shuttle laser altime- antennas with much larger aperture are required. When ter in 2004 and a land/ice altimeter free-flyer after 2005. current fabrication approaches are extended to these large

NASA studies lightning storms using uninhabited vehicles Tony Kim and Dr. Richard Blakeslee of Marshall Space Flight Center in Huntsville, AL, test aircraft sensors that will be used to measure the electric fields produced by thunderstorms as part of NASA’s Altus Cumulus Electrification Study.

106 NASA FY 2002 Performance and Accountability Report NASA tracks the paths of merging wildfires This image from the Landsat Enhanced Thematic Mapper Plus (ETM+) shows Arizona’s Rodeo (right) and Chediski (left) Fires on June 21, 2002. In this false-color image, vegetation appears bright green and burned areas are deep red. At the time this image was acquired, the two large fires, one alleged- ly due to arson, and the other by a lost hiker, were still distinct, but over the course of two weeks, the two would merge into a single massive blaze. Landsat ETM+ captured the fires’ succession over the next three weeks. Consuming almost half a million acres, the fire was the largest and most expensive fire in Arizona’s known history, costing more than $30 million before it was contained.

apertures, they result in an antenna that is impractical tional computing system delivering data to millions of because of it size and mass. This challenge may be met by users nor to provide near-real-time turnaround of data, sparse aperture approaches and/or lightweight, deploy- NASA has stepped up to the challenge of a massive able structures. To enable these approaches, technology increase in the system’s user base. The system supports development of miniaturized components and lightweight multiple satellites with single and multiple instruments, structures is necessary. and will support more satellites in the future. The system currently supports the idea of formation flying and satel- Plans. NASA will aggressively pursue the laser-lidar lite constellations (for example, operating satellites in efforts critical to future measurements. In addition, L- tandem such that their collective contribution is greater band interferometer synthetic aperture radar development than their individual sum). NASA has planned for the will be proposed as a multiagency initiative. As a contin- growing demands on the system. uing effort, NASA will refine its ability to identify breakthrough technologies and to streamline methods for sus- NASA is adding new systems and service capabilities taining key developments from the component level to the through a build and test mode for system integration. subsystem level and on to a systems-level implementa- NASA has released a Cooperative Agreement Notice and tion. The effort to find the right balance of competitive will select projects in the near future that will build and and directed research will continue. Technology infusion test new information system capabilities to form an Earth efforts will be expanded. Collaborating outside NASA science research, education, and applications solution will be important. network. Competitively selected projects will work in NASA will further investigate techniques and identify concert with NASA’s existing and emerging data and critical technologies for operating and exploiting multiple information systems by improving accessibility to an spacecraft in cooperative constellations. This will include accurate, uninterrupted series of selected geophysical consideration of observation from multiple vantage points parameters that cover the 40-year record of Earth obser- such as in geosynchronous orbits and at libration points vations from space. The awarded projects will provide along the Earth-Sun line. data products and tools to support the community in order to advance our knowledge of the Earth system, for Strategic Objective 2. Develop advanced informa- resource management policy decision support in application technologies for processing, archiving, tions of national importance, and to provide interactive accessing, visualizing, and communicating Earth access to dynamically updated knowledge of the Earth science data system for decision makers. Achievements. The Earth Observing System Data Challenges. NASA needs to improve data-system Information Systems (EOSDIS) development is com- responsiveness to changes in priorities, requirements, plete. It is an operational system. The system is operating and technologies. We recognize that Government infor- far beyond its first conception more than a decade ago. mation systems no longer drive the business of systems The system was originally designed to support 10,000 development. The complexity and diversity of require- Earth scientists conducting research and development. It ments precludes a simple commercial system purchase. served more than two million users in the past 2 years. NASA understands and agrees with leveraging off com- Although the system was not conceived to be an opera- mercial hardware and software development, and will

Part II • Discussion • Earth Science 107 make optimal use of commercial products as much as NASA is working with the U.S. Geological Survey to possible and feasible. improve our ability to predict volcanic events. We are using our satellites to monitor conditions leading to vol- Plans. NASA is formulating a strategy for future effi- canic eruptions. The organizations are moving from cient and flexible system evolution. The system was suc- research to operations in the Earth-science-based solu- cessfully fielded during a time of revolutionary rapid tions areas of land subsidence monitoring and biological information technology change. NASA realizes the need to advance the system architecture. However, we need not invasive species. We are transferring an exploratory-class start over. Concepts such as software reuse and open satellite to the operational community. NASA and the interface standards make technology infusion into a con- U.S. Department of Agriculture are collaborating on tinually evolving network possible. Earth science solutions for wildfire management, carbon management, precision agriculture, and global crop NASA is formulating the Strategic Evolution of Data assessment and prediction. Finally, in conjunction with Systems for use throughout this decade and to evolve the the Environmental Protection Agency, NASA is using current system to a next generation. Future systems will Earth observations and predictions to support air-quality ensure the timely delivery of Earth science information at management decision-support tools. an affordable cost, emphasizing flexibility to infuse new technologies. A future system is being formulated in cooperation with the NASA advisory committees and Challenges. NASA and partner agencies must develop a with the National Research Council. We will move to a coordinated approach to make the changes called for by number of smaller systems, incorporating new, innovative the Climate Change Science Program Office. Enabling technologies such as processing aboard the satellites. the systematic assimilation of remote sensing data and science-based predictions into practical solutions through Strategic Objective 3. Partner with other agencies partner-agency decision-support systems is critical to to develop and implement better methods for maximize the national investment in the Earth observing using remotely sensed observations in Earth system monitoring and prediction data, improve the quality of life, and serve society.

Achievements. The productive use of NASA’s remotely Plans. NASA is collaborating with partner agencies to sensed data has greatly expanded because of successful develop 10-year roadmaps defining the specific remote partnerships with Federal agencies. NASA application sensing missions, Earth science models and predications project activities included collaborations with U.S. that will be verified and validated for use in operational Geological Survey, U.S. Department of Agriculture, National Oceanic and Atmospheric Association, Federal decision-support systems. The systems engineering func- Emergency Management Agency, Centers for Disease tions undertaken by NASA will include rigorous bench- Control and Prevention, Environmental Protection Agency, marking (systematic determination of performance and international partnerships with the Central American improvements) of the effects of integrating Earth science Commission on Environment and Development. results into decision tools for society.

108 NASA FY 2002 Performance and Accountability Report Biological and Physical Research MISSION: Use the synergy between physical, chemical, and biological research in space to acquire fundamental knowledge and generate biological and physical research

As humans make the first steps into space, we enter a new These broad opportunities for research include research realm of opportunity to explore profound questions, new of direct interest to commercial enterprises. NASA and old, about the laws of nature. At the same time, we works to encourage and enable commercial participation enter an environment unique in our evolutionary history in space research by supporting commercially funded that poses serious medical and environmental challenges. research on the Space Shuttle and the International NASA’s biological and physical research addresses the Space Station. opportunities and challenges of space flight through basic and applied research on the ground and in space. We Strategic Goal 1. Conduct research to enable safe exploit the rich opportunities of space flight in pursuit of and productive human habitation of space answers to a broad set of scientific questions including research to address the human health risks of space flight NASA research addresses health issues created by radia- as well as research to improve our understanding of the tion, microgravity, and isolation associated with space laws of nature. travel. More than 40 years of human space flight has produced a significant body of knowledge about the effects NASA conducts research on the important changes the of space on human health. Profound changes occur in human body undergoes during space travel. These changes muscles and their strength and in bones and their hard- include significant health risks for space travelers. NASA ness. The ability of the heart and blood vessels to carry seeks to understand these changes and the basic mecha- out their normal functions is affected by the reduction of nisms behind them. We research methods to control health gravity, and the structure and function of brain circuits are risks and to improve astronaut health and safety. This altered and cardiovascular reflexes are changed. Basic research often has applications to medical problems on body functions such as immune function, susceptibility to Earth. For example, bone loss is experienced both by infection, and nutrition undergo significant changes. space travelers and by millions of aging Americans. These effects must be explored in a systematic, scientific program in order to understand their long-term conse- Just as the space environment presents challenges to our quences and to develop appropriate countermeasures; bodies, it presents challenges to the machines upon which otherwise, they will fundamentally limit humankind’s we must rely in space. Research to enable safe and effi- ability to utilize space and explore the solar system. cient human space travel includes research to improve the life-support systems that provide air and water as well as The primary goal of this research is to improve health and research on physical processes such as burning, boiling, safety for space travelers; however, this research also has and heat transfer. In the microgravity of space, smoke the potential to make significant contributions to medical does not rise away from a fire, and bubbles tend to remain care on Earth. For example, space flight can provide mod- mixed within a boiling liquid. These and other novel els for exploring osteoporosis and other diseases of mus- behaviors pose specific challenges for designing space- cle and bone. It has provided unique insights into nerve craft systems, and NASA conducts research to address regeneration and the capacity of the nervous system to those challenges. grow, change, and adapt in response to environmental stimuli. The parallels between aging and space travel are The opportunity to conduct experiments in space allows under study by researchers at NASA and the National researchers to control gravity and manipulate it as an Institutes of Aging. experimental variable. NASA takes advantage of this opportunity to conduct research in the biological and Strategic Objective 1. Conduct research to ensure physical sciences that cannot be conducted on Earth. We the health, safety, and performance of humans liv- take advantage of microgravity to probe the basic process ing and working in space of life, and we exploit the novel environment of space to run new experiments including research on burning Achievements. We conducted successful research on a processes, on growing the tissues of the body in laborato- method to reduce the risk of kidney stones in flight, suc- ry vessels, on the properties of new materials, and on the cessful tests of a drug to reduce the light-headedness and the processes by which large molecules take their shapes. The inability to stand that can affect space travelers returning to opportunities for new research span disciplines from fun- gravity, and discovered suggestive new findings on the damental physics research on the basic properties of mat- spinal cord and how reflexes change in space. Taken togeth- ter to applied research on the structure of target proteins er, these and about 20 other ongoing investigations contin- for drug development. ue to expand our understanding of many physiological

Part II • Discussion • Biological and Physical Research 109 changes associated with space flight and risks of space NASA and the National Cancer Institute are collaborating flight and the best methods for controlling them. on biological and physical science research to support development of molecular level diagnostics for future NASA researchers used historical data to identify cataract missions of exploration. While NASA’s medical objective risks from space radiation and a statistical approach for is to ensure the health and safety of astronauts during long defining the uncertainties in space radiation cancer risks space flights, the National Cancer Institute’s objective is was developed that will allow for new research approach- to fight cancer through safe, painless early detection and es to risk assessment and mitigation to be evaluated. intervention. Together, NASA and the National Cancer We made significant progress on a radiation protection plan Institute developed and implemented an approach that for improved astronaut health and safety. Under the aus- first focuses on identifying important technologies and pices of the Station’s Multi-lateral Medical Operations then generates joint program announcements (or solicita- Panel, mission termination dose limits were agreed to by the tions) that target fundamental research within key tech- international partners. The National Council on Radiation nology areas. As partners in this program, NASA and the Protection and Measurements has issued new recommenda- National Cancer Institute are united in their commitment tions on dose limits, which are being incorporated into the to make this an applied program. That is, both results of NASA medical requirements for astronauts. the research and any products developed will be used to solve the independent, yet related life-threatening con- NASA continued to improve technology for live support cerns both organizations face for the future. systems and reduce the mass required to provide future space travelers with air and water. Engineers calculate that a NASA and the National Cancer Institute issued a Broad life-support system designed in 2002 would require 33 per- Agency Announcement for Fundamental Technologies cent less mass than the life-support system currently in use for Development of Biomolecular Sensors. Awards were on the Station. announced in the first quarter of FY 2002; NASA selected 7 extramural investigations for funding from a group of Challenges. The primary challenges to progress in this 55 proposals. objective are our limited access to space and the small number of research subjects. While the presence of a per- In parallel, NASA solicited proposals for the intramural manently orbiting Station crew represents an unprece- program (restricted to NASA Jet Propulsion Laboratory dented research opportunity, there is still a substantial and Ames Research Center), which focused on technology challenge in maximizing understanding from a small development closely aligned with NASA’s exploration sample. A second major challenge is developing and goals. This solicitation resulted in 16 selections. maintaining a vigorous, balanced research program while Summaries that include a description, the innovative claims the Station is still in development. and NASA significance, and plans are available for all Extramural and Intramural projects on the NASA-National Plans. NASA research to ensure the health, safety, and Cancer Institute Biomolecular Sensor Development Web performance of humans living and working in space is site. On June 24, 2002, the National Cancer Institute among the highest priority research planned for the released the second joint announcement, Fundamental Station. NASA will use the Station to characterize phys- Technologies for Development of Biomolecular Sensors; iological changes, such as bone loss, muscle decondi- the proposals were due November 1, 2002. tioning, and radiation risks, and develop an evidence- based strategy to define innovative countermeasures. In On the Station, an experiment was conducted to deter- the near term, research on the Station will benefit from a mine the effects of microgravity on photosynthesis and suite of research equipment for regular experiments. We carbohydrate metabolism of wheat. Six on-orbit plant- ings, and seven on-orbit harvests of wheat were conduct- will support this effort with a broader campaign of ed during increment 4. The initial assessment of the data research on the ground. Regular research solicitations indicates that there was no difference in growth rate or will support this effort. dry mass of wheat grown on the Station. In addition, there was no difference in daily photosynthesis rates, leaf Strategic Objective 2. Conduct research on bio- responses to canopy carbon dioxide concentration, or logical and physical processes to enable future light intensity. This is the first replicated data obtained missions of exploration from plants grown under good environmentally con- Achievements. Basic research in the biological and trolled conditions to demonstrate that existing models physical sciences is essential for future human explo- using plants for advanced life support applications can be ration of space. Beyond reducing the cost and increasing used without significant modification. While this has safety for space travelers, this basic research promises to been the operating hypothesis for many years, the Station push the frontiers of knowledge and technology for has provided the first opportunity to test directly this Earth applications. hypothesis in a scientifically credible manner.

110 NASA FY 2002 Performance and Accountability Report NASA researchers observe a new atom wave phenomenon NASA-funded physicists at Rice University discovered ultra cold atoms forming bright solitons, localized bundles of waves that maintain a constant shape as they propagate. The researchers observed atomic soliton trains, groups of as many as 15 solitons. These solitons propagated without spreading for several seconds-an eternity for a localized wave bundle. This research may lead to technical innovations such as atom lasers that could eventually be used to predict volcanic eruptions on Earth and map a probable subsurface ocean on Jupiter’s moon, Europa.

Challenges. NASA is working to produce a more inte- gravity to study exotic forms of matter that are better han- grated strategic plan to link physical science research dled in space. Biological researchers investigate the role with the Agency’s strategic direction in a clearer manner. of gravity in life processes and how the space environ- The related challenge is how to bring innovative technol- ment affects living organisms. Gravity’s influence is ogy to bear on the problems of space flight including reli- everywhere. From the structure that gives steel its ability and performance on long missions. Because this strength, to the structure of bone in a growing child, grav- research is on the cutting edge of biology, physics, and ity plays an important role. In space, we enter a new nanotechnology, the results are unpredictable. realm of research in physics, chemistry, and biology. The results will provide important information and insight for Plans. NASA’s collaborative effort with the National improving industrial processes here on Earth. Cancer Institute will support development of next-generation instruments for molecular-level diagnostics for both space and Earth applications. NASA and the Institute Strategic Objective 1. Investigate chemical, biologi- have a common need for cutting-edge technologies. Their cal, and physical processes in the space environ- shared goal is to advance development of technologies ment, in partnership with the scientific community and informatics tools for minimally invasive detection, diagnosis, and management of disease and injury. Future research will feature a more interdisciplinary approach Achievements. NASA increased the pace of the Station and will include extending the database on radiation research to include research in fluid physics, combustion effects in materials using the newly commissioned science, materials science, and biotechnology. Each Booster Application Facility at Brookhaven, conducting Station research investigation exploits the space environ- investigations on fire safety and microgravity combus- ment to explore questions that could not be explored on tion, and carrying out a microgravity heat exchange Earth. For example, researchers continue to be excited by investigation on the Station. results from experiments on colloids in space. Colloids are mixtures of very small particles suspended in a liq- Strategic Goal 2. Use the space environment as a uid—paint and toothpaste are both usually colloids. laboratory to test the fundamental principles of Physicists studying colloids in space are exploring the physics, chemistry, and biology processes by which particles in colloids arrange themselves into regular patterns (crystal lattices). NASA The space environment offers a unique laboratory in hopes that colloid experiments in space will provide the which to study biological and physical processes. critical information necessary to use colloids to make Researchers take advantage of this environment to con- new materials on Earth, establishing the new field of col- duct experiments that are impossible on Earth. For exam- loid engineering. These processes are thought to be par- ple, most combustion processes on Earth are dominated ticularly important for developing three-dimensional by the fact that hot gases rise. In space, this is not the photonic materials, optical switches, and components for case, and hidden properties of combustion emerge. future computers. Researchers report that they have been Materials scientists study the role of gravity in important able to observe significant phenomena never before industrial processes. Physicists take advantage of micro- observed on Earth.

Part II • Discussion • Biological and Physical Research 111 Breakthrough research on waves of ultra-cold atoms may the development of balance organs, and what changes lead to sophisticated atom lasers that might eventually may take place in how they connect to the nervous sys- predict volcanic eruptions or even map a probable sub- tem. The results from these investigations should yield surface ocean on Jupiter’s moon Europa. The atoms were fundamental insights into basic animal development and manipulated to form tidy bundles of waves, called soli- may lead to improved health care in space or on Earth. tons. They were created in a laboratory at Rice University Challenges. Biological and physical research in space is in Houston, TX, under a grant from NASA’s Biological transitioning from a Shuttle-based research program to a and Physical Research Program through the Jet research program focused on the Station. At the same Propulsion Laboratory in Pasadena, CA. The researchers time, issues associated with the Station development confined lithium atoms within magnetic fields, cooled schedule and budget present challenges for research plan- them with lasers to one billion times below room temper- ning in a dynamic environment. This is true for funda- ature, and confined them in a narrow beam of light that mental biology research, which must continue to develop pushed them into single-file formation. The atoms formed and support an excellent research community while the a type of matter called a Bose-Einstein condensate, a Station remains under development. Ongoing research quantum state in which classical laws of physics are aban- operations and the continuing process of soliciting and doned and new behaviors govern the atoms. The atoms selecting the highest quality research will remain the pri- join and function as one entity. The team actually mary challenges within this objective. In addition, NASA observed a soliton train of multiple waves. continues to develop research facilities and scientific One of the first materials science experiments on the instruments for future use on the Station. These develop- Station—the Solidification Using a Baffle in Sealed ment challenges remain a focus of the program. Ampoules—was conducted during Expedition 5 inside Plans. As the Station capabilities expand, NASA looks the Microgravity Science Glovebox. The glovebox is the forward to a vigorous, peer-reviewed orbital research first dedicated facility delivered to the Station for micro- program supported by a strong ground-based program. gravity physical science research, and this experiment Research on chemical, biological, and physical process- will be the first one operated inside the glovebox. es in the space environment is ongoing aboard the Station Materials scientists want to make better semiconductor and will expand as Station capabilities expand. In the crystals to be able to further reduce the size of high-tech near term, research on the processes by which large mol- devices. To control the optoelectronic properties of the ecules (macromolecules) crystallize will provide crystals, a small amount of an impurity—called a researchers with detailed three-dimensional data on pro- dopant—must be added to the pure semiconductor. teins for drug development and biomedical research. Uniform distribution of the dopant in the semiconductor Researchers will expand on investigations on colloids as crystal is essential for production of optoelectronic model systems for self-assembling processes with appli- devices. For this investigation, tellurium and zinc are cations in computer and communication technologies. added to molten indium antimonide specimens that are NASA plans to conduct research that takes advantage of then cooled to form a solid single crystal by a process the unique environment of space to grow tissues outside called directional solidification. The goals of this experi- the body for research and medical applications. We will ment are to identify what causes the motion in melts focus on developing a strong research community pre- processed inside space laboratories and to reduce the pared to use the research capability on the Station that magnitude of the melt motion so that it does not interfere will become available after 2004. with semiconductor production. NASA successfully demonstrated its Avian Development Strategic Objective 2. Develop strategies to maxi- Facility on STS-108. The Avian Development facility is mize scientific research output on the Station and designed to incubate 36 quail eggs in flight. Eighteen of other space research platforms the eggs are exposed to microgravity and 18 are spun in a Achievements. In FY 2002, a task force of the NASA centrifuge to simulate gravity. Researchers can use the Advisory Council performed an independent review and developing quail embryos as models for exploring the assessment of research productivity and priorities for the effects of the space environment on growth and develop- entire scientific technological and commercial portfolio of ment. The initial flight of the facility focused on examin- NASA’s biological and physical research mission. The ing the growth and development of the balance system in Council formed a Research Maximization and the inner ear, as well as on the development of the skele- Prioritization Task Force that recommended a series of pri- ton. Bones from the quail eggs are being analyzed for orities across research disciplines. This review was based changes in mineralization, cell cycle timing, collagen upon past performance in these disciplines as presented by synthesis, rate of bone formation, and the conversion of the mission, as well as a review of a substantial body of cartilage to bone during development. The inner ears are existing reports from the National Research Council. The being analyzed to determine whether microgravity affects task force findings and recommendations rest on a large

112 NASA FY 2002 Performance and Accountability Report foundation of work of hundreds of scientists who worked planning. The biological and physical research mission for thousands of hours, for months and years, to prioritize responded to NASA’s new strategic plan by adopting a 5- research within each biological and physical research sci- year direction consistent with overall agency vision, mis- entific discipline. The committee successfully established sion and goals. This direction identifies major research a rationale and strategies for prioritization of the overall thrusts and the management changes required to support research program for the biological and physical research these thrusts. The biological and physical research mis- area and for the Station. The task force prioritized work sion developed a 10-year research plan that addresses its that can be done on the Station with the U.S. Core role within the NASA strategic plan by establishing a Complete configuration and identified enhancements to focused set of organizing questions and supporting top- the configuration that will enable a science-driven pro- level roadmaps that will drive the mission’s research. The gram of highest priority research. NASA’s FY 2004 budg- 10-year plan was drafted in consultation with outside et for biological and physical research focuses on research advisers and will be subjected to additional scientific areas identified as high priority by the task force. review. During the budget development cycle beginning in 2003, the biological and physical research area will The National Research Council released prepublication engage its scientific community in developing more copies of two related studies, “The Report of the Task detailed interdisciplinary roadmaps, which will be guided Group on Research on the International Space Station” by the 10-year plan. These roadmaps will form the basis and “Assessment of Directions in Microgravity and for a biological and physical research strategic plan that Physical Science Research at NASA.” Each report is con- will serve as the guiding document for future research sistent with the task force recommendations and strength- solicitation, selection, and implementation in support of ens our efforts to maximize research return from the NASA’s vision, mission, and goals. Nation’s investment in space. Challenges. The Station is moving through an adjustment period. The program is working to implement the recom- Strategic Goal 3. Enable and promote commercial mendations of the International Space Station Management research in space and Cost Evaluation Task Force of the NASA Advisory Committee and is awaiting the near-term release of recom- Ultimately, the solutions to the challenges of human space mendations from both the Research Maximization and flight will open up new avenues of commerce. Dozens of Prioritization Task Force of the committee and the Task commercial firms already conduct small-scale research Group on Research on the Station of the National Research projects in space. NASA provides knowledge, policies, Council. In their interim reports and communications, both and technical support to facilitate industry investment in the task force and the task group expressed concern over space research. We will continue to enable commercial the limited availability of up-mass and crew time for researchers to take advantage of space flight opportunities research on the Station in its currently planned U.S. Core for proprietary research. The benefits of commercial Complete configuration. research in space include improved products and services Plans. Implementing the Research Maximization and to enhance economic performance on Earth. In the long- Prioritization Task Force priorities in the FY 2004 budget term, economic activity in space will provide strength- is a crucial first step in a longer running planning and pri- ened infrastructure for the exploration and development oritization process including 5-year and 10-year strategic of space.

NASA helps Iowa firm build better soybeans Peggy Whitson’s face reflects in the cover of the Advanced Astroculture plant growth chamber as she inspects soybean plants. Whitson, the International Space Station’s first Science Officer, dried the plants and beans, and the Space Shuttle Atlantis returned them to Earth. Researchers are studying the first-ever soybean crop grown on the Station to see whether it has unique, desir- able traits. Pioneer Hi-Bred International, Inc., a DuPont subsidiary based in Des Moines, IA, is the industrial sponsor for the experiment. To fly and analyze the beans, the company is working with the Wisconsin Center for Space Automation and Robotics at the University of Wisconsin in Madison. The center is one of 15 NASA Commercial Space Centers. NASA’s Space Product Development Program at the Marshall Space Flight Center manages the centers.

Part II • Discussion • Biological and Physical Research 113 Strategic Objective 1. Provide technical support program. NASA is incorporating a new set of research for companies to begin space research priorities in our plans. Researchers conducted several commercial experiments on the Station in FY 2002, and Strategic Objective 2. Foster commercial commercial research remains a significant fraction of the research endeavors with the Station and Station research planned for the near term. Specific areas other assets include biotechnology, agribusiness, advance materials, and space and communications technology research. Achievements. NASA supports and fosters commer- Successful research to date will encourage future part- cial research in space through a network of commercial nerships by demonstrating that the Station is open for space centers. In FY 2002, these consortia attracted 2.7 business. NASA expects increases in commercial invest- times as much commercial funding in cash and in kind ment over the next few years. as they receive from NASA. Thirty-five new industrial partners were reported in FY 2002, easily surpassing Strategic Objective 3. Systematically provide the goal of 10. Companies identified are active in a basic research knowledge to industry variety of fields including agribusiness, biotechnology/biomedicine, advanced materials, and space tech- Achievements. NASA supported three diverse confer- nology/communication. ences to expand interaction with the commercial research community: the Manufacturers Association conference in The commercial space centers continue to work with Chicago in March 2002; the Biotechnology Industry their industry partners to bring products into the mar- Organization annual meeting in Toronto, Canada in June ketplace. Two products were brought to market in 2002; and the NBC4 Technology Showcase in FY 2002. The Space Rose fragrance product discov- Washington, DC, in September 2002. In addition, several ered on STS-95 by the Wisconsin Center for Space commercial space center representatives participated in a Automation and Robotics and their partner space forum in Colorado Springs, CO, in April 2002, International Flavors and Fragrances was incorporated where a number of useful contacts were made with indus- into a second product in FY 2002. The fragrance is try. Business conferences highlighting biotechnology, now an ingredient in Impulse Body Spray and the vari- materials manufacturing, and communication/technology ant Moon Grass marketed by Lever Faberge (part of development were all supported by commercial space Unilever); both products were introduced in January center researchers describing the research they have done 2002 in the United Kingdom. Solidification Design on the Shuttle and now the Station. Center Commercial Space Center affiliate Flow Simulation Services (Albuquerque, NM) began mar- Challenges. The limited availability of commercial keting software that will enable improved process research opportunities remains a significant challenge as design of particulate molding processes. The software NASA works to expand commercial participation in Arena-flow is initially being marketed to the metal space research. casting manufacturing industry, but future applications are being pursued in food and pharmaceutical produc- Plans. NASA will integrate outreach to the commercial tion, aerosol drug delivery, and other biotech applica- community with broader space research outreach goals. tions. Bioserve Space Technologies Commercial Space We will continue to seek venues for soliciting participa- Center and its corporate partner, Amgen, Inc., con- tion by commercial researchers. ducted research on osteoprotegerin a drug in clinical trials for treating osteoporosis. This drug also may Strategic Goal 4. Use space research opportuni- have potential for controlling bone loss in space. ties to improve academic achievement and the Positive results from a Shuttle experiment were pre- quality of life sented at the annual American Society for Bone and Mineral Research conference in November 2002. NASA supports academic research and programs to challenge young minds. We took pride in funding those who Challenges. The most significant challenge to commer- shared our enthusiasm for space- and ground-based cial space research is timely and affordable access to exploration of space and science. NASA accomplished space. With limited resources available on orbit and the 100 percent of its annual performance goals in support of Station in development, NASA’s commercial partners this strategic goal in FY 2002; we achieved the same face a difficult research environment. Non-NASA invest- score in the previous three years. ment to the commercial space centers remained the same in FY 2002 as in FY 2001. Regular use of the Station for commercial research is only beginning. Strategic Objective 1. Advance the scientific, technological, and academic achievement of the Plans. As Station capabilities continue to expand, Nation by sharing our knowledge, capabilities, NASA looks forward to a vigorous commercial research and assets

114 NASA FY 2002 Performance and Accountability Report NASA gives students hands-on learning opportunities Students from Lincoln West High School in Cleveland, OH, worked with NASA and University of California, Irvine scientists to load biological samples for an International Space Station experiment. In April, the Space Shuttle Atlantis delivered the samples, which thawed and formed crystals. The crystals were returned to Earth in June. The primary purpose of these experiments was to grow crystals of biological macromolecules in the low-gravity environment of space. Researchers expected to improve their understanding of the three-dimensional and chemical structure of proteins, viruses, and nucleic acids. Knowledge of the precise three-dimensional molecular structure is an important component in biotechnology, particularly for protein engineering and rational drug design.

Achievements. Our educational outreach programs pro- and commercial research increased its production run vided space research opportunities to educators and stu- from about 11,000 copies produced under the previous dents in both formal and informal learning environments. Microgravity News, focusing on physical science The input of NASA scientists and engineers added great research, to more than 20,000 copies by the end of credibility and depth of content to these opportunities. September 2002. The publication addressed all of the biological and physical research disciplines. NASA also par- Five National Education Conferences attracted more ticipated in several professional conferences: the than 70,000 teachers. The conferences featured NASA- American Society of Clinical Oncology, the American sponsored workshops and demonstrations. In addition, Library Association, and the National Medical we conducted hands-on activities that connect space Association. A number of events are also planned for research to classroom curricula and distributed numerous FY 2003. As part of our educational outreach efforts, educational publications at each Conference’s One- NASA introduced in June a multimedia program on space NASA exhibit. research for educators to use in their school system after Challenges. Because of the varied life sciences, physical taking training in the multimedia program. sciences, and commercial research efforts included in biological and physical research, this education and outreach NASA and the Public Broadcasting System established a program plays a strategic role in stimulating student and collaborative effort to produced a four-part television teacher interest in the fields of science, math, technology, series and a complementing CD-ROM to provide an in- and engineering. Our primary challenge is to communi- depth look at biological and physical science research. cate effectively with the educational community. This project may reach a substantial audience ranging from kindergarten through grade 12. Plans. NASA continues to look for opportunities to use digital media to increase dissemination of materials, to Challenges. The primary challenge is to identify the meet the needs of varied learning styles, and to add com- diverse audiences making up the public sector: profes- panion pieces to our learning activities. We participate sional, technical, business, and the public; understand the regularly at major education conferences and events, and needs and interests of these public sector communities; we are expanding electronic outreach to educators. We and develop outreach approaches that communicate the will continue to seek opportunities for students to partic- importance of NASA research. ipate directly in space research. Plans. NASA will continue to seek innovative approach- Strategic Objective 2. Engage and involve the es to bringing the experience of space flight to the public. public in research in space A British media firm is exploring potential collaboration Achievements. In FY 2002, NASA continued to expand with NASA for a National Geographic-type film high- its outreach efforts to diverse communities. The Space lighting insect research in space. The discussion is very Research newsletter highlighting physical, life science, preliminary but may result in a productive collaboration.

Part II • Discussion • Biological and Physical Research 115

Human Exploration and Development of Space MISSION: To expand the frontiers of space and knowledge by exploring, using, and enabling the development of space for human enterprise

The space program is changing, perhaps forever, the frontiers of human presence and knowledge. Once earth- bound, the frontier of human presence today is 250 miles above our planet. Once confined to what our telescopes could see through Earth’s atmosphere, the frontier of our knowledge about the universe and its origins has expanded into the past millions of years. The discoveries and the opportunities of these changes inspire and challenge us. NASA’s human exploration and development of space effort expands the frontiers of space and knowledge, exploring, using, and enabling space development. We achieve this through four strategic goals: expand the space frontier, enable humans to live and work permanently in space, enable the commercial development of space, and share the experience and benefits of discovery. Our strategic objectives include such long-term tasks as conducting research, developing new technologies, ensuring the health and safety of humans living in space, fos- tering private enterprise, and keeping the public apprised of our progress.

Strategic Goal 1. Explore the space frontier

Providing safe, reliable, and affordable access to space is a key element in realizing this goal. The five objectives for NASA completes 58th successful launch this goal pertain to technology development, engineering On May 4, we launched Aqua, an Earth observing satellite. It was the 58th successful launch out of 60 launches since 1987. This remarkable research, innovative mission designs, commercial devel- feat compares favorably with the average launch success rates over opment, and robotic missions. Four of the objectives do the same period for the U.S. Department of Defense and the U.S. not have performance measures this fiscal year because commercial launch industry. they were related to the Technology and Commerciali- zation Initiative. NASA cancelled the initiative because of ance for integrating human requirements into mission a general funding reduction. The program was to conduct and architecture designs. analysis for benefiting future safe, affordable, and effective human spaceflight projects that advanced science and Strategic Objective 3. Enable human exploration discovery, human exploration, and commercial develop- through collaborative robotic missions ment of space. NASA transferred Technology and Achievements. NASA uses the Space Shuttle and Commercialization Initiative funds to the Space Station expendable launch vehicles to deploy spacecraft within Program in the fall of 2001. We successfully completed and outside Earth’s atmosphere. In FY 2002, we oversaw the remaining performance measure—enable human the launch and deployment of five scientific spacecraft exploration through collaborative robotic missions. and one communications spacecraft using commercial expendable launch vehicles. The communications space- In FY 2002, the human exploration and space effort also craft will provide high-data-rate communication links made substantial progress in meeting management chal- with the Shuttles, the Station, the Hubble Space lenges. The Agency established team of managers to Telescope, and other spacecraft. coordinate a long-term plan for human and robotic exploration of space. We have defined requirements for Challenges. NASA’s technical challenges in human the next generations of Earth-to-orbit and nuclear in- exploration and development of space involve choosing space transportation systems for the Integrated Space the right launch vehicle and properly preparing the space- Transportation Plan and the Space Launch Initiative. We craft for launch and deployment. We carefully manage the developed a scaleable, nuclear-thermal and electric technical aspects of spacecraft and launch vehicles. When propulsion system concept. We published the first guid- a failure occurs, we step back and study the events care-

Part II • Discussion • Human Exploration and Development of Space 117 fully to learn the cause and how to avoid similar failures Station, the delivery and return of crews, and Hubble in the future. This has improved mission success. Space servicing. Development of safety and supportability exploration is inherently risky, and NASA’s key challenge upgrades continues. These include cockpit avionics, is to ensure that the process and practices we use remain engine health, landing gear tires, long-life alkaline fuel focused on mission success. cells, and the altitude switch assembly. Modification of Plans. We will continue to meet with the DOD and the the Shuttle Discovery began in September. We also U.S. launch industry annually to discuss strategies for mis- updated the prioritized list of infrastructure refurbish- sion success. Our performance goals for next year focus ment, upgrade, and replacement candidates and associat- on investing resources to maximize successful launch and ed funding. Infrastructure includes facility systems, deployment. We will ensure that our employees have the ground support equipment, fabrication tooling, and equip- skills and resources to make access to space safer, more ment used to manufacture, test, process, and operate reliable, and more affordable. Shuttle flight hardware.

Strategic Goal 2. Enable humans to live and work Challenges. The Shuttle Program faced several chal- permanently in space lenges in FY 2002. The number of flights was fewer than planned, primarily due to cracks detected in Shuttle Although U.S. and international astronauts are already Atlantis’ fuel flow liner. Team members from across the living and working in space, achieving this goal would mean people could spend their lives away from our plan- Agency gathered to determine the best repair option and et. The many steps to the goal are daunting but attainable. get the orbiters flying again. In FY 2002, we achieved most of the annual performance We also cancelled the checkout and launch control system goals for this goal. upgrade after assessments revealed that it was too expen- Over the last 3 years, the performances of the Space sive and its implementation schedule too uncertain. The Station, Space Shuttle, and Space Communications upgrade would have modernized the Shuttle launch pro- Programs have been remarkable. In FY 2001 the human cessing systems at Kennedy Space Center. exploration and development of space effort achieved seven of nine, or 78 percent, of its annual performance Plans. The Space Shuttle Program team will continue to goals; in FY 2002 we achieved almost all of our goals. maintain its commitment to safety. A portion of the This trend resulted from hard work, attention to detail, checkout and launch control system funds will be redi- and strong program management. Overall, it has been a rected to the existing launch processing system, and civil very good year for progress toward enabling humans to servant employees will be assigned to other missions. In live and work permanently in space. March we began developing an integrated 2020 strategy for system design, hardware and software reliability, Strategic Objective 1. Provide and make use of safe, facility infrastructure, and personnel skills. Also, our affordable, and improved access to space Integrated Space Transportation Plan team is developing Achievements. The Space Shuttle Program accom- a strategy to select improvements to the Shuttles and plished four flawless missions in FY 2002, starting with next-generation vehicles. We will use common technolo- Space Transportation System 108 (STS-108) and ending gies where possible. The Shuttles will serve as a test bed with STS-111. These flights supported construction of the for new vehicle technologies.

NASA performs Hubble “heart transplant” in space On March 6, 2002, Astronaut John M. Grunsfeld worked in tandem with astronaut Richard M. Linnehan to replace the Power Control Unit on the giant Hubble Space Telescope. Grunsfeld stands on a foot restraint on the end of the Space Shuttle Columbia’s Remote Manipulator System. Dubbed a “heart transplant” by the media, Hubble’s electrical “heartbeat” was halted for the first time since the telescope’s launch 12 years ago and then restored 4 hours and 24 minutes later. Rapid restoration was critical. Without electricity, the telescope could not protect itself against temperature extremes that could cause irreparable damage.

118 NASA FY 2002 Performance and Accountability Report Strategic Objective 2. Operate the International Space Station to advance science, exploration, engineering, and commerce Achievements. The Space Station Program completed all planned research objectives in FY 2002 without on-orbit safety incidents. We launched utilization flight 1 in December 2001, assembly flight 8A in April 2002, and utilization flight 2 in June. Highlights of the flights included installing the 43-foot-long, 13.5 ton, truss— the backbone for future station expansion; installing the mobile base system on the mobile transporter, which allows the robotic arm to travel along the truss to work sites; replacing the wrist roll joint on the station’s robotic arm; deploying Starshine 2, a student-tracked atmospheric research satellite for a heuristic international networking experiment; and honoring the victims of the September 11, 2001, atttacks by sending nearly 6,000 small U.S. flags into orbit as part of the “Flags for Heroes and Families’’ campaign.

Challenges. Space Station Program challenges include meeting research and science requirements, maintaining NASA expands the International Space Station commitments to international partners, and completing Astronauts Lee M. E. Morin and Jerry L. Ross, mission specialists on STS-110, put final additions on the installation of the station’s new S0 remaining integration and assembly tasks by FY 2004, all truss segment. The 13.5-ton addition is the first segment of a structure within the constraints of the U.S. Core Complete Baseline, that will ultimately expand the station to the length of a football field. The a three-person crew, limited number of flights, limited fund- full truss will support new solar arrays and power management hard- ing, and the requirements of international agreements. ware on the space station. This will allow more research and more power-intensive experiments.

Plans.Given these challenges, we are working closely with The first of three replacement tracking and data relay satel- NASA’s biological and physical research effort and the lites became operational in 2002, as did a new demand NASA chief scientist to support research priorities identi- access scheduling capability to increase the responsiveness fied by the Research Maximization and Prioritization Task and capacity for customers. The second replacement satel- Force, an external advisory subgroup of the NASA lite launched in March 2002. We achieved cost savings in Advisory Council. We have undertaken an activity to inte- several areas: grate Station research. The program continues to seek ways to increase research time within the constraints and is •Centralized scheduling via the new Data Services assessing options such as increasing flight rate and/or dura- Management Center, more automated data services, con- tion of visits to Station. We will meet our safety objective solidated mission-data storage while providing a minimum of 20 hours of crew research time each week plus the required telemetry. We will update • Re-engineering of wide-area network services for the power margin projections and coordinate power use options Space Shuttle and Space Station Programs, including with the research community. replacement of a domestic communications satellite circuit with a lower cost terrestrial circuit

Strategic Objective 3. Meet sustained space opera- • Elimination of unneeded communication circuits tions needs while reducing costs • Increased use of commercial services for ground communications from Norway, South Africa, and Alaska. Achievements. In FY 2002, our ground and space networks delivered data at or above required levels for all Several efforts with educational institutions began this year, NASA flight missions and missions of other Government including the transferring mission services for two satellites agencies, international partners, and private companies. to universities (Bowie State and University of California, The Space Communications Program supported 4 Shuttle Berkeley) and establishing a space communications con- missions, around-the-clock Station operations, 15 tractor “storefront” at Prairie View A&M, University of expendable vehicle launches, and 30 sounding rocket Texas-El Paso, Oakwood College, and Alabama A&M. In launches. We also provided ground support for the Aqua FY 2002, the Space Communications Program conducted and Mars Odyssey missions. international telemedicine demonstrations between doctors

Part II • Discussion • Human Exploration and Development of Space 119 at the University of Mississippi Medical Center and Japan. ments, maintaining commitments to international part- The Space Communications Program also received a ners, and completing the remaining integration and Federal Energy and Water Management Award at the assembly tasks by FY 2004, all given the constraints of Merritt Island Tracking Station. the U.S. Core Complete Baseline; the three-person crew, the limited number of flights, the limited funding, and Challenges. The Space Communications Program must international agreements. continue providing high quality, cost-effective communications within NASA and to external customers, including ground network support to the Aqua mission. Plans. We will continue to effectively manage crew time, middeck lockers, and up-mass (mass of the payload at Plans. Early contractor and civil service interaction will be lift-off), which are the three parameters critical for Station necessary to ensure that network is ready for upcoming research. In FY 2003, we will work with the Station uti- launches, such as IceSat. Interaction between the Space lization community to maximize research. In preparation Communications Program and the flight projects is just as for the next solar array that will launch in early FY 2004, important. To facilitate this, we will effect a distributed the Station will undergo many changes as new truss ele- management process that accommodates the flight projects ments are attached and power channels are reconfigured. and maintains high quality, cost-effective communications. These reconfigurations will limit the power available for We will also pursue space communications partnerships certain types of research, such as those requiring refriger- with other Government agencies. ation. We have described the limitations to the utilization community and are identifying research efforts that do not Strategic Goal 3. Enable the commercial develop- require high power. After the next solar array is activated, ment of space sufficient power for research will be available. In the FY 2004 performance plan, performance measures for Companies choose to locate or do business where they can research power and telemetry (annual performance goals serve customers and make a profit. Space offers many 2H10 and 2H17 in this year’s Supporting Data section) opportunities in this regard, but they must be carefully will no longer be critical. assessed by private companies that wish to take advantage of them. One of NASA’s goals is to help companies gain the knowledge and experience to make those assessments. Strategic Objective 2. Foster commercial endeavors In 2002 we achieved four out of five annual performance with the International Space Station and other assets goals related to enabling the commercial development of space. The successful goals involved providing an average of five middeck lockers on each Shuttle mission to the Achievements. NASA began using a five-point man- Station for research, establishing procedures that increase agement strategy that will achieve major Space Station our use of the U.S. new commercial launch industry, con- Program objectives within funding limitations. In addi- tinuing to implement Shuttle privatization efforts, and tion, we have begun using a new management informa- developing new collaborations with the private sector. The tion system that will strengthen the management and annual performance goal that was not achieved involves financial controls. developing and executing a management plan and opening future station hardware and service procurements to innovation and cost-savings ideas. We rated our performance toward this goal as yellow, which is an improvement over the FY 2001 rating of red.

Strategic Objective 1. Improve the accessibility of space to meet the needs of commercial research and development Achievements. Middeck lockers provide stowage for research critical to completing Station mission objectives. In FY 2002, the Space Shuttle Program provided an average of eight middeck lockers for Station research. This exceeded our commitment to provide at least five middeck lockers. To date, 24 middeck lockers have been provided and planned research objectives NASA oversight ensures safe, successful missions have been accomplished. At NASA operation centers, we control launches and spacecraft (or payload) communications throughout the life of a mission. At the Challenges. Our next Space Station Program chal- Payload Operations Center at Marshall, the International Space Station lenges are meeting the research and science require- control team watches over the station around the clock.

120 NASA FY 2002 Performance and Accountability Report Challenges. Future Space Station Program challenges We have a mission that fires the imagination and interest are meeting research and science requirements, main- of the public. Both the Administration and Congress have taining commitments to international partners, and encouraged us to use our discoveries, experiences, and completing the remaining integration and assembly popular position to spur students on to study science, tasks by FY 2004, all given the constraints of the U.S. engineering, and math. Our programs are ambitious, Core Complete Baseline, the three-person crew, the involving not only our professional outreach staffs, but limited number of flights, the limited funding, and also employee volunteers. We achieved 75 percent of the international agreements. performance measures for this strategic goal.

Plans. The new management strategy, as mentioned Strategic Objective 1. Provide significantly more above, has five focus areas. First and most critical is prior- value to significantly more people through explo- itizing the research plans upon which we will base the ration and space development efforts Station’s final configuration. Second is completing of the U.S. Core Complete configuration. Third is implementing Achievements. NASA provided public access to a a reliable and effective cost estimating and management wealth of Station and Shuttle mission information, and system to provide Department-of-Defense-style independ- public participation via the Web and exhibits such as the ent cost estimates based on requirements whose costs can International Space Station Trailer and Destiny Module be accurately estimated. Already, the new strategy is mockups. We participated in many educational, commer- improving cost estimates, bringing about management efficiencies, and refocusing staff for maximum accountability and performance. The fourth focus is identifying with our international partners areas where their role can grow. The fifth focus area is an overall assessment to ensure that logistics support is sufficient for safe, effective operations. In FY 2003, we will implement full cost accounting in accordance with the Integrated Financial Management Program.

Strategic Objective 3. Develop new capabilities for human spaceflight and commercial application through partnerships with the private sector Achievements. We extended the Space Flight Opera- tions contract and began preparing a competitive sourcing plan. A NASA-commissioned task force of private sector business specialists lead by the RAND Corporation conducted an independent review of Shuttle operations and identified options for competitive outsourcing. In addition, we developed new collaborations with private sector companies that advance our exploration, research, and outreach efforts.

Challenges. The program management team is focused on maintaining the Shuttles’ long-term safety and viability. Loss of NASA oversight because of contract consolidation and the resulting loss of NASA skills and experience could erode the program’s critical checks and balances.

Plans. The management team will maintain program robustness by leveraging the talents of the NASA and pri- NASA give students first-hand aerospace experience vate sector workforces. We will factor the RAND study Students from the University of Alabama in Huntsville, Alabama A&M University, and three Huntsville-area high schools prepare to launch the findings and recommendations into our preliminary com- rockets they designed and built. The launch, which culminates more petitive sourcing plan for the Space Shuttle Program by than a year’s work, will demonstrate the student teams have met the February 2003. challenge set by the Marshall Center’s Student Launch Initiative: to apply science and math to experience, judgment and common sense. Marshall’s Student Launch Initiative is an educational effort that aims to Strategic Goal 4. Share the experience and bene- motivate students to pursue careers in science, math, and engineering. fits of discovery It provides hands-on, practical aerospace experience.

Part II • Discussion • Human Exploration and Development of Space 121 cial, and political venues that provided hands-on opportu- Achievements. We improved our public Web sites and nities for the public to learn more about the program. participated in numerous outreach events. Viewing oppor- More than a half million people toured the mockups and tunities for Shuttle launches further contributed to suc- the visitor centers at Johnson, Kennedy, Marshall, and cessful achievement of this goal. We provided education- Stennis Centers. al opportunities to diverse formal education audiences (primary, secondary, and college educators and students). Challenges. Translating the research and science objec- NASA spaceflight programs support more than 100 col- tives and accomplishments into tangible products that are laborative education efforts including 7 science centers, meaningful to the public continues to be a challenge for museums, research labs, or observatories; 24 Government NASA. Although not applicable to all research, the imme- agencies and public organizations that support education; diate benefits to the public are difficult to realize because 32 colleges and universities; and 35 nonprofit, commer- of the long-term nature of the research projects and analy- cial, or mass media organizations. ses. Breaking down communication barriers with the pub- Challenges. So far, we have no method for isolating the lic is crucial to “inspiring the next generation of explor- effect of our education efforts on improving scientific, ers.’’ These are challenges that will be faced by the new technological, and academic achievement in our schools. NASA Office of Education. In addition, most of our programs take place at the Centers; although each has regional outreach responsibil- Plans. We will transfer this metric but continue to sup- ities, achieving a national scope with limited resources is port the new NASA Education Office by strengthening problematic. Another area of concern is our ability to inte- public knowledge and interest in NASA by arranging for grate our education efforts with the Government’s educa- public involvement in human spaceflight activities. In tion reform efforts (for example, No Child Left Behind). addition, we will develop an integrated Agency-wide system for tracking outreach performance across all space- Plans. In the coming year, we will support efforts to syn- flight Centers. chronize education activities across the Agency; strengthen education collaborations and partnerships; share resources among the Centers to support preservice Strategic Objective 2. Advance the scientific, teacher preparation programs and distance learning capa- technological, and academic achievement of the bilities; and increase the number of student competitions Nation by sharing our knowledge, capabilities, that are so effective both in energizing students, schools, and assets and communities and in enhancing NASA’s research.

122 NASA FY 2002 Performance and Accountability Report Aerospace Technology MISSION: Maintain U.S. preeminence in aerospace research and technology

NASA’s aerospace technology effort seeks to improve air causal factors, and mechanical or software malfunctions. and space travel, space-based communications, and high- We identified and assessed the situations and trends that performance computing through fundamental research lead to accidents. We then developed information tech- and technology development. We focus on four strategic nologies for building a safer airspace system. goals: (1) Revolutionize aviation—enable a safe, environ- These technologies include a self-paced, computer-based mentally friendly expansion of aviation. (2) Advance training program to help pilots detect, avoid, and mini- space transportation—create a safe, affordable highway mize exposure to icing. The program explains the effects through the air and into space. (3) Pioneer technology of icing on aircraft performance and describes how to innovation—enable a revolution in aerospace systems. (4) detect and recover from icing-related wing and tail stalls Commercialize technology—extend the commercial (loss of lift). Ice accretion images from NASA’s icing application of NASA technology for economic benefit research aircraft and icing research tunnel, pilot testimo- and improved quality of life. (5) Space transportation nials, animation, case studies, and interactive demonstra- management—provide commercial industry with the tions enhance the presentation. United States and opportunity to meet NASA’s future launch needs, includ- European airline operators, Cessna Aircraft Company, ing human access to space, with new launch vehicles that Transport Canada, United Express, the Ohio Civil Air promise to dramatically reduce cost and improve safety Patrol, and the U.S. Army Safety Center received copies and reliability. of the program, which is also available online. Originally released in videotape in 2000, a computer-based training Strategic Goal 1. Revolutionize Aviation—Enable the program for pilots of larger aircraft became available on safe, environmentally friendly expansion of aviation compact disk in FY 2002 with additional training exer- The aviation system is a complex amalgam of aircraft, cises and content for student pilots. We collaborated with airports, aircraft routing and safety mechanisms, such as the FAA, Air Line Pilots Association, and University of air traffic control, the airspace itself, and the technologies, Oregon on this effort. policies, and human factors underlying all of these. Several weather-related technology demonstrations took Expanding the system to meet demands for growth will place in FY 2002. One, a forward-looking, turbulence- mean making it more distributed, flexible, and adaptable. warning system, completed its 20th flight in NASA’s Any growth, however, must work within the physical and commercial-transport-size research aircraft. The sys- environmental constraints of today’s system while antici- tem’s performance has been excellent, demonstrating an pating and meeting the evolving needs of air travelers. 81-percent probability of detecting severe turbulence What is more, the system is and will continue to be inter- more than 30 seconds before it happens and a nuisance national in scope, requiring close coordination around the alarm rate of only 11 percent. globe. Cleaner, quieter, and faster aircraft, with better performance and new capabilities, will operate in this new In addition, we demonstrated software designed to help system. Advanced information and instruments will make airlines schedule flight crews for long-haul flights. We air travel safer and more efficient. Air transportation will based this scheduling assistant software on neurobehav- be easily accessible from urban, suburban, and rural com- ioral, subjective, and operational measurements collected munities. NASA aims to bring about this aviation expan- during commercial long-haul flights. The software pre- sion by delivering the technologies, materials, and opera- dicts the effects of acute sleep loss, cumulative sleep tions needed for these new aircraft, information systems, loss, and circadian desynchrony (disruption of our nor- and instruments. In FY 2002, the aerospace technology mal 24-hour cycle) on waking performance. Airlines can effort achieved 100 percent of its performance measures also use this software to minimize practices that lead to for this strategic goal. in-flight fatigue. Challenges. A fivefold reduction in the fatal aircraft Strategic Objective 1. Increase Safety—Make a accident rate is a national goal. NASA is contributing to safe air transportation system even safer attaining this goal by developing technologies that, if Achievements. In FY 2002, we examined aviation acci- fully implemented, will reduce these fatalities by at least dent trends and identified technologies that will improve 50 percent. NASA is also a member of the Commercial the safety of the national airspace system. In cooperation Aviation Safety team, comprising aviation safety profes- with the FAA and the aviation industry, we looked into sionals from government and industry. However, NASA accidents and incidents involving hazardous weather, and the safety team are using different system analysis controlled flight into terrain, human-performance-related tools. The safety team projects a 77-percent reduction in

Part II • Discussion • Aerospace Technology 123 the risk of fatal accidents when new technology, training, gy developments currently on the horizon may allow a and operational procedures come into full use. Our chal- fuel-cell-powered craft to exceed the payload and range lenge is to work with the team to bring these disparate of current piston-powered aircraft. The second study con- projections into alignment while we maximize the safety sidered using liquid hydrogen to fuel a transport aircraft improvements available. at today’s state of the art, at 2009, and at 2022 technology levels and predicts that by 2022 hydrogen-powered Plans. To address the disparate projections, we will transport aircraft could have a 52 percent lower gross assess aviation safety products using the Commercial weight at takeoff, lower nitrogen oxides emissions, and Aviation Safety team’s process and data sets and compare no carbon dioxide emissions while maintaining the same the results with our own process. Through this effort, we payload and range as conventionally powered aircraft. hope to help bring about a uniform assessment of progress toward the national goals. We will continue to Challenges. We must maintain emissions reduction develop critical technologies necessary to meet the avia- technology performance as we impose increasingly tion safety objective through flight tests and simulations. demanding tests—from flame tube tests of concepts, to burner rig tests of combustor segments, to burner rig tests Strategic Objective 2. Reduce Emissions—Protect of full combustors. We must ensure that the technologies local air quality and our global climate to reduce nitrogen oxides emissions do not increase carbon dioxide emissions and vice versa. Achievements. Among the chemicals produced by aircraft fuel combustion, two have the most significant Plans. We will complete sector tests of our more mature effect on the environment. Nitrogen oxides degrade local combustor technologies and select some of them for fur- air quality by creating smog and harm global air quality ther development and full configuration tests. We will by contributing to ozone loss. Carbon dioxide degrades also identify our most promising new technologies for global air quality and contributes to global warming. further development. NASA’s efforts to minimize these emissions cover three areas: (1) minimize the effect of aviation operations on Strategic Objective 3. Reduce Noise—Reduce air- local air quality, (2) significantly or totally eliminate aircraft noise to benefit airport neighbors, the avia- craft emissions as a source of harmful emissions, and (3) tion industry, and travelers eliminate aviation emissions resulting from operational Achievements. Reducing aircraft noise near airports procedures. The following are highlights of the pro- and, ultimately, confining the noise to compatible land- gram's achievements in FY 2002: use areas around airports, will benefit homes and busi- The first tests of a low-emission aircraft engine combus- nesses near airports and, by reducing constraints on where tor sector (a segment of a full combustor design) pro- new airports and runways can be located, enable faster duced a nitrogen oxides reduction of 67 percent below and more efficient growth of the Nation’s air system. 1996 International Civil Aircraft Organization standards. NASA is conducting a balanced effort to make major This result is just 3 percentage points short of our goal of advances in noise reduction by 2007 and looking to high- a 70-percent reduction, 40 percent fewer nitrogen oxides impact technologies to address the more difficult targets emissions than current commercial aircraft engines, and of 2022. 17 percent fewer than the combustor design we demon- The following are highlights of the program’s achieve- strated last year. ments in FY 2002: A new ceramic thermal barrier coating increases the abili- System-level noise assessments are critical to determin- ty of turbine blades in aircraft engines to tolerate high tem- ing which technologies have the highest potential for peratures. At higher temperatures, fuel burns more com- reducing community noise. A beta version software, the pletely and with fewer emissions. Turbine blades, located Advanced Vehicle Analysis Tool for Acoustics Research, directly behind the engine’s hot combustor section, must shows great promise in providing these assessments. The withstand these high temperatures. NASA’s coated test software has all the prediction capabilities of NASA’s blades withstood temperatures 300 degrees Fahrenheit Aircraft Noise Prediction Program and runs on the Linux higher than standard blades. They survived 1,200 cycles operating system. It also corrects for propagation of jet (100 hot hours) at surface temperatures of 2,480 degrees noise, can predict noise from advanced high-bypass ratio Fahrenheit. This new coating will significantly increase engines and airframe subcomponents, and accounts for the ability of both high-pressure turbine and combustor wind and temperature gradient effects on noise propaga- liner components to withstand high temperatures. tion. With these enhancements and its physics-based We completed two feasibility studies. One considered modeling capability, the software can allow designers to using fuel cells to power a state-of-the-art aircraft and treat the various airframe and engine noise sources as an predicts that such an aircraft would have a 54-nautical- interrelated system and find the best set of components mile range with a 140-pound payload. Fuel cell technolo- for noise mitigation.

124 NASA FY 2002 Performance and Accountability Report Challenges. Noise-reduction technology needs to be tools’ timelines showing predicted arrivals and departures available now if airplanes produced at the end of the were the most helpful aid in determining when to change decade are to be much quieter than today’s. By 2010, the runway configuration and in balancing departures. most of the existing U.S. fleet will be nearing replacement. We should not miss the opportunity to influence the The Traffic Flow Automation System, a decision-support future noise impact of our air transportation system. tool for predicting traffic loads, was developed and eval- Ensuring that the technologies we develop are actually uated. The tool tells controllers as much as a minute ear- used in future aircraft fleets requires that the technology lier than current tools how much air traffic will be enter- matures adequately from subcomponent tests in the labo- ing their sector of the sky. The software, running on a ratory, to component tests in more realistic environments, Unix-based computer cluster, processed all of the air traf- to full integrated flight tests. fic in the national airspace system’s 20 Air Route Traffic Control Centers simultaneously. The new tool predicts Developing and validating physics-based noise prediction sector loading more accurately than the current tool and models will allow us to more accurately assess engine and is 15 to 20 seconds faster. airframe noise-reduction technologies and changes in aircraft operations to reduce noise. In addition, the validated Challenges. Our greatest technological challenge is the models will enable industry to assess and integrate these need to combine real-time analysis with fidelity to a com- technologies into their products. plex system. Both aspects are essential if we are to accurately evaluate and select the air traffic management tools Plans. We will continue to develop and begin to validate needed to achieve our goals. the promising noise-reduction technologies we identified in FY 2002. Our programmers and engineers will com- Plans. The aerospace technology effort will complete plete initial physics-based prediction models of engine development and validation of the advanced air trans- and airframe noise. We will evaluate, in an interim air- portation technologies in FY 2004. NASA expects these craft-level technology assessment, the potential for these technologies to increase the capacity of the National promising concepts to reduce noise. The results from this Airspace System by 15 percent and controller productiv- analysis will provide a benchmark for measuring overall ity by 20 percent. progress and guide future decisions. Work in 2003 will lay the foundation for efforts to reduce aircraft noise an Strategic Objective 5. Increase Mobility— additional 2 decibels below the 1997 baseline. Enable people to travel faster and farther, anywhere, anytime Strategic Objective 4. Increase Capacity—Enable the movement of more air passengers with fewer delays Achievements. New technologies to increase small aircraft safety in nearly all weather conditions can greatly Achievements. In cooperation with the FAA, NASA is increase the capacity of the nation’s air system. The Small developing airspace systems technologies through two Aircraft Transportation System project will develop such paths: (1) The Advanced Air Transportation Technologies technologies. In FY 2002, the Small Aircraft project develops decision-support technologies to help air Transportation System project partners (NASA, the FAA, traffic controllers and pilots use the airspace more effi- and the National Consortium for Aviation Mobility) ciently. Techniques include reduced aircraft spacing, began work to develop, evaluate, and demonstrate four improved scheduling, and improved collaboration with new operating capabilities for small aircraft. operators. (2) The Virtual Airspace Modeling and Simulation project, new in FY 2002, will establish a vir- Challenges. The very fact of the many players in the tual airspace simulation environment to test and evaluate public-private research and development collaboration new solutions to the Nation’s aviation system problems. described above poses a challenge to its effectiveness. These technologies will increase the national airspace The players are NASA, the U.S. Department of system’s capacity to meet projected public demand and Transportation, the FAA, State and local authorities, uni- reduce delays without compromising safety. The follow- versities, industry, and transportation service providers. ing are highlights of achievements in FY 2002: The project must balance technology development, technology validation and demonstration, and technology We conducted a simulation of the interoperability of two assessment, and includes laboratory, simulation, and new graphical traffic automation tools: the Surface flight experiments. Management System and the Traffic Management Advisor. Both proved their worth to tower controllers, Plans. NASA is applying its experience in the successful including the traffic management coordinator, from the Advanced General Aviation Transport Experiments Dallas Fort Worth airport. In the simulation, the coordina- Program, which was also a public-private research and tor used the tools to decide when to switch a runway from development collaboration, to the Small Aircraft departures to arrivals. The coordinator found that the Transportation System Program. The program will

Part II • Discussion • Aerospace Technology 125 demonstrate small aircraft operating concepts in flight Strategic Objective 1. Mission Safety—Radically im- tests over the next several years. prove the safety and reliability of space launch systems Achievements. As noted above, the Space Launch Strategic Goal 2. Advance Space Transportation— Initiative Program narrowed its potential architecture Create a safe, affordable highway through the air designs—from hundreds to the 15 most promising—and and into space aligned technology development investments to support them. Stringent systems engineering evaluations ensure Revolutionizing our space transportation system to that designs are viable and that technology investments reduce costs and increase reliability and safety will open are relevant. We have created an advanced engineering the space frontier to new levels of exploration and com- environment to analyze and validate data, to ensure that mercial endeavors. With the creation of the Integrated the Government is a smart buyer. Interrelated technology Space Transportation Plan, NASA defined a single, inte- projects focus on such innovations as long-life rocket grated investment strategy for all its diverse space trans- engines, robust thermal protection materials, and sophis- portation efforts. By investing in a sustained progression ticated diagnostic software. We have completed designs of research and technology development activities, NASA for a crew transfer/return vehicle and have several options will enable future generations of reusable launch vehicles for near-term development. and in-space transportation systems that allow less costly, Propulsion is one of the keys to improving space access. more frequent, and more reliable access to our neighbor- We tested flight engine prototypes and components. A ing planets and the stars beyond. new liquid-oxygen/kerosene engine may afford quick turnaround and be fully reusable. An integrated vehicle FY 2002 produced solid achievements in the development health-management system demonstrates the potential of space launch technologies. We achieved all of our to use model-based reasoning software to monitor the annual performance goals. The Space Launch Initiative condition of the entire space launch system in every Program, after extensive analyses, narrowed architecture phase of operation. designs and conducted stringent systems engineering Challenges. Our challenges include Level 1 (program- evaluations to ensure that selected designs will be viable level) requirements validation—ensuring that we accom- and that our future technology investments are relevant to modate multiple users with a wide range of needs. The those designs. program must ensure that its cost estimate for development, operations, and the total system is credible. We must ensure that the technological payoff to NASA and the nation is enough to justify the resources and effort expended. We are coordinating a thorough review of the Level 1 requirements at the Agency level. We are refining cost models and employing innovative tools to control requirements and ensure that critical technologies mature early. We are also using a new design philosophy that focuses on total system operations. Plans. Technology risk-reduction efforts will continue, as will architecture definition, technology development and evaluation, and systems engineering integration and analysis studies. The program has adopted a new focus on simplifying design that minimizes, eliminates, or streamlines all system interfaces. The focus includes operational activities and processes as well as hardware and software. We will continue to work with the DOD to incorporate military requirements for space access as appropriate. We will also continue to validate Level 1 requirements and subsequently will develop and validate NASA advances safe, reliable, and affordable space system-level requirements. transportation propulsion Advanced propulsion systems and hardware that are more reliable, safer, and less costly to build and maintain will enhance space com- Strategic Objective 2. Mission Affordability— merce and enable more ambitious space science missions. "Safer" Create an affordable highway to space includes safer for the environment and for the people on Earth who maintain the systems. Shown here is the test firing of a reaction control Achievements. The Space Transfer and Launch thruster that uses nontoxic fuel. Technology Program is responsible for developing and

126 NASA FY 2002 Performance and Accountability Report izontal takeoff/horizontal landing, and vertical takeoff/horizontal landing. We will also screen fuel options, including hydrogen, hydrocarbon, and dual-fuels, and propulsion options, such as hypersonic airbreathing engines. These studies also encompass safety, reliability, and life-cycle cost.

Strategic Objective 3. Mission Reach—Extend our reach in space with faster travel times NASA demonstrates advanced composites processing Composite materials offer many advantages over metals, including Achievements. Research engineers demonstrated a lighter weight and greater temperature strength. Composites are often 10-kilowatt ion engine, which is designed for use in costly to manufacture, however, as they require large vacuum cham- nuclear electric propulsion systems. Such an engine, bers and heating equipment. Researchers have devised composites that can be processed in vacuum bags in an oven, somewhat like the with its nearly constant propulsion, could greatly boil-in a bag process (without the boiling water) we use at home. The reduce trip times for interplanetary missions. The high- results showed excellent adhesive strengths. Using this process will power ion engine with titanium ion optics had four allow manufacturers to use existing equipment and less energy while times the power and a 62 percent greater specific producing a material that both performs better and is reusable. impulse than the state-of-the-art ion engine. demonstrating technologies for third-generation reusable Challenges. The primary challenge is to develop com- launch systems. The objective is to identify systems to ponent technologies necessary for a flight-qualified, high- meet national mission requirements for space access and powered ion engine. to develop the necessary technologies by the end of the Plans. We will continue to develop this technology by next decade. In general, the engine demonstrator projects testing the molybdenum ion optics on test-bed engines. (rocket-based combined cycle and turbine-based com- Researchers will assemble and test new high specific bined cycle), and the X-43C flight demonstrator will impulse ion optics made of titanium. They will also test develop macro-technologies and define requirements for carbon-carbon ion optics designed by outside researchers micro-technologies. through a grant. In FY 2002, the Space Transfer and Launch Technology Program completed critical tests and established partner- Strategic Goal 3. Pioneer Technology Innovation— ships with industry and academia. Materials scientists Enable a revolution in aerospace systems improved airframe materials, while research engineers Developing the aerospace systems of the future will established design requirements for the rocket-based require revolutionary system design and technology combined-cycle engine. The X-43C vehicle’s preliminary development approaches. Using technologies that are and systems-level requirements will provide the project’s now in their infancy, developing knowledge needed to baseline goals, a decision that moves us closer to procur- design new systems, and developing tools for efficient ing X-43C demonstrator vehicles. We awarded two high-confidence design and development are the focus of University Research Education and Technology Institute NASA’s aerospace technology effort. The technologies grants: the Universities of Maryland and Florida will each we develop will enable NASA to achieve its strategic receive $5 million annually for work in airframe and objectives, supporting the collection, analysis, and distri- propulsion technologies research. bution of currently unobtainable data about our planet and Challenges. Challenges in FY 2002 included the need the universe. In FY 2002, we achieved all of the perform- to deal with the fallout from the X-43A mishap that ance indicators for the pioneer technology innovation occurred in FY 2001 and the associated, unplanned alter- strategic goal. The overall assessment for this strategic native launch vehicle study. The X-43C project has close- goal is green. ly monitored the activities of the mishap investigation board. A thorough, independent study has concluded that Strategic Objective 1. Engineering Innovation— the Pegasus booster remains the most viable launch vehi- Enable rapid, high-confidence, and cost-efficient cle. In another challenge, the prohibitive long-term cost of design of revolutionary systems modifying the aging B-52 flight test aircraft to preserve Achievements. In FY 2002, we developed engineering operability resulted in our decision to use the Lockheed- tools and computational architectures to reduce system 1011 owned by Orbital Sciences Corporation as the X- design and analysis time, link geographically distant 43C carrier aircraft. This change, while less costly in the researchers in collaborative environments, speed soft- end, incurred a cost of $8 million to the program. ware verification, provide adaptive capabilities for flight Plans. System studies will screen launch vehicle control systems, reduce mission risk, and streamline options such as single-stage and two-stage to orbit, hor- mission operations.

Part II • Discussion • Aerospace Technology 127 Several demonstrations showed the potential of advanced Plans. In FY 2003, we will develop processes for full engineering tools to reduce system design and analysis life-cycle planning and design of aerospace systems; bet- time and to streamline mission operations. Engineers rap- ter ways to certify and implement aerospace systems; idly redesigned a crew return vehicle (to bring back computational capabilities and knowledge bases for aero- Station crews in emergency conditions) using a flight space system design; and tools to model new vehicles simulation environment while pilots provided real-time under all operating conditions. feedback on handling qualities. A high-performance computing algorithm allowed mission designers to generate a Planned activities will push the state of the art in two key database of reusable launch vehicle concepts without risk management areas: organizational risk and software extensive numerical simulation. This cut the time risk. We will develop an organizational risk model for required to evaluate vehicle concepts from several decision-support tools for complex operations. We will months to a week and reduced design cycle time to less establish two new software test beds for software risk than one-third that of state-of-the-art techniques. An management and reliability. To demonstrate certifiable adaptive grid generator for computational fluid dynamics program synthesis technology, we will develop algo- analysis decreased computation time by 15 times. rithms to automatically generate software designs and code based on requirements and specifications. This will We developed a collaborative workspace to streamline include the development of autocoding technology that mission operations for the Mars Exploration Rover. The enables product-oriented certification, rather than certifi- workspace allows dispersed scientists, engineers, and cation for flight based on traditional methods. These mission operators to interactively develop mission plans innovations will make aerospace systems safer, more reli- and monitor mission status. Collaborative engineering able, and more affordable. environments could substantially reduce the time needed to conduct tests and plan mission operations. Strategic Objective 2. Technology Innovation— Enable fundamentally new aerospace system We conducted a successful proof-of-concept demonstra- capabilities and missions tion for a goal-oriented autonomous architecture tool. This software allowed prototype Mars rovers to plan their Achievements. In FY 2002, we developed technology own paths and determine ideal instrument placement. to make possible high-data-rate space communications This software reduced the number of command cycles from small ground stations, to provide advanced aircraft needed to direct the rover to reach objects of scientific with simplified high lift systems using active flow con- interest. An intelligent flight control system using adap- trol, and to demonstrate nanotechnology applications for tive neural networks—an artificial brain that learns from chemical sensors and high strength composites. experience improved aircraft performance and reconfigured the control system to maintain vehicle stability when The 622-megabit-per-second space communications link failures occurred. Such intelligent systems will result in provides direct access to scientific data from satellites in safer, more efficient flight. low-Earth orbit using only a small, portable ground station. The ground station uses a digital modem and is Challenges. There are many challenges involved in about 1/4 the size of the ground station presently making possible fast, high-confidence, cost-efficient required. This affordable way for users to communicate design of new systems. These include integrating diverse directly with spacecraft substantially reduces the time and engineering and computational tools from different expense needed to acquire and distribute data. These organizations; managing risk throughout the system life small ground stations can also supplement the existing cycle; verifying complex software and autonomous sys- space communications infrastructure to increase coverage tems; modeling the interaction of new technologies in or redundancy. complex systems; and transitioning new engineering practices and tools to users. We can overcome these chal- We demonstrated that an active-flow-control technology lenges by involving end users early in the development of can improve lift and stability on advanced aircraft. Active new engineering tools and by identifying and analyzing flow control allows aircraft to use simpler high-lift sys- all factors that could contribute to system risk. tems that can reduce noise and allows transport-sized aircraft to access smaller airports. Because these systems are The ongoing economic struggles in the information tech- typically lighter, they can also reduce fuel use and emis- nology industry posed an additional challenge to many of sions. In addition, a simulation demonstrated how flow the efforts associated with this performance measure. The control technology could affect aircraft stability. This downturn’s dampening effect on the industry’s research flow control system used a porous wing, sections of and development has left a larger than expected gap which could reconfigure to maintain stability when other between commercial capabilities and our requirements, aircraft components failed. The porous wing may one day which led us to demand more from our own, already replace conventional control surfaces to reduce weight taxed, information technologists. and improve safety.

128 NASA FY 2002 Performance and Accountability Report Nanotechnology (the art of manipulating materials on an This capability will greatly enhance our ability to extract atomic or molecular scale) may change our lives in a patterns and other meaningful information from the vast multitude of ways. NASA is engaged in nanotechnology amounts of data from space science and Earth science research with potential applications to aeronautics and missions. In FY 2003, we will also simulate an aerospace. For example, we demonstrated that it is pos- autonomous science exploration mission, including sible to fabricate ultrasensitive chemical sensors from demonstrating autonomy components operating inde- carbon nanotubes by attaching nucleic acids and other pendently during a mission. This is a key step toward probe molecules to the nanotube’s tip. When specific spacecraft that can “think” for themselves and adjust to chemicals bonded with the probe molecule, a measura- problems and opportunities during a mission. ble change occurred in the nanotube. Potential applications for nanosensors include the search for life on other Strategic Goal 4. Commercialize Technology— planets, medical diagnostics, such as detecting cancer Extend the commercial application of NASA tech- cells and detecting biological and chemical threats to nology for economic benefit and improved quality homeland security. of life We also aligned carbon nanotubes in a polymer matrix by This goal centers on extending commercial application of extrusion. This is an important first step in developing NASA technology to benefit the economy and improve carbon nanotube-based composite materials. Nanotube quality of life. Although NASA technology benefits the fibers are usually produced in tangled bundles. Materials aerospace industry directly, the creative application of our scientists believe that carbon nanotube-based composites technology to disparate design and development with their fibers aligned in a single direction may be 100 challenges has contributed to other areas, such as the times stronger than steel and 1/6 the weight. If these environment, surface transportation, and medicine. materials can be developed, they will significantly reduce Commercializing and transferring NASA technology to the weight of aircraft, launch vehicles, and spacecraft. U.S. industry, other Federal agencies, and other NASA programs involves the full range of our assets from Challenges. The challenges of enabling fundamentally expertise to research facilities. new aerospace system capabilities and missions through technology innovation are many. We must look far ahead All planned performance measures were successfully of current plans to create breakthrough ideas and identify completed in FY 2002. We transferred a significant high-payoff technologies. We must manage the long-term amount of aerospace technology to industry in 2002. In development of diverse technologies that may require 15 addition, our support of education continued to grow, years from concept to application. And we must always featuring many educational materials and video be mindful of the transition of our technology products to productions. Customers using NASA facilities were, the users who will infuse them into NASA missions. again this year, highly satisfied with the performance and quality of the services and with the support and expertise Plans. We will develop ad hoc space communications of NASA scientists and engineers. networks in FY 2003. This will vastly improve science return by allowing NASA to deploy networks on demand Strategic Objective 1. Commercialization—Facilitate to support space and planetary exploration assets. We the greatest practical utilization of NASA know-how will also demonstrate high power microwave sources and physical assets by U.S. industry capable of a two to three times increase in data transmission from Mars to Earth, and a 10 times increase from Achievements. The aerospace technology effort trans- Earth orbit to ground. The power sources are based on ferred more than double the planned number of technolo- traveling wave tubes and semiconductor power ampli- gies to industry and other Federal agencies. Our exit sur- fiers. We may actually use these sources as early as 2005 veys showed that more than 90 percent of customers for Mars mission communications. NASA will also conduct a major demonstration of tools and techniques for intelligent data understanding. Specifically, we will finish developing feature recognition algorithms.

NASA explores nanotechnology to improve chemical detectors and composite materials Carbon nanotubes could be used to make ultra-sensitive chemical detectors to search for life on other planets, to detect cancer cells, or to provide early warning of chemical agents for homeland security. Carbon nanotubes could also provide very high-strength, low-weight materials for aerospace vehicles.

Part II • Discussion • Aerospace Technology 129 using NASA facilities were highly satisfied with the capabilities and support provided. We have plans to develop educational products and increase public awareness of the benefits of NASA’s aerospace technology research. Recent products include the following: •The Aviation Safety Program Office’s Single Aircraft Accident Prevention Project is featured in a new episode of the Distance Learning Program Destination Tomorrow, a news magazine format program targeted for adults. Three Kid’s Science News Network scripts are ready for production. In these 1-minute vignettes, children instructors explain to children in kindergarten through second grade specific mathematics, science, technology, and computer science concepts. The program will be available in both English and Spanish. The Aviation Safety Program public Web site (http://avsp.larc.nasa.gov) provides much useful infor- NASA technology saves lives mation and is regularly updated. A Cirrus Airframe Parachute System, using technology developed by NASA, was deployed when the pilot experienced control difficulties. • Virtual Skies (for ages 9 to 12) is an interactive web- This marks the first time a certified aircraft has successfully landed with site that helps students explore the exciting world of the aid of an airframe parachute. aviation. It takes kids on a virtual visit of the NASA Ames Research Center to investigate the principles of opportunity to meet NASA’s future launch needs, flight, learn about flight planning, see large wind tun- including human access to space, with new nels in operation, plot cross-country excursions, con- launch vehicles that promise to dramatically sider career opportunities, and much more. reduce cost and improve safety and reliability. (Supports all objectives under the Advance Space • The Exploring Aeronautics CD-ROM (for students in Transportation Goal) grades 5 to 8) provides attractive, absorbing tutorials in the principles of flight and aircraft design. An online Web site introduces the CD-ROM, along with instruc- Strategic Objective 1: Utilize NASA’s Space tions on how to obtain it and how to incorporate it into Transportation Council in combination with an a school’s mathematics, science, technology, and External Independent Review Team to assure geography curricula. Agency-level integration of near- and far-term space transportation investments Challenges. In FY 2003, we will work to develop more efficient means of transferring our products to our tech- Achievements. In FY 2002, the External Requirements nology customers in industry and Government. The chal- Assessment Team (ERAT) performed an independent lenge of understanding how to incorporate changes in review of the Second-Generation Launch Initiative technology-customer requirements in concert with high requirements and architectures. The ERAT also actively technical risk technology demonstrations is a continuous participated in the interim architecture review. process between NASA and our technology customers Plans. In addition to building on proven mechanisms, Challenges. The Space Transportation Council disband- to transfer NASA technology to industry, we will ed in May 2002. However, the Integrated Space increase efforts to inspire academic excellence in sci- Transportation Planning team, the ERAT, the OIG, the ence, technology, engineering, and mathematics using GAO, and the NASA Office of Chief Engineer’s educational products based on NASA aerospace tech- Independent Program Assessment Office reviewed the nology research. Our outreach program will also strive Second-Generation Launch Initiative Program’s progress. to increase public awareness and understanding of the benefits of research and innovation. A special focus will Plans. We will continue to strive to improve our man- be to support the Centennial of Flight celebrations. agement practices by placing our management planning under the scrutiny of technically competent parties to Strategic Goal 5: Space Transportation Manage- ensure that our technology products will meet the needs ment—Provide commercial industry with the of our customers.

130 NASA FY 2002 Performance and Accountability Report Supporting Data

Space Science

Strategic Goal 1. Chart the evolution of the uni- with masses greater than about 1 percent of the mass of verse, from origins to destiny, and understand its the electron. galaxies, stars, planets, and life An international team of astronomers observed a dark Strategic Objective 1. Understand the structure of matter object directly for the first time. The Hubble and the universe, from its earliest beginnings to its the European Southern Observatory’s Very Large ultimate fate Telescope took images and spectra of a nearby dwarf star that gravitationally focuses light from a star in another Annual Performance Goal 2S1. Earn external review galaxy. The result is a strong confirmation of the theory rating of green, on average, on making progress in the fol- that a fraction of dark matter exists as small, faint stars in lowing research focus areas: Identify dark matter and learn how it shapes galaxies and systems of galaxies; galaxies such as our Milky Way. and, determine the size, shape, age, and energy content For the focus area “determine the size, shape, age, and of the universe. energy content of the universe,” we achieved the following: The NASA space science effort achieved a rating of green for this annual performance goal. We re-evaluated our On April 1, 2002, Microwave Anisotropy Probe com- approach to our strategic goals and objectives and revised pleted the most sensitive all-sky map to date of the cos- our annual performance measures for 2002. Therefore, a mic microwave background, the first of eight planned one-to-one match with previous years is not possible. maps. Scientists will use the map, which is currently under analysis, to determine the basic parameters of the Indicator 1. Demonstrate significant progress toward the physical universe including size, shape, and matter and goal, as determined by external expert review energy content.

Results. For the focus area “identify dark matter and The Hubble has uncovered the oldest burned-out stars in learn how it shapes galaxies and systems of galaxies,” we our Milky Way galaxy. These extremely old, dim stars achieved the following: provide a reading on the age of the universe completely independent from previous methods. The ancient white The Microwave Anisotropy Probe began science opera- dwarf stars, as seen by Hubble, turn out to be 12 to 13 bil- tions on October 1, 2001. It will perform the most sensi- lion years old, putting astronomers well within arm’s tive all-sky study to date of the cosmic microwave back- reach of calculating the absolute age of the universe. ground. Its data will be used to determine the amount of dark matter in the universe, and map how it shapes the sky Scientists have used the Chandra X-ray Observatory distribution of systems of galaxies. measurements of x-ray emitting gas in clusters of galaxies to determine the matter and energy density of the uni- The Chandra X-ray Observatory measured the distribution verse. These results place a tight constraint on the mean of dark matter, on the smallest scale yet, in several clusters total matter density of the universe and on the total densi- of galaxies and in an elliptical galaxy. The measurements ty of dark energy in the universe. imply that dark matter is not self-interacting in massive cosmic structures, narrowing the field of candidates for the Data Quality. The mission data and science outcomes enigmatic nature of dark matter, one of the most pressing accurately reflect performance and achievements in questions in astronomy. FY 2002. NASA’s Space Science Advisory Committee Data from the Hubble Space Telescope were combined evaluated progress toward this annual performance goal. with data from ground-based observatories to determine Data Sources. NASA’s Space Science Advisory the dark matter mass of several galaxies. These galaxies Committee delivers its findings directly to NASA man- are gravitational lenses that focus the light from more dis- agement. Minutes of their meetings are located at tant galaxies to reveal their mass distribution directly. http://spacescience.nasa.gov/adv/sscacpast.htm. These studies place limits on the relative amounts of normal and dark matter in galaxies. Performance outcomes are reported through normal mission reviews and are verified and validated by the pro- Data from Chandra X-ray Observatory and the European gram executive or program scientist. For descriptions of Space Agency’s XMM-Newton spacecraft were used to all space science missions that support this objective and set a limit on the characteristics of a possible dark matter example data, see http://spacescience.nasa.gov/missions/. candidate—so-called sterile neutrinos. X-ray spectra from the Virgo cluster of galaxies rule out the possibility Indicator 2. Obtain expected scientific data from 80 per- that the dark matter is in the form of sterile neutrinos cent of operating missions supporting this goal (as iden-

Part II • Supporting Data • Space Science 133 Annual Performance Goal Trends for Space Science

Annual Performance Assessment Performance Goal FY 1999 FY 2000 FY 2001 FY 2002 Strategic Goal 1. Science: chart the evolution of the universe, from origins to destiny, and understand its galaxies, stars, planets, and life. Objective 1. Understand the structure of the universe, from its earliest beginnings to its ultimate fate. 2S1

Objective 2. Explore the ultimate limits of gravity and energy in the universe. 2S2

Objective 3. Learn how galaxies, stars, and planets form, interact, and evolve. 2S3

Objective 4. Look for signs of life in other planetary systems. 2S4

Objective 5. Understand the formation and evolution of the solar system and the Earth within it. 2S5

Objective 6. Probe the evolution of life on Earth, and determine if life exists elsewhere in our solar system. 2S6

Objective 7. Understand our changing Sun and its effects throughout the solar system. 2S7

Objective 8. Chart our destiny in the solar system. 2S8 Objective 9. Support of Strategic Plan science objectives; Development/near-term future investments (Supports all objectives under the Science goal.) 2S9 Strategic Goal 2. Technology/long-term future investments: develop new technologies to enable innovative and less expensive research and flight missions. Objective 1. Acquire new technical approaches and capabilities. Validate new technologies in space. Apply and transfer technology. 2S10 2S11 Strategic Goal 3. Education and public outreach: Share the excitement and knowledge generated by scientific discovery and improve science education. Objective 1. Share the excitement of space science discoveries with the public. Enhance the quality of science, mathematics, and technology education, particularly at the pre-college level. Help create our 21st century scientific and technical workforce. 2S12

tified and documented by Associate Administrator at Data Quality. Mission performance data accurately beginning of fiscal year) reflect achievements in FY 2002.

Results. The operating missions in support of this goal Data Sources. Performance assessment data are are Hubble Space Telescope, Microwave Anisotropy obtained from normal project management reporting and Probe, Chandra X-ray Observatory, and Far Ultraviolet are verified and validated by the program executive or Spectroscopic Explorer (FUSE). All four of the missions program scientist. For descriptions of the space science obtained expected scientific data in FY 2002, operating missions that support this objective, see http://space- with very few unplanned interruptions. The FUSE spacescience.nasa.gov/missions/. craft experienced a serious problem with its pointing system in December 2001. The problem interrupted science operations for 7 weeks until a heroic engineering effort Strategic Objective 2. Explore the ultimate limits successfully restored the mission to productivity. of gravity and energy in the universe

134 NASA FY 2002 Performance and Accountability Report Annual Performance Goal 2S2. Earn external review Observations of two neutron stars by Chandra may be rating of green, on average, on making progress in the fol- inconsistent with standard models of nuclear matter. One lowing research focus areas: discover the sources of possible explanation is that the two stars (one too small, gamma ray bursts and high-energy cosmic rays; test the the other too cool) may be composed of “strange quark general theory of relativity near black holes and in the matter,” a form of matter more dense than an atomic early universe, and search for new physical laws, using nucleus. If confirmed, this would be the first detection of the universe as a laboratory; and, reveal the nature of cosmic jets and relativistic flows. naturally occurring strange quark matter in the universe. With Chandra, astronomers have detected features that The NASA space science effort achieved a rating of green may be the first direct evidence of the effect of gravity on for this annual performance goal. We re-evaluated our radiation from a neutron star. This finding, if confirmed, approach to our strategic goals and objectives and revised could enable scientists to measure the gravitational field our annual performance measures for 2002. Therefore, a of neutron stars and determine whether they contain exot- one-to-one match with previous years is not possible. ic forms of matter. Indicator 1. Demonstrate significant progress toward the Scientists have found new evidence that light emanating goal, as determined by external expert review from near a black hole loses energy climbing out of a black hole’s gravitational well, a key prediction of Results. For the focus area “discover the sources of Einstein’s theory of general relativity. This observation of gamma-ray bursts and high-energy cosmic rays,” we warped space, made with Chandra and the European achieved the following: Space Agency’s XMM-Newton satellite, offers a novel glimpse inside the chaotic swirl of gas called an accretion The High Energy Transient Explorer (HETE), the first disk that surrounds a black hole. satellite dedicated to spotting these frequent yet random explosions that last for only a few seconds, detected a rare A pulsar observed with the Rossi X-ray Timing Explorer optical afterglow of a gamma ray burst, the most power- (RXTE) appeared to glitch seven times more frequently ful type of explosion in the universe. Armed with the than any other known pulsar. These glitches, a term given satellite-derived localization, the Palomar 200-inch tele- to the sudden change in pulsar spin, are revealing the scope spotted the afterglow and measured its red shift, strange physics of the high-pressure interior of the pulsar. which is used to calculate distance. The afterglow was also observed using the very large array of radio tele- Using RXTE, NASA scientists have observed a rare ther- scopes and by a NASA-funded robotic telescope in monuclear explosion on a neutron star that brightened it Tucson, AZ. for so long that they could detect the orbital period of the star’s companion and its spin frequency. These observa- NASA scientists have analyzed more than 1,400 gamma tions help us determine the mass and radius of the neutron ray bursts from the Compton Gamma Ray Observatory. star, and thus the equation of state for nuclear matter. Although most gamma ray bursts occur in the distant uni- For the focus area “reveal the nature of cosmic jets and verse, billions of light-years away, analysis indicates that relativistic flows,” we achieved the following: a small fraction may occur within 325 million light-years of the Earth. These nearby events may represent a new Using Chandra X-ray Observatory to observe the x-ray subclass of gamma-ray bursts and could be a source of jet in a distant quasar, scientists have derived information detectable gravitational radiation. Their presence could about the supermassive black hole at the center of the explain the existence of ultrahigh-energy cosmic rays. quasar. The x-rays from the jet are likely due to the collision of microwave photons left over from the Big Bang The Trans-Iron Galactic Element Recorder scientific bal- with a high-energy beam of particles. The length of the loon experiment set a new flight record of almost 32 days jet and the prominent knots of x-ray emission observed after completing two circuits of the South Pole. The bal- suggest that the activity in the vicinity of the central loon searched for the origin of cosmic rays, atomic parti- supermassive black hole is long-lived but may be inter- cles that travel through the galaxy at near light-speeds and mittent, perhaps due to the mergers of other galaxies with shower the Earth constantly. It is the first experiment that the host galaxy. has both the collecting power and resolution to measure all nuclei from iron through zirconium, and, through Using a NASA instrument on the European Space those measurements, it will determine whether a cosmic- Agency’s XMM-Newton satellite, an international team ray source is hot or cold, gas or solid. of scientists has seen energy being extracted from a black hole for the first time. The observation may explain the For the focus area “test the general theory of relativity origin of particle jets in quasars. According to the theory, near black holes and in the early universe, and search for rotational energy can be extracted from the black hole as new physical laws using the universe as a laboratory,” we its rotation is braked by magnetic fields. The Blandford- achieved the following: Znajek theory implies that energy flows to particle jets

Part II • Supporting Data • Space Science 135 emanating perpendicularly from the accretion disk in tories and cross the outer boundary of the solar system to supermassive black hole systems. explore the nearby environment of our galaxy. Results of studies of gamma-ray bursts with the HETE-2 The results of this annual performance goal and its asso- and ground-based optical and radio observatories lend ciated indicators are located in the Highlights of credence to theories that some gamma ray bursts come Performance Goals and Results section of Part I. from the collapse of massive stars. Some of the observed emission comes from shock waves caused by relativistic Strategic Objective 4. Look for signs of life in other outflows from the collapse colliding with material planetary systems remaining from the precursor star’s stellar wind. Annual Performance Goal 2S4. Earn external review Data Quality. Mission data accurately reflect perform- rating of green, on average, on making progress in the fol- ance and achievements in FY 2002. NASA’s Space lowing research focus areas: discover planetary systems of other stars and their physical characteristics; and, Science Advisory Committee evaluated progress toward search for worlds that could or do harbor life. this annual performance goal. The NASA space science effort achieved a rating of green Data Sources. NASA’s Space Science Advisory for this annual performance goal. We re-evaluated our Committee delivers its findings directly to NASA man- approach to our strategic goals and objectives and revised agement. Minutes of their meetings are located at our annual performance measures for 2002. Therefore a http://spacescience.nasa.gov/adv/sscacpast.htm. one-on-one match with previous years is not possible. Performance outcomes are reported through normal mis- Indicator 1. Demonstrate significant progress toward the sion reviews and are verified and validated by the pro- goal, as determined by external expert review gram executive or program scientist. For descriptions of all space science missions that support this objective and Results. For the focus area “discover planetary systems example data, see http://spacescience.nasa.gov/missions/. of other stars and their physical characteristics,” we achieved the following: Indicator 2. Obtain expected scientific data from 80 percent of operating missions supporting this goal (as iden- Astronomers using Hubble have made the first direct tified and documented by Associate Administrator at detection of the atmosphere of a planet orbiting a star out- beginning of fiscal year) side our solar system and have obtained the first information about its chemical composition. Their unique obser- Operating missions in support of this goal are the High vations demonstrate that it is possible to measure the Energy Transient Explorer-2, the Rossi X-ray Timing chemical makeup of extrasolar planet atmospheres and Explorer, the Microwave Anisotropy Probe, and the perhaps to search for chemical markers of life beyond Chandra X-ray Observatory. Each mission obtained all Earth. Hubble spectra of the planet as it passed in front of expected scientific data during FY 2002, operating nor- its parent star allowed astronomers to detect the presence mally with very few unplanned interruptions. of sodium in the planet’s atmosphere. Data Quality. Mission performance data accurately The 2MASS spacecraft has revolutionized our under- reflect achievements in FY 2002. standing of the solar neighborhood with the discovery of Data Sources. Performance assessment data are from nearby brown dwarfs. This led to the modification of the normal project management reporting and are verified century-old spectral classification system and the system- and validated by the program executive or program atic surveying of the solar neighborhood for all late-M, L, scientist. Descriptions of all of the space science and T type field dwarfs and companions. Because the missions that support this objective are located at temperatures of these field objects are similar to those of http://spacescience.nasa.gov/missions/. very young brown dwarfs and planets, understanding their atmospheres is important to knowing how to look for Strategic Objective 3 Learn how galaxies, stars, recently formed planets. and planets form, interact, and evolve For the focus area “search for worlds that could or do harbor life,” we achieved the following: Annual Performance Goal 2S3. Earn external review rating of green, on average, on making progress in the fol- Recently, exosolar planet hunters, using the Keck and lowing research focus areas: Observe the formation of other ground-based telescopes, announced the discovery galaxies and determine the role of gravity in this process; of the first planet orbiting its star at a distance near or establish how the evolution of a galaxy and the life cycle beyond the orbit of Jupiter in our own solar system. This of stars influence the chemical composition of material available for making stars, planets, and living organisms; planet combined with a known inner planet and sugges- observe the formation of planetary systems and charac- tive evidence of yet a third planet in this system makes terize their properties; and, use the exotic space environ- the star 55 Cancri the best-known analog to Sun and its ments within our solar system as natural science labora- planetary system. Perhaps most interestingly, the system

136 NASA FY 2002 Performance and Accountability Report possesses dynamically favorable conditions for the exis- Laboratory studies of the Tagish Lake meteorite indicate tence of an Earth-like planet, which remains elusive to that it is the first sample of a D-type asteroid, one of the detection. NASA sponsored most of the research most primitive materials found in the solar system. involved in this effort. Kuiper Belt objects and short-period comets have differ- Data Quality. The mission data and science outcomes accu- ent surface colors, which suggest different chemical rately reflect performance and achievements in FY 2002. compositions. This is intriguing because astronomers NASA’s Space Science Advisory Committee evaluated have thought the Kuiper Belt to be the source of the progress toward this annual performance goal. short-period comets. Data Sources. NASA’s Space Science Advisory Com- Some Kuiper Belt objects are gravitationally bound bina- mittee delivers its findings directly to NASA manage- ry systems; that is, two objects that circle each other as ment. Minutes of their meetings are located at they circle the Sun. This provides insight into the collision http://spacescience.nasa.gov/adv/sscacpast.htm. processes in the Kuiper Belt. Performance outcomes are reported through normal mis- The Comet Nucleus Tour (CONTOUR) spacecraft, which sion reviews and are verified and validated by the pro- was to have conducted close-up investigations of two gram executive or program scientist. For descriptions of comet nuclei, was lost on August 15, 2002. all space science missions that support this objective and For the focus area “learn why the planets in our solar sys- example data, see http://spacescience.nasa.gov/missions/. tem are so different from each other,” we achieved the fol- Indicator 2. Obtain expected scientific data from 80 per- lowing: cent of operating missions supporting this goal (as iden- The Galileo spacecraft continued to make unique obser- tified and documented by Associate Administrator at vations of Jupiter and its moons. Two recent flybys of the beginning of fiscal year) moon Io produced new results on the short time scales of surface modification due to volcanic eruptions and mate- Results. There were no space-based operating missions rial deposition. Galileo detected an infrared hot spot and in direct support of this goal in FY 2002; however, the the tallest volcanic plume ever seen at Io, approximately Hubble provided observations contributing to progress in 300 kilometers. The continued monitoring of the Jovian this area (see indicator 1). The ground-based Keck and electromagnetic field effects on the ever-changing inter- other telescopes also support discovery of other planetary planetary environment adds to the understanding of the systems. Future space-based missions in direct support of solar wind interaction with the giant planets and our this research are expected. knowledge about spacecraft survival under intense, varying conditions. Strategic Objective 5. Understand the formation and evolution of the solar system and the Earth Measurement of climate and landscape dynamics on Mars within it from the Mars Global Surveyor and Mars Odyssey missions has illuminated how the evolution of the Martian Annual Performance Goal 2S5. Earn external review surface and atmosphere differs from Earth’s atmosphere. rating of green, on average, on making progress in the fol- Both the Mars Global Surveyor and Odyssey have shed lowing research focus areas: Inventory and characterize light on the distribution of volatiles on Mars. Recent the remnants of the original material from which the solar system formed; learn why the planets in our solar system results provide insight into the distribution of water on are so different from each other; and, learn how the solar Mars and how subsurface reservoirs may interact with the system evolves. atmosphere. For the first time, a global dust storm on Mars was observed from onset to completion. The NASA space science effort achieved a rating of green for this annual performance goal. We re-evaluated our For the focus area “learn how the solar system evolves,” approach to our strategic goals and objectives and revised we achieved the following: our annual performance measures for 2002. Therefore, a Research and analysis studies linked observations, labo- one-to-one match with previous years is not possible. ratory experiments, and theoretical models to provide an Indicator 1. Demonstrate significant progress toward the increasingly sophisticated understanding of the evolution goal, as determined by external expert review of solar system bodies. Other studies focused on how the planets have evolved within the overall context of the Results. For the focus area “inventory and characterize solar system. the remnants of the original material from which the solar system formed,” we achieved the following: Results from the Odyssey mission have mapped the regional distribution of water near the surface of Mars. The Stardust spacecraft started Interstellar Dust Additional work will aid in evaluating if this reservoir is Collection Period 2. part of a greater subsurface aquifer or if it is more strong-

Part II • Supporting Data • Space Science 137 ly coupled with processes of atmospheric exchange. Strategic Objective 6. Probe the evolution of life Initial results from Odyssey also suggest that there is a on Earth, and determine if life exists elsewhere in greater diversity in the types of surface materials than pre- our solar system viously thought. Annual Performance Goal 2S6 Earn external review The 26-degree tilt of Saturn’s pole from its orbit is puz- rating of green, on average, on making progress in the zling. It is much harder to tip over by a late impact than following research focus areas: Investigate the origin and Uranus. Recently it was shown how the large angular early evolution of life on Earth, and explore the limits of life in terrestrial environments that might provide ana- momentum in Neptune’s orbit can be coupled to the much logues for conditions on other worlds; determine the smaller amount in Saturn’s spin, greatly changing the general principles governing the organization of matter direction of Saturn’s spin vector, if the rates of precession into living systems and the conditions required for the of Saturn’s pole and Neptune’s orbit are integer multiples emergence and maintenance of life; chart the distribution of each other—a resonance. Just such a resonance may of life-sustaining environments within our solar system, have arisen in the early days of the solar system, as and search for evidence of past and present life; and, Saturn’s nebula dissipated and Neptune moved outwards identify plausible signatures of life on other worlds. scattering comets into the Oort cloud along the way. The results of this annual performance goal and its asso- Data Quality. The mission data and science outcomes ciated indicators are located in the Highlights of accurately reflect performance and achievements in Performance Goals and Results section of Part I. FY 2002. NASA’s Space Science Advisory Committee evaluated progress toward this annual performance goal. Strategic Objective 7. Understand our changing Sun and its effects throughout the solar system

Data Sources. NASA’s Space Science Advisory Annual Performance Goal 2S7. Earn external review Committee delivers its findings directly to NASA man- rating of green, on average, on making progress in the fol- agement. Minutes of their meetings are located at lowing research focus areas: understand the origins of http://spacescience.nasa.gov/adv/sscacpast.htm. long- and short-term solar variability; understand the effects of solar variability on the solar atmosphere and Performance outcomes are reported through normal mis- heliosphere; and, understand the space environment of Earth and other planets. sion reviews and are verified and validated by the program executive or program scientist. For descriptions of The results of this annual performance goal and its asso- all space science missions that support this objective and ciated indicators are located in the Highlights of the example data, see http://spacescience.nasa.gov/missions/. Performance Goals and Results section of Part I.

Indicator 2. Obtain expected scientific data from 80 per- Strategic Objective 8. Chart our destiny in the cent of operating missions supporting this goal (as identi- solar system fied and documented by Associate Administrator at beginning of fiscal year) Annual Performance Goal 2S8. Earn external review rating of green, on average, on making progress in the fol- Results. Operating missions in support of this goal are lowing research focus areas: understand forces and processes, such as impacts, that affect habitability of Earth; Stardust, Genesis, Cassini, and Submillimeter Wave develop the capability to predict space weather; and, find Astronomy Satellite (SWAS). Each mission achieved its extraterrestrial resources and assess the suitability of solar data collection and operation efficiency levels. Each mis- system locales for future human exploration. sion obtained all expected scientific data in FY 2002, operating normally with very few unplanned interruptions. The NASA space science effort achieved a rating of blue for this annual performance goal. We re-evaluated our approach to our strategic goals and objectives and revised Data Quality. The mission data and science outcomes our annual performance measures for 2002. Therefore, a accurately reflect performance and achievements in one-to-one match with previous years is not possible. FY 2002. NASA’s Space Science Advisory Committee evaluated progress toward this annual performance goal. Indicator 1. Demonstrate significant progress toward the goal, as determined by external expert review Data Sources. Performance assessment data are Results. Understand forces and processes, such as obtained from normal project management reporting and impacts, that affect habitability of Earth. are verified and validated by the program executive or program scientist. For descriptions of the space science Between October 1, 2001, and July 1, 2002, scientists dis- missions that support this objective, see http://space- covered and catalogued 78 near-Earth objects with diam- science.nasa.gov/missions/. eters greater than 1 kilometer. Almost all of these discov-

138 NASA FY 2002 Performance and Accountability Report eries were through search efforts supported by the Near- Data Quality. The mission data and science outcomes Earth Object Observations Program. The total population accurately reflect performance and achievements in is about 1,000 to 1,100 objects, of which more than 600 FY 2002. NASA’s Space Science Advisory Committee have been discovered and catalogued. NASA is on sched- evaluated progress toward this annual performance goal. ule to catalog 90 percent of near Earth objects greater Data Sources. NASA’s Space Science Advisory than 1 kilometer in diameter by 2008. Committee delivers its findings directly to NASA man- For the focus area “develop the capability to predict space agement. Minutes of their meetings are located at weather,” we achieved the following: http://spacescience.nasa.gov/adv/sscacpast.htm.

Measurements by the Solar, Anomalous, and Performance outcomes are reported through normal mis- Magnetospheric Particle Explorer (SAMPEX) satellite sion reviews and are verified and validated by the pro- show that, during large solar particle events, the geomag- gram executive or program scientist. For descriptions of netic cutoff for entry of energetic particles into the mag- all space science missions that support this objective and netosphere is often highly variable. These changes corre- example data, see http://spacescience.nasa.gov/missions/. late well with changes in the geomagnetic activity. SAM- Indicator 2. Obtain expected scientific data from 80 per- PEX has shown that the actual cutoffs generally fall cent of operating missions supporting this goal (as iden- below calculated values and that the Earth’s polar cap is tified and documented by Associate Administrator at larger than expected. During large solar particle events, beginning of fiscal year) the radiation dose at satellites such as the Station will be several times greater than expected. Results. There were no space-based operating missions substantially dedicated to supporting this goal in FY 2002. The global ultraviolet imager on the Thermosphere, However, some operating missions have contributed to Ionosphere, Mesosphere Energetics and Dynamics research in this area (see indicator 1). Future space missions (TIMED) spacecraft obtained images of equatorial plas- are expected. ma depletions. The images enable surveys of the extent and the distribution of large-scale plasma depletions. The Strategic Objective 9. Support of Strategic Plan depleted plasma structures are important because they science objectives; Development/near-term future significantly perturb, and even completely disrupt, elec- investments (Supports all objectives under the tromagnetic signal propagation. In addition to causing Science goal) abrupt communication outages, this phenomenon can also Annual Performance Goal 2S9. Earn external review significantly affect Global Positioning System (GPS)- rating of green on making progress in the following area: based navigation systems. design, develop, and launch projects to support future research in pursuit of Strategic Plan science objectives. The Living With a Star targeted research and technology program supports a wide-ranging set of theoretical and The results of this annual performance goal and its asso- empirical modeling designed to provide the framework ciated indicators are located in the Highlights of the Most for predicting space weather effects. Noteworthy studies Important Performance Goals and Results segment of include applying new methodologies for calculating and Part I. forecasting satellite drag; modeling the effects of solar energetic particles and galactic cosmic rays on cloud con- Strategic Goal 2. Technology/Long-Term Future densation in the stratosphere; characterizing the plasma Investments: develop new technologies to environment responsible for spacecraft charging; identi- enable innovative and less expensive research fying the conditions in the solar wind and within the mag- and flight missions netosphere that are responsible for the strong variability Strategic Objective 1. Acquire new technical in the relativistic electron flux in Earth’s magnetosphere; approaches and capabilities. Validate new tech- and developing new models and software tools for evalu- nologies in space. Apply and transfer technology ating near-real time geomagnetic cutoffs. Annual Performance Goal 2S10. Earn external review For the focus area “find extraterrestrial resources and rating of green on making progress in the following tech- assess the suitability of solar system locales for future nology development area: Focus technology develop- human exploration,” we achieved the following: ment on a well-defined set of performance requirements covering the needs of near-term to mid-term strategic Mars Odyssey observations indicate the presence of plan missions. water near the surface of Mars, a potential resource for future explorers. Both Odyssey and the MGS have iden- The NASA space science effort achieved a rating of green tified localities that are potentially suitable for in-depth for this annual performance goal. Because the focus of surface exploration, a necessary step for possible future this goal resides in completion of specific milestones and human exploration. development, once they are achieved, they are no longer a

Part II • Supporting Data • Space Science 139 focus. Therefore, a one-to-one match with previous years Data Sources. Performance assessment data are from goals is not possible. normal project management reporting and are verified and validated by the program executive or program scien- Indicator 1. Meet no fewer than 66 percent of the perform- tist. For descriptions of the space science missions that ance objectives for technology development support this objective, see http://spacescience. nasa. • Next Generation Space Telescope (NGST): Downselect gov/missions/. to single Phase II prime contractor. Annual Performance Goal 2S11. Earn external review • Space Interferometry Mission (SIM): Use the rating of green on making progress in the following tech- Microarcsecond Metrology (MAM-1) Testbed to nology validation area: Formulate and implement cost- demonstrate metrology at the 200-picometer level with effective space demonstrations of selected technologies white light fringe measurements. (Accomplishing this on suitable carriers. level of performance is required in order for SIM to identify multi- planet solar systems out to 10 parsecs.) The NASA space science effort achieved a rating of green for this annual performance goal. Since this goal involved •Terrestrial Planet Finder (TPF): Provide studies and completion of specific milestones and development integrated models of mission architecture concepts. stages, there is not a clear one-to-one match with 2002 • Gamma-ray Large Area Space Telescope (GLAST): goals and performance from previous years. Conduct Large Area Telescope Preliminary Design Indicator 1. Meet no fewer than 66 percent of the per- Review (PDR). formance objectives for flight validation • Herschel Space Observatory: Complete the Spectral and Photometric Imaging Receiver (SPIRE) qualifica- Results. All but one performance objective were tion model detectors. achieved. The flight validation for the New Millennium Program did not conduct the New Millennium Carrier-1 • StarLight: Conduct Preliminary Design Review (PDR). (NMC-1) confirmation review. The carrier was initially • Outer Planets Program: Complete evaluation and conceived for the experiments of Space Technology-6; restructuring of Outer Planets Program. however, none of the Space Technology-6 experiments required it. • In-Space Propulsion: Compete and select Phase I award(s) for electric propulsion technology development. The Space Technology-6 mission confirmation review was completed, and two technologies were selected to be •Living With a Star: Announce instrument investiga- flown. The Autonomous Sciencecraft Experiment is soft- tions for Solar Dynamics Observatory mission. ware designed to increase spacecraft decision-making Results. We achieved seven of nine performance objec- capabilities for data processing, downlinking data, and tives for technology development, surpassing the required identifying opportunities for interesting science observa- percentage for success in this metric. The Herschel Space tions. The Inertial Stellar Compass experiment is an ultra Observatory did not complete the SPIRE qualification low power and low weight technology that will enable a model detectors, and StarLight did not conduct a prelim- spacecraft to determine its orientation whether it is spin- inary design review. ning or stable. It will also enable a spacecraft to sense its position and recover its orientation after a power loss. The Next Generation Space Telescope mission selected TRW, Inc. to design and fabricate the next-generation The Space Technology-5 mission completed critical space-based observatory, named for NASA’s second design review and is now ready for manufacturing, testing administrator, James E. Webb. Under the terms of the and integration. Three miniature spacecraft, or nanosats, contract, TRW will be responsible for the design and fab- are scheduled to fly in a constellation to flight validate the rication of the telescope’s primary mirror and spacecraft, technology that will improve scientific understanding of and instrument integration, pre-flight testing, and on-orbit the Earth’s high-altitude space weather. checkout. Herschel experienced a delay due to a change in vibration Data Quality. Mission performance data accurately requirements for SPIRE. The StarLight flight demonstra- reflect achievements in FY 2002. tion has been terminated, but the effort continues as ground-based technology development in support of for- Data Sources. Performance assessment data is retrieved mation-flying interferometry under the umbrella of the from normal project management reporting and are veri- Terrestrial Planet Finder project. fied and validated by the program executive or program scientist. For descriptions of the space science missions Data Quality. Mission performance data accurately that support this objective, see http://spacescience. reflect achievements in FY 2002. nasa.gov/missions/.

140 NASA FY 2002 Performance and Accountability Report Strategic Goal 3. Education and Public Outreach: Colleges, with at least 3 being underway in an institu- share the excitement and knowledge generated by tion of each type scientific discovery and improve science education •Provide exhibits, materials, workshops, and personnel Strategic Objective 1. Share the excitement of at a minimum of five national and three regional edu- space science discoveries with the public. cation and outreach conferences Enhance the quality of science, mathematics, and technology education, particularly at the pre- • Ensure that at least eight major Enterprise-sponsored college level. Help create our 21st century exhibits or planetarium shows will be on display or on scientific and technical workforce tour at major science museums or planetariums across the country Annual Performance Goal 2S12. Earn external review rating of green, on average, on making progress in the •Prepare the second comprehensive Space Science following focus Areas: Incorporate a substantial, funded Education/Outreach Report describing participants, education and outreach program into every space sci- audiences, and products for Enterprise education and ence flight mission and research program; Increase the public outreach programs fraction of the space science community that contributes to a broad public understanding of science and is direct- •Initiate a major external review of the accomplish- ly involved in education at the pre-college level; establish ments of the Space Science education and public out- strong and lasting partnerships between the space sci- reach efforts over the past five years, and complete a ence and education communities; develop a national network to identify high-leverage education and outreach pilot study directed towards the eventual development opportunities and to support long-term partnerships; of a comprehensive approach to assessing the educa- provide ready access to the products of space science tion and public outreach program’s long-term effec- education and outreach programs; promote the partici- tiveness and educational impact. Use the preliminary pation of underserved and underutilized groups in the results of both studies to guide adjustments in program space science program by providing new opportunities direction and content for minorities and minority universities to compete for and participate in space science missions, research, and Results. We exceeded the performance objectives in the education programs; and, develop tools for evaluating following four areas: About 330 space science-funded the quality and impact of space science education and education and outreach activities took place in all 50 outreach programs. states in FY 2002, greatly exceeding the metric of plan- NASA met or exceeded seven of the eight performance ning or implementing such activities in at least 40 states. indicators for space science education and public out- The numbers of discrete events associated with such reach in FY 2002, earning an overall grade of blue for activities in FY 2002 was about 3,700. This is a more this metric. than 25 percent increase in the number of events reported in FY 2001. Indicator 1. Meet no fewer than six (75 percent) of the eight performance objectives for education and public NASA made history in FY 2002 by awarding the lead outreach responsibility for a space flight mission, for the first time, to a Historically Black College and University (HBCU). • Ensure that every mission initiated in FY 2002 has a Hampton University’s Aeronomy of Ice in the Mesosphere funded education and public outreach program, with a (AIM) mission was one of only two missions selected comprehensive education and public outreach plan through competitive peer review for future flight under the prepared by its critical design review Small Explorers (SMEX) Program. This $92 million •Establish a baseline for the number of space scientists award dwarfs all previous NASA investments in HBCU’s. who are participating in education and public out- Also in FY 2002, 15 minority universities, including reach activities. This baseline will be used in the future (HBCUs), 3 Hispanic serving institutions (HSIs), and 3 to track success in increasing the fraction of the space tribal colleges (TCUs), continued work on space science science community that is directly involved in pre-col- development activities under the Space Science Minority lege education and is contributing to a broad public University Initiative. Additional activities underway at understanding of science minority universities in FY 2002 included continued funding of research grants to HBCUs and HSIs, continued • Plan and/or implement Enterprise-funded education operation of the FUSE mission through a ground station at and public outreach activities taking place in at least the University of Puerto Rico at Mayagüez, and continued 40 states operation of a facility for launching scientific high-altitude • Ensure that at least 10 Enterprise-sponsored research, balloons by New Mexico State University at Ft. Sumner, mission development or operations, or education proj- New Mexico. Together, these activities greatly exceeded ects are underway in Historically Black Colleges and the FY 2002 metric of having at least 10 funded research, Universities, Hispanic Serving Institutions, and Tribal mission development or operations, or education projects

Part II • Supporting Data • Space Science 141 underway at HBCUs, HSIs, and TCUs, with at least one •MarsQuest Traveling Exhibition (Hickory, NC; being underway in an institution of each type. Chicago, IL; Hampton, VA)

We provided exhibits, materials, workshops, and person- • Space Weather Center Exhibition (Chicago, IL; El nel at 21 national and 15 regional education and outreach Paso, TX; Belleville, MI) conferences during in FY 2002. This greatly exceeds the FY 2002 metric of having such a presence at five nation- •Voyage: A Journey Through Our Solar System al and three regional conferences. Exhibition (Washington, DC) The national education and outreach conferences at • Journey to the Edge of Space and Time Planetarium which there was a major space science presence in Show (Boston, MA; Philadelphia, PA) FY 2001 included: • MarsQuest Planetarium Show (Arkadelphia, AR; • Association of Science-Technology Centers (October Bowling Green, OH; Chicago, IL; Columbus, GA; 2001 in Phoenix, AZ) Hastings, NE; Maryville, TN; Orlando, FL; Radford, VA; Richmond, KY; Toms River, NJ; Tucson, AZ) • American Indian Science and Engineering Society (November 2001 in Albuquerque, NM) • Northern Lights Planetarium Show (Berkeley, CA; • International Technology Education Association Champaign, IL). (March 2002 in Columbus, OH) In addition, ViewSpace provided more than a hundred •National Organization of Black Chemists and institutions around the country—most of them small sci- Chemical Engineers (March 2002 in New Orleans, LA) ence centers or planetariums—with displays of continuously updated images from Hubble and other NASA •National Science Teachers Association meeting space science missions. This exceeds the metric of having (March 2002 in San Diego, CA) at least eight museum exhibits or planetarium shows on • Public Library Association (March 2002 in Phoenix, AZ) display or on tour in FY 2002. New for FY 2002 are “Voyage: A Journey Through Our Solar System,” a scale •Civil Air Patrol National Congress (April 2002 in model solar system installed on the National Capitol mall Arlington, VA) in Washington, DC, in October 2001, and “Cosmic •National Council of Teachers of Mathematics (April Questions: Our Place in Space and Time,” an exhibition 2002 in Las Vegas, NV) inviting visitors to understand the universe and our place in the cosmos, which opened at the Museum of Science in • International Planetarium Society (July 2002 in Boston in September 2002. These exhibitions, and sever- Wichita, KS) al others mentioned above, are direct results of collabora- • Society for the Advancement of Chicanos and tions with institutions such as the Smithsonian Institution Native Americans in Science (September 2002 in and the National Science Foundation. These collabora- Anaheim, CA). tions take advantage of the science content that is our primary resource and leverage it through the expertise of the The regional conferences with such a presence included Smithsonian in developing and exhibits and the funding two state library associations, seven state science available from the National Science Foundation for sup- teachers associations, and three National Science porting such exhibits. Teachers Association regional meetings, along with a number of other local or regional meetings. We met the performance objectives in the following three areas: The following major NASA-sponsored space science exhibits and planetarium shows were on display or on •A preliminary count shows that 895 space science national tours at major science museums or planetariums mission affiliated space scientists, technologists, and across the country in FY 2002 included: support staff participated in education and public outreach activities in FY 2002. This sets a baseline for Exhibits measuring future success in increasing the fraction of • Cosmic Questions: Our Place in Space and Time the space science community that is directly involved in Exhibition (Boston, MA)—Explore the Universe pre-college education and is contributing to a broad Exhibition (Washington, DC)—Hubble Space public understanding of science. The FY 2003 metric Telescope: New Views of the Universe Exhibition— calls for a 5 percent increase over the FY 2002 baseline. Large Version (Kennedy Space Center, FL; Kansas •The second space science education and public out- City, MO) reach report describing participants, audiences, and • Hubble Space Telescope: New Views of the Universe products for the FY 2001 education and public out- Exhibition—Small Version (Bridgeport, CT) reach programs was made available in a searchable,

142 NASA FY 2002 Performance and Accountability Report online version in May 2001 and in printed form in We were unable to examine each mission’s plan because June 2001. of a lack of staff. Thus, we did not meet the metric that every mission initiated in FY 2002 shall have a funded •A task force of the NASA Space Science Advisory program with a comprehensive education and public out- Committee convened in April 2002 to begin examining reach plan by the time of its critical design review. and evaluating how well we have done in carrying out the education and public outreach program over the past 5 years and to determine whether any significant Data Quality. The data cited are presented in the NASA adjustments in the approach are needed. The task force Space Science Education and Public Outreach Annual held its final meeting in August 2002 and is now Report, which is available at http://ossim.hq.nasa. gov/ preparing its findings and recommendations. In addi- ossepo/. Further information on this NASA space science tion, the Program Evaluation and Research Group at program is available at http://spacescience.nasa. gov/ Lesley University in Cambridge, MA, submitted their education/.The major limitation of these data is that they interim report on assessing the long-term effectiveness represent only activities, products, and events that were and educational effect of the activity. The preliminary reported through the NASA space science tracking and findings from both studies provided a very consistent reporting system. They are, therefore, undoubtedly picture. They indicated that we have a well-regarded incomplete and the numbers cited here represent education and public outreach program that needs sev- minimum values. eral adjustments. The most significant of these are the need to develop more coherence in the program mate- Data Sources. The data cited are presented in the rials and to provide significantly more opportunities NASA Space Science Education and Public Outreach for professional development for the personnel Annual Report, which is available at http://ossim.hq. charged with carrying out the program. These findings nasa.gov/ ossepo/. Further information on this NASA provide the major guidance for improving the program space science program is available at http://spacescience. in FY 2003. nasa. gov/ education/.

Part II • Supporting Data • Space Science 143

Earth Science

Strategic Goal 1. Observe, understand, and model high, it will take at least another decade of observations to the Earth system to learn how it is changing, and establish regional statistics. the consequences for life on Earth Data Quality. Peer-reviewed publication is the most Strategic Objective 1. Discern and describe how relied upon assessment of the validity of a scientific the Earth is changing accomplishment. Annual Performance Goal 2Y1. Increase understand- Data Sources. The results and related publications in ing of global precipitation, evaporation and how the cycling of water through the Earth system is changing by scientific journals are available at http://www.stcnet.com/ meeting at least three of four performance indicators. projects//nvap.html and http://eosweb.larc.nasa.gov/.

The overall assessment for this annual performance goal Indicator 3. Determine the time and spatial variability of is yellow. Scientists used precipitation data sets to assess the occurrence of strong convection regions, precipitation the effect of global warming and other temperature varia- events, and areas of drought to assess whether or not tions on rainfall. However, preliminary results proved there are discernable global changes in the distribution of unclear and further analysis was needed. Data analysis of moisture availability useful to food and fiber production polar and geostationary satellite observations provided a and management of fresh water resources new perspective on the way moisture varies seasonally in Results. NASA did not achieve the indicator. The early both the Northern and Southern Hemispheres. It will take analyses focused on calibrating the sensors and validating at least another decade to establish regional statistics their accuracy. of variability. Indicator 1. Combine analysis of global water vapor, precip- Data Quality. The science outcomes accurately reflect itation and wind data sets to decipher variations (and possi- performance and achievements in FY 2002. ble trends) in the cycling of water through the atmosphere Data Sources. Performance assessment data is from and their relation to sea surface temperature changes normal project management reporting and is verified and Results. NASA did not achieve the indicator. validated by the program executive or program scientist. Precipitation data from the Tropical Rainfall Measuring Mission (TRMM) and other satellites assisted in assessing Indicator 4. Establish passive and active rainfall retrievals the effect of rain on global warming and other temperature of zonal means to establish a calibration point for long- variations. However, we did not combine global water term data records of the World Climate Research Program, vapor and wind data sets to decipher these variations. Global Precipitation Climatology Project (GPCP) Preliminary results (see the example data source) indicat- Results. Researchers established a calibration point by ed an unclear relation and further analysis was required. comparing TRMM Version 5 satellite data products and Data Quality. Peer-reviewed publication is the most GPCP data. This allows us to use TRMM data to calibrate relied upon assessment of the validity of a scientific a long-term record of GPCP. accomplishment. Data Quality. Peer-reviewed publication is the most Data Sources. The following is an example of a journal relied upon assessment of the validity of a scientific that published information about the indicator: accomplishment. Robertson, F. R., R.W. Spencer, and D.E. Fitzjarrald, 2001. A new satellite deep convective ice index for tropi- Data Sources. See indicator 1. cal climate monitoring: possible implications for existing oceanic precipitation data sets, Journal of Geophysical Annual Performance Goal 2Y2. Increase understanding of global ocean circulation and how it varies on Research Letters, 28, 251-254. interannual, decadal, and longer time scales by meeting Indicator 2. Analyze data from polar and geostationary two of two performance indicators. satellites in a consistent fashion over at least two decades to NASA achieved the annual performance goal with a rat- evaluate whether the detectable moisture fluxes are ing of green. The progress made this year in understand- increasing beyond the expected ranges of natural variability ing changes in sea ice cover in the Arctic and Antarctic Results. Researchers analyzed the data showing how led to an assessment of green. Researchers examined for moisture varies seasonally in both the Northern and the first time the perennial ice cover trends and found Southern Hemispheres. Because the variability was so dramatic changes.

Part II • Supporting Data • Earth Science 145 Annual Performance Goal Trends for Earth Science

Annual Performance Assessment Performance Goal FY 1999 FY 2000 FY 2001 FY 2002 Strategic Goal 1. Observe, understand, and model the Earth system to learn how it is changing, and the consequences for life on Earth. Objective 1. Discern and describe how the Earth is changing. 2Y1 2Y2 2Y3 2Y4 2Y5 2Y6 Objective 2. Identify and measure the primary causes of change in the Earth system. 2Y7 2Y8 2Y9 Objective 3. Determine how the Earth system responds to natural and human-induced changes. 2Y10 2Y11 2Y12 2Y13 2Y14 2Y15 Objective 4. Identify the consequences of change in the Earth system for human civilization. 2Y16 2Y17 2Y18 Objective 5. Enable the prediction of future changes in the Earth system. 2Y19 2Y20 2Y21 2Y22 Strategic Goal 2. Expand and accelerate the realization of economic and societal benefits from Earth science, information, and technology. Objective 1. Demonstrate scientific and technical capabilities to enable the development of practical tools for public and private-sector decision makers. 2Y23 Objective 2. Stimulate public interest in and understanding of Earth system science and encourage young scholars to consider careers in science and technology. 2Y24 Strategic Goal 3. Develop and adopt advanced technologies to enable mission success and serve national priorities.

Objective 1. Develop advanced technologies to reduce the cost and expand the capability for scientific Earth observation. 2Y25 Objective 2. Develop advanced information technologies for processing, archiving, accessing, visualizing, and communicating Earth science data. 2Y26 N/A N/A N/A 2Y27 N/A N/A N/A Objective 3. Partner with other agencies to develop and implement better methods for using remotely sensed observations in Earth system monitoring and prediction. 2Y28 N/A N/A N/A 2Y29 2Y30 2Y31

146 NASA FY 2002 Performance and Accountability Report Indicator 1. Routine (every 10 days) analysis from a data- global ocean color data coverage by 25 percent from a assimilating global ocean model, using NASA satellite baseline of 17 percent per day observations, will be used to evaluate ocean circulation changes. (http://www.ecco.ucsd.edu/) Results. The indicator was achieved. A software program merged the MODIS and SeaWiFS Level-3 prod- Results. NASA satellites helped establish a new tech- ucts. The application converted the 4.6-kilometer nique to assimilate ocean data. Operational production MODIS Level-3 products to the 9-kilometer SeaWiFS needs to be established. format, combined the data by weighted averaging, and produced standard SeaWiFS-like Level-3 products as Data Quality. Peer-reviewed publication is the most output. These products can be processed more or dis- relied upon assessment of the validity of a scientific played using existing software (for example, SeaDAS, or accomplishment. SeaWiFS Data Analysis System). Data Sources. The project homepage contains informa- Data Quality. Peer-reviewed publication is the most tion on the data and links to publications and collaboration relied upon assessment of the validity of a scientific information: http://www.ecco.ucsd.edu/. accomplishment. Indicator 2. Sponsor research and satellite data analysis to develop and publish the trends in the duration and Data Sources. The following is an example of a journal dynamics of the sea ice season for the Arctic and that published information about the indicator: Antarctic polar sea ice covers for the period 1979-1999 Kwiatkowska, E.J. and G.S. Fargion: China, October 23- 27, 2002: “Merger of Ocean Color Data from Multiple Results. NASA-sponsored research to develop and pub- Satellite Missions within the SIMBIOS Project,” The lish trend data showing the Arctic ice cover decreased by International Society for Optical Engineering’s several percent per decade from 1979 to 2000, while in Symposium on Remote Sensing of the Atmosphere, the Antarctic, it increased from 1979 to 1998. Ocean, Environment, and Space. Data Quality. Peer-reviewed publication is the most Indicator 2. Test our ability to discriminate phytoplankton relied upon assessment of the validity of a scientific from other constituents in coastal waters using observa- accomplishment. tions of phytoplankton fluorescence observations acquired by MODIS Data Sources. Some examples of journals that published information about this indicator include: Results. Numerous underflights validated the fluorescence line height that MODIS recorded. Once validat- Fukumori, I., 2002: A partitioned Kalman filter and ed, the observations helped differentiate between color smoother, Monthly Weather Review, 130, 1370-1383. dissolved material and phytoplankton pigments in Parkinson, C. L., 2002: Trends in the length of the coastal areas. Southern Ocean sea-ice season, 1979-99, Annals of Data Quality. Peer-reviewed publication is the most Glaciology, 34, 435-440. relied upon assessment of the validity of a scientific Annual Performance Goal 2Y3. Increase understand- accomplishment. ing of global ecosystems change by meeting at least three of four performance indicators. Data Sources. The following is an example of a journal that published information about the indicator:Validation NASA achieved the annual performance goal with a rat- of Terra-MODIS Phytoplankton Chlorophyll Fluo- ing of green. Seasonal and interannual changes in terres- rescence Line Height: 1. Initial Airborne Lidar Results, trial and marine primary productivity are key measures of Frank E. Hoge, Paul E. Lyon, Robert N. Swift, James K. global ecosystem change. In FY 2002, we ensured the Yungel, Mark R. Abbott and Ricardo M. Letelier. continuing utility of estimating global primary productiv- Submitted to Applied Optics in September 2002. ity for the time series of ocean color and vegetation index data. Merging data from separate instruments increased Indicator 3. Release first comprehensive validation daily ocean color spatial coverage. In addition, the quan- of MODIS land data products using results from the titative comparisons of regional vegetation-index data South African Fire-Atmospheric Research Initiative products appeared in peer-reviewed journals. We took a (SAFARI 2000) field campaign and related field valida- first step toward improving satellite-derived marine pro- tion programs ductivity estimates. Field campaigns produced solid validation for many terrestrial ecosystem data products. Results. SAFARI 2000 validated MODIS land data products such as Leaf Area Index, fraction of Photo- Indicator 1. Merge Moderate-Resolution Imaging synthetic Active Radiation, fire, and burn scar. Ground- Spectroradiometer (MODIS) instrument and Sea-viewing based measurements showed accuracy to within the field Wide Field-of-view Sensor (SeaWiFS) data to increase the measurement uncertainty.

Part II • Supporting Data • Earth Science 147 Data Quality. Peer-reviewed publication is the most instruments will not be sufficiently mature to address relied upon assessment of the validity of a scientific ozone recovery for several years. Below 20 kilometers, accomplishment. A special issue of Remote Sensing of space-based data are presently more limited and, while Environment documented the validation material. NASA launched new instruments, it will take many years to develop a useful long-term record. Data Sources. Information about the MODIS land data product validation and resulting publications is located at Indicator 1. Provide continuity of calibrated data sets for http://modis-land.gsfc.nasa.gov/ and http://modarch.gsfc. determining long term trends in the total column and nasa.gov/MODIS/LAND/VAL/. Information on special profile abundances of stratospheric ozone with sufficient journal issues related to the SAFARI 2000 field campaign precision to enable the later assessment of expected is available at http://safari.gecp.virginia.edu/. ozone recover The following is an example of a journal that published Results. We provided data continuity despite the failure information about the indicator: Justice, C. O., Giglio, of QuikTOMS and calibration problems with Earth L., Korontzi, S., Owens, J., Morisette, J. T., Roy, D., Probe/TOMS. The National Oceanic and Atmospheric Descloitres, J., Alleaume, S., Petitcolin, F., and Administration’s NOAA 16 and NOAA 17 SBUV/2 Kaufman, Y. The MODIS fire products, Remote Sensing instruments should last for several years. NOAA planned of Environment, in press. to continue these measurements until the National Polar- orbiting Operational Environmental Satellite System Indicator 4. Establish a quantitative relationship becomes operational. A merged record containing 23 between vegetation indices time series derived from years of data, from 1979 to 2001 is available on the Web. Advanced Very High-Resolution Radiometer (AVHRR) It will be updated using NOAA 16 and NOAA 17 data. and MODIS to ensure long-term continuity and compa- rability of time series For the Upper Stratospheric Profile (from about 20 to 50 kilometers), the Stratospheric Aerosol and Gas Results. Several studies quantitatively related AVHRR Experiment (SAGE) and HALogen Occultation and MODIS vegetation index data and the results were Experiment (HALOE) instruments provided a self-cali- prepared for publication. These studies focused on partic- bration mechanism that makes their records invaluable ular regions and time spans. The SAFARI 2000 and for the long-term trends. While some questions existed Large-Scale Atmosphere Biosphere Experiment in about the calibration of SBUV instruments in the past, Amazonia, Ecological Research Program (LBA-ECO) recent instruments performed far better. SBUV record can field campaigns compared results from the AVHRR and be checked using data from SAGE. the Terra-MODIS instruments. In the Lower Stratosphere (tropopause to about 20 kilo- Data Quality. Peer-reviewed publication is the most meters), given very high variability of ozone in the lower relied upon assessment of the validity of a scientific stratosphere and the difficulty of isolating different mech- accomplishment. anisms of change using sparse data, chances of develop- Data Sources. Publications include: Huete, A., Didan, ing a good understanding of the trends in this region in K., Miura, T., and Rodriguez, E., 2002, Overview of the the next 5 years are not very promising. The Aura and Radiometric and Biophysical Performance of the MODIS ENVIronmental SATellite instruments should provide Vegetation Indices. Remote Sensing of Environment. better coverage of the lower stratosphere, but it will take (Special issue in press). years to develop a useful long-term record. Annual Performance Goal 2Y4. Increase under- Data Quality. Data on total column ozone and profile standing of stratospheric ozone changes, as the ozone trends played prominent roles in the latest interna- abundance of ozone-destroying chemicals de-creases tional ozone assessment, (Scientific Assessment of Ozone and new substitutes increases by meeting two of two Depletion: 2002, World Meteorological Organization, performance indicators. Global Ozone Research and Monitoring Project Report The overall assessment for this annual performance goal (in press). is yellow. NASA provided a total ozone data set of con- Data Sources. Information on the project and related tinuous trends. A new merged data record from the Total publications is located at http://code916.gsfc.nasa. Ozone Mapping Spectrometer (TOMS) series of instru- gov/Data_services/merged. Upper Stratospheric Profile ments and Solar Backscatter Ultraviolet (SBUV/2) instru- satellite data, including SAGE, HALOE, SBUV, Umkehr, ments was assembled. This record will be updated using and the Network for the Detection of Stratospheric data from more recent SBUV/2 instruments. Change lidars, is available at http://www.ndsc.ws. Collaborative work between United States and European scientists will add other instrument data to this record. Indicator 2. Characterize the inter-annual variability and The instruments for ozone profile trends above 20 kilo- possible long-term evolution of stratospheric aerosol meters are aging and data from recently launched satellite characteristics and profile abundances to assist in the

148 NASA FY 2002 Performance and Accountability Report interpretation of observed ozone changes and Chemistry- launched Gravity Recovery and Climate Experiment climate interactions. This requires a combination of (GRACE), which offers a new paradigm in gravity field consistently processed data records from ground-based, applications. Its ability to track water mass within the airborne, balloon-borne, and space-based measurements Earth system will significantly advance the ability to assess flood risk, climate change, and water resources. Results. NASA achieved the indicator. NASA supported NASA altered the Continuous Observations of the the World Climate Research Programme’s Stratospheric Rotation of the Earth (CORE) Program—designed to Process and the Role in Climate Assessment of enhance Very Long Baseline Interferometry (VLBI) Stratospheric Aerosol Properties. The assessment consid- observing capability—to increase reference frame accura- ered NASA’s SAGE II and HALOE results, as well as cy to the millimeter level, and provide a more accurate data from ground-based lidar and in situ measurement measure of changes in Earth rotation to help us under- systems. A new version of SAGE II data released in late stand changes in water storage on a global basis. 2001 produced improved short wavelength aerosol extinction information near the tropopause. The data Indicator 1. Produce first estimate of the secular (long- helped us understand the observed seasonal variations in term) change of the Earth’s magnetic field from continu- lower stratospheric aerosol. SAGE III provided multi- ous satellite measurements of the geomagnetic field. wavelength aerosol extinction data. The improved wave- Estimate the long-term variation to 3 nano Tesla/year or length sampling (9 wavelengths from 385 to 1,550 better which is equivalent to a change of 1 part in 20,000 nanometers) should increase our understanding of aerosol Results. NASA achieved the indicator by developing a microphysical changes. comprehensive geomagnetic modeling technique that Data Quality. Peer-reviewed publication is the most incorporated main, crustal, and external field terms to relied upon assessment of the validity of a scientific model long-term geomagnetic secular variation. This accomplishment. approach will become the standard for future modeling efforts because it better estimates the sources of the geo- Data Sources. The following is an example of a journal magnetic field. The 5-year averages for the first six gauss that published information about the indicator: coefficient terms are no larger than 3 nano Tesla per year. Thomason, L. W., Andreas B. Herber Takashi Yamanouchi, Kaoru Sato, Sharon P. Burton: Arctic Study A second publication this year derived the secular varia- on Tropospheric Aerosol and Radiation: Comparison of tion from two sets of measurements acquired by tropospheric aerosol extinction profiles measured by air- Magsat—a NASA geomagnetic satellite and the Oersted borne photometer and SAGE II, submitted to Geophysical Satellite—a NASA/Danish/French collaboration. The Research Letters, October 2002. secular variation error for the 20-year timespan is better than 3 nano Tesla per year. Annual Performance Goal 2Y5. Increase understanding of change occurring in the mass of the Earth’s Data Quality. The data quality is high, as these are ice cover by meeting at least three of four performance world-class, first-ever observations published in presti- indicators. gious, peer-reviewed publications. The results of this annual performance goal and its asso- Data Sources. The paper commanded a cover photo for ciated indicators are located in the Highlights of Nature and inclusion in the prestigious peer-reviewed Performance Goals and Results segment of Part I. journal Royal Academy of Science. Annual Performance Goal 2Y6. Increase understand- Other sources include: ing of the motions of the Earth, the Earth’s interior, and what information can be inferred about the Earth’s inter- Sabaka, T.N. Olsen, R.A. Langel, A Comprehensive nal processes by meeting at least three of four perfor- Model of the quiet-time, near-Earth magnetic field: phase mance indicators. 3, Geophysical Journal International, 151, 32-68, 2002. NASA achieved the annual performance goal with a rat- Hulot, G.C., C. Eymin, B. Langlais, M. Mandea, N. ing of green. The Oersted and CHAllenging Mini- Olsen, 2002: Small Scale structure of the geodynamo Satellite Payload (Danish and German, respectively) inferred from Orsted and Magsat satellite data, Nature, operations improved the measuring and modeling of the 416, 620-523. geomagnetic field. NASA supported these efforts with Indicator 2. Complete the evaluation of the CORE launch support, instruments, and scientific analysis. concept to demonstrate a nearly 300-percent improve- NASA demonstrated a factor-of-100 improvement in the ment in Earth rotation precision using the new Mark IV positioning accuracy of the Global Positioning System correlator technology and an international consortium of (GPS) on a real-time global basis. The achievement will VLBI observatories have a significant effect on satellite airborne science capabilities, as well as aircraft safety, marine operations, Results. The evaluation showed that a 300-percent mining, construction, and agriculture. In addition, NASA improvement in Earth-rotation precision was not

Part II • Supporting Data • Earth Science 149 possible. A blue ribbon panel report by members of the data set. The GRACE Web site provides additional insight international space geodetic community recommended into the modeling algorithms and the status of GRACE integrating GPS and VLBI observations to achieve an data processing at http://www.csr.utexas.edu/grace/. increase in temporal resolution and improve the Examples of works in print, in press, and submitted are accuracy of measurement. Many of the panel report recommendations became part of the program. A Jayne, S.R. J.M. Wahr, and F.O. Bryan Observing ocean National Geodetic Observatory program seeks to better heat content using satellite gravity and altimetry, Journal integrate the three NASA geodetic observing networks of Geophysical Research, submitted. into a more effective and accurate capability. Swenson, S. and J. Wahr, Estimated effects of the vertical Data Quality. Peer-reviewed publication is the most structure of atmospheric mass on the time-variable geoid, relied upon assessment of the validity of a scientific Geophysical Research Letters (in press). accomplishment. Strategic Objective 2. Identify and measure the Data Sources. The review process and the draft report primary causes of change in the Earth system are available at http://ivscc.gsfc.nasa.gov/core-panel/. Annual Performance Goal 2Y7. Increase under- Indicator 3. Complete Solar Laser Ranging 2000 standing of trends in atmospheric constituents and solar (SLR2000) prototype development and begin evaluation radiation and the role they play in driving global climate of the performance of new SLR2000 automated satellite by meeting at least three of four performance indicators. ranging station NASA achieved the annual performance goal with a Results. The SLR2000 prototype was successfully com- rating of green. Our continuous sampling of tropospheric pleted; performance testing will run through FY 2003. air showed a decrease in halocarbons and an increase in replacement chemicals. A NASA-sponsored flask- Data Quality. Peer review is the most relied upon assess- sampling program also showed similar behavior. ment of the validity of a scientific accomplishment. Comparisons between the NASA and NOAA networks Data Sources. More than 100 members of the reduced uncertainties in the trend results. Combined International Laser Ranging Service had the opportunity measurement of carbon monoxide and methane in a new to inspect the prototype SLR2000 instrument. model will improve future investigations of interannual variations in global emissions. NASA created integrated Indicator 4. Evaluate the ability of the real-time precision data sets to study aerosols using multiple satellites and GPS positioning software to produce better than ground-based programs. The changes allowed us to 40-centimeter global real-time positioning using NASA’s identify aerosol sources and to detect and quantify sulfate Global GPS Network aerosols from industrial pollution. Results. NASA exceeded this indicator. The GPS soft- Indicator 1. Provide continuity of 22 years of concentra- ware produced 10-centimeter global real-time position- tion measurements (and associated standards developing—a factor of four beyond the goal. The capability is ment) of anthropogenic and naturally occurring halogen- being tested on airplanes. containing chemicals and other chemically active green- Data Quality. Peer-reviewed publication is the most house gases to provide for an understanding of future relied upon assessment of the validity of a scientific changes in ozone and climate forcing accomplishment. Results. NASA achieved the indicator. The NASA Data Sources. Data, project information, and publica- Advanced Global Atmospheric Gases Experiment (AGAGE) tions are located at http://gipsy.jpl.nasa.gov/igdg/. Network’s measurement activities continued with a high level of success, and standards comparisons with the Climate Indicator 5. Complete preliminary algorithms for mass Monitoring and Diagnostics Laboratory Network reduced ear- flux estimation from temporal gravity field observations lier differences in the results from these two data archives. in preparation for the GRACE mission Data from the AGAGE and the NASA-funded University of California, Irvine (UCI) flask sampling network played Results. GRACE had a successful launch and the sci- important roles in the 2002 World Meteorological ence team was selected. Preliminary algorithms and grav- Organization/United Nations Environment Programme ity fields were generated. (WMO/UNEP) Scientific Assessment of Ozone Depletion. Data Quality. Some of the data and algorithms appeared Data Quality. Data on atmospheric halocarbon abun- in peer-reviewed journals. dances played prominent roles in the latest international Data Sources. More than 50 proposals responded to the ozone assessment, “Scientific Assessment of Ozone GRACE and Gravity component announcement. The pro- Depletion: 2002,” World Meteorological Organization, posals offered ways to apply algorithms to the GRACE Global Ozone Research and Monitoring Project Report

150 NASA FY 2002 Performance and Accountability Report (in press). Publications from the AGAGE and UCI pro- fairly complete picture of aerosol properties. For exam- grams appeared in peer-reviewed scientific literature such ple, the combined data from TOMS, SeaWiFS, and as the Journal of Geophysical Research. Clouds and the Earth’s Radiant Energy System (CERES) quantified how smoke aerosols change the cloud forcing Data Sources. The Carbon Dioxide Information and in the Southeast Asia region. Analysis Center archived the AGAGE Network data. The World Data Center for Atmospheric Trace Gases Data Quality. Peer-reviewed publications represent a archived the UCI Network data. Both centers are high level of quality in the scientific community. located at the U.S. Department of Energy, Oak Ridge Data Sources. The project homepages for the data col- National Laboratory. lecting instruments provide data, news, collaborators, and Indicator 2. Use data assimilation techniques to combine publications. The TOMS homepage is http://skye.gsfc. carbon monoxide and methane measurements from nasa.gov/. The homepage for MODIS is located at Measurements of Pollution in the Troposphere (MOPITT) http://modis.gsfc.nasa.gov/ and the one for MISR is at with chemical transport models of the atmosphere to help http://www-misr.jpl.nasa.gov/. characterize interannual differences in global emissions Indicator 4. Reduce the uncertainty in the retrievals of Results. NASA achieved the indicator. A prototype for upper troposphere/lower stratosphere water vapor (from deriving surface fluxes of carbon monoxide using microwave soundings) by 10 to 30 percent through MOPITT data and the Model for OZone And Related improved laboratory spectroscopic measurements of the chemical Tracers-2 (MOZART-2) is in the testing phase. water vapor continuum In addition, a university group is assimilating the data to support the TRAnsport and Chemical Evolution over the Results. The new laboratory system displayed the Pacific (TRACE-P) field program, investigating outflow required sensitivity, simultaneous measurement capabili- of pollutants from Asia. Better agreement of retrieved ty, and measurement accuracy. data with co-located in-situ profiles led to improved accu- Data Quality. Peer-reviewed publications represent a racy and coverage. high level of quality in the scientific community—see The loss of some MOPITT data in 2001 required the below for references. development of a new retrieval scheme. A much- Data Sources. NASA sponsored an international improved algorithm is in the testing phase. The new data workshop on “Spectroscopic Needs for Atmospheric appeared to retain almost the same quality as the pre- Sampling” that highlighted the findings of the laboratory anomaly data. In regions of high signal-to-noise ratio, studies. Peer-reviewed literature such as the Journal of such as over bright desert areas, credible results are now Molecular Spectroscopy published the findings. possible. Work is continuing to extend these results. Annual Performance Goal 2Y8. Increase under- Data Quality. The project homepage includes links to standing about the changes in global land cover and land papers at International Society for Optical Engineering use and their causes by meeting at least two of three (SPIE’s) 44th Annual Meeting. These peer-reviewed pub- performance indicators. lications are the most relied upon assessment of the valid- NASA achieved the annual performance goal with a rat- ity of a scientific accomplishment. ing of green. Case studies of the NASA Land Cover Land Data Sources. The homepage of the University of Use Change Program are included in a book under devel- Toronto MOPITT team provided useful information opment. Several chapters will discuss changes associated including a list of relevant papers: http://www.atmosp. with natural fires and deforestation. Second, a 15-year physics.utoronto.ca/MOPITT/ home.html. history of fire occurrences and emissions over North America based on operational satellite data is being pre- Indicator 3. Provide first comprehensive multi- pared. The results on quantification of the impact of instrument/multi-angle integrated data set for study of deforestation in the Amazon on global carbon balance sources/sinks and distribution of tropospheric aerosols were under consideration for publication. over land based on data from Total Ozone Mapping Spectrometer, MODIS, and Multi-angle Imaging Spectro- Indicator 1. Publish the first set of regional land cover radiometer (MISR) instruments and land use change case studies and a synthesis of their results Results. The combined satellite data set helped identify aerosol sources. MODIS and SeaWiFS satellite data aug- Results. Published research on the project entitled mented the long-term record of smoke from 1979 to the Landscape Dynamics and Land Use Land Cover Change present, started by TOMS. The combined data sets detect- in the Great Basin-Mojave Desert showed the importance ed dust over all surfaces, helping researchers determine of environmental changes in semiarid regions, their the basic optical properties (particle size, refractive index, drivers, and the implications for future climatic, land use, and absorption coefficients). The combined sets formed a and land cover scenarios.

Part II • Supporting Data • Earth Science 151 Data Quality. Peer-reviewed publication is the most renewed. In FY 2002, the team—named the present and relied upon assessment of the validity of a scientific future effects of ground fires on forest carbon stocks, accomplishment. metabolism, hydrology and economic value in Amazonia and the Cerrado—continued working with large experi- Data Sources. Some examples of journals that published mental forest fires, manipulating fire frequency and seed information about this indicator include: Elmore, A. J., J. F. sources in four pairs of 1-hectare forest plots in the Mustard, and S. J. Manning, Regional patterns of great Tapajós forest. On the project, Anthropogenic Landscape basin community response to changes in water resources: Changes and the Dynamics of Amazon Forest Biomass, Owens Valley, CA, (in press) Ecological Applications 2002. researchers assessed the effects of intensive land uses— House, J., S. Archer, D. Breshears, RJ Scholes. such as habitat fragmentation, forest regeneration, selec- 2002. Conundrums in mixed woody-herbaceous plant tive logging, and fire—on biomass and carbon storage in systems. The Journal of Biogeography received the Amazonian forests. Multiple journals published both sets paper submission. of findings. Indicator 2. Characterize the role of land cover changes Data Quality. Peer-reviewed publication is the most associated with natural fires in determining the carbon relied upon assessment of the validity of a scientific balance of ecosystems in at least two major regions of the accomplishment. boreal forests, quantify their impact on the global carbon Data Sources. Publications include: budget, and submit the results for publication Potter, C., E. Davidson, D. Nepstad, C. Carvalho. Results. Two major projects and publication in several Ecosystem modeling and dynamic effects of deforestation respected journals helped achieve this indicator. The first on trace gas fluxes in Amazon tropical forests. Forest and project, Modeling and Monitoring Effects of Area Burned Ecology Management. 5350: 1-21. and Fire Severity on Carbon Cycling, Emissions, and Forest Health and Sustainability in Central Siberia, Laurance, W. F., M. A. Cochrane, S. Bergen, P. M. involved a United States-Russian team that developed a Fearnside, P. Delamonica, C. Barber, S. D’Angelo, and T. comprehensive data set on fire emissions, behavior, and Fernandes. 2001. The future of the Brazilian Amazon. ecosystem effects in the boreal zone. In the second, Science. 291: 438-439. Development of Long Term Inventory of Fire Burned Annual Performance Goal 2Y9. Increase understand- Areas and Emissions of North America’s Boreal and ing of the Earth’s surface and how it is transformed Temperate Forests, data from the early period of the and how such information can be used to predict AVHRR record were analyzed. future changes by meeting at least four of five performance indicators. Data Quality. Peer-reviewed publication is the most relied upon assessment of the validity of a scientific The results of this annual performance goal and its accomplishment. associated indicators are located in the Highlights of Performance Goals and Results segment of Part I. Data Sources. Some examples of journals that published information about this indicator include: Conard, Strategic Objective 3. Determine how the Susan G., Anatoly I. Sukhinin, Donald R. Cahoon, Earth system responds to natural and human- Eduard P. Davidenko, Brian J. Stocks, and Galina A. induced changes Ivanova. Determining effects of area burned and fire severity on carbon cycling and emissions in Siberia. Annual Performance Goal 2Y10. Increase under- Climatic Change (in press). standing of the effects of clouds and surface hydrologic processes on climate change by meeting at least four of Csiszar, I., A. Abdelgadir, Z. Li, J. Jin, R. Fraser and five performance indicators. W.M. Hao, Interannual changes of active fire detectabili- ty in North America from long-term records of the NASA achieved the annual performance goal with a rat- Advanced Very High Resolution Radiometer. Journal of ing of green. Multiangle Imaging SpectroRadiometer Geophysical Research, accepted. aerosol products helped assess global aerosol budgets and calculate aerosol radiative forcing. The products also Indicator 3. Characterize the role of deforestation in the served to retrieve surface bidirectional reflectance and carbon balance of ecosystems of the Amazonian tropical albedo. Their quality and accuracy improved cloud iden- forest, quantify the impact on the global carbon budget, tification and screening over both land and ocean. Finally, and submit the results for publication a revised set of aerosol mixtures in the retrieval algorithm produced tighter constraints on aerosol type with little Results. The LBA-ECO Research Program and the loss of spatial coverage. Interdisciplinary Program contributed to achieving this indicator. LBA-ECO entered its second phase, and most Indicator 1. Continue assembling and processing of satel- Land Cover Land Use Change (LCLUC) projects were lite data needed for the multi-decadal global cloud

152 NASA FY 2002 Performance and Accountability Report Climatology being developed under the International Results. A direct quantitative evaluation of the effects Satellite Cloud Climatology Project (ISCCP). Reduce of the diurnal, synoptic, seasonal, and interannual varia- uncertainty (3-7 percent in monthly mean) in the current tions of clouds on the radiative part of the diabatic forc- ISCCP dataset of globally observed cloud characteristics, ing for the atmospheric general circulation, albeit at low particularly in the polar regions, by comparing it with vertical resolution, is now possible for the first time. new satellite datasets that provide new constraints on the This represented a key step toward evaluating cloud- derived quantities and with in situ ground-based and air- radiative feedbacks. borne measurements Data Quality. Peer-reviewed publication is the most Results. Calculation of top-of-atmosphere shortwave relied upon assessment of the validity of a scientific and longwave radiative fluxes using the ISCCP cloud accomplishment. products showed excellent quantitative agreement with the long-term Earth Radiation Budget Experiment flux Data Sources. See indicator 1. anomalies at low latitudes associated with several El Niño Indicator 4. Demonstrate over a variety of landscapes the Southern Oscillation (ENSO) events and the Mount capability to measure and diagnose soil moisture from Pinatubo volcanic eruption as well as the long-term airborne platforms, in preparation for a space-flight trial change between the 1980s and 1990s. This result showed of soil moisture remote sensing that much of these flux anomalies occurred because of cloud changes determined by ISCCP. The finding also Results. Preliminary results using different types of veg- confirmed the accuracy of the ISCCP radiance calibration etation in Iowa proved encouraging. standard for all of the weather satellites (the only one in Data Quality. Data from previous field experiments existence). Climate models predict a change in the inten- appeared in many scientific publications. Once validated, sity distribution of mid-latitude storms in a warming cli- the data are available to the public through NASA’s mate: the ISCCP cyclone cloud survey provides an evalu- Distributed Active Archive Center (DAAC). Peer- ation of the resulting radiation budget perturbations that reviewed publication is the most relied upon assessment would be associated with such a change (one component of the validity of a scientific accomplishment. of cloud-radiative feedbacks). Data Sources. Information is available at http:// Data Quality. Peer-reviewed publication is the most _hydrolab.arsusda.gov/smex02/. In addition, see the data relied upon assessment of the validity of a scientific sources for indicator 1. accomplishment. Indicator 5. Improve the understanding and modeling of Data Sources. Information on the Earth Observing the aerosol radiative forcing of climate and its anthro- System (EOS)-related instruments and publications are pogenic component (reduce current uncertainties of 0.1 to located at http://eospso.gsfc.nasa.gov/. 0.05 in the aerosol column optical thickness and 1 to 0.4 Indicator 2. Initiate development of the Cirrus Regional in the Angstrom coefficient). Develop and validate Study of Tropical Anvils and Layers (CRYSTAL) field study aerosol retrieval and cloud screening algorithms, and to determine the upper tropospheric distribution of ice par- processing of satellite data and transport model evalua- ticles and water vapor and associated radiation fluxes on tions for a 20-year Climatology of aerosol optical thick- storms and cloud systems, and on cloud generation, regen- ness and particle size eration and dissipation mechanisms and their representa- Results. The global monthly mean optical thickness and tion in both regional-scale and global climate models Angstrom exponent showed no significant trends and Results. The Mission was planned and executed suc- oscillate around the average values 0.14 and 0.75, respec- cessfully in July 2002. It was centered in Key West, FL. tively. The optical thickness maxima and minima for the Southern Hemisphere occur around January to February Data Quality. Peer-reviewed publication is the most and June to July, respectively. The Northern Hemisphere relied upon assessment of the validity of a scientific exhibits a similar pattern, but with maxima in the accomplishment. February to April timeframe. The Northern Hemisphere Data Sources. Same as indicator 1. mean systematically exceeded that average over that of the Southern Hemisphere. The results of AVHRR Indicator 3. Improve the determinations of radiation forc- retrievals during the period affected by the Mount ings and feedbacks, and thereby increase accuracy in our Pinatubo eruption are consistent with the SAGE retrievals knowledge of heating and cooling of the Earth’s surface of the stratospheric aerosol optical thickness. Time series and atmosphere. Continue the analysis of global mea- of the aerosol properties computed for four specific geo- surements of the radiative properties of clouds and graphic regions showed varying degrees of seasonal vari- aerosol particles being made by MISR and CERES instru- ability controlled by local meteorological events and/or ments on the Terra and Aqua spacecraft anthropogenic activities.

Part II • Supporting Data • Earth Science 153 Data Quality. Peer-reviewed publication is the most Results. Satellite ocean color data provided the basis for relied upon assessment of the validity of a scientific developing empirical models of carbon production and accomplishment. exportation. The scientific community has not reached a consensus on any one model. Data Sources. See indicator 1. Data Quality. Peer-reviewed publication is the most Annual Performance Goal 2Y11. Increase understand- relied upon assessment of the validity of a scientific ing of how ecosystems respond to and affect global environmental change and affect the global carbon cycle by accomplishment. meeting at least four of five performance indicators. Data Sources. Examples of publications include: NASA achieved the annual performance goal with a rat- Gregg, W.W., 2002: Tracking the SeaWiFS record with a ing of green. Scientifically validated EOS Terra-MODIS coupled physical/biogeochemical/radiative model of the higher level data products that became available in global oceans. Deep-Sea Research, II, 49: 81-105. FY 2002, the continuing time-series of SeaWiFS ocean Shipe, R.F., U. Passow, M.A. Brzezinski, D.A. Siegel color data, and results from field campaigns advanced our and A.L. Alldredge, 2002: Effects of the 1997-98 El Niño understanding of ecosystem responses and global carbon on seasonal variations in suspended and sinking particles cycling. In particular, NASA demonstrated the ability to in the Santa Barbara Basin. Progress in Oceanography, identify, quantify, and monitor the duration of major pro- 54, 105-127. ductivity bursts (that is, blooms) for important functional groups of marine algae in the world’s oceans. Chlorophyll Indicator 3. Conduct airborne remote sensing campaign data products derived from satellite data improved model in Amazonia to evaluate measurement approaches for estimates of carbon export to the deep sea. Improved vegetation recovery and biomass change following forest ecosystem models integrated data acquired from NASA clearing and impact of this secondary growth on removal field campaigns. Peer-reviewed journals published results of water from the atmosphere from modeling exercises involving several advanced, Results. NASA did not achieve the indicator. After multi-factor ecosystem models. The published papers delays in planning and development, NASA agreed to the described improvements in the portrayal of land cover Brazilian government’s request for a new agreement for and in quantifying the role of land use in ecosystem deployment of United States aircraft to Brazil with a 1- change. The next modeling steps will require more fully year delay in the airborne campaign. Research on trace interactive treatment of the important factors controlling gases (primarily carbon dioxide) and wetlands using ecosystem response. Brazilian aircraft continued under a separate agreement, Indicator 1. Demonstrate the feasibility of using remote but this research did not address the structural changes sensing imagery to identify functional groups of phyto- called for by this indicator. It does address, in part, the plankton in the ocean issue of secondary growth effects on removal of carbon from the atmosphere. (NOTE: The indicator from the Results. Using both the spectral signature and intensity FY 2002 NASA 2000 Strategic Plan incorrectly reads of the upwelled radiance as measured by SeaWiFS and “water.” It should read “carbon.”) MODIS, researchers identified and quantified several functional groups of phytoplankton. They then mapped Data Quality. The International Journal of Remote the distribution and concentration of the calcium carbon- Sensing published quality information on the airborne ate forming coccolithophores and the nitrogen fixing videography data. Information on the atmospheric carbon Trichodesmium organisms, which play a key role in the dioxide concentrations had not yet been published, but the export of carbon to the deep ocean. data are being analyzed by a world-class laboratory (NOAA CMCL) using established international standards. Data Quality. Peer-reviewed publication is the most relied upon assessment of the validity of a scientific Data Sources. Publications include: Hess LL, Novo accomplishment. EMLM, Slaymaker D.M., Holt J., Steffen C., Valeriano D.M., Mertes, LAK, Krug T., Melack J.M., Gastil M., Data Sources. The following is an example of a journal Holmes C., Hayward C. (2002) Geocoded digital videog- that published information about the indicator: Iglesias- raphy for validation of land cover mapping in the Amazon Rodríguez, M.D., C.W. Brown, S.C. Doney, J. Kleypas, basin. International Journal of Remote Sensing 23. D. Kolber, Z. Kolber, P.K. Hayes, and P.G. Falkowski. (In press) Representing key phytoplankton functional groups For more information, see http://lba-ecology.gsfc.nasa. in ocean carbon cycle models: Coccolithophorids. Global gov/ and http://lba.cptec.inpe.br/lba/ eng/scientific.htm. Biogeochemical Cycles. Indicator 4. Assemble and publish the first comprehensive Indicator 2. Develop a relationship between oceanic prima- regional analysis of the linkages between land-atmo- ry productivity and export of carbon to the deep-sea based sphere interaction processes and the relationship between on remote sensing observations and ocean biology models trace gas and aerosol emissions and the consequences of

154 NASA FY 2002 Performance and Accountability Report their deposition to the functioning of the ecosystems of Data Sources. Publications include: Li, C., X. Wang, southern Africa M. Cao, P. Crill, Z. Dai, S. Frolking, B. Moore, W. Salas, W. Song, and X. Wang. 2001: Comparing a process-based Results. Two major journals (Journal of Geophysical agro-ecosystem model to the IPCC methodology for Research and Global Change Biology) published special developing a national inventory of N2O emissions from issues in FY 2002 on the regional analysis in southern arable lands in China. Nutrient Cycling Agroecosystems Africa. The SAFARI-2000 field campaign acquired field, 60: 159-175. airborne, and EOS Terra satellite observations to study land-atmosphere interactions associated with regional McGuire, A., S. Sitch, J. Clein, R. Dargaville, G. Esser, biomass burning and industrial emissions in southern J. Foley, M. Heimann, F. Joos, J. Kaplan, D. Kicklighter, Africa. Analyses of data from this field campaign yielded R. Meier, J. Melillo, B. Moore III, I. Prentice, N. results summarizing both physical and chemical land- Ramankutty, T. Reichenau, A. Schloss, H. Tian, L. atmosphere interactions and linkages between them. In Williams, and U. Wittenberg. 2001: Carbon balance of particular, journals published studies quantifying the the terrestrial biosphere in the twentieth century: properties of aerosols (size, shape, and forcing) resulting Analyses of CO2,climate and land use effects with four from biomass burning and their effects on the regional process-based ecosystem models. Global Biogeo- radiation balance. Papers in the Global Change Biology chemical Cycles, 15: 183-206. special issue addressed consequences with respect to the ecosystem functioning in the region. Annual Performance Goal 2Y12. Increase understanding of how climate variations induce changes in the Data Quality. Peer-reviewed publication is the most global ocean circulation by meeting at least four of six relied upon assessment of the validity of a scientific performance indicators. accomplishment. NASA achieved the annual performance goal with a rat- Data Sources. Information on special journal issues relating of green. Researchers linked high-resolution defor- ed to the SAFARI 2000 Field Campaign is located at mation, volume, and transport characteristics of Arctic http://safari.gecp.virginia.edu/. Other papers of note include: Sea ice to dominant atmospheric circulation patterns, suggesting that atmospheric changes can strongly influ- Dubovik, O., Holben, B., Eck, T., Smirnov, A., Kaufman, ence ice formation and ocean circulation. In addition, Y., King, M., Tanre, D., and Slutsker, I. Variability of progress was made in advancing strategies of assimila- Absorption and Optical Properties of Key Aerosol Types tion of satellite-derived sea ice data into process and cli- Observed in Worldwide Locations. Journal of mate models, which will enhance understanding of the Atmospheric Sciences 59: 590-608. ice-climate linkages. Hély, C., S. Alleaume, R.J. Swap, H.H. Shugart, and C.O. Indicator 1. Diagnostic analysis of seasonal and interannu- Justice, SAFARI-2000 characterization of fuels, fire al variability induced in the interior ocean based on forcing behavior, combustion completeness, and emissions from of an ocean model with three years of high resolution ocean experimental burns in infertile grass savannas in western winds (Ocean Surface Vector Winds Science Team) Zambia, Journal of Arid Environment, in press. Results. Scientists achieved the indicator, completing Indicator 5. Conduct diagnostic analysis of results from the first-ever collection of 3 years of high-resolution new carbon cycling models that improve the treatment of ocean vector wind data from August 1999 to July 2002. land use and land management and incorporate the The findings are located at http://www.seawinds.jpl. effects of nutrient deposition as well as climate change, nasa.gov. For the first time, scientists recorded an annual carbon dioxide enrichment, and land cover change to cycle of global distributions of high-resolution ocean assess interrelation among these multiple factors affect- vector winds. ing these ecosystems Data Quality. Peer-reviewed publication is the most Results. Multiple journals published results from mod- relied upon assessment of the validity of a scientific eling exercises involving several advanced, multi-factor accomplishment. ecosystem models. Some of these papers described improvements in the portrayal of land cover and in Data Sources. Examples of publications include: quantifying the role of land use in ecosystem change. Freilich, M. H., and B. A. Vanhoff, in press. The accura- Others showed that more than one factor can account for cy of remotely sensed surface wind speed measurements, known ecosystem responses and that the model needed Journal of Atmospheric and Oceanic Technology. to more fully integrate multiple interactions among con- Milliff, R. F., M. H. Freilich, W. T. Liu, R. Atlas, and W. trolling factors. G. Large, 2001. Global ocean surface vector wind obser- Data Quality. Peer-reviewed publication is the most vations from space, Observing the Oceans in the 21st relied upon assessment of the validity of a scientific Century, edited by C. J. Koblinsky and N. R. Smith, accomplishment. Bureau of Meteorology, Melbourne, Australia, 102-119.

Part II • Supporting Data • Earth Science 155 Indicator 2. Near decade-long sea surface topography Data Sources. Publications include: Kwok, R., Arctic, time series will be assimilated into high resolution Pacific 2002: Ocean sea ice area and volume production: A con- Ocean model to elucidate the mechanisms of the Pacific trast of two years—1996/97 and 1997/98. Annals of Decadal Oscillation and its impact on seasonal/decadal Glaciology, 34, 447-453. climate variations Kwok, R. and G. F. Cunningham. Seasonal ice area and Results. Low-resolution model computations showed volume production of the Arctic Ocean: November 1996 Indonesian through flow regulates the exchange of waters through April 1997. Journal of Geophysical Research— between the tropical and middle latitudes, and thereby, Oceans (in press). could alter the time interval between El Niño and La Niña. Another study described the origin and pathway of Indicator 5. Complete a preliminary review of how data El Niño waters. assimilation techniques are currently being used to improve knowledge of the polar oceans (in particular the Data Quality. Peer-reviewed publication is the most Arctic), through convening a workshop. Provide recom- relied upon assessment of the validity of a scientific mendations that outline the way forward for future appli- accomplishment. cation of data assimilation techniques for polar oceans Data Sources. Lee, T., I. Fukumori, D. Menemenlis, Z. research in NASA’s Earth Science Enterprise Xing, and L.-L. Fu, 2002. Effects of the Indonesian Results. The participants shared and discussed data throughflow on the Pacific and Indian Oceans, Journal of assimilation (DA) methods. The participants provided a Physical Oceanography, 32, 1404-1429. comprehensive set of recommendations was provided, in Fukumori, I., T. Lee, B. Cheng, and D. Menemenlis, sub- specific areas in which NASA can improve models of sea mitted. The origin, pathway, and destination of Niño3 ice processes. These included: (1) articulation of how sea water estimated by a simulated passive tracer and its ice DA can help address the science questions, (2) scien- adjoint, Journal of Physical Oceanography. tific community outreach, (3) suggested improvements to implementation of DA methods, (4) use of satellite data Indicator 3. From Ocean Topography Experiment in forcing, facilitating assimilation and evaluation (TOPEX) time series, in situ observations of the World through access to computational resources, and (5) eval- Ocean Data Assimilation Experiment, and assimilation of uation considerations. these data into ocean models, ascertain whether detectable changes in the deep ocean have occurred over Data Quality. Peer-reviewed publication is the most the last decade relied upon assessment of the validity of a scientific accomplishment. Results. Data assimilating model computations of four- dimensional ocean circulation were made. Torque pro- Data Sources. For more information on this project and duced by deep ocean circulation showed influence over the report, see http://oceans.nasa.gov/csp/index3.html, the Chandler wobble and the Earth’s shape. with planned submission to Bulletin of the American Meteorological Society or a similar publication. Data Quality. Peer-reviewed publication is the most relied upon assessment of the validity of a scientific Indicator 6. Submit for publication twenty years of Fram accomplishment. Strait sea ice flux from RADARSAT and passive microwave ice motion. Sea ice flux through the Fram Data Sources. The following is an example of a journal Strait represents export of fresh water from the Arctic that published information about the indicator: Dickey, Ocean, which in turn influences deep ocean circulation J.O., S. L. Marcus, O. de Viron, and I. Fukumori, in press. and climate variations Recent changes in Earth oblateness, Science. Results. The submitted papers described how sea level Indicator 4. Submit for publication the first estimate of pressure gradient dominated the flow through Fram Strait, the inter-annual variability of Arctic Ocean seasonal ice but showed less correlation in years of negative North production and heat and brine flux, from three years of Atlantic Oscillation because of the decreased dominance Canadian Radar Satellite (RADARSAT) observations of the large-scale atmospheric pattern on sea level pres- Results. The published results showed, for the first time, sure. The North Atlantic Oscillation index explains more the contrast in Arctic Ocean sea ice deformation and sea- than 70 percent of the ice area flux through the Fram sonal ice volume production between 1996 and 1998. Strait. Over the 17-year period, an average of about 7 per- Researchers found the 1997-1998 ice deformation created cent of the ice area and 10 percent of the ice volume went an ice volume 1.6 times that of the first year. through this passage. Data Quality. Peer-reviewed publication is the most Data Quality. Peer-reviewed publication is the most relied upon assessment of the validity of a scientific relied upon assessment of the validity of a scientific accomplishment. accomplishment.

156 NASA FY 2002 Performance and Accountability Report Data Sources. The following is an example of a journal Data Quality. Peer-reviewed publication is the most that published information about the indicator: Kwok, R., relied upon assessment of the validity of a scientific 2000: Recent changes of the Arctic Ocean sea ice motion accomplishment. associated with the North Atlantic Oscillation, Geophysical Research Letters, 27(6), 775-778. Data Sources. SOLVE played a prominent role in the latest international ozone assessment, (Scientific Assess- Rothrock, D. A., R. Kwok, and D. Groves, 2000: Satellite ment of Ozone Depletion: 2002), World Meteorological Views of the Arctic Ocean Freshwater Balance, The Organization, Global Ozone Research and Monitoring Freshwater Budget of the Arctic Ocean, edited by E. Lyn Project Report (in press). Publications from both the Lewis, Kluwer Academic, 409-452. SOLVE and the THESEO 2000 campaigns appeared in the Journal of Geophysical Research. Annual Performance Goal 2Y13. Increase understanding of stratospheric trace constituents and how they Indicator 2. Document and submit for publication the respond to change in climate and atmospheric compo- respective variability of temperatures, ozone concentrations, sition by meeting two of two performance indicators. and water vapor in and above the tropopause region and assess the interconnectedness of these changes through NASA achieved the annual performance goal with a retrospective modeling and data analysis rating of green. The SAGE III Ozone Loss and Validation Experiment (SOLVE) examined the processes controlling Results. Two separate documented theories, convective ozone levels at mid- to high latitudes, thereby enabling dehydration and slow ascent, appeared in publications. the improved prediction of ozone variability in an evolving future atmosphere. The joint endeavor between Data Quality. Peer-reviewed publication is the most SOLVE and the Euro-SOLVE component of the relied upon assessment of the validity of a scientific European Communities-sponsored Third European accomplishment. Stratospheric Experiment on Ozone (THESEO) 2000 campaign was the most comprehensive international field Data Sources. Some examples of journals that pub- measurement campaign ever conducted to examine the lished information about this indicator include: Dessler, frailties of the Earth’s stratospheric ozone layer. The A.E., The effect of deep, tropical convection on the trop- unprecedented measurement and analysis suite yielded ical tropopause layer, Journal of Geophysical Research, important information with which to project the future of 10.1029/2001JD000511, 2002. ozone chemistry and transport in an atmosphere with Holton, J.R., and A. Gettelman, 2000: Horizontal trans- increased abundances of greenhouse gases. This port and the dehydration of the stratosphere, Geophysical information is essential in developing an understanding of Research Letters, 28, 2799-2802. the nature and timing of the expected long-term recovery of the ozone layer as the abundances of ozone-destroying Annual Performance Goal 2Y14. Increase under- chemicals decrease in the atmosphere because of standing of global sea level and how it is affected by cli- international agreements. mate change by meeting at least two of three performance indicators. In addition, our understanding of the variability of temperatures, ozone concentrations, and water vapor in and NASA achieved the annual performance goal with a rat- above the tropopause region has greatly improved over ing of green. Ice sheet and glacier flow is responsible for the past year, and we expect significant progress on this nearly all of the ice loss in Antarctica and roughly half in problem to continue for the next few years. Greenland. Antarctica appeared very dynamic, losing ice in the west and gaining ice in other areas. In addition, data Indicator 1. Assess the possible impact of the increased suggested melting beneath floating ice shelves contribut- abundances of greenhouse gases on the future evolution ed substantially to the loss of ice in Antarctica. This of Northern Hemisphere high latitude ozone concentra- proved the most comprehensive assessment of the ice tion. Based on data from the SOLVE experiment sheet’s mass balance to date. Scientists also made progress in modeling ice stream behavior in Greenland Results. SOLVE data played an important role assessing using airborne radar data that sees into the ice. The tech- these impacts and in the polar ozone chapter of the 2002 nique uses new data in a new way, and identified a cause WMO/UNEP Scientific Assessment of Ozone Depletion. for enhanced sliding to be melting at the bottom of the ice These data also factored heavily in discussions at a March stream (more than 1 kilometer thick), possibly caused by 2002 international workshop on Arctic ozone loss. The heat from the Earth’s interior. Journal of Geophysical Research published a special issue of dedicated to the SOLVE results. The SOLVE Indicator 1. Map the surface velocities at their outlets of results factor heavily into the planning and implementa- at least 10 major outlet glaciers draining West Antarctica tion of SOLVE–2, which will occur in FY 2003 and be and at least 10 outlet glaciers draining East Antarctica heavily dedicated to SAGE III validation. and determine the positions where these glaciers start to

Part II • Supporting Data • Earth Science 157 float with a precision of 100 meters. Submit these maps climate changes on regional air quality by meeting at least for publication four of five performance indicators. Results. Researchers mapped the velocities in the north- NASA achieved the annual performance goal with a rat- ern part of the West Antarctic ice sheet, which showed ice ing of green. The Southern Hemisphere Additional losses. Mapping showed ice accumulated in the western Ozonesondes (SHADOZ) project continued its successful part. Ice in East Antarctica appeared in balance within the augmentation of balloon-borne launches and data archiv- certainty of measurements. In sum, the results suggested ing. SHADOZ will provide a profile climatology of trop- a net loss of ice in Antarctica, which is a result of the ical ozone while assisting in the validation and improve- velocities draining ice faster than precipitation accumula- ment of ozone profile data from satellite remote sensing tion replace it. In addition, scientists found that melting measurements. The latest data helped evaluate the current underneath the floating ice shelves in Antarctica is rough- concentration and possible trends in this atmospheric ly an order of magnitude greater than previously thought. region. With the rapid diminishment in methyl chloro- form abundance, trend data for new industrial chemicals Data Quality. Peer-reviewed publication is the most are being analyzed as potential new hydroxyl (OH) esti- relied upon assessment of the validity of a scientific mation gases. The completion of a coupled aerosol-chem- accomplishment. istry-climate model means processes can be evaluated in Data Sources. The journal Science published the exper- transient climate simulations. A new method assessing the iment findings (Rignot and Thomas), on August 30, 2002, amount of ozone brought from the stratosphere into the and in Annals of Glaciology (Rignot et al.) in troposphere at mid-latitudes more precisely computes an August 2002. exchange rate. Indicator 2. Compare new estimates of ice discharge of Indicator 1. Continue and extend the three year data 20 or more Antarctic glaciers with interior mass accu- record in order to build climatology of the high resolution mulation to provide the first estimates of mass balance vertical distribution of ozone in the tropics to improve the for their grounded ice catchments. Submit these esti- retrievals of tropospheric ozone concentrations based on mates for publication the residual products from space-based observations Results. NASA achieved the indicator. See indicator 1. Results. A recent announcement confirmed that the Data Quality. Peer-reviewed publication is the most SHADOZ Network received a favorable review. SHADOZ relied upon assessment of the validity of a scientific investigators participated in an international ozone sonde accomplishment. intercomparison to establish consistent standard operating procedures among ozone sonde researchers. Data Sources. The journal Science published the experiment findings on August 30, 2002 (Rignot and Thomas) Data Quality. Peer-reviewed publication is the most and in July 2002 (Rignot and Jacobs); they also appeared relied upon assessment of the validity of a scientific in Annals of Glaciology in August 2002 (Rignot et al.). accomplishment. Indicator 3. Establish a methodology for refining ice Data Sources. The SHADOZ project homepage pro- stream models based on radar sounding, surface velocity vides information on news, data, and collaborations: and surface topographic observations. Generate a techni- http://code916.gsfc.nasa.gov/Data_services/shadoz/. The cal report for peer review following journal article is in press: Results. Researchers derived a method for analyzing Thompson, A.M., et al., 1998-2000 SHADOZ (Southern radar-derived internal layering to determine flow charac- Hemisphere Additional Ozonesondes) Tropical Ozone teristics. Applying the method to the Northeast Greenland Climatology. 1. Comparisons with TOMS and Ground- Ice Stream led to the discovery of a very high geothermal based Measurements, Journal of Geophysical Research— heat source that is causing lubrication at the base of the Atmospheres, in press, 2002. ice sheet, enhancing sliding. Indicator 2. Archive and analyze data from the Data Quality. Peer-reviewed publication is the most TRACE-P airborne mission and associated data sets to relied upon assessment of the validity of a scientific characterize the atmospheric plume from East Asia and accomplishment. to assess its contribution to regional and global atmo- Data Sources. The results (Fahnestock et al.) appeared spheric chemical composition in the journal Science in December 2001 and the Journal Results. The files were archived and publicly released. of Geophysical Research in December 2001. A second workshop was held in June. A special session Annual Performance Goal 2Y15. Increase under- dedicated to the TRACE-P results was held at the fall standing of the effects of regional pollution on the global 2002 American Geophysical Union Meeting. Analyses atmosphere, and the effects of global chemical and are ongoing with draft manuscripts being developed. A

158 NASA FY 2002 Performance and Accountability Report peer-reviewed journal published the collection of model versions to 2000-2100 transient climate TRACE-P manuscripts. calculations is ongoing. These developments complete the essential model components in that all the critical Data Quality. Peer-reviewed publication is the most aerosol-chemistry-climate processes are represented in a relied upon assessment of the validity of a scientific single model and can be evaluated in 2000-2100 transient accomplishment. climate simulations. Data Sources. The Journal of Geophysical Research Data Quality. Peer-reviewed publication is the most published a special section containing the collection of relied upon assessment of the validity of a scientific TRACE-P manuscripts. accomplishment. Indicator 3. Estimate the tropospheric distributions of OH Data Sources. A general description and more than 20 and examine the consistency between inverse and publications related to this activity are located at assimilation models in determining global OH fields using http://www-as.harvard.edu/chemistry/trop/ids.html. multiple data sets; document via sub mission of one or more publications to peer-reviewed literature Indicator 5. Estimates of the stratospheric contribution to tropospheric ozone will be made through chemical Results. Earlier OH estimates provided information to transport and Lagrangian transport models. The update the latest AGAGE data. The results will appear in stratosphere-troposphere exchange included in these the 2002 international ozone assessment, as well as model calculations will be examined for its sensitivity to other publications. global warming Data Quality. Peer-reviewed publication is the most Results. A new method assessing the amount of ozone relied upon assessment of the validity of a scientific brought from the stratosphere into the troposphere at mid- accomplishment. latitudes more precisely computes an exchange rate using Data Sources. The AGAGE project homepage provides the Data Assimilation Office (DAO) meteorological prod- information on news, data, and collaborations are located ucts. These estimates are on the low side. Previous esti- at http://agage.eas.gatech.edu/. mates made using various models and much lower than tropospheric chemical transport model parameterizations. Examples of publications include: The findings are that the higher ozone transport in the Prinn et al., 2000: A History of Chemically and Northern Hemisphere is caused by the higher amounts of Radiatively Important Gases in Air deduced from ozone in the lower stratosphere in late winter compared ALE/GAGE/AGGE, Journal of Geophysical Research, with the Southern Hemisphere. The mass exchange is 105, 17,571-17,792. nearly equivalent in both hemispheres. Two-dimensional model work on the effect of increasing greenhouse gases Cunnold, D.M., R. F. Weiss, R. G. Prinn, D. E. Hartley, P. on stratospheric circulation and chemistry showed G. Simmonds, P.J. Fraser, B. R. Miller, F. N. Alyea, and increasing greenhouse gases speeds up the recovery in the L. Porter, GAGE/AGAGE measurements indicating upper stratosphere and slows the recovery in the lower reduction in global emissions of CCl3F and CCl2F2 in stratosphere because of a combination of circulation 1992-1994, Journal of Geophysical Research, 102, 1259- changes and the effect of temperature changes on the pho- 1269, 1997. tochemical production rates. Indicator 4. Simulate changes in atmospheric composi- Data Quality. Peer-reviewed publication is the most tion projected over the 21st century with a coupled relied upon assessment of the validity of a scientific aerosol-chemistry-climate general circulation model accomplishment. including projected changes in anthropogenic emissions. This model, which will include first-time parameteriza- Data Sources. The data source is Olsen et al., Journal tion of tropospheric aerosol chemistry, will help to diag- of Geophysical Research, 2002 (in press). nose the climatic consequences of these emissions and the associated feedbacks on atmospheric composition Strategic Objective 4. Identify the consequences of change in the Earth system for human civilization Results. A coupled aerosol-chemistry-climate model has been developed that incorporates detailed representations Annual Performance Goal 2Y16. Increase under- of gas-phase and aerosol chemistry into the standing of variations in local weather, precipitation and NASA/Goddard Institute for Space Studies (GISS) water resources and how they relate to global climate variation by meeting two of two performance indicators. general circulation model. Early applications of this model to future radiative forcing by tropospheric ozone NASA achieved the annual performance goal with a and aerosols in scenarios with 2,100 emissions were rating of green. This activity helped determine the effect reported in the Intergovernmental Panel on Climate of climate trends in the frequency, strength, and path of Change (IPCC) 2001 report. Application of this and other weather systems, which produce clouds and rain and

Part II • Supporting Data • Earth Science 159 replenish fresh water supplies. Progress was made with NASA Headquarters with the Global Modeling and data assimilation algorithms that assimilate TRMM data Analysis Program Manager. NASA Seasonal-to- into weather and climate models. The combination of Interannual Prediction Project (NSIPP) Climate Models: TRMM data and advanced modeling and data Progress on climate model predictions is located at assimilation system achieved measurable improvements http://nsipp.gsfc.nasa.gov/exptlpreds/exptl_preds_main.h in hurricane track forecast. tml. Goddard Cloud Resolving Model and TRMM data analysis: Progress on cloud model predictions and contri- Indicator 1. Characterize the interannual variations of bution to climate model studies is located at deep tropical convection utilizing existing and new satel- http://rsd.gsfc.nasa.gov/912/model/model.html. lite-based datasets to understand relations between large- scale surface and atmospheric forcing and tropical forc- Annual Performance Goal 2Y17. Increase under- ing and submit results for publication standing of the consequence of land cover and land use change for the sustainability of ecosystems and Results. Progress was made in using TRMM data to economic productivity by meeting at least two of three monitor convection and rainfall variations in the Tropics performance indicators. associated with El Niño/La Niña over the past 4 years. NASA achieved the annual performance goal with a The variations were used to relate to previous satellite rating of green. A book compiling the publications of the data used to analyze previous ENSO variations. case studies produced under the NASA Land Cover Land Data Quality. Peer-reviewed publication is the most Use Change Program is in its last stage of preparation. In relied upon assessment of the validity of a scientific particular, studies of patterns in land cover and land use accomplishment. changes in Amazon region allowed development of prediction scenarios and their evaluation. The scientific Data Sources. The variability of South American con- network in the Amazon region is one example of the vective cloud systems and tropospheric circulation global science network system that international projects, between January and March of 1998 and 1999 appeared such as the Global Observation of Forest Cover and Land in a paper submitted for publication in the Monthly cover dynamics, are developing. Along with the well- Weather Review. A peer-reviewed paper in the Journal of established networks in Africa and Asia, new networks, Geophysical Research documented the impact of sub- such as in Russia, produced new links and contributed to monthly variability of the South Atlantic convergence the study of land cover and land use change. zone on convection over the Southern Amazon Basin. Indicator 1. Release a document describing the first set of Publications include: Curtis, S., R. Adler, G. Huffman, D. regional land cover and land use change case studies and Bolvin, and E. Nelkin, 2001: Global precipitation during providing a synthesis of their results the 1997-98 El Niño and initiation of the 1998-99 La Niña. International Journal of Climatology 21, 961-971. Results. NASA achieved this indicator. A book in preparation is based on publications from several projects Adler, R.F., C. Kummerow, D. Bolvin, S. Curtis, C. Kidd, including (1) Landscape Dynamics and Land-Use Land- 2002. Status of TRMM Monthly Estimates of Tropical Cover Change in the Great Basin-Mojave Desert Region, Precipitation, Meteorological Monographs, Symposium (2) Regional NPP and Carbon Stocks in Southwestern on Cloud Systems, Hurricanes and TRMM (in press). USA Rangelands: Land-use Impacts on the Grassland- Indicator 2. Demonstrate impact of assimilation of Woodland Balance, (3) Developing Land Cover Scenarios TRMM rainfall data on forecasting track and intensity of in Metropolitan and Non-Metropolitan Michigan, USA: tropical storms by showing improvement in near real- A Stochastic Simulation Approach. time hurricane and typhoon forecasts in a variety of Data Quality. Peer-reviewed publication is the most cases and conditions relied upon assessment of the validity of a scientific accomplishment. Results. The use of TRMM rainfall data in numerical models improved hurricane track forecasting in Goddard Data Sources. The publication list is provided in the Space Flight Center (GSFC) case studies. Experiments results section of annual performance goal 2Y8, indicator 1. at Florida State University also indicated positive impact of rainfall information on track forecasts. A manuscript Indicator 2. Develop models incorporating the bio- is in preparation. physical, socio-economic, institutional, and demographic determinants of land use and land cover Data Quality. Peer-reviewed publication is the most change in Amazonia relied upon assessment of the validity of a scientific accomplishment. Results. Progress on this indicator followed from the results of LBA-ECO Program. The team successfully ana- Data Sources. Peer-reviewed scientific literature docu- lyzed parts of the Amazon and extracted statistically inde- mented the results. The citations are available on file at pendent predictors of land use and land cover change. In a

160 NASA FY 2002 Performance and Accountability Report separate project, researchers used differences in soil qual- suspended solids in these coastal areas and efforts to ity to explain important differences in rates of secondary correct for the atmospheric component in ocean color succession across regions. Further, the team developed and signals when viewing coastal regions made the tested a fractional cover algorithm, and assessed availabil- improvements possible. ity of other algorithms for project products. Indicator 1. Increase the coverage of space-based maps Data Quality. Peer-reviewed publication is the most of coral reef distribution by 25 percent beyond current relied upon assessment of the validity of a scientific estimates using remotely sensed imagery accomplishment. Results. In achieving this indicator, NASA and NOAA Data Sources. Some examples of journals that pub- investigators generated 1-kilometer maps of potential lished informatoin about this indicator include: Laurance, coral reef habits using SeaWiFS data. The investigators W. F.,Albernaz, A. K. M. and Da Costa, C., 2001: Is compared previous coral reef maps to produce a more deforestation accelerating in the Brazilian Amazon? accurate assessment of spatial extent and geographic Environmental Conservation. 28, 305-311. location of these reefs. In addition, the purchase of IKONOS—a hyperspatial satellite sensor—imagery Moran, E.F. et al. Effects of soil fertility and land use on through our Landsat data buy program permitted NOAA forest succession in Eastern Amazonia, Brazil. Forest investigators to map coral reefs at a higher spatial resolu- Ecology and Management. (In press) tion with improved classification algorithms. Indicator 3. Enable the scientific interchange of data, methods, and results through the operation of regional Data Quality. Peer-reviewed publication is the most networks of scientists in four major regions of the world relied upon assessment of the validity of a scientific accomplishment. Results. In FY 2002, three regional networks were enhanced and the Russian network was established. The Data Sources. The following is an example of a journal fire-monitoring network is being formed, and the land that published information about the indicator: Robinson, cover network will be formed soon. The NASA Scientific J., A. Spraggins, K.P. Lulla, S. Andréfouët, G.C. Feldman, Data Purchase Program acquired a series of images for N. Kuring, J.K. Oliver, M. Noordeloos, J.C. Brock, J. Central Africa and distributed them to in-country collab- Gebelein, E.P. Green, M.D. Spalding, R.P. Stumpf, S.O. orators in order to implement local-scale land cover map- Rohmann, and M. Atkinson, 2002: Distributing reef maps ping activities. The proposed development of the regional to resource managers: bridging the gap between detailed information network will help integrate all extant data remote sensing mapping and global applications. Seventh sets into the framework of Global Observation of Forest International Conference on Remote Sensing for Marine Cover. The network will synthesize and update the and Coastal Environments, Miami, FL. May 20-22, 2002. region-specific requirements for observations and prod- Indicator 2. Develop an improved algorithm for retrievals ucts, work with government agencies to improve access to of ocean color information from remotely sensed obser- data, and help coordinate regional research agendas with vations of turbid coastal systems (i.e., Case 2 water) global remote sensing community. Results. Ocean color data in turbid coastal waters, Data Quality. Peer-reviewed publication is the most improved atmospheric correction, and in-water algo- relied upon assessment of the validity of a scientific rithms provided improved algorithms. A better under- accomplishment. standing of the optical properties in these highly hetero- Data Sources. See the LCLUC Web site for the project geneous waters and more studies of these coastal areas description and publications: http://lcluc.gsfc.nasa.gov/. contributed to these improvements.

Annual Performance Goal 2Y18. Increase under- Data Quality. Peer-reviewed publication is the most standing of the consequences of climate and sea level relied upon assessment of the validity of a scientific changes and increased human activities on coastal accomplishment. regions by meeting two of two performance indicators. Data Sources. Some examples of journals that pub- NASA achieved the annual performance goal with a lished information about this indicator include: Chomko, rating of green. Our remote sensing ability in coastal R.M., H.R. Gordon, S. Maritorena, and D.A. Siegel, regions improved in FY 2002. NASA and commercial 2002. Simultaneous determination of oceanic and atmo- remote sensors mapped coral reef and they made a spheric parameters for ocean color imagery by spectral substantial effort to map them at smaller spatial scales. optimization: A validation. Remote Sensing of The fluorescence line-height measurements from both Environment, (in press). Terra and Aqua MODIS instruments provided a method for separating living phytoplankton from non-living Ransibrahmanakul, V. and R.P. Stumpf. 2001. Refining particles. New numerical techniques for retrieving SeaWiFS Vicarious Calibration Using Spectra Slopes.

Part II • Supporting Data • Earth Science 161 American Geophysical Union, 2001 Fall Meeting. San Data Sources. The data used were simulated using Francisco, CA, December 10-14, 2001. actual satellite-based measurements and field-experiment-based measurements of cloud properties and Toole, D.A., and D.A. Siegel, 2001: Modes and mecha- aerosols. nisms of ocean color variability in the Santa Barbara Channel. Journal of Geophysical Research, 106; Indicator 3. Develop new analysis methods that integrate 26,985-27,000. global observations from the complete suite of satellite (and conventional) weather measurements into a single, Strategic Objective 5. Enable the prediction of self-consistent analysis of water-related phenomena (dia- future changes in the Earth system batic heating by radiation and precipitation, water vapor and clouds, inference of water and energy fluxes and Annual Performance Goal 2Y19. Increase under- transports). This development provides for developing standing of the extent that weather forecast duration and requirements for new satellite sensors and new data reliability can be improved by new space-based observa- assimilation techniques tions, data assimilation and modeling by meeting at least two of three performance indicators. Results. Information from multiple instruments on TRMM (microwave and infrared) was combined using a NASA achieved the annual performance goal with a rat- new algorithm to estimate longwave, shortwave, and ing of green. This activity improved the accuracy of short- latent heat fluxes and compared to top of atmosphere term weather predictions and increased the period of radiative fluxes from the TRMM CERES instrument. validity of long-range forecasts for government, business, Additional analysis will be needed. and individuals to help them protect lives and property and make investment decisions. Data Quality. Peer-reviewed publication is the most relied upon assessment of the validity of a scientific Indicator 1. Determine tropical mean convection struc- accomplishment. ture (fraction of convective vs. stratiform rainfall) for the first time using TRMM’s first three years of data and sub- Data Sources. Some examples of journals that pub- mit results for publication lished information about this indicator include: Report on monitoring the Earth’s energy Budget in the Results. Researchers determined the fraction of rain that is TRMM/GPM Era Presentation at TRMM International convective and the fraction that is stratiform using TRMM Science Conference, Honolulu, HI. data. They submitted their findings for publication. L’Ecuyer and G. Stephens, 2002: Monitoring the Earth’s Data Quality. Peer-reviewed publication is the most energy budget in the TRMM/GPM Era Presentation at relied upon assessment of the validity of a scientific TRMM International Science Conference, Honolulu, HI. accomplishment. Annual Performance Goal 2Y20 Increase under- Data Sources. Report on stratiform rain in the tropics as standing of the extent that transient climate variations can seen by the TRMM Precipitation Radar. Journal of Climate be understood and predicted by meeting at least four of (submitted): Schumacher, C. and R. A. Houze, Jr., 2002. five performance indicators. Indicator 2. Define the quantitative requirements for new NASA achieved the annual performance goal with a operational sensors, including space-based tropospheric rating of green. This activity contributed to the ability to winds through participation in inter-agency Observing predict global and regional climate on seasonal-to- System Simulation Experiments (OSSE) interannual time scales with sufficient accuracy for concerned socioeconomic interests. The predictions Results. NASA DAO, NESDIS (National Environmental helped people estimate the likely impact of climate Satellite, Data, and Information Service/NOAA), and variations, such as those associated with El Niño/La Niña, NCEP (National Centers for Environmental Prediction/ and issue warnings and make appropriate contingency NOAA), conducted a series of Observing System plans. NASA developed coupled land-atmosphere-ocean Simulation Experiments. The organizations defined model capabilities, and produced and contributed the requirements for Global Tropospheric Wind Sounding model forecasts to national and international (GTWS). In addition, new meteorological metrics of organizations with planning and warning responsibilities. OSSE have direct importance to the public, the economy, Team members published their findings in peer review and the Government. In particular, the potential effect of journals describing the analysis and diagnosis of climate GTWS and other advanced sounders was evaluated with variations using NASA Seasonal-to-Interannual Pre- respect to landfall of hurricanes, and the prediction of diction Project model data. intense extra tropical cyclones such as northeasters. Indicator 1. Document in the peer-reviewed literature the Data Quality. The outcomes reported accurately reflect quantified impact of satellite altimeter observations on performance and achievements in FY 2002. improving 12-month El Niño forecasts with a state-of-the-

162 NASA FY 2002 Performance and Accountability Report art coupled ocean-atmosphere-land model by comparing on many aspects of the performance of the coupled model predictions initialized with in-situ data and both model, the forecasts, and the ocean assimilation to incor- with and without satellite altimeter data porate satellite altimetry data. Results. C.L. Keppenne and M.M. Rienecker wrote Data Quality. The science outcomes accurately reflect “Multivariate assimilation of altimetry into an OGCM performance and achievements in FY 2002. with diagnostic sea surface height using the ensemble Kalman filter,” documenting assimilation of altimeter Data Sources. The NSIPP experimental predictions are data into the ocean model used for NSIPP forecasts. In available at http://nsipp.gsfc.nasa.gov/exptlpreds/exptl_ addition, an improved ocean model solved problems in preds_main.html. the eastern Pacific. Progress was made in using altimetry The experimental data allowed the NSIPP science team to initialize ensembles of coupled ocean-atmosphere fore- members to analyze model prediction results, study the casts. A lack of knowledge of mean sea level hampered model behavior, and provide suggestions to the core improvement over conventional data. This is being model development team. addressed through bias correction techniques. Indicator 3. Estimate and document potential predictabil- Data Quality. The results appeared in the proceedings of ity, based on multi-year reanalysis data and modeling, of the Symposium on Observations, Data Assimilation and regional climate variability in order to evaluate the rela- Probabilistic Prediction (Keppenne and Rienecker), January tive contributions of seasonal-to-interannual and decadal 13-17, 2002, 158-163, American Meteorological Society. climate variability on specific regions, with a focus on Data Sources. The forecasts related to experimental occurrence of major floods and droughts in North seasonal climate predictions are located at http://nsipp. America and the Asian-Australian monsoon regions gsfc.nasa.gov/exptlpreds/exptl_preds_main.html. Results. An ensemble of 70-year NSIPP atmospheric The improved atmospheric model climatologies are simulations with observations, including the upper level located at http://nsipp.gsfc.nasa.gov/research/atmos/ winds from the NCEP/U.S. National Center for Atmos- descrip/atmos_descr.html. pheric Research (NCAR) reanalysis, provided the basis for an assessment of the predictability and causes of long- Coupled and component model simulations are available term (decadal) drought over the U.S. Great Plains. through http://nsipp.gsfc.nasa.gov/data_req/data_req_ Researchers confirmed a link to tropical Pacific sea main.html. surface temperature (SST). However, predictability associated with SST proved modest with about two-thirds Indicator 2. Contribute to national seasonal forecasts by of the signal related to interactions with soil moisture. delivering ensembles of forecast products (for example, The Journal of Climate received a paper submission surface temperature, precipitation, upper level winds) to describing these results. Operational agencies (for example, NCEP, International Research Institute (IRI)). Forecasts with and without the Data Quality. Peer-reviewed publication is the most use of satellite-based data will be used to document the relied upon assessment of the validity of a scientific impact of such remotely sensed data on forecast quality accomplishment. Results. NASA’s Seasonal-to-Interannual Prediction Data Sources. Publications include: Schubert, S., M. J. Project delivered forecast products (surface temperature, Suarez, P. Pegion and M. Kistler, and A. Kumar, 2002: precipitation, upper level winds) on a monthly basis to Predictability of Zonal Means During Boreal Summer, NCEP/Climate Prediction Center (for example, http:// Journal of Climate 15, 420-434. www.emc.ncep.noaa.gov/cmb/atm_forecast/consortium/ intro.html), the IRI (for example, http://iri.columbia.edu/ A list of other peer-reviewed publications is available at forecast/climate/), and NOAA/Centers for Disease Con- http://nsipp.gsfc.nasa.gov/pubs/pubs_main.html. trol and Prevention. The experimental predictions are Indicator 4. Develop, implement, and document advanced located at http://nsipp.gsfc.nasa.gov/exptlpreds/exptl_ cloud radiation and moist physics schemes in NASA cli- preds_main.html. The Asia-Pacific Climate Network also mate models, and validate them against remotely-sensed uses these forecasts on a quarterly basis. NASA’s esti- radiation data, in order to improve overall skill of climate mates of satellite-based surface winds, AVHRR sea model simulations of the global energy and water cycles surface temperature, and SeaWiFS data sets were used. NSIPP made substantial advances in improving the Results. Cloud resolving (processes) model simulations model forecast with improved models and began using provided a better understanding of precipitation efficien- satellite altimetry data for initializing and validating cy and surface energy budget associated with convection model-skills. Ensemble forecasts assessing the forecast developed over very different geographic locations (that reliability over the past 8 years represented a major is, South China Sea, West Pacific Ocean, East Atlantic advancement. Other achievements included progress was Ocean, Mid-U.S.A.). Researchers used the simulations to

Part II • Supporting Data • Earth Science 163 examine and verify the hypothesis associated with dictability on longer timescales associated with long-term climate variations to show that the convective momentum drought conditions over the U.S. Great Plains. The NSIPP transport processes and their interaction with ocean sur- 2001 contained information on altimetry assimilation. face is responsible for simulating different tropical cli- The annual report is available at http://nsipp.gsfc.nasa. mate regimes. The simulations also allowed them to gov/pubs/pubs_main.html and in the American Meteor- demonstrate that the microphysics and its interaction with ological Society Proceedings. Other results listed above radiation cannot alter the simulated tropical climate appeared in several published papers in peer-reviewed regime (from warm to cold), but it can change the degree scientific literature. The citations are available on file at of climate (from warm to warmer). NASA Headquarters with the Global Modeling and Analysis Program Manager. Data Quality. Peer-reviewed publication is the most relied upon assessment of the validity of a scientific The research results from the lightning measurements are accomplishment. available on the Internet at the Global Hydrology and Data Sources. The following is an example of a journal Climate Center. that published information about the indicator: Tao, W.K., Annual Performance Goal 2Y21. Increase under- Y. Wang, J. Qian, W. K.M. Lau, C.L. Shie, and R. Kakar, standing of the extent that long-term climate trends can 2002: Mesoscale Convective Systems during SCSMEX: be assessed or predicted by meeting at least four of five Simulations with a Regional Climate Model and a Cloud- performance indicators. Resolving Model, INDO-US Climate Research Program, (in press). NASA achieved the annual performance goal with a rating of green. NASA made progress in several areas this Indicator 5. Use multiyear satellite observations of light- year. Activities concentrated at NASA GISS. Many jour- ning to assess the relationship of strong convection to nals published quantitative analyses of climate forcings interannual climate variations (for example, El Niño and and climate change trends. We again led the world in La Niña), and use as proxy data to assist in evaluating increasing the understanding of the forcing and trend of model representation of convective precipitation. the long-term climate. Document results Indicator 1. Monitor global tropospheric and strato- Results. The Optical Transient Detector and Lightning spheric temperatures, to validate climate model simula- Imaging Sensors on low-Earth orbiting satellites enabled tions, and to improve understanding of the relationship multi-year observations of global lightning distributions. between surface and upper-air temperatures in a chang- The study found lightning varies seasonally and is pri- ing climate system. Document results marily related to storms containing ice particles. NASA used high-altitude aircraft and observations from the Results. GISS research found the observed stratospheric Space Shuttle, as well as recent unmanned aerial vehicle cooling and tropospheric warming consistent with and measurements to gain understanding of the complicated accounted for by known climate forcings, especially micro-physical and electrical processes involved with the changes in carbon dioxide, ozone, and stratospheric water discharges. NASA advances in the last 5 years improved and aerosols. All of the results listed in this annual per- quantitative understanding of the Earth’s electrification formance goal appeared in several published papers in more than the previous 100 years of more limited storm- peer-reviewed scientific literature. scale research. The study established the relationship between lightning flash rate and precipitation rate of con- Data Quality. Peer-reviewed publication is the most vective storms and led researchers to the conclusion that relied upon assessment of the validity of a scientific lightning rate can be a proxy for precipitation rate under accomplishment. certain circumstances. The relationships to longer-time- Data Sources. The citations are available on file at scale events such as El Niño and La Niña are under study. NASA Headquarters with the Global Modeling and It will take many years of continuous lightning monitor- Analysis Program Manager. Progress on climate modeling to establish the relationship to a process as slowly ing is located at http://www.giss.nasa.gov/research/ varying as El Niño. modeling/. GISS climate data is available at http://www. Data Quality. Peer-reviewed publication is the most giss.nasa.gov/data/. relied upon assessment of the validity of a scientific Indicator 2. Quantify and document the likely contribu- accomplishment. tions of different climate forcings (greenhouse gases, Data Sources. The Journal of Atmospheric Science ozone, water vapor, solar irradiance) to observed published the improved NSIPP atmospheric model. The long-term trends of the Arctic Oscillation. The Arctic Journal of Climate published information on seasonal Oscillation has practical significance as it affects the geo- predictability for boreal summer. The Journal of Climate graphical patterns of climate variability and change in received a paper for publication concerning the pre- the troposphere

164 NASA FY 2002 Performance and Accountability Report Results. NASA GISS made quantitative analyses of this Indicator 5. Make quantitative comparisons of the ability problem including investigation of the roles of specific of alternative ocean modeling treatments to simulate cli- forcings one-by-one. A peer-reviewed professional jour- mate variability and change on interannual to century nal documented this. Another paper describing the role of time scales. Document results volcanic aerosols in greater depth is in preparation. Evidence showed that the well-mixed greenhouse gases, Results. GISS compared the results of simulations with especially carbon dioxide, ozone, stratospheric water, and observed SSTs, Q-flux oceans, and dynamic oceans. The solar irradiance changes, contributed to changes in the comparisons provided a better understanding of these dif- Arctic Oscillation. ferent ocean representations, offered insight for ways to improve them, and conclusions about the physical world, Data Quality. Peer-reviewed publication is the most including the fact that the Earth was out of radiation bal- relied upon assessment of the validity of a scientific ance with space in 1951 by about 0.18 w/m2. Journals accomplishment. published the finding. Data Sources. See indicator 1. Data Quality. Peer-reviewed publication is the most relied upon assessment of the validity of a scientific Indicator 3. Quantify and document the degree to which accomplishment. the stratosphere and mesosphere need to be incorporated and resolved in climate models to realistically simulate Data Sources. See indicator 1. interannual and decadal climate variability and change in the troposphere Annual Performance Goal 2Y22. Increase understanding of the extent that future atmospheric chemical Results. We achieved this indicator using climate mod- impacts on ozone and climate can be predicted by meet- els that simulated the effect of various climate forcings ing at least two of three performance indicators. extending from the upper atmosphere to at least to the top NASA achieved the annual performance goal with a rat- of the stratosphere. GISS investigated the potential of ing of green. Newly evaluated data and the latest industry stratospheric models of intermediate complexity, that is, reports contributed to formulating emission scenarios for with efficient representations of stratospheric drag and the 2002 international ozone assessment. The Global without including the mesosphere. GISS showed that Modeling Initiative incorporated the latest set of data and such efficient models, which could readily be included as improved the atmospheric models. The latest version of part of nominally tropospheric climate models, are able to the model provided a simulation of 35 years of strato- simulate well the interannual variability of stratospheric spheric ozone, from 1995 to 2030. temperatures and winds, but it remains to be determined whether they can simulate well long-term climate change Indicator 1. Analyze the measured trends in atmospher- mechanisms involving the stratosphere. ic trace gas concentrations and compare with those estimated from industrial production and emission data. Data Quality. Peer-reviewed publication is the most Analysis will be used to assess the completeness of our relied upon assessment of the validity of a scientific understanding of the atmospheric persistence and accomplishment. degradation of industrial chemicals as well as to exam- Data Sources. See indicator 1. ine the efficiency of current regulatory agreements and international reporting on the production and emissions Indicator 4. Quantify and document the role of different of regulated chemicals forcings (greenhouse gases, ozone, water vapor, solar irradiance, stratospheric and tropospheric aerosols) and Results. The latest AGAGE data, industry reports of unforced (chaotic) variability in determining the evolu- halocarbon production, and industry models of release tion of global climate over the past 50 years, to develop from product applications assisted in formulating emission confidence in quantitative model predictions of future scenarios for the 2002 international ozone assessment. climate change Data Quality. Peer-reviewed publication is the most Results. In the last 50 years, much of the global temper- relied upon assessment of the validity of a scientific ature variation at the surface, in the troposphere, and in accomplishment. the stratosphere, was associated with anthropogenic and natural climate forcings, especially greenhouse gases and Data Sources. The AGAGE project homepage provides volcanic aerosols. information on news, data, and collaborations: http://agage.eas.gatech.edu/. Data Quality. Peer-reviewed publication is the most relied upon assessment of the validity of a scientific Publications include: Prinn et al., 2000: A History of accomplishment. Chemically and Radiatively Important Gases in Air deduced from ALE/GAGE/AGGE, Journal of Data Sources. See indicator 1. Geophysical Research, 105: 17,571-17,792.

Part II • Supporting Data • Earth Science 165 Indicator 2. Conduct laboratory studies designed to Strategic Objective 1. Demonstrate scientific and assess the atmospheric fate of new industrial chemicals technical capabilities to enable the development by characterizing the key photochemical processes of practical tools for public and private-sector responsible for their atmospheric breakdown decision makers Results. Experiments at several NASA-funded laborato- Annual Performance Goal 2Y23. Provide regional ries yielded data used in the NASA Panel for Data decision-makers with scientific and applications products Evaluation. Modelers who performed calculations associ- and tools. ated with the 2002 international ozone assessment used The results of this annual performance goal and its asso- the database. ciated indicators are located in the Highlights of Data Quality. The NASA Panel for Data Evaluation Performance Goals and Results segment of Part I. included members of the science community. Peer review is the most relied upon assessment of the validity of a sci- Strategic Objective 2. Stimulate public interest in entific accomplishment. This report is a source of data for and understanding of Earth system science and modelers participating in international assessments encourage young scholars to consider careers in including UNEP/WMO and IPCC. science and technology Data Sources. The NASA Panel for Data Evaluation’s Annual Performance Goal 2Y24. Stimulate public interest in and understanding of Earth system science report is located at http://jpldataeval.jpl.nasa.gov/. and encourage young scholars to consider careers in sci- Indicator 3. Continue the implementation of the Global ence and technology. Modeling Initiative (GMI) to provide metrics, bench- NASA achieved the annual performance goal with a rat- marks and controlled numerical experiments for model ing of green. NASA promoted public understanding of and algorithm simulations performance, which will allow the Earth system and collaborated with educational insti- the development of standards of model behavior for par- tutions. A wide array of learning venues attended by both ticipation in assessment exercises adults and students used our extensive resources, includ- Results. The GMI incorporated the latest set of fields ing our 14 orbiting observing platforms, content, data, generated by the NASA DAO at Goddard Space Flight and expertise. Center. The initiative updated the previous stratospheric Indicator 1. Release at least 50 stories per year that model. A team of investigators at NASA Goddard, NASA cover scientific discoveries, practical benefits or Langley, and University of Miami analyzed the results of new technologies simulation behavior in comparison to satellite and aircraft data. The findings helped define further metrics for satis- Results. NASA achieved this indicator, releasing 112 factory model behavior. The initiative also integrated a tro- science stories, forty-two 90-second radio stories, and 70 pospheric version of the model, and incorporated the latest news releases. More than 3.3 million Americans heard advances in dry and wet deposition schemes, calculation each radio story. Americans also read, saw, or heard 60 of photolysis rates, and emission inventories. A team of percent of the 70 news releases. The rest of the world read, investigators is examining these results in comparison to saw, or heard about 30 percent of the releases through ground-based observations. This analysis will establish newspapers, magazines, radio, television, and the Internet. performance metrics for tropospheric models in compari- Data Quality. Radio broadcast fellowship grant reports son to available data, and will reduce uncertainties in the (monthly and annual) helped validate these sources. prediction of anthropogenic activities such as aircraft and industrial emissions. Data Sources. An internal report and annual and monthly grant reports provide story tracking. Data Quality. Peer-reviewed publication is the most relied upon assessment of the validity of a scientific Indicator 2. Sponsor assistance to at least 2 leading accomplishment. undergraduate institutions to develop courses that enable pre-service science educators to become proficient in Data Sources. Results are located at a password- Earth system science restricted FTP site at Livermore: http://esg.llnl.gov. Results. NASA achieved this indicator, sponsoring eight undergraduate institutions, three of which are principal More publications related to the initiative are located at sources for educators to create and/or deploy Earth sys- http://www.giss.nasa.gov/gpol/abstracts/1999/Douglass_ tem science courses targeted to undergraduates with Prather.html. majors or minors in science education or for master’s degree students in education. Strategic Goal 2. Expand and accelerate the realization of economic and societal benefits from Data Quality. An independent panel of experts reviewed Earth science, information, and technology grant reports.

166 NASA FY 2002 Performance and Accountability Report Data Sources. The courses are documented in our exceeded all of its metrics. The EO–1 Program continued online database and in annual grant reports from Earth its technology validation mission while refocusing some System Science Education Alliance and NOVA online, of its technology validation observations to serve other and the EdCats online database. post-September 11 national interests. The technology development element ensured the selection, development Indicator 3. Continue to train a pool of highly qualified and adoption of technologies, which will enable mission scientists and educators in Earth science and remote success and serve national priorities. In FY 2002, this sensing by sponsoring approximately 140 fellowships (50 program advanced 41 percent of these technologies by at of which are new) and a total of 30 New Investigator least one technology readiness level (TRL). Aircraft sci- Program awards ence campaigns, space flight missions, and ground sys- Results. We continued to train the next generation of tem information processing benefitted from technology Earth system scientists, sponsoring 149 graduate student infusion. New measurements enhanced the performance fellows, 52 new awardees, and 41 New Investigator of an existing measurement. The EO–1 mission success- awards (25 of which were new). fully demonstrated the use of a hyperspectral (hundreds of spectral) instrument from space for both technology Data Quality. Responsible organizing officials verified validation, science, and national priorities. sponsorships. Data Sources. Next Generation Earth System Scientists Indicator 1. Annually advance 25 percent of funded technol- is located at http://research.hq.nasa.gov/code_y/nra/cur- ogy developments one TRL rent./Fellowship-ESS02/winners.html. Results. We surpassed the indicator target; 41 percent of Indicator 4. Work with at least one professional society to funded technology development projects advanced at develop content standards for professional practice of least one TRL in FY 2002. Earth remote sensing Data Quality. Data quality used for these metrics proved Results. NASA sponsored the National Space Grant accurate and reliable because the results underwent review Consortium, which addressed the foundation knowledge and external scrutiny throughout the development process. and concepts needed for professional practice of Earth Project executives at Earth Science Technology Office remote sensing (land, air, water, and life). The workshop (ESTO) maintain the assessment database, which is acces- constituted the initial steps in identifying a basic sible to all internal NASA project managers and program competency in the professional practice of Earth remote scientists and to others authorized outside NASA. sensing. A report from this workshop will be available in early FY 2003. Data Sources. Data sources for this assessment include Data Quality. The science outcomes accurately reflect formal reports from project managers, reviews held at sci- performance and achievements in FY 2002. ence and technology workshops, and an annual assessment conducted by the ESTO program manager. Other Data Sources. The data source is the Professional sources include the results of competitive solicitations in Practice Content Standards: Notes and minutes from the which NASA-developed technologies are considered for Space Grant Consortium workshop. The formal report use in instrument and mission concepts and annual inde- will appear in FY 2003. pendent reviews held with the Technology Subcommittee of the Earth Systems Science and Applications Advisory Strategic Goal 3. Develop and adopt advanced Committee. Web information on each project is available technologies to enable mission success and serve at http://esto.gsfc.nasa.gov/ for ESTO and at http://nmp. national priorities jpl.nasa.gov/index_flash.html for the New Millennium Strategic Objective 1. Develop advanced tech- Program. Individual project details can be found through nologies to reduce the cost and expand the capa- those Web pages. bility for scientific Earth observation Indicator 2. Mature 2-3 technologies to the point Annual Performance Goal 2Y25. Successfully devel- where they can be demonstrated in space or in an op and infuse technologies that will enable future science operational environment measurements, and/or improve performance and reduce the cost of existing measurements. Increase the readi- Results. Two Instrument Incubator Program projects ness of technologies under development, advancing flew successfully on Convection And Moisture them to a maturity level where they can be infused into EXperiment-4: Second Generation Precipitation Radar new missions with shorter development cycles. and High Altitude Monolithic Microwave Integrated NASA achieved the annual performance goal with a rat- Circuit Sounding Radiometer. The Low Power Trans- ing of green. FY 2002 proved a productive year for the ceiver (LPT) will fly on STS-107 and the Air Force Earth Science Technology component, which met or Research Laboratory’s XSS-11.

Part II • Supporting Data • Earth Science 167 NASA selected LPT as a constellation cross-link commu- Data Sources. See the Earth System Modeling nication device for the AFRL TechSat 21 mission. Framework Web site at http://www.esmf.ucar.edu for more information and for progress relative to their milestones. Data Quality. See indicator 1. Indicator 2. Finalize Earth science multidisciplinary, Data Sources. See indicator 1. integrated Modeling Framework requirements by holding Indicator 3. Enable one new science measurement capability successful system design review or significantly improve performance of an existing one Results. This indicator was not achieved. Three teams led by NCAR, Massachusetts Institute of Technology Results. The Hyperion high-resolution hyperspectral (MIT), and NASA Goddard were awarded cooperative imager provided a new class of Earth observation data for agreements to develop jointly an Earth System Modeling improved Earth surface characterization through the reso- Framework. A successful workshop on community lution of surface properties into hundreds of spectral requirements definitions was held and a document for the bands compared with the 10 multispectral bands flown on Earth System Modeling Framework was widely circulat- traditional Landsat imaging missions. ed for public comment. The teams completed their initial Data Quality. See indicator 1. software engineering milestone and application milestone. A peer review of the framework architecture defi- Data Sources. See indicator 1. nition document was scheduled to be completed in August 2002. It is behind schedule by about 2 months. Strategic Objective 2. Develop advanced informa- The expected completion date is in the first quarter tion technologies for processing, archiving, of FY 2003. accessing, visualizing, and communicating Earth science data The Computational Technologies Investigator teams developing an Earth System Modeling Framework have Annual Performance Goal 2Y26. Develop hard- completed initial requirements definition for the frame- ware/software tools to demonstrate high-end computa- work, but have not completed the peer review of the tional modeling to further our understanding and ability to framework design scheduled for August 2002. predict the dynamic interaction of physical, chemical, and biological processes affecting the Earth. Data Quality. See indicator 1. The overall assessment for this annual performance goal Data Sources. See indicator 1. is red. We developed a modeling test bed for Earth Annual Performance Goal 2Y27. Develop baseline Science modeling challenges. World-class coupled cli- suite of multidisciplinary models and computational tools mate models are running on the test bed system. A mea- leading to scalable global climate simulations. surable increase in productivity was documented. However, the design of Earth Science Modeling NASA received a rating of red for this annual perfor- Framework, which has the ambitious goal of uniting the mance goal. Because of delays in releasing the Nation’s climate model software infrastructure, is about Computational Technologies Cooperative Agreement one quarter behind schedule. We plan to make up with the Notice (CAN) and the awarding of investigations from schedule in the next year. this notice, work in response to these indicators is 1 year out of phase. NASA expects to achieve some of the indi- Indicator 1. Successfully establish networked high cators in FY 2003. performance computer test bed for Earth science modeling challenges Indicator 1. Attain a three time improvement over negotiated baseline for three to eight Earth science modeling codes Results. NASA installed two high-performance transferred to the high performance computer test bed computer test beds to address Earth science modeling. A 1024-processor Silicon Graphics Origin 3000 entered Results. This indicator was not achieved because of production service at NASA Ames Research Center delays in the release of the Computational Technologies (ARC). A 440-processor Compaq began production at CAN, and the awarding of investigations from this notice. NASA GSFC. The ARC system is heavily used by the Work in response to these indicators is 1 year out of Computational Technology Grand Challenge Round 3 phase. NASA chose 7 investigator teams from 58 respon- Investigators for advanced Earth and Space modeling dents to the Cooperative Agreement Notice. NASA gave studies. The GSFC system is used by the NSIPP for awards to NCAR, MIT, and NASA Goddard for an Earth climate change and variation studies. System Modeling Framework, to UCLA for Expanding Interoperability in Atmospheric-Ocean Dynamics and Data Quality. Information about the ARC system is avail- Tracer Transports, to NASA Goddard for Land able at http://www.nas.nasa.gov. Information about the Information System and for Infrastructure for Public GSFC system is available at http://esdcd.gsfc.nasa.gov. Health and Environment Forecasting, and to the Jet

168 NASA FY 2002 Performance and Accountability Report Propulsion Laboratory for Numerical Simulations for Results. NASA developed, launched, and operated the Active Tectonic Processes: Interoperability and Jason, SAGE, Aqua, and GRACE missions. Performance. All teams were under contract by March Data Quality. NASA maintained a mission status list 2002. Fourteen milestones were accomplished on the updated and reported on monthly at the Headquarters negotiated schedules of the teams working toward these Center Program Review. code demonstrations. However, because of the lateness of the awards, these teams are not scheduled to achieve their Data Sources. A list of all Earth Science launches is code demonstration milestones until the fourth quarter located at http://gaia.hq.nasa.gov/ese_missions/default. of FY 2003. cfm?transaction=Enter_ESE_Missions. Data Quality. NASA awarded the Computational Indicator 2. At least 90 percent of the total on-orbit Technology CAN; the information is located at instrument complement will be operational during their http://research.hq.nasa.gov/code_y/nra/current/CAN-00- design lifetime OES-01/index.html. Results. There are 28 NASA-funded on-orbit instru- Data Sources. The Computational Technologies Web ments, 27, or 96 percent, remained functional. Not includ- site is located at http://ct.gsfc.nasa.gov/grand.st3.html. ed in the 27 operating instruments are 7 still operating and collecting science data aboard the Upper Atmosphere Indicator 2. Successfully demonstrate up to three Earth Research Satellite launched in 1991. NASA also did not science modeling codes interoperating on a functioning include one instrument still operating on the Earth Modeling Framework prototype Radiation Budget Satellite, which launched in 1984. Results. This indicator was not achieved. Please Data Quality. The Earth Science Program Planning and see above. Development Division maintained an instrument status Data Quality. See indicator 1. list and updated it regularly. The Earth Science Resources Team Lead maintained all budgetary informa- Data Sources. See indicator 1. tion. The Program Planning and Development Division maintained a mission schedule list. The Earth Science Strategic Objective 3. Partner with other agencies Deputy Associate Administrator for Programs validated to develop and implement better methods for this list monthly. using remotely sensed observations in Earth system monitoring and prediction Data Sources. The Web site located at http://gaia. hq.nasa.gov-/ese_missions/lau_select.cfm lists all Annual Performance Goal 2Y28. Collaborate with operating satellites. A search of any satellite mis- other Federal and international agencies in developing sion from the Web site provides current instru- and implementing better methods for using remotely sensed observations. ment status. Moreover, the Earth Science Program Planning and Development Division tracked and archived The results of this annual performance goal and its asso- this information. ciated indicators are located in the Highlights of Performance Goals and Results segment of Part I. Annual Performance Goal 2Y30. Successfully disseminate Earth Science data to enable our science Enterprise-wide activities that enable achievement of research and applications goals and objectives. Success Earth Science strategic goals. will equate to meeting four of five performance indicators.

Annual Performance Goal 2Y29. Successfully devel- NASA exceeded the annual performance goal for the op, have ready for launch, and operate instruments on at fourth consecutive fiscal year with a rating of blue. The least two spacecraft to enable Earth science research and NASA Earth Observing System Data and Information applications goals and objectives. System (EOSDIS) facilitated NASA’s goals by enabling the public to benefit fully from increased understanding NASA achieved the annual performance goal with a rat- and observations of the environment. The EOSDIS oper- ing of green. Launching spacecraft with cutting-edge ated the EOS satellites in orbit, and retrieved flight data technology and instruments in a timely and cost-effective and converted it into useful scientific information. manner was a key element for the continued success of Development of EOSDIS was nearly completed; remain- Earth system research and analysis. In FY 2002, four ing activities are timed to provide releases to support the Earth observing satellites were launched. The satellites’ upcoming launches of EOS missions through Aura in instruments added to the 10 existing operating missions in 2004. NASA developed and operated EOSDIS as a dis- orbit and provided users with unprecedented volumes of tributed interoperable system that: (1) operated the EOS information and data. satellites, (2) acquired instrument (science) data, (3) pro- Indicator 1. Successfully develop and have ready for duced data and information products from the EOS space- launch at least two spacecraft craft, (4) archived all these and other Earth science envi-

Part II • Supporting Data • Earth Science 169 ronmental observation data for continuing use, and (5) Data Quality. The individual DAACs and ESIPs validat- make all these data and information easily available for ed the data. use by the research and education communities, government agencies and all those who can benefit from the data Data Sources. The DAACs and the ESIPs provided in making economic and policy decisions. the data. ESDIS Project compiled the data. System logs are the primary data source. Emails, contact logs, and Indicator 1. Make available data on seasonal or climate user surveys provide the information for customer prediction, and land surface changes to users within comment data. 5 days of their acquisition Indicator 5. User satisfaction: increase the number of Results. The average delivery time was 1.7 days favorable comments from DAAC and ESIP users as compared with 2.7 days in FY 2001. Electronic recorded in the customer contact logs over FY 2001; subscription or user order and retrieval dominated the decrease total percentage of order errors by 5 percent product delivery method. over FY 2001

Data Quality. The individual DAACs and Earth Science Results. The Earth science data centers received 2,169 Information Partners (ESIPs) validated the data. positive comments, well exceeding the goal. The DAACs Data Sources. The DAACs and the ESIPs provided data have an error rate of 0.46 percent, also exceeding the from their system logs. Customer comment data came goal. from visual inspection of emails, contact logs, and user Data Quality. The individual DAACs and ESIPs validat- surveys. ESDIS compiled the data. ed the data. Indicator 2. Increase by 50 percent the volume of data acquired and archived by NASA for its research programs Data Sources. The ESDIS project compiled data. The compared to FY 2001 DAACs and the ESIPs provided the data. System logs are the primary data sources. Visual inspection of e-mails, Results. NASA satellites and research projects produced contact logs, and user surveys are the sources of customer more than a petabyte of data in FY 2002. This data dou- comment data. bled the volume of archived data to 2.06 petabytes to sur- pass the indicator measure. Annual Performance Goal 2Y31. Safely operate airborne platforms to gather remote and in situ Earth science Data Quality. The individual DAACs and ESIPs validat- data for process and calibration/validation studies. ed the data. NASA achieved the annual performance goal with a rating Data Sources. The DAACs and the ESIPs provided the of green. All missions conducted on airborne platforms data, which come primarily from system logs. Visual went safely and achieved the data collection objectives. inspection of emails, contact logs, and user surveys Scientific importance, seasonal factors, the presence of col- provided customer data. The ESDIS Project compiled laborative observing teams, and satellite validation needs the data. played a role in establishing research priority.

Indicator 3. Increase the number of distinct EOSDIS Indicator 1. Support and execute seasonally dependent customers by 20 percent compared to FY 2001 coordinated research field campaigns within one-week Results. Our data centers provided data and information of target departure with the aid of airborne and sub- products to more than 3.2 million customers, 900,000 orbital platforms, as scheduled at the beginning of the more than in FY 2001. fiscal year Data Quality. The individual DAACs and ESIPs validat- Results. NASA established the Cold Land Processes ed the data. Experiment (CLPX) and the CRYSTAL-Florida Area Cirrus Experiment (FACE) as this year’s priority cam- Data Sources. The DAACs and the ESIPs provided the paigns for performance metrics, based on seasonal fac- data. ESDIS Project compiled the data. System logs are the tors, collaborative observing teams, and the concurrence primary data source. E-mails, contact logs, and user sur- of the cognizant science manager. NASA incorporated the veys provide the information for customer comment data. CLPX experiment with other experiments scheduled for the same aircraft configuration/payload, time period, and Indicator 4. Increase scientific and applications data geographical area. We designated the IceSAR (Synthetic products delivered from the EOS DAACs by 10 percent Aperture Radar) mission for the DC-8 aircraft. This compared to FY 2001 marked the first phase of a multiyear, multiplatform Results. NASA data centers provided more than experiment, designated Intensive Observing Period-1; it 26 million data and information products to customers, 11 concluded successfully without mishaps, and science million more than in FY 2001. team members have exchanged data sets internally.

170 NASA FY 2002 Performance and Accountability Report The CRYSTAL-FACE mission utilized the NASA ER-2 guidance for aircraft mission priorities, cost/schedule tar- and WB-57F, in addition to four other airborne platforms gets, and other performance constraints. from industry, university, and federal laboratory sources. Quick-look data sets are available at http://cloud1.arc. Data Sources. Information about the Suborbital nasa.gov/cgi-bin/view_ quicklook_links.cgi. Science Program missions, platforms, and sensors is available from the field center projects: The ARC Earth Data Sources. CLPX Mission: Dryden Flight Research Science Project Office is located at http://www.espo. Center (DFRC)/Airborne Science Office maintains mis- nasa.gov/; the DFRC High-Altitude Airborne Science sion book files that contain copies of the investigator’s Project Office at http://www.dfrc. nasa.gov/airsci/; flight request, Experimenter’s Bulletins, and Daily Flight GSFC/Wallops Flight Facility Aircraft Operations Office Reports. These reports document aircraft integration and at http://www. wff.nasa.gov/~apb/; and the ARC Airborne flight activity. NASA identified the CLPX experiment as Sensor Facility at http://asapdata. arc. nasa.gov/. Flight Request 28003, and included it in the IceSAR Mission Book. Information about the performance-metric campaigns is CRYSTAL-FACE Mission: ARC/Earth Science Project available from the CLPX Project located at http:// Office maintains project files for all project activity, www.nohrsc.nws.gov/~cline/clp/field_exp/clpx_02/clpx_ including aircraft integration and flight coordination. 02.html and the CRYSTAL-FACE Project at http:// NASA identified the CRYSTAL-FACE mission as Flight cloud1.arc.nasa.gov/crystalface/. Requests 22301 and 2M301. Information about recent and current campaigns is avail- The Research Division at NASA Headquarters maintains able from the Suborbital Science Program at http:// files for program direction to the Aircraft Centers, such as www.earth.nasa.gov/science/suborbital/.

Part II • Supporting Data • Earth Science 171

Biological and Physical Research

Strategic Goal 1. Conduct research to enable safe Data Sources. Reports on Station research investiga- and productive human habitation of space tions are available at http://spaceresearch.nasa.gov. The investigation was described in Nutrition in Spaceflight Strategic Objective 1. Conduct research to ensure and Weightlessness Models (Lane, Helen W. and the health, safety, and performance of humans liv- Schoeller, Dale A. (eds.) CRC Press LLC, Boca Raton, ing and working in space 2000) and Chapter 5 of Isolation: NASA Experiments in Annual Performance Goal 2B1. Earn external review Closed-Environment Living, Science and Technology rating of green or blue by making progress in the follow- Series (Lane, Helen W., Sauer, Richard L., and Feeback, ing research focus areas as described in the associated Daniel L. , volume 104, American Astronomical Society, indicators. San Diego, CA, 2002).

•Identify and test biomedical countermeasures that will Indicator 3. Prepare in-flight validation of cardiovascular make space flight safer for humans. countermeasures • Identify and test technologies that will enhance human Results. We prepared the in-flight countermeasures val- performance in space flight NASA’s Biological and idation. Twenty subjects in short-duration (both aircraft Physical Research Advisory Committee reviewed and Shuttle) flights and 20 Station crewmembers are progress on this annual performance goal and evaluat- required to complete this study. At present, 2 of 20 short- ed progress as satisfactory, or green, based on the supporting metrics. duration astronauts completed this study. Indicator 1. Complete protocols for flight-testing coun- Data Quality. The program scientist reported these termeasure to reduce kidney stone risk results. NASA’s Biological and Physical Research Advisory Committee evaluated progress toward this Results. Researchers completed the protocols and tested annual performance goal. potassium citrate on 5 of the required 20 Station Data Sources. Because this indicator describes an crewmembers. The 15 remaining crewmember tests will ongoing investigation, the documentation is internal to be conducted with future crews as they rotate on and off NASA. The sources include proposal review and selec- the Station. This study assessed the renal stone-forming tion documentation and the proposal entitled “Test of potential in humans as a function of mission duration and Midodrine as a Countermeasure Against Postflight determined how long after space flight the higher risk for Orthostatic Hypotension” by Dr. Janice M. Yelle. stone formation exists. Reports on Station research investigations are available at Data Quality. The outcomes reported by the program http://spaceresearch.nasa.gov. scientist accurately reflect performance and achievements in FY 2002. NASA’s Biological and Physical Research Indicator 4. Evaluate and provide annual reports of the Advisory Committee evaluated progress toward this progress in reducing medical risk factors annual performance goal. Results. Understanding and developing strategies for mit- Data Sources. NASA investigated the countermeasures on igating the biomedical risks of spaceflight to humans Station Expeditions 3 and 4, and data collection continued requires a consistent and incremental program of scientific on the Expedition 5 crew. Reports on Station research research. Progress is measured each time required data are investigations are available at http://spaceresearch.nasa.gov. collected on an additional subject, each time an experiment reaches completion of data for the complete sample of sub- Indicator 2. Develop an investigation of crew nutritional jects, and when the data from multiple experiments are needs and metabolism status understood, collated, and compared with the results of Building on the Biomedical Research and Countermeasures other studies. In FY 2002, 17 manifested flight experiments Program work described in Nutrition in Spaceflight and made measurable progress in achieving this goal. NASA Weightlessness Models (2000), researchers developed an selected three new experiments submitted in response to investigation and made nutritional status assessments during NASA Research Announcement (NRA) 01-OBPR-03. 15-, 30-, 60-, and 90-day experiments using a ground-based Nineteen ground-based investigations made measurable simulation model of spaceflight at the Johnson Space Center. progress toward the goal by performing experiments that refine understanding and lead to the honing of hypotheses Data Quality. NASA’s Biological and Physical Research that should be proposed for flight experiments. NASA Advisory Committee evaluated progress toward this selected five additional experiments either as new or annual performance goal. renewal efforts for ground-based study.

Part II • Supporting Data • Biological and Physical Research 173 Annual Performance Goal Trends for Biological and Physical Research

Annual Performance Assessment Performance Goal FY 1999 FY 2000 FY 2001 FY 2002

Strategic Goal 1. Conduct research to enable safe and productive human habitation of space.

Objective 1. Conduct research to ensure the health, safety, and performance of humans living and working in space.

2B1 2B2 Objective 2. Conduct research on biological and physical processes to enable future missions of exploration.

2B3

Strategic Goal 2. Use the space environment as a laboratory to test the fundamental principles of physics, chemistry, and biology.

Objective 1. Investigate chemical, biological, and physical processes in the space environment, in partnership with the scientific community. 2B4 2B5 2B6 2B7 2B8 2B9 Objective 2. Develop strategies to maximize scientific research output on the Station and other space research platforms. 2B10 2H13 Strategic Goal 3. Enable and promote commercial research in space.

Objective 1. Provide technical support for companies to begin space research.

Objective 2. Foster commercial research endeavors with the Station and other assets.

2B11 Objective 3. Systematically provide basic research knowledge to industry.

2B12 Strategic Goal 4. Use space research opportunities to improve academic achievement and the quality of life.

Objective 1. Advance the scientific, technological, and academic achievement of the Nation by sharing our knowledge, capabilities, and assets. 2B13 Objective 2. Engage and involve the public in research in space.

2B14

Data Quality. Progress on performance goal 2B1 was •Multiple Opportunities for Ground-Based Research In evaluated by NASA’s Biological and Physical Research Space Life Sciences, NRA-01-OBPR-07, Issued: Advisory Committee. The committee received lists of the October 31, 2001. Selection: July 31, 2002. manifested and planned flight experiments. Annual Performance Goal 2B2. Earn external review Data Sources. Two solicitations for research proposals rating of green or blue by making progress in the fol- addressed medical risk factors in FY 2002. They were lowing research focus area: • International Life Sciences Research Announcement: •Identify and test new technologies to improve life Research Opportunities for Flight Experiments in support systems for spacecraft. Space Life Sciences & Space Sciences, NRA-01- NASA successfully demonstrated a 33-percent reduction OBPR-03 (ILSRA-2001), Issued May 29, 2001. in the projected mass of life support for a baselined life- Selection: January 11, 2002. support system. Despite substantial progress, including

174 NASA FY 2002 Performance and Accountability Report contributions to a Space Radiation Health Plan and the Assistant Associate Administrator for Crew Health and impending release of new radiation standards from the Safety (Office of Space Flight); Safety and Risk National Council on Research Protection, NASA did not Management Division of the Office of Safety and release a new radiation protection plan in FY 2002. The Mission Assurance; Assistant Associate Administrator for Biological and Physical Research Advisory Committee Advanced System (Office of Space Flight); Sun-Earth reviewed our progress and determined that a rating of Connection Division of space science; and the research green best conveyed our performance. division of the Earth science mission. There is also one representative from each of the following: Ames Indicator 1. Office of Biological and Physical Research Research Center, Dryden Flight Research Center, (OBPR), will demonstrate, through vigorous research and Goddard Space Flight Center, Jet Propulsion Laboratory, technology development, a 33-percent reduction in the Johnson Space Center, Kennedy Space Center, Langley projected mass of a life support flight system compared to Research Center, and Marshall Space Flight Center. the current (FY 2001) system baselined for the Station. The quantitative calculation of this metric will be posted The state of the NSRR activities in developing an updat- on the Internet ed strategic plan for radiation health is as follows: Results. NASA achieved the indicator and posted quan- It was agreed that development of an Agency-wide strate- titative calculations on the Internet. The 33-percent figure gic plan required a process that fully addresses the wide accounts for the state of technology development by pro- range of radiation-related issues with which different jecting the mass of a benchmark life-support system and organizations within NASA are concerned. The develop- comparing it to the baselined Station life-support system. ment of the plan requires collection of information about these activities. This was completed. A draft of an updat- Data Quality. NASA’s Biological and Physical Research ed strategic plan was prepared and distributed to all mem- Advisory Committee evaluated progress toward this bers. It will be discussed at the NSRR meeting in January annual performance goal. 2003. The target date for completion and sign-off of the Data Sources. The calculation and supporting docu- strategic plan by the NASA Chief Scientist is mentation are located at http://advlifesupport.jsc. September 30, 2003. nasa.gov. A Radiobiology External Review Panel (RERP) was Indicator 2. Complete a radiation protection plan that chartered by the biological and physical research DAA will guide future research and development to improve for Science in May 2001. This panel was intended to ful- health and safety for space travelers fill the role of the steering committee. It met several times and was expected to provide a final report in Results. Progress toward accomplishment of the per- December 2002. formance goal was made. While the actual completion of the plan has been delayed, its purpose was better served The panel co-chairs are: Elizabeth L. Travis of the MD by a more considered approach and the time was used Anderson Cancer Center and Nancy L. Oleinick of Case effectively to develop an Agency-wide understanding of Western Reserve University. The RERP members radiation-related activities. include: Bruce M Coull (University of Arizona), Albert J. Fornace, (Head, Gene Response Section, National In February 2001, NASA’s Chief Scientist chartered the Institutes of Health), Philip J. Tofilon (MD Anderson NASA Space Radiation Research Working Group Cancer Center), Susan S. Wallace (University of (NSRR) as the task force to coordinate all Agency-wide Vermont), and Andrew J. Grosovski (University of activities related to space radiation. The NSRR held four California, Riverside). Members who contributed but are meetings and will meet quarterly, at a minimum, in the no longer participating include: Claire Fraser (President, future. The NSRR reports to the NASA Chief Scientist Institute for Genomic Research), Michael B. Kastan (St. and briefs the Chief Health and Medical Officer on rec- Jude Children’s Research Hospital), Judith Campisi ommendations for developing radiation health policy. The (Lawrence Berkeley National Laboratory), and Esther H. Deputy Associate Administrator (DAA) for Science of the Chang (Georgetown University Medical Center). biological and physical research effort was the designated NSRR chair. Data Quality. NASA’s Biological and Physical Research Advisory Committee evaluated progress toward this There is one representative from each of the following annual performance goal. NASA organizations: Data Sources. Publications on data and plans include Bioastronautics Research Division of biological and Radiation Protection Guidance for Activities in Low- physical research; Fundamental Space Biology Division Earth Orbit, NCRP Report 132, Bethesda, MD, 2000; of biological and physical research; Physical Sciences Operational Radiation Protection Methods for Space Research Division of the biological and physical research Flight, NCRP Report (in press), 2002; F.A. Cucinotta, et effort; Headquarters Office of the Chief Technologist; al., Space Radiation and Cataracts in Astronauts,

Part II • Supporting Data • Biological and Physical Research 175 Radiation Research 156, 460-466, 2001; and F.A. California at San Francisco and the Veterans Affairs Cucinotta et al., Space Radiation Cancer Risks and Medical Center. The study compared the effects of space- Uncertainties for Mars Missions, Radiation Research 156, flight on the bones of young rats with those of mature 682-688, 2001. Further data are available at ones. It sought to determine whether the skeletal system http://srhp.jsc.nasa.gov. of the mature rat mimics the responses of the human skeletal system to microgravity. If the mature rat and Strategic Objective 2. Conduct research on bio- human bones respond similarly, this finding would be a logical and physical processes to enable future boon to the study of the skeletal system in space and the missions of exploration development of countermeasures to bone loss in spaceflight crews. Annual Performance Goal 2B3. Earn external review rating of green or blue by making progress in the following Data Quality. NASA’s Biological and Physical Research research focus areas: Advisory Committee evaluated progress toward this •Develop and test cutting-edge methods and instru- annual performance goal. ments to support molecular-level diagnostics for phys- Data Sources. As noted above, this indicator describes iological and chemical process monitoring. a study that has not yet been conducted. The available • Identify and study changes in biological and physical documents are the products of NASA’s peer-review mechanisms that might be exploited for ultimate appli- process for selecting research. cation to improving the health and safety of space travelers Indicator 3. Develop studies on space-flight-induced genomics changes The Biological and Physical Research Advisory Committee rated progress on this annual performance Results. A series of experiments that investigate genom- goal as green. This goal and the field of research were ic changes were selected through the peer-review process new in FY 2002. and were developed for flight. The studies include examining of the effects of spaceflight on gene expression in Indicator 1. Collaborate with the National Cancer microbial populations, identifying key genes involved in Institute to create and maintain a core program using plant growth and functioning in the space environment, academic, industrial, and government researchers to studying the genes associated with the response of fruit develop and test cutting-edge methods and instruments to flies to space, and understanding genetic mechanisms support molecular-level diagnostics for physiological and associated with muscle atrophy and immune cell func- chemical processes tioning in space. Results. The National Cancer Institute and NASA issued Data Quality. NASA’s Biological and Physical Research a joint research opportunities announcement for funda- Advisory Committee evaluated progress toward this mental biomolecular sensor technology development. annual performance goal. The committee received a list of NASA announced awards in the first quarter of FY 2002; the investigations described. we funded 7 of the 55 proposals for extramural investigations. In parallel, NASA received 16 proposals for the Data Sources. As noted above, this indicator describes intramural program, which focused on developing tech- a future study. The available documents are the products nology to support NASA’s exploration goals. of NASA’s peer-review process for selecting research. Data Quality. NASA’s Biological and Physical Research Advisory Committee evaluated progress toward this Strategic Goal 2. Use the space environment as a annual performance goal. laboratory to test the fundamental principles of physics, chemistry, and biology Data Sources. The committee received a list of the selected investigators and their project titles. Summaries Strategic Objective 1. Investigate chemical, biolog- are available for all extramural and intramural projects on ical, and physical processes in the space environ- the NASA-National Cancer Institute Biomolecular ment, in partnership with the scientific community Sensor Development Web site at http://nasa- Annual Performance Goal 2B4. Earn external review nci.arc.nasa.gov/. rating of green or blue by making progress in the follow- Indicator 2. Develop a study on the effects of space flight ing research focus areas as described in the associated on bone loss as a function of age in an animal model indicators. • Advance the scientific understanding of complex bio- Results. We developed for flight the experiment “Space logical and physical systems Flight And Bone Metabolism: Age Effects And Development Of An Animal Model For Adult Human The results of this annual performance goal and its asso- Bone Loss,” by Bernard Halloran of the University of ciated indicators are located in the Highlights of the Most

176 NASA FY 2002 Performance and Accountability Report Important Performance Goals and Results segment of Annual Performance Goal 2B7. Earn external review Part I. rating of green or blue by making progress in the following research focus area. Annual Performance Goal 2B5. Earn external review rating of green or blue by making progress in the follow- • Investigate fundamental and unresolved issues in ing research focus areas as described in the associated condensed matter physics and atomic physics, and indicators: carry out atomic clock development for space-based utilization •Elucidate the detailed physical and chemical process- NASA’s Biological and Physical Research Advisory es associated with macromolecular crystal growth and cellular assembling processes in tissue cultures Committee rated progress on this annual performance goal as green. This goal was new in FY 2002. The results of this annual performance goal and its asso- Indicator 1. Maintain an outstanding and peer-reviewed ciated indicators are located in the Highlights of the Most research program in condensed matter physics, Bose- Important Performance Goals and Results segment of Einstein Condensation, and atomic clocks development Part I. for space-based utilization Annual Performance Goal 2B6. Earn external review Results. The fundamental physics discipline of the rating of green or blue by making progress in the follow- Physical Sciences Research Program supported 19 inves- ing research focus areas as described in the associated indicators. tigations in laser-cooled atomic physics and 31 investigations in low-temperature condensed matter physics. The •Initiate a focused research program specifically inte- two areas accounted for 76 percent of the investigations grating fluid physics and materials science with funda- in the discipline compared with 79 percent in FY 2001. mental biology Within the discipline, 11 flight-based investigations are NASA’s Biological and Physical Research Advisory in various stages of development. Included among the Committee declined to rate the target in light of anticipated fundamental physics investigators are five Nobel Prize difficulties in 2003. The rating for this performance goal is winners, most recently in 2001. Indicator 2 provides green. This goal was new in FY 2002. research results. Data Quality. NASA’s Biological and Physical Research Indicator 1. Initiate the definition of a bioscience and Advisory Committee evaluated progress toward this Engineering institute to drive novel concepts for space- annual performance goal. based investigations in biomolecular systems Data Sources. Indicator data came from the FY 2002 Results. NASA released a cooperative announcement Office of Biological Research (OBPR) Research notice for a bioscience engineering institute that would Taskbook, http://research.hq.nasa.gov/ taskbook.cfm, enable excellent research, development, U.S. technology which will be available to the public by February 28, 2003. transfer, and education in bioscience and engineering. It is planned to emphasize biological and physical processes Indicator 2. Produce scientific discoveries in atomic and and space exploration and development. NASA received condensed matter physics, and publish in mainstream 13 proposals for establishing either a single academic insti- peer-reviewed archival journals tution or an academic institution consortium with a clear Results. NASA supports ground-based research in con- lead institution responsible for oversight and coordination. densed matter physics that uses lasers to produce An external peer-review panel evaluated the proposals and extremely cold matter which, under the right conditions, conducted site visits between February and May 2002. forms a new state of matter called a Bose-Einstein con- Because proposals varied from the priorities established by densate. The atoms in a Bose-Einstein condensate func- the Research Maximization and Prioritization Task Force tion as a single entity in a way that normal matter does not Task Force (ReMaP), NASA did not select a candidate (They are said to share the same quantum state.). NASA from this cooperative announcement. NASA is studying supports this cutting edge research in anticipation of sim- options for funding a bioscience and engineering institute ilar research that will be conducted on the Station. Earth- consistent with Agency research priorities. based research is limited by the tendency of the samples Data Quality. NASA’s Biological and Physical Research to fall out of the experimental apparatus in seconds. Advisory Committee evaluated progress toward this Anything done to levitate the sample on Earth would tend annual performance goal. to raise its temperature, but in space samples may last for minutes or even hours. The experiments described repre- Data Sources. The Cooperative Agreement Notice and the sent substantial milestones in physicists’ quest to study other supporting data are located at http://research.hq.nasa. quantum phenomena—physical phenomena that are ordi- gov/code_u/nra/current/CAN-01-OBPR-01/index.html and narily only observable at microscopic scales—in macro- http://spaceresearch.nasa.gov/general_info/remapreport.html. scopic systems. This research could have far-reaching

Part II • Supporting Data • Biological and Physical Research 177 implications for the future of information and communi- The data sources for Fermi-Dirac atoms experiments are cation technologies including next-generation computers located at http://link.aps.org/abstract/PRL/v88/e180401. based on quantum physics. Indicator 3. Design and develop flight experiment appa- In FY 2002, NASA-funded research made three key ratus for low-temperature physics, laser cooling, and discoveries in the area of Bose-Einstein condensates. atomic physics investigations on the Station Continuing his Nobel Prize winning work, Dr. Wolfgang Results. Low-temperature physics research exploits the Ketterle and his colleagues at the Massachusetts Institute microgravity environment of space to explore the basic of Technology investigated vortices in the condensate. properties of matter. In FY 2002, flight experiment appa- Ketterle’s group created vortices in a condensate by mov- ratus were under development for experiments (Critical ing a laser beam through it and then imaging its phase by Dynamics in Microgravity, Microgravity Scaling Theory interfering that condensate with a second unperturbed Experiment, and Liquid-Gas Critical Point in condensate that served as a local oscillator. These results Microgravity) on the behavior of matter under conditions are described in the paper “Observation of Vortex Phase in which it can be a liquid and a gas simultaneously. Other Singularities in Bose-Einstein Condensates” by S. experiments explored the properties of a form of helium, Inouye, S. Gupta, T. Rosenband, A.P. Chikkatur, A. known as superfluid helium, which has extremely low Gürlitz, T.L. Gustavson, A.E. Leanhardt, D.E. Pritchard, viscosity and hence essentially no resistence to flowing or and W. Ketterle, published in Physical Review Letters 87, changes in shape (Heat Capacity of Superfluid Helium-4 080402 (2001). in the Presence of a Heat Flux). This research probes the basic organization of matter, the nature of complexity, and NASA-supported researchers at Rice University cooled the mechanisms that drive the interplay between order lithium atoms to 1 billion times below room temperature and disorder. The applications of this research include to form a Bose-Einstein condensate. In this state, the tests of basic theories in quantum mechanics and the atoms formed a soliton train of multiple waves. results could lead to improved models of complex phe- Dr. Randall G. Hulet co-authored “Formation and propa- nomena (such as the weather or the economy) at many gation of matter-wave soliton trains,” which appeared in a different scales. May 9, 2002, issue of the journal Nature. The Low Temperature and Microgravity Physics Facility Juha Javanainen and his colleagues investigated a two- (LTMPF) project continued progress in all design and species mixture of cold Fermi-Dirac atoms. They development areas. The facility’s preliminary design observed fractionalization of the particle at unique sites in review was completed and the project continued on to the a one-dimensional optical lattice. This research also implementation phase. Proposed experiments for the first applied to two-dimensional and three-dimensional lat- flight have received authority to proceed into the imple- tices. As described recently in the Physics Review Focus mentation phase. A combined science concept review and online news magazine (http://focus.aps.org/v9/st21.html), requirements definition review for two add-on experi- ultra-cold atoms placed in a periodic confining lattice can ments was held in April. One received authority to pro- have partial numbers of atoms at places in the lattice ceed for flight development, while a second awaits a deci- where phase kinks occur. Some atoms can be located at sion based on more science data published by late 2002. the nodes in the potential by studying a two-species Some hardware procurements and fabrication activities Fermi-Dirac gas in a one-dimensional optical lattice, cou- are well under way. pled to an electromagnetic field with a phase kink. Details are in Physical Review Letters, 88, 180401 (2002). Researchers are working to use the unique environment of space to produce super accurate atomic clocks. Such Data Quality. NASA’s Biological and Physical Research clocks, which may measure the passage of time even more Advisory Committee evaluated progress toward this accurately than current atomic clock technology, would annual performance goal. The committee received serve as instruments for fundamental research on time, abstracts of the progress in this research area. matter, and relativity. They would also have important Data Sources. Further information on the vortex phase sin- applications for navigation in space, improved global posi- gularities observations is available at http://link.aps. tioning systems, and improved global and wireless com- org/abstract/PRL/v87/e080402,http://link.aps.org/ munication technologies. With rapid advances in compu- abstract/PRL/v88/e090801 and http://spaceresearch.nasa. tation and communication technology, an improved time gov/general_info/OBPR-02-101.html. standard could have countless applications. Supporting information on soliton research is available Our work on laser cooling and atomic physics investiga- at http://www.nature.com/cgi-taf/DynaPage.taf?file=/ tions made progress in FY 2002. We put in place the core nature/journal/v417/n6885/abs/417153a_fs.html and engineering team for the Primary Atomic Reference http://spaceresearch.nasa.gov/general_info/OBPR-02- Clock in Space experiment and worked on determining 130.html. preliminary subsystem designs. A successful 2-day peer

178 NASA FY 2002 Performance and Accountability Report review examined the subsystem requirements and evalu- Data Sources. Data for this indicator came from the ated progress toward solving technical challenges. FY 2002 OBPR Research Taskbook, http://research.hq.nasa. Researchers developed a ground test bed for rapid proto- gov/taskbook.cfm, which will be available to the public by typing and evaluation of designs. In a second experiment February 28, 2003. using a rubidium atomic clock, a conceptual design for a high-power 789-nanometer laser system was developed. Indicator 2. Complete the preparation for Station investigations in fundamental materials science to be carried Data Quality. NASA’s Biological and Physical Research out in the Microgravity Science Glovebox Advisory Committee reviewed progress toward accomplishing performance goal 2B5. The committee does not Results. STS-111 delivered the hardware for the necessarily review individual experiments but is provided Solidification Using a Baffle in Sealed Ampoules experi- with summary information and the Web address for ment. Researchers will conduct the experiment inside the abstracts and citations for this indicator Microgravity Science Glovebox in FY 2003. Investigators added tellurium and zinc to molten indium antimonide Data Sources. The program scientist reported results specimens and cooled them to form a solid single crystal for this indicator. by a process called directional solidification. To control Annual Performance Goal 2B8. Earn external review the optoelectronic properties of the crystals, researchers rating of green or blue by making progress in the follow- added a small amount of an impurity—called a dopant— ing research focus area. to the pure semiconductor. Uniform distribution of the dopant is essential for production of optoelectronic •Investigate fundamental and unresolved issues in fluid devices. The goals of this experiment are to identify what physics, and materials and combustion science using causes the motion in melts processed inside space labora- gravity as a theoretical and experimental revealing tool tories and to reduce the magnitude of the melt motion so NASA’s Biological and Physical Research Advisory that it does not interfere with semiconductor production. Committee rated progress on this annual performance goal as green. The rating improved from a red in The same mission delivered to the Station the Pore FY 2001. NASA accomplished all of the indicators relat- Formation and Mobility During Controlled Directional ed to fluid physics and combustion science. Solidification in a Microgravity Environment experiment. Through this investigation, we will observe bubble for- Indicator 1. Maintain an outstanding and peer- mation in the samples and study their movements and reviewed program in fluid physics, and materials and interactions. Ultimately, the goal is to improve the pro- combustion sciences duction of uniform composites. Results. The fluid physics, materials science, and com- Data Quality. NASA’s Biological and Physical Research bustion science disciplines supported 317 investigations, Advisory Committee evaluated progress toward this 62 percent of the total in the physical sciences, compared annual performance goal. with 342 investigations in FY 2001, also 62 percent of the total. NASA-supported researchers received three honors Data Sources. The data sources for the glovebox in combustion research. The National Academy of experiments are located at http://www1.msfc.nasa.gov/ Engineering elected Princeton University’s Dr. C.K. Law. NEWSROOM/background/facts/SUBSA.html; He also won the American Institute of Aeronautics and http://spaceresearch.nasa.gov/research_projects/ros/ Astronautics’ best paper award. The U.S. National subsa.html; http://www1.msfc.nasa.gov/NEWSROOM/ Academy of Engineering inducted Professor Felix background/facts/PFMI.html; and http://spaceresearch.nasa. Weinberg of the Imperial College London. gov/research_projects/ros/pfm.html. NASA-supported researchers received five honors in flu- Indicator 3. Prepare two major space-based combustion ids physics area. The American Society of Mechanical research experiments for flight on the Space Shuttle Engineers elected Dr. Paul Neitzel of Georgia Tech a fel- Results. The Laminar Soot Processes experiments low. The American Physical Society elected Dr. John aboard the Shuttle will use the microgravity environment Goree of the University of Iowa a fellow. Dr. Gary Leal, to eliminate buoyancy effects and slow the reactions of the University of California at Santa Barbara, won the inside a flame for easier study. This classical flame American Physical Society’s prestigious Fluid Dynamics observed in microgravity approximates combustion in Prize for 2002. ASM International named NASA Glenn’s diesel engines, aircraft jet propulsion engines, and fur- Dr. Walter Duval a fellow. Dr. Andreas Acrivos of City naces. The experiments will expand on prior data sug- College of New York won the President’s National Medal gesting the existence of a universal relationship, or soot of Science. paradigm, that would be used to model and control com- Data Quality. NASA’s Biological and Physical Research bustion systems on Earth. In addition, they will help set Advisory Committee evaluated progress toward this the stage for extended combustion experiments aboard annual performance goal. the Station.

Part II • Supporting Data • Biological and Physical Research 179 NASA prepared a second experiment, Structure of Flame Annual Performance Goal 2B9. Earn external review Balls at Low Lewis-number–2, or SOFBALL–2, which rating of green or blue by making progress in the follow- will help improve our understanding of the flame-ball ing research focus area. phenomenon; determine the conditions under which • Understand the role of gravity in biological processes flame balls exist; test predictions of flame ball lifetimes; at all levels of biological complexity. and acquire better data for critical model comparison. Flame balls—the weakest fires in space or on Earth—typ- NASA’s Biological and Physical Research Advisory ically produce 1 watt of thermal power compared to the Committee rated progress on this annual performance 50 watts a birthday candle generates. The Lewis-number goal as green. This goal was new in FY 2002. measures the rate of diffusion of fuel into the flame ball Indicator 1. Maintain an outstanding and peer-reviewed relative to the rate of diffusion of heat away from the program in fundamental space biology flame ball. Lewis-number mixtures conduct heat poorly. Hydrogen and methane are the only fuels that provide low Results. In FY 2002, we supported 158 investigations, of enough Lewis-numbers to produce stable flame balls, and which 134 were ground-based and 24 were flight-based. even then only for very weak, barely flammable mixtures. A total of $16.9 million, or 51 percent of the space biolo- In space, flame balls give scientists the opportunity to test gy research and technology budget, directly supported models in one of the simplest combustion experiments these investigations. We released a solicitation for possible. What we learn is applicable to managing and ground-based research in FY 2002. Of 100 proposals using combustion in many other processes. received, we funded 22.

Data Quality. NASA’s Biological and Physical Research Data Quality. NASA’s Biological and Physical Research Advisory Committee evaluated progress toward this Advisory Committee evaluated progress toward this annual performance goal. annual performance goal. Data Sources. The data for this indicator came from the Data Sources. A description of the laminar soot exper- FY 2002 OBPR Research Taskbook, http://research.hq. iments is located at http://spaceresearch.nasa.gov/sts- nasa.gov/taskbook.cfm, which will be available to the 107/107_lsp.pdf. Information on the SOFBALL–2 stud- public by February 28, 2003. ies is located at http://spaceresearch.nasa.gov/sts-107/107 _sofball.pdf and http://spaceresearch.nasa.gov/ general_ Indicator 2. Develop and implement Fundamental Space info/21aug_flameballs.html. Biology research plans to utilize early ISS capability

Indicator 4. Initiate a new annual process to solicit and Results. Planning for early Station utilization kicked off select peer-reviewed, ground-based investigations in mate- at a March workshop at Ames Research Center. Members rials science, fluid physics, and combustion research of the research community, hardware developers, and representatives of the Station Program Office, Astronaut Results. NASA established the Annual NASA Research Office, and relevant advisory committees developed rec- Announcement process, which solicited flight- and ommendations for program procedures, science priorities, ground-based research for areas including biotechnology, and associated technology capability. The plans will be combustion science, fluid physics, fundamental physics incorporated in future solicitations for flight experiments. and materials science, as well as special focus themes, Data Quality. NASA’s Biological and Physical Research such as materials science for advanced space propulsion. Advisory Committee evaluated progress toward this annual performance goal. In this process, NASA issues a research announcement once per year. The proposal due dates for each scientific Data Sources. NASA published the results of the work- discipline are staggered throughout the year. The new shop in Workshop Report, Space Biology on the Early process was successful and allowed the Physical Sciences International Space Station Workshop, March 14-15, 2002. Research Program to make more timely adjustments to program content. Indicator 3. Determine baseline data requirements for model specimens to be used on ISS Data Quality. NASA’s Biological and Physical Research Indicator 4. Plan for incorporation of baseline data col- Advisory Committee evaluated progress toward this lection in ISS hardware validation flights annual performance goal. NASA determined baseline data requirements for the C. Data Sources. The NASA Research Announcement, Elegans and yeast specimens planned for use on Station. Research Opportunities In Physical Sciences Physical We will incorporate these data requirements into valida- Sciences Ground-Based And Flight Research (NRA-01- tion flights of Station hardware including the Biological OBPR-08), is available at http://research.hq.nasa.gov/ Research Project incubator, cell culture unit, and insect code_u/nra/current/NRA-01-OBPR-08/index.html. habitat. This preparatory work will make possible Station

180 NASA FY 2002 Performance and Accountability Report experiments using animal models to pursue basic ques- •WORF:http://iss-www.jsc.nasa.gov/ss/issapt/rpwg/ tions in biology. Presentations/WORF.ppt

Data Quality. NASA’s Biological and Physical Research • ER-8:http://iss-www.jsc.nasa.gov/ss/issapt/rpwg/ Advisory Committee evaluated progress toward this Presentations/EXPRESS.ppt annual performance goal. • HRF-2: http://hrf.jsc.nasa.gov/. Data Sources. The results of the workshop appeared in Workshop Report, Space Biology on the Early Indicator 2. Provide integration support for delivery of International Space Station Workshop, held at NASA two International Partner provided research racks for ISS Ames Research Center, March 14-15, 2002. Results. NASA successfully integrated the Microgravity Strategic Objective 2. Develop strategies to maxi- Science Glovebox provided by the European Space mize scientific research output on the Agency into the Station, where it supports investigations International Space Station and other space in the physical sciences. research platforms The European Space Agency also developed and deliv- Annual Performance Goal 2B10. In close coordina- ered the Minus Eighty-Degree Laboratory Freezer for the tion with the research community, allocate flight resources to achieve a balanced and productive research Space Station. It is at Kennedy Space Center in prepara- program. tion for launch in March 2003.

The results of this annual performance goal and its asso- Data Quality. NASA’s Biological and Physical Research ciated indicators are located in the Highlights of Advisory Committee evaluated progress toward this Performance Goals and Results segment of Part I. annual performance goal.

Annual Performance Goal 2H13. Demonstrate Data Sources. Information on the Microgravity progress toward Station research hardware development. Sciences Glovebox is available at http://spaceresearch. nasa.gov/research_projects/ros/msg.html. Information on NASA accomplished this goal by developing three U.S. the Minus Eighty-Degree laboratory Freezer for the provided research racks for the Station and providing Space Station is available at http://www.esa.int/ integration support for delivery of two international-part- export/esaHS/ESAJVCF18ZC_iss_0.html. ner-provided research racks. The rating for this performance goal is green. Strategic Goal 3. Enable and promote commercial Indicator 1. Complete development of three U.S. provided research in space research racks for ISS Strategic Objective 1. Provide technical support Results. NASA completed development of the following for companies to begin space research three racks: Human Research Facility-2 (HRF-2), Window Strategic Objective 2. Foster commercial research Observational Research Facility (WORF), and Expedite endeavors with the Station and other assets the Processing of Experiments to Space Station (EXPRESS) Rack-8 (ER-8). These racks are available for Annual Performance Goal 2B11. Engage the com- Station research in the biological, physical, and observa- mercial community and encourage non-NASA investment tional sciences for both commercial and academic in commercial space research by meeting at least three of researchers. four performance indicators The results of this annual performance goal and its asso- Data Quality. NASA’s Biological and Physical Research ciated indicators are located in the Highlights of Advisory Committee evaluated progress toward this Performance Goals and Results segment of Part I. annual performance goal.

Data Sources. The HRF-2, WORF, and ER-8 Station Strategic Objective 3. Systematically provide research facility racks were developed, delivered, and basic research knowledge to industry accepted by the Government. Acceptance data packages Annual Performance Goal 2B12. Highlight Station- (ADPs) for WORF and ER-8 is on file at the Marshall based commercial space research at business meetings Space Flight Center, and an ADP for the HRF-2 is on file and conferences. at Johnson Space Center. NASA’s Biological and Physical Research Advisory Background information on the racks is located at the fol- Committee rated progress on this annual performance lowing Web sites: goal as green.

Part II • Supporting Data • Biological and Physical Research 181 Indicator 1. Support at least three business/trade confer- Data Quality. NASA’s Biological and Physical Research ences to highlight ISS-based commercial space research Advisory Committee evaluated progress toward this annual performance goal. Results. At three conferences, NASA shared information on the commercial space centers’ research on the Data Sources. The portal for biological and physical Shuttle and now the Station. We expanded interaction research educational materials is located at with the commercial community at the National http://spaceresearch.nasa.gov. Association of Manufacturers conference in Chicago; the Biotechnology Industry Organization annual meeting in Strategic Objective 2. Engage and involve the Toronto, Canada in June 2002; and the NBC4 Technology public in research in space Showcase in Washington, DC. Several commercial space center representatives participated in a space forum in Annual Performance Goal 2B14. Work with media Colorado Springs, CO, making a number of useful indus- outlets and public institutions to disseminate OBPR information to wide audiences. try contacts. Our staff highlighted areas of commercial medical research including tumor treatment using photo- NASA’s Biological and Physical Research Advisory sensitive dyes and light emitting diodes, protein crystal Committee rated progress on this annual performance research, and telemedicine in an exhibit at the American goal as green. This goal was new in FY 2002. Society of Clinical Oncology conference in Orlando, FL. Indicator 1. Work with Public Broadcasting System (PBS) Data Quality. The outcomes accurately reflect perform- and Discovery Channel producers to explore opportuni- ance and achievements in FY 2002. NASA’s Biological ties for TV products with space/research/microgravity and Physical Research Advisory Committee evaluated themes progress toward this annual performance goal. Results. NASA’s Distance Learning at Langley Data Sources. Commercial research program informa- Research Center began collaboration with PBS to pro- tion is available at http://spd.nasa.gov. duce a four-segment TV series and a CD-ROM that expanded on the concepts. The complete package will Strategic Goal 4. Use space research opportuni- bring NASA information to grades kindergarten to 12 ties to improve academic achievement and the through PBS, the Web, and CD-ROM in both English and quality of life Spanish. Strategic Objective 1. Advance the scientific, Data Quality. NASA’s Biological and Physical Research technological, and academic achievement of the Advisory Committee evaluated progress toward this Nation by sharing our knowledge, capabilities, annual performance goal. and assets Data Sources. No publicly available data sources exist. Annual Performance Goal 2B13. Provide information and educational materials to American teachers. Indicator 2. Work with Life Science Museum Network members to explore opportunities for the development of We reached out to teachers through our well-attended projects, special events, or workshops focused on Life educational conferences. NASA’s Biological and Physical Sciences biology-related research themes to attract and Research Advisory Committee rated this annual perform- engage public audiences ance goal as blue to indicate that NASA significantly exceeded expectations for this performance goal. NASA Results. The Life Sciences Museum Network was received green ratings in the previous three fiscal years. renamed the Space Research Museum Network to better represent our research of biological and physical sci- Indicator 1. Develop electronic and printed educational ences. A multi-media product, “Space Research and You,” materials which focus on biological and physical explained the science conducted on STS-107 to the pub- research, and distribute these materials at at least three lic and educators. Museum members helped develop and conferences and through the Internet pilot the product. Results. We achieved the indicator, holding 5 National A museum member questionnaire formed the basis of a Education Conferences attended by more than 70,000 white paper assessment for management and the NASA teachers, and participating in each conference’s “One Education Office. We received recommendations for NASA” exhibit. We distributed numerous educational bringing projects, materials, workshops, and leadership to publications. Space Research, the biological and physical informal science center learning institutions. effort’s research newsletter, was disseminated at several conferences including the American Society of Clinical Data Quality. The outcomes accurately reflect perform- Oncology and the National Medical Association. The ance and achievements in FY 2002. NASA’s Biological publication was well received and the mailing list is rap- and Physical Research Advisory Committee evaluated idly expanding. progress toward this annual performance goal.

182 NASA FY 2002 Performance and Accountability Report Data Sources. NASA’s activities with the Space Research online database containing information about affiliates, Museum Network are located at http://spaceresearch.nasa. leveraged funding from industry and other non-NASA gov/general_info/sts107museum.html. sources, refereed and nonrefereed publications, and recent accomplishments, patents, and other indices of Indicator 3. Make available to wide audiences an online interest to the public and in particular to companies seek- database of Commercial Space Center activities, including our market data. ing publications listings, patents, and other information useful to the public Data Quality. The outcomes accurately reflect performance and achievements in FY 2002. NASA’s Biological Results. NASA maintains a Web site for the commercial and Physical Research Advisory Committee evaluated center program at http://spd.nasa.gov. This site provides progress toward this annual performance goal. an overview of the commercial space centers and links to each center. Data Sources. The database is available at http://www. spd.nasa.gov. The commercial space center Source book is available at http://www.spd.nasa.gov/sourcebook/index.html. It is an

Part II • Supporting Data • Biological and Physical Research 183

Human Exploration and Development of Space

Strategic Goal 1. Explore the space frontier (NPD) “Technical Oversight Policy for Launch Services” (NPD 8610.23)). The goal of a sustained demonstrated Strategic Objective 3. Enable human exploration success rate of 95 percent was based on goal to achieve through collaborative robotic missions the ELV predicted design reliability of 95 percent for Annual Performance Goal 2H03. Provide reliable NASA missions. This metric accepts the inherent risk of launch services for approved missions. launching on an expendable vehicle and accounts for the probability that NASA missions may indeed suffer a Although this is the first year for this performance metric, launch failure. The running average is calculated from NASA has a history of 59 successes out of 60 attempts to 1987 to the present. Launch success is defined as a pay- launch primary payloads on expendable launch vehicles load being deployed to its required orbit by the launch (ELVs) since 1987. That is a 98.3 percent success rate. All vehicle within the specified contractual launch environ- five NASA-managed ELV launches of primary payloads ments. NASA withholds final launch payments until in FY 2002 were successful. As a result, we earned a rat- after engineering and contracting officer determination of ing of green for this annual performance goal. (As noted mission success. in the Discussion section, the cancellation of the Strategic Launch Initiative caused the elimination of strategic NASA maintains a running average calculation of all U.S. objectives 1, 2, 4, and 5.) launch vehicles by key user groups (commercial, DOD, Indicator 1. NASA success rate at or above a running and NASA) to serve as a comparison for the 95 percent average of 95 percent for missions noted on the flight performance goal. Launch of NASA-sponsored second- planning board manifest and launched pursuant to com- ary payloads on commercial or DOD missions are not mercial launch service contracts included in the calculation of NASA’s running average of success, because they do not employ the same high level Results. Domestic ELVs have a historical predicted of technical oversight. The DOD provided launch servic- design reliability of 95 percent. Demonstrated flight histo- es for seven NASA and National Oceanic and ry varies by launch vehicle and customer and can be affect- Atmospheric Administration (NOAA) meteorological ed by a myriad factors, including vehicle maturity, launch satellites on DOD’s converted intercontinental ballistic provider experience, clarity and adherence to proce- missiles from 1987 to the present; all were successful. dures/process, and technical management. In the aftermath These missions are included in the DOD running average of the Space Shuttle Challenger tragedy, NASA was because they provided the primary technical management directed to acquire ELV launch services from the domestic for the missions. launch industry to meet the needs of scientific, Earth observing, communication, and technology payloads Over this same period, NASA has used commercial ELVs requiring launch on a range of vehicles to a variety of for seven missions that were either secondary payloads or orbits and destinations. Most NASA payloads flown on on-orbit service purchases. Five of these missions were ELVs are unique, with an investment in resources in excess successfully launched; two missions were not (the first of the cost of the launch system. With the transition to flight of the Conestoga vehicle in 1995 with the Meteor acquisition of ELV services, NASA implemented an ELV payload and the Quick Total Ozone Mapping technical strategy to focus government technical oversight Spectrometer (QuikTOMS) payload in 2001 flown as a to maximize the successful launch of NASA primary pay- secondary payload). The running average success for loads on commercial systems. NASA has used this techni- these seven missions was 71.4 percent. These missions cal oversight approach for 60 missions since 1987 with 59 are included in the commercial launch (licensed by the successful launches (98.3 percent running average). In FAA) running average of 90.5 percent (105 successful FY 2002, all five (Thermosphere Ionosphere Mesosphere launches, 116 total launches). Note that we can only Energetics and Dynamics (TIMED)/Jason, High Energy roughly compare these running averages because, unlike Solar Spectroscopic Imager (HESSI), Tracking and Data our primary payload ELV missions, both the level of tech- Relay Satellite Project (TDRS)-I, Aqua, and Comet nical oversight and the criteria for success vary from Nucleus Tour (CONTOUR)) of the NASA-managed ELV launch to launch for commercial and DOD ELVs. launches for which this technical oversight approach was applied were successfully launched. Data Quality. The data accurately reflect NASA launch history. This performance indicator seeks to ensure the continued successful deployment of NASA’s commercially Data Sources. The flight history of NASA payloads launched primary payloads for which it exercises techni- discussed in this assessment is available at cal oversight (as described in the NASA Policy Directive https://extranet. hq.nasa.gov/elv/IMAGES/lh.pdf.

Part II • Supporting Data • Human Exploration and Development of Space 185 Annual Performance Goal Trends for Human Exploration and Development of Space

Annual Performance Assessment Performance Goal FY 1999 FY 2000 FY 2001 FY 2002

Strategic Goal 1. Explore the Space Frontier.

Objective 3. Enable human exploration through collaborative robotic missions. 2H03 Strategic Goal 2. Enable Humans to Live and Work Permanently in Space.

Objective 1. Provide and make use of safe, affordable, and improved access to space. 2H06 2H07 2H08 2H09 Objective 2. Operate the International Space Station to advance science, exploration, engineering, and commerce. 2H10 2H11 2H12 Objective 3. Meet sustained space operations needs while reducing costs. 2H15 2H16 2H19 Strategic Goal 3. Enable the Commercial Development of Space.

Objective 1. Improve the accessibility of space to meet the needs of commercial research and development. 2H17 2H18 Objective 2. Foster commercial endeavors with the International Space Station and other assets. Objective 3. Develop new capabilities for human spaceflight and commercial application through partnerships with the private sector. 2H26 2H21 Strategic Goal 4. Share the Experience and Benefits of Discovery.

Objective 1. Provide significantly more value to significantly more people through exploration and space development efforts. 2H24 Objective 2. Advance the scientific, technological, and academic achievement of the Nation by sharing our knowledge, capabilities, and assets. 2H28

The NASA policy document that sets forth NASA’s tech- The results of this annual performance goal and its asso- nical oversight approach for launch services is available ciated indicators are located in the Highlights of from http://nodis3.gsfc.nasa.gov/library/displayDir.cfm? Performance Goals and Results section of Part I. Internal_ID=N_PD_8610_023A_& page_name=main. Annual Performance Goal 2H07. Safely meet the FY 2002 manifest and flight rate commitment. Strategic Goal 2. Enable humans to live and work permanently in space In flight for more than 20 years, the Shuttle remains the world’s only spacecraft capable of satellite deployment, Strategic Objective 1. Provide and make use of maintenance, repair, and retrieval; International Space safe, affordable, and improved access to space Station assembly and support; and on-orbit research. The Annual Performance Goal 2H06. Assure public, flight number of planned flights for FY 2002 was seven. crew, and workforce safety for all Shuttle operations. However, because of safety concerns about the orbiter’s

186 NASA FY 2002 Performance and Accountability Report main propulsion flow liners, we delayed three flights. Indicator 1. Baselined Flight Requirements Document During inspection of OV-104 (Atlantis) propulsion sys- (FRD) tracks achievement of this goal and it defines the tem hardware, inspectors found cracks in the fuel flow primary cargo manifest that uses the 12-month template liner. The Program Inspection Team was committed to Results. There were four Shuttle missions in FY 2002. making sure the vehicle was safe even if it meant signifi- All missions used the 12-month template. Delays that cant delays. A multicenter team gathered to find a repair occur after the signed flight requirements document date option and get the orbiters flying again. The delay in occur because of events such as unplanned but necessary meeting our flight goals is regrettable, but our emphasis safety modifications, payload readiness and test schedule on safety is correct. The FY 2002 performance proved changes, and changes in flight dates. that our safety system is sound. Overall, the mission success trend remains good. The Space Shuttle Program Data Quality. Performance data accurately reflect safely supported operating time for secondaries, expend- achievements in FY 2002. The FRD is a Space Shuttle able launch vehicles, docking and undocking with the Program controlled document. It reflects the mission’s Station, and the capture and redeployment of the Hubble planned launch date and the schedule for key integration Space Telescope. We achieved a rating of green for this tasks. NASA maintains a record of all FRDs for each performance goal. Shuttle mission and all changes to it.

Indicator 1. Achieve 100 percent on-orbit mission success Data Sources. The FRD is an internal Space Shuttle for all flights in FY 2002. For this metric, mission success Program controlled document. The FRDs for the four criteria are those provided to the prime contractor FY 2002 Shuttle launches were as follows: (SFOC) for purposes of determining successful accomplishment of the performance incentive fees in the contract Launch Planning Shuttle Initial FRD Date at FRD Flight Signed Results. All four missions achieved all of their objec- Initiation tives. STS-108 (Space Shuttle Endeavor) carried the STS-108 09/26/00 10/04/01 Expedition 4 crew and logistics to the Station in December 2001. This mission also honored the victims of STS-109 09/22/00 11/01/01 the September 11, 2001, terrorist attacks by the Flags for STS-110 12/19/00 01/17/02 Heroes and Families campaign, carrying thousands of STS-111 03/05/01 03/14/02 U.S. flags into space. The flags were given to victims of the attacks or their families. STS-109, the fourth mission Annual Performance Goal 2H09. Have in place a to service the Hubble, extended the life-expectancy and Shuttle safety investment program that ensures the avail- capabilities of the famous orbiting telescope. STS-110, ability of a safe and reliable Shuttle system for Station the 13th U.S. mission to the Station, carried the first assembly and operations. major external truss section for the Station. On June 5, 2002, we launched STS-111, which carried the fifth resi- This year’s assessment is an improvement over previous dent crew to the station and the Leonardo logistics mod- years. We met milestones for the following safety ule filled with experiments. upgrades: the advanced health management system, which will provide improved real-time monitoring of Data Quality. Mission success data accurately reflect engine performance and environmental data, improved performance and achievements in FY 2002. engine health advisories, better response to anomalies, and reduced risk of catastrophic engine failure; main Data Sources. The Space Shuttle Customer and Flight landing gear, which will allow tire designs that are capa- Integration Office conducts customer surveys and con- ble of higher landing speeds, allow higher cross winds verts them to mission success metrics. The office keeps and landing load limits, mitigate obsolescence issues, and the metrics for each flight. improve margins for pressure leakage and colder temperatures; and cockpit avionics upgrade, which will enhance Annual Performance Goal 2H08. Maintain a Shuttle safety by providing the crew with unprecedented 12-month manifest preparation time. situational awareness for aborts and system failures. Two other upgrades, development of external tank friction stir The 12-month manifest preparation template is a standard welding (which will improve joint strength) and industri- work template we created to identify the recurring inte- al engineering for safety (which will reduce risks to gration efforts for a nominal (that is, normal and success- ground personnel and flight hardware), are also proceed- ful) Shuttle mission. All four Shuttle launches in FY 2002 ing on schedule. Accordingly, we earned a rating of green used the template. Its use is beneficial because it provides for this performance goal. customers with an easy to grasp series of tasks needed to integrate and launch a Shuttle mission. For this annual Indicator 1. Meet the major FY 2002 Space Shuttle Safety performance goal, we earned a rating of green. Upgrade milestones. For purposes of this metric, major

Part II • Supporting Data • Human Exploration and Development of Space 187 milestones are defined to be: the Preliminary Design Review Results. In this performance period, the planned payload dates, Critical Design Review dates, Ready for Upgrade allocation for power and telemetry was available Installation/Integration with Flight Hardware/Software 80 percent of the time. In addition, crew time was dates, and Ready dates for first flight dates sufficient to accomplish all planned research objectives. The total research crew time (for three increment Station Results. This activity is essential to providing safe and crews) in FY 2002 was 920 hours. To date, we have reliable access to space. We accomplished all the scheduled performed 61 U.S. research investigations. The total safety upgrade project milestone reviews FY 2002. These accumulated U.S. and Russian research crew time is include the preliminary design reviews for cockpit avionics 1,497 hours. upgrade and for the main landing gear pressure sensor. Data Quality. The reported performance data accurately Data Quality. The performance data accurately reflect reflect achievements in FY 2002. There is also a supporta- achievements in FY 2002. The data represent the power bility upgrade program, which is not included in this metric. margins and telemetry available for use at the end of each flight. The crew time metrics reflect the research hours Data Sources. The Shuttle Upgrade Major Milestones performed by the crews (increments 3, 4, and 5). Because Summary is available at http://sspweb.jsc.nasa.gov/ crew time is calculated by increments rather than by fis- upgrades/ (under the link for Upgrades Schedules). Brief cal year, the hours are approximations. We base research descriptions of the projects are under the Upgrade Road objectives on the number of middeck lockers, up mass, Show link. and the 20-hour-per-week available crew time; the objectives are determined before each increment launch. Strategic Objective 2. Operate the Station to advance science, exploration, engineering, and Data Sources. The Station research accommodations commerce status is located at http://iss-www.jsc. nasa.gov/ss/issapt/ pmo/gprametrics.htm; however, this URL is accessible Annual Performance Goal 2H10. Demonstrate only if you have access to NASA servers. A new manage- Station on-orbit vehicle operational safety, reliability, ment information system will provide stakeholders access and performance. to key performance metrics in FY 2003. The Station provides a safe, reliable platform for scientific Annual Performance Goal 2H11. Demonstrate Space research even as assembly of the Station proceeds. Our rat- Station Program progress and readiness at a level sufficient ing for this performance goal is green. to show adequate readiness in the assembly schedule. Indicator 1. Zero safety incidents (i.e., no on-orbit injuries) The results of this annual performance goal and its Results. No on-orbit safety incidents occurred, and suf- associated indicators are located in the Highlights of ficient crew time, power, and telemetry were available to Performance Goals and Results section of Part I. complete all scheduled research. Annual Performance Goal 2H12. Successfully com- Our careful monitoring of critical systems and operations plete 90 percent of the Station planned mission objectives. and our attention to safety and mishap prevention has helped us complete mission objectives. The results of this annual performance goal and its associated indicators are located in the Highlights of Data Quality. The data report provided by Performance Goals and Results section of Part I. NASA’s Office of Safety and Mission Assurance accurately reflects the safety and reliability performance Strategic Objective 3. Meet sustained space oper- of the Space Station Program in FY 2002. There were no ations needs while reducing costs data limitations. Annual Performance Goal 2H15. The Space Data Sources. The Safety and Mission Assurance on- Communications Program will conduct tasks that enable orbit assessment metric is located at http://iss-www. commercialization and will minimize investment in gov- jsc.nasa.gov/ss/issapt/pmo/gprametrics.htm; however, ernment infrastructure for which commercial alternatives this URL is accessible only if you have access to the are being developed. NASA servers. NASA is developing a new NASA management information system that will provide stakehold- This year’s assessment of green demonstrates increased in ers access to key performance metrics and will complete the use of commercial data services, continuing the trend it within the next performance period. of previous years. Indicator 2. Actual resources available to the Indicator 1. Increase the percentage of the Space payloads measured against the planned payload Operations budget allocated to the acquisition of commu- allocation for power, crew time and telemetry (green = nications and data services from the commercial sector 80 percent or greater) from 15 percent in FY 2001 to 20 percent in FY 2002

188 NASA FY 2002 Performance and Accountability Report Results. Based upon review of contract reports and the reworked research priorities for the budget submission. original intent of this metric, the Space Communications Two independent cost estimation organizations have esti- Program used 20 percent of its Consolidated Space mated and validated the Space Station Program baseline Operations Contract budget for commercial services. We cost. The validated cost estimates from the two studies are increased our use of commercial ground stations and within 10 percent of the Space Station Program baseline video and teleconferencing services. The achievement of cost in most years. We have established a coordination this goal will lead to further performance improvements process with our international partners to discuss and in the future. agree upon options to meet utilization and research requirements. The Space Station Program has found oper- Data Quality. The results accurately reflect the ational cost savings to address a cost disconnect reflected performance in FY 2002. in the President’s FY 2002 Budget. Data Sources. Data were obtained from Center budget In this fiscal year, NASA began using a new management documents and from Space Operations Management strategy to achieve high priority Space Station Program Office commercialization plan measurements. objectives within the funding limitations. Despite this Annual Performance Goal 2H16. Performance met- positive step, it is still clear that we must demonstrate to rics for each mission will be consistent with detailed pro- the Administration and to Congress that we can complete gram and project operations requirements in project our missions within budget. Until this is accomplished, Service Level Agreements. our overall assessment rating is yellow. This year’s data delivery record was above the Data Quality. The data accurately reflect changes and 95-percent-of-plan goal of the indicator. We achieved a progress made In FY 2002. Progress in correcting past rating of blue and continued the trend of previous years. management deficiencies is monitored by the NASA Indicator 1. Achieve at least 95 percent of planned data Internal Control Council chaired by the NASA Deputy delivery for space flight missions Administrator and, in November 2002, by the Management and Cost Evaluation Task Force. NASA and Results. The Space Communications Program delivered the OMB are working on success criteria for restoring over 98 percent of planned data delivery. confidence in Space Station Program management. Data Quality. The results accurately reflect the Data Sources. Performance assessment data are performance in FY 2002. obtained from normal reporting. Data Sources. The data were obtained from the monthly program management reviews, including opera- Strategic Goal 3. Enable the commercial develop- tions metrics reports for space science, Earth science, and ment of space human spaceflight facilities. Strategic Objective 1. Improve the accessibility of Annual Performance Goal 2H19. Develop and exe- space to meet the needs of commercial research cute a management plan and open future Station hard- and development ware and service procurements to innovation and cost- saving ideas. Annual Performance Goal 2H17. Provide an average of five mid-deck lockers on each Shuttle mission to the Indicator 1. Implement management plan—The Station for research. International Space Station Program Management Action Plan (PMAP) addresses the cost and management chal- NASA exceeded the commitment to fly an average of five lenges/risks in OMB, GAO, and NASA OIG reports. It middeck lockers, dedicated to science, aboard each Space contains reforms that strengthen Headquarters involve- Shuttle mission to the Station in FY 2002. We achieved a ment, increases communications, provides more accurate rating of green. Because this is the first year for this per- assessment and maintains budget accountability formance goal, trend data are not available. Results. The Station’s assembly element hardware is on Indicator 1. Demonstrate that an average of five mid-deck schedule. Task agreements to provide the Space Station lockers was used to support research on Shuttle mission Program Manager with more direct control of all Space going to the Station (source Station manifest) Station Program staff support are in place. The new Results. In FY 2002, the Space Station Program provid- Deputy Associate Administrator, who oversees both Space ed the science community with nine mid-deck lockers on Station and Space Shuttle Programs, has established more the first utilization flight, nine mid-deck lockers on the management controls. The Space Station Program plans to truss delivery flight, and almost six full lockers on the consolidate 28 directly managed contracts into 6, with second utilization flight. earned value reporting as a contract requirement. Five of the seven contracts are competitive procurements that Data Quality. The data report provided by the align with the President’s Management Agenda. We have Space Station Program office accurately reflects the

Part II • Supporting Data • Human Exploration and Development of Space 189 performance of the Space Station Program. The data per- Indicator 1. Materially participate in the development tain only to FY 2002, and align with the FY 2002 Revised and issuance of a NASA-wide enhanced space commerce Final Performance Plan. strategy document; and produce formal documents that demonstrate serious potential collaboration with at least Data Sources. Performance assessment data are three private sector companies obtained from normal project management reporting.

Annual Performance Goal 2H18. Establish mecha- Results. In FY 2002, we participated materially in the nisms to enable NASA access to the use of U.S. com- development of the new NASA mission and vision state- mercially developed launch systems. ments and the implementation of the President’s Management Agenda. We tailored our efforts to enable NASA has five active launch service contracts. Four of the commercial development of space to further the over- these contracts include firm and option launch services, all NASA mission and vision and the President’s which we have exercised. The most recent contract covers Management Agenda. Examples are described earlier in a broad range of launch capabilities and includes an “on- this report, including efforts to enhance the use of com- ramp” opportunity allowing service providers to intro- mercial launch services (annual performance goal 2H18) duce qualified launch vehicles not available at the time of and our evaluation of options for Shuttle privatization contract award. The intent of the on-ramp is to foster (annual performance goal 2H21). Along with those activ- competition for future launch services. Each February ities, we developed formal collaborations with private and August during the 10-year life of this contract, NASA companies. One collaboration involves the development accepts proposals for new launch service capabilities. We of flexible and inflatable technologies that will enhance achieved a rating of green for this performance goal. future human exploration; another, a commercial research Indicator 1. NASA launch service contracts in place or experiment on the Station; and a third collaboration will planned with annual on-ramps for newly developed enhance our education and outreach efforts. commercial launch services as they meet NASA’s risk Data Quality. Data quality information for annual per- mitigation policy formance goals 2H18 and 2H21 are described in those Results. We received no on-ramp proposals in February sections. Information about collaborations is derived from and only one proposal in August. We are evaluating the Space Act Agreements and Memoranda of Understanding proposal received in August. with private sector companies.

Data Quality. The performance data reported accurately Data Sources. The performance data were obtained reflect achievements in FY 2002. from normal program reporting and from procurement documents. For more information about NASA’s com- Data Sources. The performance data were obtained from mercial development of space activities, see http://www. normal program reporting and from procurement documents. commercial.nasa.gov/. For more information about the NASA Launch Services contract request for proposal, including the on-ramp provisions, Annual Performance Goal 2H21. Continue imple- see http://www.ksc.nasa.gov/procurement/nls/index.html. mentation of planned and new Shuttle privatization efforts We post notices to the public of the upcoming open sea- and further efforts to safely and effectively transfer civil service positions and responsibilities to private industry. son for on-ramps on the NASA Acquisition Internet Service Web site a month before each February and The results of this annual performance goal and its asso- August open season. See http://prod.nais.nasa.gov/cgi- ciated indicators are located in the Highlights of bin/nais/index.cgi. Performance Goals and Results section of Part I.

Strategic Objective 2. Foster commercial endeav- Strategic Goal 4. Share the experience and bene- ors with the Station and other assets fits of discovery Strategic Objective 3. Develop new capabilities for human space flight and commercial applications Strategic Objective 1. Provide significantly more through partnerships with the private sector value to significantly more people through exploration and space development efforts Annual Performance Goal 2H26. Increase collaboration in space commerce with a variety of industry, acade- Annual Performance Goal 2H24. Expand public mia and non-profit organizations. access to HEDS missions information (especially the Station) by working with industry to create media projects This is the first year for this metric. The FY 2002 perform- and public engagement initiatives that allow first-hand ance indicator was achieved because of new collaborations public participation using telepresence for current mis- that advance our exploration, research and outreach efforts. sions, and virtual reality or mock-ups for future missions Our rating for this performance goal is green. beyond Earth orbit.

190 NASA FY 2002 Performance and Accountability Report We provided considerable public access to mission Indicator 2. Public Web presence—Track number and information (especially the Station) and public participa- duration of visits to the Human Exploration and tion venues using mockups, the Web, and media. Our Development of Space (HEDS) Web site personnel participated in various educational, commercial, and political events that provided hands-on opportunities Results. The HEDS Web site provides public access to for the public to experience and become more knowledge- real-time the Station mission information such as Station able about the Station and the Destiny module. Over a half time in orbit, Station news, and living in space. It also million people toured these mockups and the visitor cen- includes other interactive activities such as a ham radio ters at the spaceflight Centers (Johnson, Kennedy, project in which dozens of orbiting astronauts used the Marshall, and Stennis). For this performance goal, we Shuttle Amateur Radio Experiment to talk to thousands of earned a rating of yellow. Because this is the first year for schoolchildren and their families. They have pioneered this performance goal, trend data are not available. space radio experimentation, including television and text messaging and voice communication. Other interactive Indicator 1. Museums—Track the number of science links inform the public about research projects on the museums and other informal education forums incorpo- Station. The curator of the Human Exploration and rating first person participation with the Station Development of Space Web site reported an average of 14 million hits per week in FY 2002, the approximate num- Results. Data from individual installations make clear ber of hits for FY 2002 was 728 million. The duration of that the NASA Headquarters and Centers are actively each Web site was not provided since the Web site visits supporting science museum and informal education are not currently being tracked. events. According to the metrics maintained by the NASA Kennedy’s External Relations and Business Data Quality. The FY 2002 estimate extrapolated the Development Directorate, Kennedy participated in 76 weekly average over a 52-week year. informal kindergarten through grade 12 educational Data Sources. The data provided came from the metrics events. In FY 2002, the audience for these events was provided by the HEDS Web site curator. Remaining data 64,560 people who visited science fairs, career days, came directly from the Web site (http://www. National Engineers Week events, and classroom presen- spaceflight.nasa.gov/). tations. Other events supported by several Centers and NASA Headquarters include the following: Strategic Objective 2. Advance the scientific, IMAX—Space Station 3-D: Thousands of movie goers technological, and academic achievement of the experienced what it is like to travel, live, and work in Nation by sharing our knowledge, capabilities, space and the experience of exploration and discovery and assets aboard the Station. More than 45 major media stations Annual Performance Goal 2H28. Initiate the develop- aired information on the film during 2 days in April. ment and implementation of a formal and systematic mechanism to integrate HEDS latest research knowledge National Medical Association: NASA astronauts provided into the kindergarten through grade 12 or university class- information about their missions and research, including room environment. delivery of the Destiny Lab to the Station and medical research aboard the Lab. The National Medical Associ- Indicator 1. Research and develop products, services, ation is the leading organization focusing on medical and distance learning methodologies that facilitate science and African American health issues. Tours of a the application of technology to enhance the educa- full-scale mockup of the Destiny Lab provided hands-on tional process for formal and informal education and experience with Destiny Lab features. lifelong learning.

Science Museums: (1) Ogden Museum: exhibit featuring Results. In FY 2002, the human exploration and devel- the Destiny Module and Environmental Control and Life opment of space effort used such technological tools as Support System racks. Estimated number of participants: videoconferencing, the Web, satellite television, and 60,000 people including 4,000 to 5,000 students per day. videotape programs to engage and excite learners of all (2) Golden State Museum: Exhibited mini-towers that ages. Of our 53 programs surveyed at space flight Centers featured mockups of future space missions. Estimate in FY 2002, 33 percent focus on supporting students and number of people: 29,000. about 40 percent have a research and development component. Fully 25 percent of programs offer each of the Data Quality. The data accurately represent events that following: curriculum support and development, teacher/ occurred in FY 2002. faculty preparation and enhancement, and systemic improvement of education. Just under 20 percent of our Data Sources. The spaceflight Centers (Johnson, programs incorporate educational technology as an objec- Kennedy, Marshall, and Stennis) provided the data. tive to enhance the educational process for formal and

Part II • Supporting Data • Human Exploration and Development of Space 191 informal education and lifelong learning. Some examples • NASA Explores MSFC (Marshall Space Flight Center), of these projects include: an Internet-based, distance learning resource about NASA’s research and technology and presented in timely, • The NASA Distance Learning Outpost (Johnson Space high-quality, standards-based educational materials. Center), a distance learning method of delivering NASA educational materials to groups that are remote Data Quality. The data represent actual education to NASA facilities program activity that occurred during the FY 2002 • The Exploration Station (Kennedy Space Center), an performance period. This information appears in the easily accessible facility containing a variety of Education Implementation Action Plan. educational technologies and materials, which is staffed by professional educators versed in national Data Sources. The information for this performance education standards measure was provided by the education leads and managers at each of the spaceflight Centers and from these • Mississippi Education Involvement (Stennis Space Web sites: http://learningoutpost.jsc.nasa.gov/index.html Center), a coordinated plan of statewide efforts for and http://wwwedu.ssc.nasa.gov/distance_learn/dist_ educational, economic, and social success in Mississippi learn.htm#NASA Stennis Space Center.

192 NASA FY 2002 Performance and Accountability Report Aerospace Technology

Strategic Goal 1. Revolutionize Aviation—Enable Data Quality. Mission performance data accurately the safe, environmentally friendly expansion reflect achievements in FY 2002. The research data were of aviation acquired using test techniques and instruments accepted by the FAA for previous commercial engine certification Strategic Objective 1. Increase Safety—Make a programs safe air transportation system even safer Data Sources. Performance assessment data are from Annual Performance Goal 2R1. Complete the interim normal management reporting and are verified and vali- progress assessment utilizing the technology products of dated by program managers. the Aviation Safety program as well as the related Aerospace Base R&T efforts and transfer to industry an Indicator 2. Select ceramic thermal barrier coating icing CD-ROM, conduct at least one demonstration of an and process aviation safety related subsystem, and develop at least two-thirds of the planned models and simulations. Results. Several ceramic coating materials prepared using a combination of plasma spray and physical vapor The results of this annual performance goal and its asso- deposition underwent screening for thermal conductivity ciated indicators are located in the Highlights of the and resistance to sintering. One coating withstood tem- Performance Goals and Results section of Part I. peratures 300 degrees Fahrenheit higher than typical turbine blades and 1,200 cycles (100 hot hours) at 2,480 Strategic Objective 2. Reduce Emissions—Protect degrees Fahrenheit surface temperature. We selected that local air quality and our global climate coating system for further testing on turbine blades. By Annual Performance Goal 2R2. NASA’s research significantly increasing temperature, capability of both stresses engine technology to reduce the emissions of turbine and combustor components, this new coating will oxides of nitrogen (NOx) and carbon dioxide (CO2). The increase engine turbine efficiency and reduce emissions. annual performance goal is to complete sector testing of a low-NOx combustor concept capable of a 70 percent Data Quality. Mission performance data accurately reduction in NOx from the 1996 [International Civil Aviation reflect achievements in FY 2002. The research data were Organization (ICAO)] baseline, and demonstrate at least acquired using test techniques accepted by the FAA for one additional concept for the reduction of other previous commercial engine certification programs. emittants. The research data were acquired using test techniques accept- NASA met this goal by assessing the results of sector ed by the FAA for previous commercial engine certification testing of a low nitrogen oxides combustor and programs. determining that this technology, with a normal program of technology maturation, will be capable of reducing Data Sources. Performance assessment data were nitrogen oxides emissions by 70 percent from the 1996 obtained from normal management reporting and are veri- baseline. We also demonstrated several other concepts that fied and validated by program managers. promise additional reductions in nitrogen oxides and Indicator 3. Demonstrate aspirating seal technology carbon dioxide emissions. We achieved a rating of green for this annual performance goal. Results. The partnership between NASA and GE Aircraft Engines to test full-scale aspirating seal in a Indicator 1. Complete sector evaluations of a combustor GE90 engine will demonstrate the improved engine per- capable of a 70 percent reduction in oxides of nitrogen formance possible with these seals. This improved per- Results. A low-nitrogen oxides combustor concept, tested formance will mean reduced fuel usage and, thus, fewer in a sector configuration (or segment of a full combustor), carbon dioxide emissions. However, GE Aircraft Engines has demonstrated a 67 percent reduction in nitrogen oxides delayed the certification and field tests of its engine, emissions below the 1996 International Civil Aircraft which caused us to delay the demonstration test of the Organization standards. This is just 3 points from our goal. aspirating seal. The combustor sector ran at temperature and pressure con- Data Quality. Mission performance data accurately ditions typical of engines in commercial service today. reflect achievements in FY 2002. We expect to accom- Emissions measurements were for the landing, takeoff, and plish this performance measure in FY 2003. cruise conditions over which environmentally friendly commercial engines will operate in the future. The demonstra- Data Sources. Performance assessment data were tion increases our confidence that the full combustor can obtained from normal management reporting and are ver- meet the 70-percent-reduction goal. ified and validated by program managers.

Part II • Supporting Data • Aerospace Technology 193 Annual Performance Goal Trends for Aerospace Technology

Annual Performance Assessment Performance Goal FY 1999 FY 2000 FY 2001 FY 2002

Strategic Goal 1. Revolutionize Aviation—Enable the safe, environmentally friendly expansion of aviation.

Objective 1. Increase Safety—Make a safe air transportation system even safer. 2R1 Objective 2. Reduce Emissions—Protect local air quality and our global climate. 2R2 Objective 3. Reduce Noise—Reduce aircraft noise to benefit airport neighbors, the aviation industry, and travelers. 2R3 N/A Objective 4. Increase Capacity—Enable the movement of more air passengers with fewer delays. 2R4 N/A Objective 5. Increase Mobility—Enable people to travel faster and farther, anywhere, anytime. 2R5

Strategic Goal 2. Advance Space Transportation—Create a safe, affordable highway through the air and into space.

Objective 1. Mission Safety—Radically improve the safety and reliability of space launch systems. 2R6 N/A N/A N/A Objective 2. Mission Affordability—Create an affordable highway to space. 2R7 Objective 3. Mission Reach—Extend our reach in space with faster travel times. 2R8 N/A Strategic Goal 3. Pioneer Technology Innovation—Enable a revolution in aerospace systems.

Objective 1. Engineering Innovation—Enable rapid, high-confidence, and cost efficient design of revolutionary systems. 2R9 Objective 2. Technology Innovation—Enable fundamentally new aerospace system capabilities and missions. 2R10 Strategic Goal 4. Commercialize Technology—Extend the commercial application of NASA technology for economic benefit and improved quality of life. Objective 1. Commercialization—Facilitate the greatest practical utilization of NASA know-how and physical assets by U.S. industry. 2R11 2R12 Strategic Goal 5. Space Transportation Management—Provide commercial industry with the opportunity to meet NASA’s future launch needs, including human access to space, with new launch vehicles that promise to dramatically reduce cost and improve safety and reliability. Objective 1. Utilize NASA’s Space Transportation Council in combination with an External Independent Review Team to assure agency-level integration of near and far-term space transportation investments. 2R13 N/A N/A N/A

Indicator 4. Develop an integrated component demonstra- technologies. The plan covers transcontinental (large tion plan for collaborative tests of engine demonstrators thrust) and regional jets (small thrust) aircraft. The plan incorporating Ultra-Efficient Engine Technologies (UEET) provides the U.S. industry and NASA an integrated, sys- technologies for large and small thrust class engines tematic process to demonstrate viable technologies for Results. We completed an integrated component demon- advanced turbine engine components and systems. stration plan that includes planned system studies conducted with five engine companies, describes candidate Data Quality. Mission performance data accurately propulsion systems, and identifies high risk, high payoff reflect achievements in FY 2002.

194 NASA FY 2002 Performance and Accountability Report Data Sources. Performance assessment data were Data Sources. Performance assessment data were obtained from normal management reporting and are ver- obtained from normal management reporting and are verified and validated by program managers. ified and validated by program managers.

Indicator 5. Assess hybrid fuel cell and liquid hydrogen Indicator 7. Identify revolutionary aeropropulsion con- fueled optimized turbofan concepts cepts identified and assess preliminary performance

Results. We completed two feasibility studies of hydro- Results. An expert team assessed more than 115 propos- gen-powered aircraft. The first study considered a two- als for advanced aeropropulsion technology concepts and seat, fuel-cell-powered aircraft with current state-of-the- chose 53 for funding. Assessment outcomes included (1) art components, and the second study considered a liquid- 28 university grants for a broad range of revolutionary hydrogen-engine aircraft with current, 2009, and 2022 propulsion technologies; (2) 8 sizable awards in areas technology levels. Results of the first study show the fea- such as microengines and ultra-high-power-density sibility of a two-seat, fuel cell-powered with a 54-nauti- motors; and (3) reinforcement, replanning, or termination cal-mile range and a 140-pound payload. Results of the of 20 NASA in-house research tasks. This assessment second study show that transport aircraft, optimized for allowed us to optimize our investment to produce tech- use with liquid hydrogen fuel and with 2022 technologies, nologies capable of twice the payload and range of cur- could have a 52-percent lower take-off gross weight, rent aircraft, air travel with near-zero to zero emissions, or lower nitrogen oxides emissions, and no carbon dioxide high-performance aircraft missions. emissions for the same payload and range as a conventional fueled aircraft. Data Quality. Mission performance data accurately reflect achievements in FY 2002. A team of NASA Data Quality. Mission performance data accurately experts conducted this assessment. Their results were reflect achievements in FY 2002. consistent with an assessment conducted by Quality These results are first-order assessments of the feasibility, Function Deployment experts from the Georgia Institute benefits, and key technology barriers for both a hybrid of Technology. fuel-cell propulsion system and hydrogen fueled subson- Data Sources. Performance assessment data were ic transport resulting in zero carbon dioxide emissions. obtained obtained from normal management reporting Industry counterparts appraised the data and results and and are verified and validated by program managers. deemed them to be of sufficient fidelity to achieve the study’s objective. Indicator 8. Demonstrate durability of a 2,200 degrees Fahrenheit ceramic matrix composite combustor liner. Data Sources. Performance assessment data were (Increase in the budget by the U.S. Congress) obtained from normal management reporting and are verified and validated by program managers. Industry Results. NASA fabricated a set of full-scale ceramic sources provided state of the art component information matrix composite (CMC) liners and conducted a rig test for this assessment. to provide data to enable a go/no-go decision to be made Indicator 6. Demonstrate concepts for reduction in regarding a follow-on engine test. The objectives of this gaseous, particulate, and aerosol emissions effort were to design, demonstrate the feasibility of alternate fiber architecture, and manufacture a set of full-scale Results. NASA developed and demonstrated an all- liners to be used to demonstrate the cyclic durability of a metal multipoint fuel-injection concept, the lean direct silicon carbide fiber reinforced silicon carbide combustor injector, in partnership with Goodrich Aerospace. The liner in a rig test. In addition, alternate methods of manu- injector uses small mixing and combustion zones to max- facturing the CMC liners were to be investigated. Based imize mixing and minimize emissions. Goodrich upon the liner performance during the rig test, NASA Aerospace built the injector, and NASA tested it flame decided to proceed onto a production engine test of the tube rig. Test conditions were limited to those comparable CMC liners, which is planned for FY2003. to full power operation for a regional jet class engine and to about 30 percent cruise power for a large transport Data Quality. Mission performance data accurately class engine. At landing and take-off conditions, the injec- reflect achievements in FY 2002. tor concept’s nitrogen oxides emission was 80.5 percent Data Sources. Performance assessment data were lower than the 1996 International Civil Aircraft obtained from normal management reporting and are ver- Organization Standard. The measured particulate and ified and validated by program managers. aerosol emissions were at least an order of magnitude lower than those of an operational turbine engine. Strategic Objective 3. Reduce Noise—Reduce air- Data Quality. Mission performance data accurately craft noise to benefit airport neighbors, the avia- reflect achievements in FY 2002. tion industry, and travelers

Part II • Supporting Data • Aerospace Technology 195 Annual Performance Goal 2R3. NASA’s research than the older one, and the use of the Linux operating sys- stresses reducing noise in the areas of engines, nacelles, tem means more industry partners can use it. engine-airframe integration, aircraft interiors and flight procedures. The annual performance goal is to assess and Data Quality. Mission performance data accurately establish the strongest candidate technologies to meet the reflect achievements in FY 2002. 10-decibel reduction in community noise. Data Sources. Performance assessment data were We met this annual performance goal by identifying the obtained from normal management reporting and are ver- dominant contributors to total aircraft noise and identifying ified and validated by program managers. concepts that would reduce or mitigate their effect. In addition, we developed an advance physics-based noise-predic- Strategic Objective 4. Increase Capacity—Enable the tion code. We achieved a rating of green for this perform- movement of more air passengers with fewer delays ance goal. Annual Performance Goal 2R4. NASA’s research Indicator 1. Identify community noise impact reduction stresses operations systems for safe, efficient air traffic technology required to meet 10-year, 10-decibel management and new aircraft configurations for high pro- Enterprise goal ductivity utilization of existing runways. The annual performance goal is to develop a decision support tool, and Results. An aircraft-level system study identified the define concepts for future aviation systems. dominant contributors to community noise: for the airframe, the landing gear is the primary source, followed by We met this annual performance goal by the successfully flaps and slats; for the engine, the dominant noise sources demonstrating two decision-support tools and the identi- are the jet and the fan, particularly fan noise that radiates fying concepts that have the potential for safely increas- through the aft duct. Technologies to reduce landing gear ing the capacity of a future National Airspace System. For noise entail streamlining flow around gear to produce a this performance measure, we achieved a rating of green. virtual gear fairing. In addition to changes to the landing gear itself, an operational modification is later deploy- Indicator 1. Develop and evaluate interoperability of ment of landing gear. Promising technologies for reduc- decision support tools that address arrival, surface, and ing engine noise include blowing from the trailing edge of departure operations the fan, sweeping the fan blades forward, and using a Results. We conducted a simulation of the interoperabil- splitter in the aft fan duct. These physics-based jet-noise- ity of two new graphical traffic automation tools, the prediction codes will enable us to optimize noise-reduc- Surface Management System and Traffic Management ing nozzle concepts. Simulations identified operations Advisor, in an environment simulating the Dallas Fort that could reduce community noise: The continuous- Worth Airport. Tower controllers from the airport, includ- descent approach and delayed landing-gear deployment ing the Traffic Management Coordinator and supervisor, holds the most promise for community noise reduction. controlled traffic and managed the airport runways. The These and other concepts will be pursued in the Quiet tools worked well together and provided good decision Aircraft Technology Program, and at the end of FY 2003 support. In the simulation, runways 17R and 17C were ini- the projected component benefits will be assessed on an tially for departures, and runway 17L was for arrivals. The airplane basis. Traffic Management Coordinator, who had to decide when Data Quality. Mission performance data accurately to switch runway 17C from departures to arrivals, judged reflect achievements in FY 2002. the predicted arrivals and departures timelines to be the most helpful in determining when to change the runway Data Sources. Performance assessment data were configuration. These tools provide information for manag- obtained from normal management reporting and are ver- ing the tradeoff between arrival and departure capacities ified and validated by program managers. more effectively and, so, for reducing delays at airports.

Indicator 2. Deliver initial version of improved aircraft Data Quality. Mission performance data accurately systems noise prediction code reflect achievements in FY 2002.

Results. A new code, Advanced Vehicle Analysis Tool Two tower controllers from Memphis and Norfolk air- for Acoustics Research (AVATAR) was delivered. It has ports and representatives from several air carriers (FedEx, all the prediction capabilities of Aircraft Noise Prediction UPS, Northwest Airlines, United Airlines, and American Program (ANOPP) and the following: Linux operating Airlines) observed portions of the simulation and com- system compatible, correction for propagation of jet noise mented on it. through shear layer, prediction for advanced (ultra) high- bypass ratio engines, airframe subcomponent noise pre- Data Sources. Performance assessment data were diction, and atmospheric propagation (wind and tempera- obtained from normal management reporting and are ver- ture) effects. The new code is more accurate and faster ified and validated by program managers.

196 NASA FY 2002 Performance and Accountability Report Indicator 2. Develop and evaluate a traffic flow manage- Results. This activity was terminated in FY 2002, and no ment decision support tool for system-wide prediction of work was conducted. sector loading Data Quality. Not applicable. Results. The newly developed Traffic Flow Automation System, a decision-support tool for predicting traffic loads, Data Sources. Not applicable. demonstrated its accuracy and speed. The software, running on a Unix-based computer cluster, processed all of the air Strategic Objective 5. Increase Mobility—Enable peo- traffic in the national airspace system’s 20 Air Route Traffic ple to travel faster and farther, anywhere, anytime Control Centers simultaneously. It was the first time this Annual Performance Goal 2R5. NASA’s research type of algorithm and model have been used to predict traf- stresses aircraft technologies that enable the use of exist- fic flow for all air traffic in the national air system simulta- ing small community and neighborhood airports, without neously. The tool tells controllers how much air traffic will requiring control towers, radar installations, and more be entering their sector of the sky more accurately than the land use for added runway protection zones. The annual current tool and 15 to 20 seconds faster. performance goal is to baseline in partnership with the FAA, the system engineering documents for the Small Data Quality. Mission performance data accurately Aircraft Transportation System concept. reflect achievements in FY 2002. We achieved a rating of green for this performance goal. Data Sources. Performance assessment data were The accomplishments this year provide the groundwork obtained from normal management reporting and are ver- for the partnership to integrate our technologies into ified and validated by program managers. viable systems. Indicator 3. Complete virtual airspace system technology Indicator 1. Complete preparation of the baseline system real-time environments definitions and preliminary design engineering documents (including the operational requirements document, functional architecture, and tech- Results. In FY 2002, we completed the preliminary nical requirements document) for Small Aircraft design review and the system description document for Transportation System concept and place under configu- the Virtual Airspace System Technology (VAST) simula- ration management tion environment. The system will allow a real-time, system-wide, gate-to-gate, and human-in-the-loop simula- Results. The Small Aircraft Transportation System tion for evaluating air traffic management and air traffic (SATS) Project partners (NASA, FAA, and the National control concepts. Consortium for Aviation Mobility) have baselined and placed under configuration management the following Data Quality. Mission performance data accurately key Systems Engineering documents: reflect achievements in FY 2002. • Systems Engineering Management Plan: This docu- Data Sources. Performance assessment data were ment, from the SATS 01-002 Project Plan, governs the obtained from normal management reporting and are ver- system engineering activities performed by NASA and ified and validated by program managers. its partners in the conduct of the SATS Project. Indicator 4. Identify candidate future air transportation • Concepts of Operations: This document supports the system capacity-increasing operational concepts development of 2010 concepts of operations that can Results. We evaluated 18 industry operational concepts accomplish the objectives of the SATS project. The goal that could increase airspace capacity and chose to fund 8 of the 5-year project is to take the first steps towards the for further development. Each of the submitted concepts long-term SATS vision by developing key airborne tech- had to satisfy 27 required elements of the Virtual Airspace nologies to provide an integrated technology evaluation Modeling and Simulation (VAMS). With VAMS we will and validation. run trade-off analyses of air transportation systems con- • Functional Architecture: The SATS system architec- cepts and technologies. ture is composed of the functional architecture and the Data Quality. Mission performance data accurately physical architecture. These architectures are matrixed reflect achievements in FY 2002. to provide the framework by which functions can be allocated to physical entities of the SATS system. Data Sources. Performance assessment data were obtained from normal management reporting and are ver- •Operational and Technical Requirements Document: ified and validated by program managers. This document defines the structure, decomposition, attributes, and management approach to SATS Project Indicator 5. Complete the critical design review for the requirements. It includes reports from the require- blended wing body experimental vehicle ments database of all operational (Level 1 and 2) and

Part II • Supporting Data • Aerospace Technology 197 technical (Level 3 and below) requirements of the Annual Performance Goal 2R8. NASA’s long-term SATS Project. research emphasizes innovative propulsions systems. The annual performance goal is to conduct a test of an • Master Schedule: This document shows the project’s advanced ion propulsion engine. milestones and a rolled-up time phase presentation of the activities required to complete the project. We earned a rating of green for this performance goal by successfully testing a high-power ion engine. Data Quality. Mission performance data accurately reflect achievements in FY 2002. Indicator 1.Demonstrate >10 kilowatt operation of a 75- centimeter ion engine Data Sources. Performance assessment data were obtained from normal management reporting and are ver- Results. Research engineers demonstrated a 10-kilowatt ified and validated by program managers. ion engine designed for use in a nuclear electric propul- Indicator 2. Complete preliminary design of extremely sion system. Such an engine with its nearly constant slow takeoff and landing vehicle propulsion could greatly reduce trip times for interplanetary missions. The high-power ion engine with titanium Results. This activity was terminated in FY 2002, and no optics had four times the power of and a 62 percent work was conducted. greater specific impulse (a measure of rocket propulsion Data Quality. Not applicable. efficiency akin to miles per gallon) than the state-of-the- art ion engine. The high-power ion engine is 76 centime- Data Sources. Not applicable. ters in diameter, and for this test, had 50-centimeter titanium optics. Strategic Goal 2. Advance Space Transportation— Create a safe, affordable highway through the air Data Quality. Mission performance data accurately and into space reflect achievements in FY 2002. Strategic Objective 1. Mission Safety—Radically Data Sources. Performance assessment data were improve the safety and reliability of space obtained from normal management reporting and are ver- launch systems ified and validated by program managers. For more information about ion propulsion research, see http://www. Annual Performance Goal 2R6. NASA’s investments grc.nasa.gov/ WWW/Ion/. emphasize thorough mission needs development, requirements definition, and risk reduction effort leading to commercially owned and operated launch systems to Srategic Goal 3. Pioneer Technology Innovation— meet NASA needs with commercial application where Enable a revolution in aerospace systems possible. The annual performance goal is to complete risk reduction and architecture reviews to support design and Strategic Objective 1. Engineering Innovation— demonstration decisions. Enable rapid, high confidence, and cost efficient The results of this annual performance goal and its asso- design of revolutionary systems ciated indicators are located in the Highlights of Annual Performance Goal 2R9. NASA’s investments Performance Goals and Results section of Part I. emphasize advances in experimental vehicles, flight test- beds, and computing tools to enable revolutionary Strategic Objective 2. Mission Affordability— designs. The annual performance goal is to conduct at Create an affordable highway to space least five demonstrations of revolutionary aerospace subsystems. Annual Performance Goal 2R7. NASA’s investments emphasize thorough mission needs development, In FY 2002, there were 15 indicators to measure progress requirements definition, and risk reduction effort leading toward the engineering innovation strategic objective. to commercially owned and operated launch systems to Fourteen indicators were met during the fiscal year. One meet NASA needs with commercial application where indicator was not fully accomplished, but is projected to possible. The annual performance goal is to complete risk be met in FY 2003. One indicator to improve the produc- reduction and architecture reviews and initial hardware demonstrations to support design and demonstration tivity of aerospace test environments will not be accom- decisions. plished because work in that area was stopped. The overall assessment for this performance goal is green. This The results of this annual performance goal and its asso- continues the good performance of the past 3 years. ciated indicators are located in the Highlights of Performance Goals and Results section of Part I. Indicator 1. Demonstrate a prototype mishap-cause database of space transportation and exploration Strategic Objective 3. Mission Reach—Extend our system missions including the definition of the appro- reach in space with faster travel times priate taxonomies

198 NASA FY 2002 Performance and Accountability Report Results. The prototype mishap-cause database became capabilities in using the tools cannot be factored out. operational in September 2002, with core event, cause, Designing the experiment to factor out individual capa- and subsystem taxonomies that will improve risk man- bilities would require an industrial-scale setup. agement. The modular approach of the system allows the Data Sources. Performance assessment data were use of existing mishap-investigation report data (for obtained from normal management reporting and are ver- example, from NASA and National Transportation Safety ified and validated by program managers. Board (NTSB)). The taxonomy imposes consistent, concise, and complete classification of mishap causes. A Indicator 3. Integrate and demonstrate an intelligent major requirement of the taxonomy was that the classifi- flight control (IFC) into a C-17 simulation cation process be reliable and repeatable and the taxonomy itself not introduce significant bias. Designers and Results. The integration of a neural-network-based intel- managers may query the system for subsystem failure ligent flight-control system into a simulation of a military modes, previously identified pitfalls, safe-design best transport aircraft (a C-17) increases our confidence that practices, and lessons learned for the mitigation of pro- we can flight validate, over the full altitude and speed grammatic and technical risks. range, a redundant flight-control system. Two NASA and one U.S. Air Force test pilot from the C-17 test force flew Data Quality. Mission performance data accurately the simulation to ensure that neural network software flew reflect achievements in FY 2002. comparable to or better than the existing C-17 control Data Sources. Performance assessment data were law. The pilots flew a standard set of C-17 maneuvers to obtained from normal management reporting and are ver- determine simulation suitability. The pilots' assessments ified and validated by program managers. were positive. The goals of this test project is to demonstrate a control concept that uses using neural network to The prototype database is operational; however, its access identify aircraft stability and control characteristics and to is restricted until verification that any export control optimize aircraft performance in both normal and failure information is secured. conditions. Neural-network-based flight-control technol- Indicator 2. Complete a case study demonstrating soft- ogy may one day control new aerospacecraft including ware verification and validation techniques that are fighter and transport aircraft, reusable launch vehicles, applicable to Mars mission software uninhabited vehicles, and space vehicles. Results. A study of software verification and validation Data Quality. Mission performance data accurately techniques applicable to Mars mission software indi- reflect achievements in FY 2002. cates that the technology advances over the last 5 years Data Sources. Performance assessment data were have made these tools far more usable and scalable and obtained from normal management reporting and are ver- that their use can substantially ease verification and val- ified and validated by program managers. idation. Of particular concern to space missions are possible defects in autonomy software, such as faulty com- Indicator 4. Apply human-centered computing analysis ponent interactions (including interactions with the and modeling techniques to evaluate and improve the environment) and defects in the execution of plans. The Mars Exploration Rover (MER) 2003 flight team man- study also identified the gaps between current capabili- machine system performance for operations and science ties and future needs for autonomy verification. We will Results. The MERBoard Collaborative Workspace, address these gaps through a combination of technology designed to improve mission operations for the Mars and algorithmic advances to enhance precision, scalabil- Exploration Rover, has completed two field tests. The ity, and usability. Verification and validation researchers Mars Exploration Rover team used MERBoard at its mis- will work with autonomy researchers to develop tools sion system thread test and its field integrated design and and methodologies that scale as autonomy capabilities operations (FIDO) rover field test. The data gathering and improve. use patterns will be used to improve the design. Data Quality. Mission performance data accurately Data Quality. Mission performance data accurately reflect achievements in FY 2002. Four hundred hours of reflect achievements in FY 2002. data were gathered on use of these advanced verification tools applied to Mars rover software. This was done Data Sources. Performance assessment data were through a controlled experiment simulating four teams obtained from normal management reporting and are ver- with one using baseline tools team and the other three ified and validated by program managers. using separate tools. This is among the largest controlled Indicator 5. Develop conceptual high-level autonomy experiments with advanced verification tools ever per- rover architecture formed. The data quality exceeded case study requirements. However, because only eight human subjects were Results. Our concept for a high-level autonomy rover included in the experiment, the variations in individual has the following characteristics:

Part II • Supporting Data • Aerospace Technology 199 •A single command cycle short traverse and instrument The Johns Hopkins University Applied Physics placement using autonomous decision-making capa- Laboratory developed the portable neutron spectrometer bilities. This architecture will be used on the K9 rover. for the National Space Biomedical Research Institute. State of the art architecture (PathFinder) uses three or This experiment validated the in-flight suitability of the more command cycles for a short traverse. portable neutron spectrometer in flight.

•A series of long-traverse scenarios using autonomous The flight test of the propulsion flight-test fixture showed on-board replanning for obstacle avoidance and its ability, working in combination with thee F-15B to resource (time and power) management. This archi- provide a unique, low-cost flight facility for the develop- tecture will be used on Rocky 8 and Rocky 9 and is a ment and flight test of advanced propulsion systems. new capability. Propulsion and flight research capabilities up to Mach 1.8 and 1,100 pounds per square foot dynamic pressure are Data Quality. Mission performance data accurately available. reflect achievements in FY 2002. Inlet Spillage Shock Measurement flights with F-15B and Data Sources. Performance assessment data were F-5E experiment provided flight data for DARPA’s obtained from normal management reporting and are ver- Supersonic Shaped Boom Demonstration project. The ified and validated by program managers. purpose of flight test was to document baseline sonic boom signature of the aircraft (near and far field) with an Indicator 6. Demonstrate improvement in time-to-solu- emphasis on inlet spillage shocks. The Quiet Supersonic tion for aerospace applications through high-end com- Platform Program is to foster the development of new puting and end-to-end networking capabilities technologies sufficient to mitigate sonic boom to the point that unrestricted supersonic flight over land is possible. Results. Grid-based job launcher and run manager software packages were developed to automatically launch, Data Quality. Mission performance data accurately execute, monitor, restart, terminate, enter into a database, reflect achievements in FY 2002. and analyze 1,000 Cart3D Euler Code runs and 100 Overflow Navier-Stokes runs within 1 week for a liquid- Data Sources. Performance assessment data were fueled glide-back booster configuration. The software obtained from normal management reporting and are ver- enables designers of Space Launch Initiative vehicles to ified and validated by program managers. generate, rapidly and automatically, databases of concep- Indicator 8. Develop prototype environments that are dis- tual designs without requiring extensive numerical simu- tributed across heterogeneous platforms, are dynamically lation or the use of special expertise and skills. It also extensible, and which support collaborative visualization, enables a large reduction in the design cycle time by inte- analysis, and computational steering grating and automating labor intensive steps and reducing the time for database generation by a factor of 3 to 4 from Results. We created a Grid environment that provides current state-of-the-art capabilities. consistent access to heterogeneous computing platforms operated with a common policy. Seventeen platforms in Data Quality. Mission performance data accurately seven locations composed the grid, but the grid can reflect achievements in FY 2002. include more platforms. Grid-based job launcher and run manager software packages automatically launched, exe- Data Sources. Performance assessment data were cuted, monitored, restarted, terminated, entered into a obtained from normal management reporting and are ver- database, and analyzed 1,000 Cart3D Euler Code runs ified and validated by program managers. and 100 Overflow Navier-Stokes runs within 1 week for a liquid-fueled glide-back booster configuration. Users Indicator 7. Integrate and test at least 4 flight experiments shared access to the AeroDB framework that provided the on the F-15B test bed aircraft analysis, automated job management, and visualization of Results. Three experiments were successfully complet- results. Testing and data analysis using used 13 systems at ed on the F-15B test bed aircraft. Because of a U.S. Air 4 locations. After 7 days, 2,863 Cart3D and 211 Overflow Force-imposed speed restriction on all F-15s, we did not cases were completed. No special permissions or job test at speeds beyond Mach 1.5. In addition, a scarcity of queues were used. This is over three times faster than cur- F-15 aircraft and engine parts caused an extended down- rent state-of-the-art capabilities. time this year. We completed F-15B experiments for Data Quality. Mission performance data accurately Defense Advanced Research Projects Agency (DARPA), reflect achievements in FY 2002. NASA, and academia. The use of this F-15B test bed enables a more rapid transition of technology into indus- Data Sources. Performance assessment data were try, national defense, and scientific applications. We com- obtained from normal management reporting and are ver- pleted the following experiments: ified and validated by program managers.

200 NASA FY 2002 Performance and Accountability Report Indicator 9. Develop capability to redesign aerospace Indicator 11. Demonstrate automated software verifica- vehicles during flight simulations exploiting high-end tion technology that scales to aerospace software systems computing and advanced information management technologies Results. The Java PathFinder model checker, with accompanying synergistic verification technologies Results. We created a tailless version of the concept (including, abstractions, slicing, partial-order reduction, Crew Transfer Vehicle 8 within 3 days of a request and intelligent search, and environment generation tech- while tests on the CTV8 were being conducted in the ver- niques) enables the efficient analysis of object-oriented, tical motion simulator. We created the aerodynamics of concurrent programs such as those found in the next gen- the modified vehicle and then modified the geometry, eration of avionics systems. These model-checking tech- aerodynamic characteristics, and control system, also in nologies significantly reduce the effort required to ana- response to user request. The virtual laboratory allowed lyze avionics software. Currently, we analyze 1,000 lines pilots, researchers, and engineers to observe and analyze of code per day compared with 50 lines per day in 1998. data in real-time and actively participate in the test design The Java PathFinder model checker will also provide suggestions. The use of the virtual laboratory is a new increased confidence and may lower the development approach for rapid vehicle design and specifications stud- cost of next generation avionics software. ies by allowing collaborative evaluation of handling qualities of vehicles while they are still on the drawing board. Data Quality. Mission performance data accurately reflect achievements in FY 2002. Data Quality. Mission performance data accurately reflect achievements in FY 2002. Data Sources. Performance assessment data were obtained from normal management reporting and are ver- Data Sources. Performance assessment data were ified and validated by program managers. obtained from normal management reporting and are verified and validated by program managers. Indicator 12. Develop system for real-time data acquisi- Indicator 10. Demonstrate a highly integrated simulation tion and display of disparate instrumentation types environment that facilitates the rapid development of Results. We demonstrated a capability for simultaneous future generation electronic devices for PetaFLOPS com- acquisition and display of real-time data from three instru- puting and onboard computing systems for autonomous ment systems. The Developmental Aeronautics intelligent vehicles Revolutionizing Wind tunnels and Intelligent systems of Results. A quantum device simulator was developed for NASA (DARWIN) is a data delivery mechanism that con- electron transport in ultra-small and molecular devices for nects the source system and the remote customer. It cap- potential use in petaflop and low-power space computing tures both the structure and context of the data so that they systems. The results of the demonstration produced the may be retrieved and compared with other data in a man- following: development of formalism for full quantum ner that is intuitive and useful. Customers of NASA Ames mechanical transport in a range of nanoscale devices; and Langley wind tunnels will be able to use the distrib- development of numerical methods and simulation capa- uted system to directly access and compare data from tests bility to cover the range of potential nanoscale devices; conducted at either Center. implementation of simulation capability on high-performance supercomputers; demonstration of capability for In a separate project that also addressed this indicator, the ultra-small metal oxide semiconductor, field effect tran- enhancement of diagnostic software for analysis of hard- sistors, carbon nanotubes, and deoxyribonucleic acid ware malfunctions was demonstrated. The upgraded diag- (DNA) structures; journal publications and numerous nostic software in evaluating flight-like hardware and conference presentations to document the developed proved to be a faster, more compact diagnostic tool than capability; and development of scripts and other comput- previous versions (demonstrated successfully on the Deep er code enhancements for ease of use. The simulation Space-1 probe). Significant enhancements to the diagnos- environment will help speed the development of nano- tics include scalability, sensor noise, soft sensor failures, electronic components and systems for use in meeting the valve timing information, flight hardware restrictions, and needs of the Space Science and Biological and Physical ground station usability. This is enabling technology for Research Enterprises. autonomous vehicle systems that will enhance human capabilities to respond to anomalous events. Data Quality. Mission performance data accurately reflect achievements in FY 2002. Validation of the simu- Data Quality. Mission performance data accurately lations was by peer review and journal publications. reflect achievements in FY 2002. Data Sources. Performance assessment data were Data Sources. Performance assessment data were obtained from normal management reporting and are ver- obtained from normal management reporting and are verified and validated by program managers. ified and validated by program managers.

Part II • Supporting Data • Aerospace Technology 201 Indicator 13. Demonstrate turbo-prop remotely piloted Data Sources. Performance assessment data were aircraft capabilities that exceed the minimum Earth obtained from normal management reporting and are ver- Science Enterprise altitude and duration requirements ified and validated by program managers. Results. The NASA Environmental Research Aircraft Indicator 15. Demonstrate, in production facilities, and Sensor Technology (ERAST) program developed the tools and techniques for high-productivity aerospace Predator-B/Altair vehicle with General Atomics test environment Aeronautical Systems, Inc., under a joint sponsored Results. This annual performance goal was not accom- research agreement. The vehicle was selected for devel- plished. Work in this area was terminated because of opment to meet the requirements of the Earth Science insufficient progress. Enterprise for an airborne science platform. The Predator- B/Altair is the next generation reconnaissance and sensor Data Quality. Not Applicable. platform developed from the Predator vehicle. The events Data Sources. Not Applicable. of September 11, 2001, accelerated the development and test of the aircraft. In December 2001, the Air Force per- Indicator 16. Complete a Mars mission software verifi- formed a Predator-B mission that demonstrated flight cation study above 40,000 feet for greater than 24 hours and a useful Results. Verification tools were applied to modules in payload (about 750 pounds). the legacy Mars Pathfinder code and descendents of that The Altair is a Predator B aircraft with a 22-square-foot code (Deep Space-1). On Mars Pathfinder code, latent larger wing area and carries an additional 500 pounds of errors were found with minimal human effort using the fuel. The Altair will have payload and mission duration Polyspace Technology's software error detection tool, exceeding those of the Predator-B. National security despite previous extensive testing. Tool-based error detec- needs have delayed the completion of the Altair. tion finds errors earlier in the software process and with less human effort, resulting in an order of magnitude Data Quality. Mission performance data accurately improvement over the baseline in finding, localizing and reflect achievements in FY 2002. fixing errors. Other tools that find different kinds of errors Data Sources. Performance assessment data were than were applied to descendents of the Mars Pathfinder obtained from normal management reporting and are ver- code with good results. ified and validated by program managers. Data Quality. Mission performance data accurately Indicator 14. Demonstrate a viscous, solution-adaptive, reflect achievements in FY 2002. unstructured-grid Computational Fluid Dynamics Detailed records of the original Mars Pathfinder verifica- Results. An output-based adaptation, developed specifi- tion state of practice were not available. The baseline cally to minimize the error in computed drag, provides a combines generic models for aerospace software, discus- dramatic improvement in resolution over standard fea- sions with mission personnel, and records from Deep ture-based methods. With the output-based adaptation, Space-1. the grid points are distributed in a smarter fashion; that is, Data Sources. Performance assessment data were they tend to cluster in the boundary layer only. This tech- obtained from normal management reporting and are ver- nology greatly reduces the number of grid points required ified and validated by program managers. for an equivalent solution accuracy, and therefore reduces (by a factor of 15) computation time. This is a unique Strategic Objective 2. Technology Innovation— three-dimensional error assessment capability for com- Enable fundamentally new aerospace system plex geometries. The mathematically rigorous formula- capabilities and missions tion enables very efficient grids for engineering predictions with specified error levels. We accomplished this Annual Performance Goal 2R10. NASA’s investments performance metric through collaboration with the emphasize revolutionary technologies such as nanotechnology, information technology and biotechnology that Massachusetts Institute of Technology under a coopera- could enable new missions and capabilities. The annual tive agreement as part of an integrated effort to produce performance goal is to develop at least two new materi- fast, smart design and analysis methods for large-scale als concepts and demonstrate the feasibility of at least simulation. The effort includes a unique complex geome- two nanotechnology and two other concepts. try/complex flow physics capability (incompressible to planetary entry physics) developed within a modern team In FY 2002, there were 10 indicators to measure progress development environment bridging the spectrum from toward the technology innovation strategic objective. CAD to design. Eight of these indicators were met during the fiscal year. Two indicators were not fully accomplished, but we Data Quality. Mission performance data accurately expect to meet them in FY 2003. The overall assessment reflect achievements in FY 2002. for technology innovation is green. This is an improve-

202 NASA FY 2002 Performance and Accountability Report ment over the assessment for FY 2001, and a reversal of versions for any new vehicle, thus reducing the develop- the trend in performance over the past three years. ment cost significantly.

Indicator 1. Demonstration of space communication link Data Quality. Mission performance data accurately technology operating at 622 megabit per second for direct reflect achievements in FY 2002. space data distribution to users Data Sources. Performance assessment data were Results. The 622-megabit-per-second space communi- obtained from normal management reporting and are ver- cations link required development of three key microwave ified and validated by program managers. and digital technologies: a Ka-band phased array antenna, a cryogenic receiver for the ground station, and a modem Indicator 3. Demonstrate feasibility of nanotechnology- to modulate the digital data stream onto the microwave based chemical and biosensors and of manufacturing carrier frequency. Raytheon developed the electronically approaches for low-power nanoelectronic components scannable Ka-band phased array antenna on a cost share basis. The cryogenic receiver reduces the system noise (4 Results. The feasibility of nanotechnology-based sen- decibels below conventional receivers), which allows a sors and electronic components was demonstrated in much smaller Ka-band ground terminal antenna. The three areas. First, a vertically aligned carbon nanotube power-efficient digital modem, based on multicarrier fre- platform was developed to provide spatially controlled, quency techniques, combines four 155 megabit-per-sec- electrically addressable arrays for electronic components ond channels to create a wideband composite signal for and sensors. Second, nucleic acid probe molecules very high-rate information delivery. The modem and the attached to carbon nanotube tips via covalent bonding Ka-Band phased array are being used in a project to showed an ability to amplify signals for sensing devices. investigate direct data distribution from low Earth orbit Third, the electrical response of carbon nanotube field- spacecraft to distributed ground terminal sites. The low- effect transistors and indium oxide nanowire transistors to cost, autonomous ground terminal was developed and nitrogen dioxide was characterized. The nanowire transis- tested at 622 megabits per second using the cryogenic tors are a factor of 10 more sensitive than carbon nan- receiver. The low-cost ground terminal was used in mul- otube transistors, and the reliability of device fabrication tiple demonstrations to track the Station, the Shuttle, and is much improved. other low Earth orbit spacecraft. Data Quality. Mission performance data accurately Data Quality. Mission performance data accurately reflect achievements in FY 2002. reflect achievements in FY 2002. Although 622-megabit- per-second data rates were achieved, synchronization of Data Sources. Performance assessment data were data streams remained a problem. Validation and verifica- obtained from normal management reporting and are ver- tion of data were achieved through peer reviews of jour- ified and validated by program managers. nal publications and by conducting an industry review to assure that data quality met current engineering practices Indicator 4. Demonstrate the methodology to produce physics and standards. based scaling laws to quantify Reynolds number sensitivities of aerodynamic flow separation on-set and progression Data Sources. Performance assessment data were obtained from normal management reporting and are ver- Results. The joint NASA and Boeing study used ified and validated by program managers. wind tunnel data of a 2.7 percent scale model of a Indicator 2. Develop and demonstrate in flight next gen- Boeing 777, computational fluid dynamics data, and eration neural flight control flight data. Analyses of the three types of aerodynamic data led to the development of new scaling laws for Results. Neural-network flight-control algorithms flow separation on-set and progression. Flow separa- (real-time Parameter Identification and Dynamic Cell tion is an aerodynamic phenomenon that is harmful to Structure) were validated using flight hardware comput- aircraft efficiency. These new scaling laws are already ers in the Boeing Phantom Works hardware-in-the-loop in use by industry and will allow the design of more simulation in St. Louis, MO. The tests determined that fuel efficient and therefore less polluting aircraft. The the Dynamic Cell Structure learning neural net software combination of wind tunnel data, flight data, and would function properly in future flight tests. This test- highly accurate computational fluid dynamics data ing will be used as part of the flight clearance process represents a unique data set that has increased the for an F-15 flight test. This technology has the potential capability to design more efficient and therefore less to provide real-time robustness in vehicle control of polluting aircraft. unmodelled effects such as mispredicted aerodynamics or control surface failures. In addition, neural-net flight- Data Quality. Mission performance data accurately control will reduce the number of flight-control software reflect achievements in FY 2002.

Part II • Supporting Data • Aerospace Technology 203 Data Sources. Performance assessment data were reconfigure the control authority to emphasize the obtained from normal management reporting and are ver- Passport colony. Without reconfiguration, the aircraft ified and validated by program managers. became uncontrollable with a failed control effector. The simulations on the Innovative Control Effector aircraft Indicator 5. Demonstrate the ability to dynamically alter concept illustrated the effectiveness of the new aircraft the localized flow instabilities over advanced lifting sur- control algorithm to detect control system failure and faces with micro-adaptive flow control devices adapt instantly for highly complex and unconventional Results. The ability of micro-adaptive flow control sets of control effectors. devices to force attached flow on the upper surface of the Data Quality. Mission performance data accurately wing was demonstrated in prior years during feasibility reflect achievements in FY 2002. tests in Langley’s Basic Aerodynamic Research Tunnel. The follow-up tests of the aircraft configuration were Data Sources. Performance assessment data were delayed 1 year because the aluminum propeller blades obtained from normal management reporting and are ver- cracked during shakedown testing. New titanium pro- ified and validated by program managers. peller blades were delivered in August, and shakedown Indicator 7. Develop concepts for non-deterministic testing is scheduled for April or May 2003. analyses of advanced composites, including nanotube- The objective of the current activity is to incorporate reinforced polymers to characterize processing uncer- active separation control technology into the high-lift tainties on material properties system on an aircraft configuration with propellers. Results. Predicting the effect of processing uncertain- Active separation control technology, which dynamical- ties in the manufacture of composite materials, includ- ly forces attached flow on the wing through rapidly pul- ing the new carbon nanotube-based composite materials, sating small air jets, has the potential to enable a simpler is essential to the development of accurate structural (fewer parts), lighter weight high-lift system with equiv- design methods. A newly developed computational alent or better aerodynamic performance than today's method predicts the effect of manufacturing uncertain- slotted flap systems. The current NASA, DARPA, and ties on the strength of the composite structural material. Boeing jointly funded effort is evaluating this new type This study is the first step in computationally determin- of high-lift system on an extreme short takeoff and landing the trade-off between manufacturing cost and the ing aircraft. The potential benefits of this technology are strength of nanotube-reinforced composite structures. to reduce fuel use and emissions and to provide greater This emerging capability will ultimately allow the access to small airports and even unimproved fields by design and manufacture of lighter weight and more fuel- transport-sized aircraft. efficient aircraft. Data Quality. Mission performance data accurately Data Quality. Mission performance data accurately reflect achievements in FY 2002. reflect achievements in FY 2002. Data Sources. Performance assessment data were The computational technique of this study is an entirely obtained from normal management reporting and are ver- new approach for structural design based on the well- ified and validated by program managers. established Monte Carlo method. Laboratory validations Indicator 6. Develop concepts for design and analyses of the method must be performed. of algorithms for control of colonies of fluidic flow Data Sources. Performance assessment data were control effectors obtained from normal management reporting and are ver- Results. Modern aircraft require sophisticated flight- ified and validated by program managers. For more infor- control systems for safe and efficient flight. Adaptive mation, see “Nanostructured Composites: Effective flight control systems will contribute to increased avia- Mechanical Property Determination of Nanotube tion safety by reducing loss-of-control accidents that Bundles,” American Institute of Aeronautics and result from control surface failures (for example, jammed Astronautics (AIAA) paper 02-1523. control surfaces, actuator failures, and uncommanded Indicator 8. Develop concepts for advance sensory mate- surface deflections), operation in extreme conditions, or rials development and methodologies for imbedding sen- structural damage to the aircraft. In this research, a sors into aerospace structural materials colony of passive porosity fluidic control effectors was added to the simulated aircraft and the existing conven- Results. We developed prototype inductor piezoelec- tional control effectors. The effectiveness of the new tric sensors that can be embedded in structural materi- reconfigurable controls algorithm was evaluated in com- als and a new concept for coupling to embedded optical puter simulations. Control effectors were systematically fiber sensors. Compared to traditional surface mounted failed to test the ability of the reconfigurable vehicle con- sensors, embedded sensors offer numerous advantages. trol algorithm to identify the control's failure and to These include protection of the sensors from damage,

204 NASA FY 2002 Performance and Accountability Report integration of the sensors during manufacture rather Data Sources. Performance assessment data were than as a costly add-on, and avoidance of material obtained from normal management reporting and are ver- surface modification. ified and validated by program managers.

In addition, several concepts for embedding integral Indicator 10. Demonstrate aligned carbon nanotubes for vehicle health monitoring sensors into aerospace struc- polymer matrix material tural materials have been developed, and some preliminary tests have been performed. If successful, these Results. A small-scale melt extruder was designed and concepts will enable the development of embedded built to optimize alignment of carbon nanotubes. The sensors in future aerospace vehicles. Novel fiber-optic carbon nanotubes were used to dope a low cost, com- concept results in significant reduction in complexity mercially available polyimide. The objective was to and 50 percent cost reduction for embedding sensor demonstrate the feasibility of producing aligned carbon- systems into aerospace structural materials. The fiber- nanotube-doped fibers using the shear forces induced by optic sensor concept also has the potential to benefit laminar flow during extrusion. The rods were drawn to aircraft safety by reducing catastrophic failure of 250 micrometers in diameter to achieve approximately a the airframe. 60-percent increase in the fiber tensile modulus. The drawing increased the carbon nanotubes’ alignment, but Data Quality. Performance assessment data are from it appears that there is a gradient of alignment, with normal management reporting and are verified and vali- alignment increasing toward the outside of the rods. dated by program managers. Future research includes processing materials with higher carbon nanotube concentrations (5 percent) in polymer Data Sources. Performance assessment data were matrices. An alternative extrusion technique will also be obtained from normal management reporting and are veri- investigated as a route toward aligned fibers. In both fied and validated by program managers. cases, nanocomposites will be fabricated from the processed fibers and tested. Indicator 9. Demonstrate oscillatory flow control actuators Data Quality. Mission performance data accurately Results. The effect of active oscillatory flow control on reflect achievements in FY 2002. upper surface separation was evaluated during two- dimensional wind tunnel tests. A system study resulted in Data Sources. Performance assessment data were several recommendations for future research, such as obtained from normal management reporting and are ver- combined leading and trailing edge excitation, higher ified and validated by program managers. deflection angles, and the development of a modern cruise airfoil. The system study suggestions were imple- Strategic Goal 4: Commercialize Technology— mented on a wind tunnel model. The next goal is to apply Extend the commercial application of NASA tech- this technology to a representative three-dimensional nology for economic benefit and improved quality wing with a simplified high-lift system to further estimate of life the potential benefits. Separation control for simplified high-lift systems would enable extremely short Strategic Objective 1. Commercialization—Facilitate take-off and landing vehicles. The effect of this capabili- the greatest practical utilization of NASA know-how ty is lower community noise, access to smaller airports by and physical assets by U.S. industry transport-sized aircraft, and, through potential savings in Annual Performance Goal 2R11. Continue the system weight, reduced fuel use (and the consequent solicitation of customer feedback on the services, facili- reduced emissions). ties, and expertise provided by the Aerospace Technology Enterprise. Data Quality. Mission performance data accurately reflect achievements in FY 2002. The annual performance goal was met by the successful completion of the customer survey. The target The experiment is complete, and the feasibility of using for customer satisfaction on the exit interviews was oscillatory blowing for a drooped nose and simple met. In addition, far in excess of the required num- flap on a modern airfoil was demonstrated using electri- ber of technologies were transferred to industry in cally driven zero-net mass actuators (synthetic jets). FY 2002. The overall assessment for this performance However, less than the desired amount of control was goal is blue. achieved. The reason appears to be that the synthetic jet actuators did not perform as well as expected. The Indicator 1. Achieve a facility utilization customer satis- level of separation control achieved was consistent with faction rating of 95 percent at 5 or better using a the amount of actuator authority produced. Data analysis 10 point scale, and 80 percent at 8 or better, based on is continuing. exit interviews

Part II • Supporting Data • Aerospace Technology 205 Results. Three NASA Research Centers (Ames, Glenn, Honeywell has chosen WINN to provide cockpit weather and Langley) conduct customer satisfaction interviews at information for their Epic line of cockpit avionics. selected wind tunnels and motion-based simulators to Honeywell recently added global winds aloft, convection both gauge and improve their services to users. For the 75 and turbulence products, and a flight plan editor to WINN. surveys received in FY 2002, 92 percent of the respon- Data Quality. Mission performance data accurately dents were highly satisfied (8 points or higher rating on a reflect achievements in FY 2002. 10-point scale) with the service and 96 percent responded as satisfied (5 or higher rating). Data Sources. Performance assessment data were Data Quality. Mission performance data accurately obtained from normal management reporting and are ver- reflect achievements in FY 2002. ified and validated by program managers. Data Sources. Performance assessment data were Annual Performance Goal 2R12. Continue the imple- obtained from normal management reporting and are ver- mentation of current education outreach plans, and estab- ified and validated by program managers. Satisfaction lish new plans for all new program activities initiated in FY 2002. data are from facility survey surveys collected in FY 2002 for NASA’s major aeronautical test facilities. We met the requirements of this performance goal with an overall assessment of green. The aerospace technolo- Indicator 2. Transfer at least twelve new technologies and gy program offices have demonstrated their support processes to industry and other government agencies dur- NASA’s education mission and their enthusiasm in using ing the fiscal year program resources appropriately to inspire the next gen- Results. In FY 2002, a significant number of NASA tech- eration of explorers. nology transfers were successfully accomplished. A par- Indicator 1. Implementation examples from current edu- tial listing is provided below that constitutes more than cation outreach plans double the goal of transferring 12 technologies. iLAB, a tool for creating high-fidelity computational Results. The following is a partial list of accomplish- parameter studies on distributed computing systems, has ments in FY 2002: been transferred to Boeing Corporation. Their Phantom •The Aviation Safety Program Office’s Single Aircraft Works Division at Long Beach used. iLAB to create and Accident Prevention Project is featured in a new run parameter studies and to generate a matrix of compu- episode of the NASA Distance Learning Program tational fluid dynamics (CFD) solutions to provide pretest Destination Tomorrow, a news magazine format pro- aerodynamic estimates for upcoming wind tunnel tests in gram for adult audiences. They provided subject mat- Boeing and NASA facilities. The 3 by 3 matrix of CFD ter, script content, and on-screen talent. Three Kid’s solutions was obtained in 1 week; the computation would Science News Network (KSNN) scripts are ready for have taken more than 2 weeks without iLAB. production. These 1-minute vignettes that use children Java PathFinder, tool for software verification and testing, to explain to children in grades kindergarten to second has been released to industry and university collaborators. grade mathematics, science, technology, and computer The Java PathFinder is verification and testing environ- science concepts will be produced in both English and ment for Java that integrates model checking, program Spanish. analysis and testing. The software is available to industry •The Aerospace Propulsion and Power program office and university collaborators through a commercial tech- produced a 21st Century Propulsion Systems video nology licensing agreement. that is available on the web and on CD. The Performance Data Analysis and Reporting System •The Quiet Aircraft Technology Office produced two (PDARS) is being used daily by 19 FAA Air Traffic NASA KSNN newsbreaks (short commercial televi- Control facilities in the United States to monitor the per- sion broadcasts aimed at motivating elementary stu- formance of the National Airspace System, identify and dent interest in math and science), and one program analyze operational performance problems, and design segment (3 to 7 minutes) for NASA’s Destination and evaluate improvements to the system. The system col- Tomorrow distance learning program. lects, extracts, and processes air traffic control operational data. •The General Aviation Programs Office worked with NASA Marshall to produce a segment for NASA Through a cooperative research agreement, NASA and Explores web based curriculum. Honeywell Commercial and Business Aircraft have been developing a data-link cockpit weather-information sys- •The Ultra Efficient Engine Technology Office spon- tem called Weather INformation Network (WINN). This sored a “Teaching Science through Reading” work- system provides graphic and text weather information to shop; filmed a “Destination Tomorrow” segment on transport and business aircraft operating worldwide. how jet engines work; sponsored a Young Astronaut

206 NASA FY 2002 Performance and Accountability Report Day with thee American Institute of Aeronautics and Indicator 2. Documented plans for all new program activ- Astronautics (AIAA). ities initiated in FY 2002

In addition to the education activities supported directly Results. All new Aerospace Technology program activities by program and project offices, the aerospace technology initiated in FY 2002 produced signed, official education mission develops and implements a wide variety of edu- program plans for implementation in FY 2003. The program cational programs, products, and services designed to activities are the 21st Century Aircraft Technology (TCAT) inspire academic excellence in kindergarten to 12th grade Program; Advanced Space Transportation Technologies science, technology, engineering, and mathematics Program, Airspace Systems Program, Computing through the development and implementation of inquiry- Information and Communications Technology Program, based educational products that incorporate NASA and Engineering for Complex Systems. Aerospace Technology research. Examples of these projects include: Data Quality. Mission performance data accurately reflect achievements in FY 2002. •Virtual Skies, an interactive Web site for students in grades 9 through 12 Data Sources. Performance assessment data were obtained from normal management reporting and are ver- • Exploring Aeronautics, a CD-ROM tutorial program ified and validated by program managers. designed for students in grades 5 through 8 about the principles of flight and aircraft design Strategic Goal 5. Space Transportation Manage- • F-15 Active Educational Materials, a wall poster ment—Provide commercial industry with the with classroom activities for grades 7 and 8 and a opportunity to meet NASA’s future launch needs, teacher’s curriculum guide that describe this NASA including human access to space, with new research aircraft launch vehicles that promise to dramatically reduce cost and improve safety and reliability. •NASA Connect, an award-winning series of instruc- (Supports all objectives under the Advance Space tional television programs designed to enhance the Transportation Goal.) teaching of math, science, and technology concepts in grades 5 through 8 Strategic Objective 1. Utilize NASA’s Space Transportation Council in combination with an • Destination Tomorrow, a new NASA educational pro- external independent review team to assure gram aimed primarily at adult lifelong learners Agency-level integration of near- and far-term • Mobile Aeronautics Education Laboratory (MAEL), a space transportation investments tractor-trailer unit jammed with high-tech learning sta- Annual Performance Goal 2R13. Review results of tions that travels throughout the country to encourage NASA and commercial-sector performed launch system local communities to establish teaching facilities called architecture studies, related requirements, and refine- NASA Aerospace Education Laboratories ments in planned risk-reduction investments.

• Education Exhibit, an attractive and engaging educa- The annual performance goal was considered to be met tional exhibit for use at national education conferences because the first requirement was met by the External and other appropriate educational venues Requirements Assessment Team participating in the reviews and reporting their findings to NASA manage- • Earth-to-Orbit Design Challenge, a program for junior ment. Although the Space Transportation Council was high school students that challenges them to solve disbanded by the Agency in May 2002, numerous other problems related to aeronautical and aerospace engi- teams reviewed the Space Launch Initiative Program, neering, and produces curriculum materials that sup- including the Aerospace Technology Advisory Com-mit- port the national standards for math, science and tech- tee, the independent review team (Independent Program nology education Assessment Office), and an Inter-Center Analysis Team. •NASA Explores, weekly educational activities and These reviews of the Space Launch Initiative Program are informational updates on NASA’s Aerospace equivalent to the ones that would have been provided by Technology research and development. The site has the Space Transportation Council. As a result, the overall three sections for elementary, middle and high school assessment for this performance measure is green. students. A major theme of the Web site is the celebra- tion of the 100th anniversary of flight Indicator 1. Complete an assessment of the Space Launch Initiative architectures and requirements by an External •The NASA SCIence Files—an educational television Independent Review Team (EIRT); the EIRT will submit a program designed to enhance and enrich the teaching of written report on their evaluation within 45 days following mathematics, science, and technology in grades 3 to 5. completion of the review

Part II • Supporting Data • Aerospace Technology 207 Results. The External Requirements Assessment Team, Indicator 2. The Space Transportation Council will an external independent review team of aerospace indus- review progress and planning of the Space Launch try experts, provides senior-level advice to NASA about Initiative at least twice during the fiscal year, including the Space Launch Initiative program, and assesses the report filed by the External Independent Review Team requirements and analysis processes, and ensures incorporation of proven technical and programmatic methods, Results. The Space Transportation Council was disband- including the Space Shuttle legacy. The External ed by the Agency in May 2002. However, numerous other Requirements Assessment Team (ERAT) is reviewing the teams are actively reviewing the program, including the program’s Design Reference Missions and the Agency’s Aerospace Technology Advisory Committee, Level 1 Requirements. The ERAT participated in the Independent Review Team (Independent Program interim architecture review and briefed the Marshall Assessment Office), Inter-Center Analysis Team, Space Flight Center Director and the Program Manager. It External Requirements Assessment Team, the NASA has also conducted and supported program reviews and OIG, and GAO. provided written recommendations. Data Quality. Mission performance data accurately Data Quality. Mission performance data accurately reflect achievements in FY 2002. reflect achievements in FY 2002. Data Sources. Performance assessment data were Data Sources. Performance assessment data were obtained from normal management reporting and are veri- obtained from normal management reporting and are verified and validated by program managers. fied and validated by program managers.

208 NASA FY 2002 Performance and Accountability Report Manage Strategically Crosscutting Process

NASA continually assesses the direction of the organiza- Data Quality. The performance data reported are com- tion, adapting to changing circumstances, both external plete and accurately reflect the activities of FY 2002. and internal. Managing strategically requires short-term and long-term appraisal of external factors facing the Data Sources. Our performance results originated with Agency, such as technological advances and security in the Department of Labor’s Office of Workers Compen- the post-September 11 world. The internal factors involve sation database for labor injury data and NASA personnel determining the organizational structure that will best workforce information. Summary tables of NASA work- meet the needs of the challenges ahead. For instance, force data are located at http://www.hq.nasa.gov/office/ NASA assigns high priority to protecting the safety of its codef/fm_home.html. workforce and the environment. Other factors include Indicator 3. Award construction contract(s) for all identi- integrating small- and women-owned businesses and fied critical facilities safety requirements as specified in minority universities in the NASA community, tightening the Agency Annual Construction Program financial management controls, and attracting and retain- ing a high-quality workforce. Management, guided by Results. NASA awarded 92 percent of critical safety these standards of safety, quality, and efficiency, meets its projects. The indicator was designed to help reduce safe- performance goals and returns the taxpayers’ investment. ty risk and reinforce the commitment to zero-lost-time safety incidents. Strategic Goal 1. Enable the Agency to carry out its responsibilities effectively, efficiently, and Data Quality. The performance data reported are com- safely through sound management decisions plete and accurately reflect the activities of FY 2002. and practices Construction of Facilities managers verified the data. Strategic Objective 1. Protect the safety of our Data Sources. The facilities engineering program man- people and facilities and the health of our workforce agers gathered data for this metric. Data sources are not available to the public. Annual Performance Goal 2MS1. NASA will increase the safety of its infrastructure and the health of its work- Indicator 4. Award/modify all planned contracts for force through facilities safety improvements, reduced physical security upgrades to NASA’s minimum essen- environmental hazards, increased physical security, tial infrastructure defined in the NASA Critical enhanced safety and health awareness, and appropriate tools and procedures for health enhancement. Infrastructure Plan NASA achieved a rating of green compared with a rating Results. NASA completed 34 of 37 planned contracts of yellow in FY 2001, blue in FY 2000, and green in for physical security upgrades and made other key securi- FY 1999. This rating demonstrates our continued com- ty improvements Agency-wide as defined in the NASA mitment to the safety and well-being of our people, prop- Critical Infrastructure Protection Plan. Of the three con- erty, and the national assets entrusted to us. tracts not awarded, one was delayed because of a GAO protest, another had technical problems that delayed bid- Indicator 1. No fatalities will result from NASA mishaps ding beyond September 30, and the third one was deter- Results. NASA had no fatalities because of mishaps. mined to be less hazardous than originally thought and it was downgraded in importance relative to other projects. Data Quality. The performance data reported accurately reflect the activities of FY 2002. We will initiate more acquisition planning to minimize Data Sources. The Department of Labor’s Office of risk during the bid process. We will also employ pre- Workers Compensation database for labor injury data and project planning to address technical issues prior to the the NASA Incident Reporting Information System pro- execution year and define project requirements that ideal- vided the basis for our performance results. ly will eliminate bidding problems. Finally, we will better identify and prioritize our safety projects. Indicator 2. Per the Federal Worker 2000 Initiative, reduce the overall occurrence of injuries (due to occupa- Data Quality. The Centers’ security chiefs considered tional injury or illness) by 3 percent per year from the the data accurate and complete for FY 2002. FY 1997 baseline to 1.15 occurrences per 100 workers Data Sources. The Centers’ security chiefs provided the Results. NASA exceeded the indicator with a case rate data. Some information about NASA Security Programs of 0.84 total cases per 100 workers, which is well below and security upgrades information are sensitive; there- NASA’s final goal of 1.12 in FY 2005. fore, they are not available to the public.

Part II • Supporting Data • Manage Strategically 209 Annual Performance Goal Trends for Manage Strategically

Annual Performance Assessment Performance Goal FY 1999 FY 2000 FY 2001 FY 2002 Strategic Goal 1. Enable the Agency to carry out its responsibilities effectively, efficiently, and safely through sound management decisions and practices.

Objective 1. Protect the safety of our people and facilities and the health of our workforce. 2MS1 Objective 2. Achieve the most productive application of Federal acquisition policies. 2MS2 2MS9 Objective 3. Manage our fiscal and physical resources optimally. 2MS3 2MS10 Objective 4. Enhance the security, efficiency, and support provided by our information technology resources. 2MS4 2MS5 2MS6 Objective 5. Invest wisely in our use of human capital, developing and drawing upon the talents of all our people. 2MS7 2MS8

Indicator 5. Reduce the level of Agency environmental Data Sources. The procedures are available at noncompliance incidents and releases in order to achieve http://www.nodis.hq.nasa.gov. The draft statement of a 5 percent reduction from the FY 2000 level by 2005 work is available from the OCHMO. Results. We far exceeded the indicator, reducing non- Indicator 7. Establish a mechanism to aggregate employ- compliance incidents and releases by 95 percent from 218 ee epidemiological preventive health risk data for long- in FY 2000 to 11 in FY 2002. term tracking and as a basis for policy. (This action will begin the process of creating an employee longitudinal Data Quality. The performance data reported are com- health study similar to the Astronaut Longitudinal Health plete and accurately reflect the activities of FY 2002. Study by establishing a voluntary, statistically significant Data Sources. The NASA Environmental Tracking pool of employees at each Center. This pool could poten- System, a real-time database that stores all noncompli- tially expand the control group for the Astronaut Study ance incidents and releases, provided information for this and will give NASA insight into any health hazards pecu- indicator. The tracking system is not publicly accessible. liar to each Center) Indicator 6. Standardize and implement minimum ele- Results. We established the Agency Health Enhance- ments of employee preventive and medical monitoring ment Database, which records screening exams, clinic examinations to standardize services across the Agency visits, employee-assistance consultations, and education- using the recommendations from the U.S. Preventive al and training programs. The information provided a Health Services Task Force framework for policy decisions. In addition, we developed a two-phase feasibility study for a more comprehen- Results. NASA issued the directive “Occupational Health sive epidemiological database. The first phase was nearly Program Procedures,” which sets forth the minimum stan- complete; the second was on schedule. dards for occupational health programs. We also developed a draft statement of work for health program services that all Data Quality. NASA considered the OCHMO an accu- Centers will use in future contract solicitations. rate and appropriate source. Data Quality. The Office of the Chief Health and Data Sources. Because the database contains employee Medical Officer (OCHMO) provided the content for the health information, it is not publicly accessible. The procedure and statement of work, and the office consid- Occupational Health Program maintains a public Web site ered the information accurate and appropriate. at http://ohp.nasa.gov, which discusses the types of

210 NASA FY 2002 Performance and Accountability Report programs available, resources, training, related health business together with minority universities into the links, employee programs, and health alerts. competitive base from which NASA can purchase goods and services. Indicator 8. Develop and implement a medical quality assurance system based on a comprehensive program NASA exceeded its Congressionally mandated goal of audits of all aspects of health care delivery and assur- 8 percent, awarding more than 19 percent of its total ances of professional competency contract budget to small disadvantaged businesses. The second indicator under this annual performance goal Results. We developed a draft medical quality assurance challenged us to award 1 percent of NASA’s total contract procedure and employed the Department of Health and and subcontract dollars to minority educational institu- Human Services’ electronic physician credentialing sys- tions. Although we did not achieve this indicator in its tem. Bi-annual program audits and the standardized occu- first year of existence, we expect to achieve it in FY 2003 pational health program verified the system. In addition, through enhanced training and outreach. Because we the OCHMO established and filled a position for a senior added this new indicator, the overall assessment for this medical quality assurance advisor. annual performance goal is yellow compared with blue in FY 2001 and 2000 and green in FY 1999. Data Quality. The OCHMO developed the system structure and considered it accurate and appropriate. Indicator 1. Achieve at least an 8 percent Congressionally mandated goal for annual funding to small disadvan- Data Sources. Information regarding the quality assur- taged businesses (funding for prime and subcontractors ance system is available through the OCHMO. awarded to programs supporting small disadvantaged businesses, Historically Black Colleges and Universities Strategic Objective 2. Achieve the most produc- and other minority educational institutions, and women- tive application of Federal acquisition policies owned small businesses) Annual Performance Goal 2MS2. Continue to take Results. In FY 2002, NASA awarded more than advantage of opportunities for improved contract man- 19 percent of its total contract budget to small disadvan- agement by maintaining a high proportion of Performance Based Contracts (PBCs). taged businesses. For Performance Based Contracting, NASA exceeded its Data Quality. NASA’s large prime contractors submitted goal of obligating 80 percent of funds available for PBC semiannual reports on contract awards to small and small awards. These funds excluded grants, cooperative agree- disadvantaged businesses. NASA reviewed and validated ments, actions under $100,000, Small Business the data during our Center Procurement Management Innovation Research (SBIR), Small Business Technology Surveys. In addition, the Small Business Administration Transfer (STTR), Federally Funded Research and and the Department of Defense Contract Management Development Center’s, intergovernmental agreements, Agency conducted periodic on-site surveys to verify and and contracts with foreign governments and organiza- validate prime contractor’s claims. Our Minority tions. The overall assessment for this performance indica- Business Resource Advisory Council and the tor is blue, continuing the trend from FY 1999. NASA/Prime Contractor Roundtable also performed reviews and provided recommendations for process Indicator 1. Maintaining PBC obligations at greater improvements to NASA management. than 80 percent of funds available for PBCs (funds available exclude grants, cooperative agreements, Data Sources. The NASA Acquisition Internet Service actions under $100,000, SBIR, STTR, FFRDCs, intra- is available at http://www.procurement.nasa.gov. governmental agreements, and contracts with foreign Indicator 2. Award 1 percent of NASA’s total contract and governments and organizations) subcontract dollars to Historically Black Colleges and Universities and other minority institutions Results. NASA obligated 88 percent of funds available for PBC awards. The Agency has met its PBC goal for the Results. NASA did not achieve the indicator, although past 5 years with percentages of 81.0 in FY 1998, and the 0.55 percent in FY 2002 represented a 10-percent 1999, 84.0 in FY 2000, and 86.4 in FY 2001. improvement compared with FY 2001’s percentage. NASA will conduct symposia to improve minority busi- Data Quality. NASA examined a sampling of contracts nesses ability to qualify for NASA contract awards. to determine whether these met the definition of a PBC. Data Quality. Contract awards to small and small disad- Data Sources. The Financial and Contractual Status vantaged businesses are documented for verification and System contains the Center acquisition data used for validation in the Summary Contractor Reports submitted this indicator. semiannually by large prime contractors to NASA Annual Performance Goal 2MS9. Continue integrat- Headquarters. Headquarters personnel conduct Center ing small, small disadvantaged, and women-owned Procurement Management Surveys. In addition, the

Part II • Supporting Data • Manage Strategically 211 Small Business Administration and the DOD Contract Indicator 2. Reduce the Agency’s unfunded environmental Management Agency conduct periodic on-site surveys to liability through a long-term strategy, annually investing verify and validate the performance claims and the an amount of not less than 3-5 percent of the Agency’s process integrity of large prime contractor submissions. environmental liability in environmental compliance and The NASA Minority Business Resource Advisory restoration funding Council and the NASA/Prime Contractor Roundtable also Results. NASA invested 3 percent of the Agency’s envi- do periodic reviews and provide NASA management with ronmental liability, which is estimated at $1.27 billion. recommendations for process improvements. The Environmental Compliance and Restoration (ECR) Data Sources. Most of the data appears at Program obligated $38.1 million of the identified ECR http://procurement.nasa.gov as part of the NASA Acqui- projects. In FY 2003, NASA will replace the indicator sition Internet Service (NAIS). with one that better measures our progress.

Strategic Objective 3. Manage our fiscal and Data Quality. NASA maintains an internal system for physical resources optimally recording and tracking environmental liabilities. That system has been tested and passed the FY 2002 Chief Annual Performance Goal 2MS3. Revitalize Agency Financial Officer (CFO) Act audit. The CFO maintains facilities and reduce environmental liability. and validates the Financial and Contractual Status system. We reduced our environmental liability; however, we did Data Sources. The NASA internal environmental liabil- not meet the facility revitalization challenge. The overall ities tracking system and the Financial and Contractual assessment for FY 2002 is yellow. In FY 1999 and Status system are not accessible to the public. FY 2000, the rating was red and in FY 2001, it was green. Annual Performance Goal 2MS10. Improve the Agency’s financial management and accountability. Indicator 1. Improve facility revitalization rate to 100- year frequency for all facilities as identified by the NASA’s commitment to the efficient and effective use of integrated long-term Agency plan its financial resources reflects in the Agency’s efforts to cost its financial resources in a timely manner and to Results. NASA did not achieve the performance indi- develop an Integrated Financial Management (IFM) sys- cator for facility revitalization. In FY 2002, the rate rose tem. The IFM system links budget formulation, execu- to 102 years after a steady decline from 147 years in tion, accounting, and other functions for the purpose of FY 1999 to 95 years in FY 2001. The facilities revital- consolidating and streamlining NASA’s financial activi- ization rate is an industry-standard indicator of the ties. We met our resources-costing goal every year since appropriateness of the yearly amount spent to maintain its introduction in FY 1999 (the percentage rose from facilities and is dependent on the Current Replacement 70 percent to 75 percent beginning in FY 2001). In addi- Value (CRV) of NASA’s facilities and the amount of tion, the IFM Program achieved its goals for FY 2002. annual funding. A 100-year revitalization rate indicates The Core Financial module will be deployed to NASA the minimum maintenance investment needed to ensure Centers in FY 2003. The rating is green. safe and effective operations. The industry revitalization rate averages 57 years. Indicator 1. Cost at least 75 percent of the resources authority available to cost during the fiscal year The FY 2003 President’s Budget funding request for facilities revitalization and NASA’s CRV is expected to Results. NASA costed 79 percent of its available help us reach our goal of 100 years. Future improvements resources in FY 2002, exceeding the indicator in this area. to the 100-year rate will reduce NASA’s CRV through This indicator provided NASA with a measure of how facility closures and demolition and by advocating an effectively it uses its financial resources, and helped appropriate level of facilities revitalization funding in ensure that the Agency does not allow a disproportionate future budgets. percentage of these resources to go unused. Data Quality. The performance data reported are Data Quality. We use data contained in our financial and accurate and complete for this performance period. contractual status reports to calculate the percentage of We calculate the rate by dividing the current replace- Agency resources costed. These reports show documenta- ment value of the facility by the annual amount spent tion of the Agency’s costs and obligations for the fiscal on its maintenance. year. The CFO compiled the information from the Centers, Headquarters, and the Jet Propulsion Laboratory. Data Sources. The Centers recorded the relevant data in the real property database. Facilities Engineering updated Data Sources. While reports are not publicly available, a the revitalization rate to reflect appropriations and operat- resource library with links to budgets, policies, plans, and ing plan changes. The Agency’s real property database is other relevant reports is located at the CFO’s Web site at not publicly accessible. http://ifmp.nasa.gov/codeb/index.html.

212 NASA FY 2002 Performance and Accountability Report Indicator 2. Initiate the pilot phase (Pilot Center cut- providing increased capability and efficiency while main- over) of the Core Financial project and initiate at least taining a customer rating of satisfactory. one other module project For each of the infrastructure support services, the per- Results. The IFM Program completed a pilot project, formance of Agency-wide IT support was substantially initiated another module, and integrated a third. improved in FY 2002, while customer ratings of satisfied to very satisfied were maintained. Furthermore, NASA The pilot at Marshall Space Flight Center involved the maintained or reduced the cost-per-resource unit in each program’s core financial module, designed to improve area. NASA maintained a green rating compared with the financial management. Both Glenn Research Center and previous 3 fiscal years. Marshall completed operational readiness reviews, and no significant issues remained. In October 2003, the Centers Indicator 1. Improve IT infrastructure service delivery to will begin using the fourth of eight program modules. provide increased capability and efficiency while maintaining a customer rating of satisfactory and holding NASA initiated the budget formulation module that costs per resource unit to established baselines for each encompasses bottom-up formulation of institutional-, major IT service program-, mission-, and Agency-level budget formulation requirements. The content, form, and accessibility of Established Service budget information will support real-time manage- Cost Baseline ment decisions. NASA ADP Consolidation $3.5 M per Processing We also initiated the position description module and an Center (NACC) Resource Unit integration of travel management and core financial (an expansion of the original Travel Management Project) in NASA Integrated $0.78/ KBPS per month FY 2002. The entire financial management program is Services Network (NISN) about 36 percent complete. Outsourcing Desktop $2,940 per Standard Initiative for NASA (ODIN) Workstation Data Quality. The program’s financial director and the Agency Program Management Council reviewed the status quarterly. When the program initiated a new module, Results. The infrastructure support services improved in it submitted an addendum to the Program Commitment FY 2002 and maintained customer ratings of satisfied and Agreement and a Project Scope Document. very satisfied. In each area, NASA reduced the cost per resource unit: for NACC, to an average of $1,263,419 per Management reviews may consider project monthly sta- processing resource per quarter for the year; for NISN, to tus reports, IFM Steering Council review, Program an average of $0.49 per kilobit per second per month for Quarterly Status Review, Non-Advocacy Review, First the year.; and for ODIN to $2,940 per general purpose Independent Annual Review, independent annual reviews, seat (GP 1, 2, and 3). independent assessment at major project milestones, systems compliance Reviews, and requirements reviews. Data Quality. The Center CIOs, the NACC Project Independent assessment responsibilities are divided Office staff, the NISN Project Office staff, and the between the NASA Fairmont Independent Verification ODIN Project Office staff collect and verify the IT and Validation facility and an independent assessment performance data. contractor. Data Sources. The data sources include customer sur- Data Sources. Information about the IFM Program is veys and normal management reviews. located at the program Web site: http://www.ifmp. nasa.gov/. The site contains information on NASA’s Annual Performance Goal 2MS5. Enhance IT security efforts to integrate Enterprise applications, and allows by meeting established performance indicators in three critical areas: Vulnerabilities Detected, Training, and IT visitors to remain abreast of the program. It provides Security Plans. background information and key deliverables, such as project plans, schedules, and strategy documents, for the A significant reduction in specified vulnerabilities, entire program. This information includes data about the annual training of key individuals, and publication of a module projects in this program. complete set of IT security plans for critical systems enhanced the IT Security in FY 2002. NASA achieved a Strategic Objective 4. Enhance the security, effi- green rating in FY 2002 and FY 2001, the first year this ciency, and support provided by our information goal was introduced. technology resources Indicator 1. Reduce known system vulnerabilities across Annual Performance Goal 2MS4. Improve Informa- all NASA Centers to at least the established goal’s ratios tion Technology (IT) infrastructure service delivery by (10 percent of systems scanned, on the next page)

Part II • Supporting Data • Manage Strategically 213 Indicator 3. Complete 90 percent of ITS plans for critical FY 2002 IT Security Element Goal systems, including authorization to process (below)

FY 2002 Percentage vulnerabilities detected to 10% IT Security Element systems scanned Goal

IT Security Plans completed for critical Results. We achieved a 12.4 percent vulnerabilities systems 90% detected to systems scanned, which exceeds the FY 2002 goal of 10 percent. Results. NASA completed IT plans for 100 percent of Data Quality. NASA’s IT security manager and the critical systems, exceeding our 90-percent indicator. Centers’ Chief Information Officers and security man- Data Quality. NASA’s IT security manager and the agers verified the results. Several layers of management Centers’ CIOs verified the results. Several layers of man- review the verification process. agement reviewed the verification process. In the first quarter of FY 2002, we established a new base Data Sources. The data sources include Center CIOs. line for the phase 3 vulnerability ratio (10 percent), and during the rest of FY 2002, we scanned computer systems Annual Performance Goal 2MS6. Enhance mission to determine what ratio of systems were vulnerable to the success through seamless, community-focused elec- set of vulnerabilities. We measured our performance tronic service delivery. against the phase 2 vulnerability ratio. Each year we iden- Community-focused electronic service delivery has tify a new set of vulnerabilities and then scan for them. enhanced mission success through improvements in Data Sources. Data sources include scanning systems NASA’s electronic accessibility to the public. NASA con- to detect vulnerabilities, Center CIO, and IT Security tinues to improve its electronic service delivery. This goal Manager assessments. received a rating of green. There is no comparative data for previous fiscal years. Indicator 2. Provide IT security awareness training to NASA employees, managers, and system administrators Indicator 1. Develop the eNASA Strategic Plan and at or above targeted levels (below) Roadmap to deliver electronic services and information to the public, partners, suppliers, key stakeholders, and the internal employees and teams that execute FY 2002 IT Security Element Goal NASA’s missions Results. The eNASA Strategic Plan and Roadmap, ITS Awareness Training: developed in FY 2001, formed the basis for our Civil Service Employees 80% e-Government Plan in response to the President’s Civil Service Managers 95% Management Agenda (PMA). Our activities with respect to Expanding Electronic Government are detailed in the Civil Service System Administrators 90% PMA section of this report.

Results. NASA achieved the performance goal for all Data Quality. The performance data reported is com- areas of training. We trained 98 percent of all civil service plete and accurately reflects the activities of FY 2002. employees, exceeding the goal of 80 percent; 98 percent Data Sources. The eNASA team, chartered by the of all civil service managers, exceeding the 95 percent NASA CIO, produced the original eNASA Strategic Plan goal; and 97 percent of civil service system administra- and Roadmap. The NASA CIO compiled the NASA tors, exceeding the 90 percent goal for that measure. e-Government Plan in response to PMA requirements. Data Quality. NASA’s IT security manager and Indicator 2. Make the NASA Web more accessible, com- the Centers’ CIOs, and training managers verified the munity-focused, and useful to all of NASA’s diverse audi- results. Several layers of management review the verifica- ences as demonstrated by increased customer satisfaction tion process. from the FY 2001 baseline survey results Data Sources. The training goals are measures of Results. NASA did not capture baseline customer satis- annual training taken. Therefore, the training measure- faction metrics in FY 2002 because of a change in plans ments are reset to zero at the beginning of each year for implementing the customer survey on the NASA and progress toward reaching the goals is tracked homepage (http://www.nasa.gov). Rather than implement throughout the year. Data sources included SOLAR Web and conduct the survey, as originally planned, NASA pur- training certification records, Center CIOs, and training chased a Government survey service through the Federal managers assessments. Consulting Group of the Department of Treasury.

214 NASA FY 2002 Performance and Accountability Report Following a pilot project during part of FY 2002, the sur- Indicator 4. Implement digital signatures that are accept- vey will be in online production in FY 2003. The data ed by Federal Agencies for secure online communications from this year will form the baseline for measuring this performance metric in subsequent years. Results. NASA implemented digital signatures compatible with the Federal mechanism for exchanging informa- Offered to a random selection of visitors to the NASA tion via the Public Key Infrastructure (PKI). An intera- homepage, the survey asks them to rate the organization, gency panel reviewed and approved our certification navigability, image, search capability, and other elements process for ensuring the validity of digital signatures. We of the site. The survey basis is the American Customer received permission to utilize the Federal PKI. This Satisfaction Index developed by the University of approval means that NASA can send and receive secure Michigan. The index allows NASA to compare its cus- communications with any other Federal agency that has tomer satisfaction rating to those of other Government also achieved the correct level of certification. NASA agencies or commercial companies. received an award for being among the first agencies to complete this process. Data from the survey will help improve the offerings of the NASA homepage and its planned replacement, the Data Quality. The performance data completely and OneNASA Web Portal. The outcome for the public will accurately reflect the events of FY 2002. be a single Web address where students, teachers, news Data Sources. Documentation concerning NASA’s media, and the public can find NASA’s Web offerings, certification to use the Federal PKI is located at fulfilling NASA’s mission to inspire the next generation http://www.cio.gov/fbca/news/index.htm. of explorers “…as only NASA can.” Indicator 5. Post a majority of the NASA grants announce- Data Quality. Proprietary software developed by ments online by the end of FY 2002, consistent with inter- Foresee Results of Farmington Hills, MI, collected and agency efforts such as the Federal Commons Initiative analyzed the data gathered in this survey. The company which seeks to automate the Federal Grants process provides the software and analytical services through a contract with the Federal Consulting Group. The Federal Results. NASA exceeded the indicator, recording 24 Consulting Group has received OMB’s approval to use grant announcements this year. All of them appear online. this software to gather and analyze customer satisfaction data on behalf of Federal agencies. Data Quality. The associated data originated from interviews with representatives of the NASA grant-sponsoring Data Sources. The data itself is not online, although organizations and through research of pertinent Web sites. summaries appear periodically on the NASA homepage. Data Sources. The grant announcements appear at the Indicator 3. Increase the scope and level of corporate and following Web sites: shared electronic services from the FY 2001 baseline •http://fedbizops.gov—the Federal Business Opport- Results. NASA met this performance measure by unities site, a searchable database which includes increasing its scope and the level of its electronic servic- announcements from Headquarters and the Centers); es in FY 2002. Some of the new e-Government services and/or implemented in FY 2002 include the NASA Staffing and • http://research.hq.nasa.gov/research.cfm—the NASA Recruiting System (STARS), an online system Headquarters Research Opportunities Web site, which (http://www.nasastars.nasa.gov) that provides informa- lists research announcements associated with NASA tion on NASA job vacancies, enables job applicants to Headquarters organizations. submit resumes electronically, and provides support for NASA’s human resources offices; the electronic NASA Strategic Objective 5. Invest wisely in our use of Employee Benefits Statement, which provides current human capital, developing and drawing upon the pay and leave information to NASA’s civil service talents of all our people employees; and the Gelco Travel Manager system, implemented under the IFM Program, which provides a Web- Annual Performance Goal 2MS7. Align management based travel management service to Agency employees. of human resources to best achieve Agency strategic goals and objectives. Data Quality. The performance data completely and accurately reflect the events of FY 2002. NASA aligned human resources management with Agency strategic goals by developing a comprehensive Data Sources. The level of corporate and shared elec- workforce planning and reporting system; enhancing tronic services was assessed through various activities Center recruitment of fresh-outs; and maintaining its including eNASA, the PMA e-Government initiative, supervisor-to-employee ratio. The overall assessment and NASA’s Government Paperwork Elimination Act for this annual performance goal is green. Trend data are reporting process. not available.

Part II • Supporting Data • Manage Strategically 215 Indicator 1. By September 30, 2002, develop, test, and NASA and subject matter experts developed a student- evaluate at each NASA Center a prototype of a consistent, focused employment Web site located at http://www. Agency-wide workforce planning and reporting system nasajobs.nasa.gov/stud_opps/employment/index.htm. that incorporates the current Federal Activities Inventory Students reviewed the site and we incorporated their Reform (FAIR) Act inventory process recommendations into the final product. Results. NASA completed a prototype of workforce NASA linked its NASA Jobs Web site to minority-focused inventory planning in early 2002. Each Center conducted and science and engineering professional association Web an inventory that meets the FAIR Act requirements. In sites. The sites included The Black Collegian located at May 2002, the Centers used the inventory data to improve http://www.black-collegian.com; Women in Aviation at their competitive sourcing plans. An Agency-level com- http://www.women-in-aviation.com/; Diversity Careers in petitive sourcing review board evaluated the Centers’ Engineering and Technology located at http://www.diver- plans and used them to develop NASA’s competitive sitycareers.com/index.htm; and The Scientist’s Employ- sourcing plan. ment Network located at http://www.scijobs.org/. We standardized our approach to defining and managing NASA developed an automatic vacancy notification fea- workforce competencies using the inventory. NASA ture in NASA STARS. This timesaving tool enables inter- formed an Agency-wide team to produce a dictionary of ested applicants to create their resumes online with organizational competencies. The workforce competen- NASA and to choose automatic notification of NASA cies dictionary will be complete in early FY 2003. This vacancies. The system is available through the Applicant will serve as the foundation for future competency-driven Services at http://www.nasajobs.nasa.gov. workforce planning in the Agency. Data Quality. The performance data reported are com- The Competency Management System team is making a plete and accurately reflect the activities of FY 2002. link between the emerging, standard NASA competency structure and data already available in the employee data- Data Sources. The performance data were collected base. NASA developed a new set of analysis and fore- through normal performance reporting and were vali- casting tools that will be available to all Centers through dated and verified by managers. the Web. These tools will enable the Agency to project Indicator 3. Maintain, on an Agency-wide basis (exclud- where competency gaps are likely to open based on attri- ing the Inspector General), the supervisor to employee tion. NASA will be able to target recruitment and devel- ratio of 1 to 10 within a range of +/- 0.5 opment efforts to forestall such talent gaps. Results. The Agency’s supervisor-to-employee ratio Data Quality. An independent audit firm randomly remained on target. We finished the fiscal year unchanged audits the NASA payroll system. Each Center independ- at 1 to 10.1 with the number of supervisors declining from ently performs a workforce survey using Agency standard 1,722 to 1,711. formats and instructions. The result is best-available data that is not entirely accurate. Data Quality. The performance data reported are complete and accurately reflect the activities of FY 2002. Data Sources. Data pertaining to NASA civil servants The NASA Personnel/Payroll System itself is an Agency originated in the NASA Personnel/Payroll System. The system, subject to random audit. An independent audit NASA FAIR inventory and the competitive sourcing plan firm audits the system for the Agency’s Annual are available at http://www.competitivesourcing.nasa.gov/. Accountability Report. Workforce analysis data and planning tools are available at http://nasapeople.nasa.gov. Data Sources. The performance data reported originate from the payroll system, in which current and historical Indicator 2. Develop an initiative to enhance Centers’ records exist for each employee. recruitment capabilities, focusing on fresh-outs Annual Performance Goal 2MS8. Attract and retain Results. The National Recruitment Initiative focused on a workforce that is representative at all levels of NASA’s current and future science and engineering America’s diversity. recruitment needs, including recent graduates. The study The percent of women and minorities in the NASA work- recommended the need for an agile, flexible hiring model force increased slightly over the previous fiscal year, as it that is candidate-centered, maximizes current networks, has since FY 1999. In FY 1999 and FY 2000, NASA’s and creates new relationships to identify highly skilled goal was to maintain workforce diversity at pre-downsiz- candidates. The model also should market NASA’s attrib- ing levels. This proved an achievable goal because the utes as an employer of choice. We identified tools to majority of those leaving during downsizing were achieve an agile, flexible hiring model. white males. For FY 2001, we agreed that NASA needed NASA developed three Web-based recruiting tools more of a stretch, and we changed the performance indi- in FY 2002. cator with increased goals for women, minorities, and

216 NASA FY 2002 Performance and Accountability Report individuals with targeted disabilities. NASA did not meet Data Quality. The NASA Consolidated Personnel and these specific increase goals in FY 2001 or FY 2002. The Payroll System, while not 100 percent accurate, is the overall assessment for this performance goal is red for most reliable and valid source available for NASA work- FY 2002 compared with yellow in FY 2002 and green in force data. The very small number of coding errors con- both FY 2000 and FY 1999. tained within the database would be unlikely to change the overall assessment. Indicator 1. During the fiscal year, increase representation of minorities by at least 0.6 percent, women by at Data Sources. The source of the data is the NASA least 0.4 percent, and individuals with targeted disabili- Consolidated Personnel and Payroll System, which is a ties by at least .085 percent snapshot of the NASA workforce by pay period. Summary charts of NASA workforce data are available at Results. During FY 2002, the representation of minori- http://www.naade02.msfc.nasa.gov/workforce/index.html. ties among full-time permanent employees increased by 0.4 percent, women by 0.2 percent, and individuals with disabilities by 0.04 percent. None met the goal levels of the performance indicator, resulting in the red rating.

Part II • Supporting Data • Manage Strategically 217

Provide Aerospace Products and Capabilities Crosscutting Process

Strategic Goal 1. Enable NASA’s Strategic number of development programs and the large effect Enterprises and their Centers to deliver of the delay on the hypersonic-X program. NASA is products and services to customers more confident that continued close attention to program man- effectively and efficiently agement will bring improvements to both the cost and schedule estimates. Strategic Objective 1. Enhance program safety and mission success in the delivery of products Data Quality. The performance data reported are com- and operational services plete and accurately reflect the activities of FY 2002. The Office of the Chief Financial Officer validated the infor- Developing cutting-edge technologies and engineering mation from cost and schedule baseline documents. capabilities are fundamental to NASA’s success. Through this process, NASA efficiently and effectively delivers Data Sources. The Enterprises produced the cost and systems (ground, aeronautics, and space), technologies, schedule baseline documents. The Office of the Chief data and operational services to its customers. Each year Financial Officer validated the documents. NASA improves its engineering expertise and strengthens its position as a leader in engineering research and devel- Annual Performance Goal 2P2. Track the availability opment. We hone engineering and technological best of NASA’s spacecraft and major ground facilities by keep- practices and processes to improve our program and proj- ing the operating time lost due to unscheduled downtime ect management skills. to less than 10 percent of scheduled operating time.

Annual Performance Goal 2P1. Meet schedule and This metric was achieved and reflects the effectiveness of cost commitments by keeping development and upgrade NASA’s engineering capability as demonstrated by facil- of major scientific facilities and capital assets within ity availability. NASA’s sound engineering enables 110 percent of cost and schedule estimates, on average. science and technology mission success. The rating for FY 2002 is blue, as it has been for the past 2 years. Although we again failed to meet this metric, earning a rating of yellow, we improved nearly 5 percentage points Indicator 1. Each field center reports the operational over last year. downtime of the major spacecraft and ground facilities Indicator 1. Development schedule and cost data are drawn Results. The NASA Centers from which spacecraft and from NASA budget documentation for major programs and ground facilities operations take place reported the projects to calculate the average performance measures operational downtimes for the major spacecraft and Results. The life-cycle cost and schedule estimates for ground facilities. In FY 2002, less than 1 percent of FY 2002 are based on the FY 2004 program budget scheduled operating time was lost to unscheduled down- request and the program original baseline budget. The lifetime. In FY 1999, 2000, and 2001, 5.6, 2.8, and 0.65 cycle costs for the development and upgrade of major sci- percent, respectively, of scheduled operating time were entific facilities and capital assets were an average of lost to unscheduled downtime, on average. The expend- 113.7 percent of cost estimates, which is nearly 4 percent- able launch vehicle information was not available, and age points above the annual performance goal. The life- the ground facility data was not fully complete at the cycle schedules for the development and upgrade of major time of this report, although no significant change is scientific facilities and capital assets were an average of expected. 129.5 percent of schedule estimates, which is nearly 20 Data Quality. The performance data reported are com- percentage points above the annual performance goal. plete and accurately reflect the activities of FY 2002. Our cost and schedule performance in FY 2001 was 118 percent and 123 percent, respectively, and in FY 2000 Data Sources. The spacecraft data reported are from was 103 percent and 117 percent, respectively. operational logs; ground facility data are from the NASA Improvements in the FY 2002 life-cycle costs resulted Facility Utilization online database. from the launch of some spacecraft in FY 2001 (thus ending development costs) and the cancellation of cost Strategic Objective 2. Improve NASA’s engineer- inefficient programs in FY 2002. The schedule’s increase ing capability to remain as a premier engineering over FY 2001 resulted from the reduction in the total research and development organization

Part II • Supporting Data • Provide Aerospace Products and Capabilities 219 Annual Performance Goal Trends for Provide Aerospace Products and Capabilities

Annual Performance Assessment Performance Goal FY 1999 FY 2000 FY 2001 FY 2002 Strategic Goal 1. Enable NASA’s Strategic Enterprises and their Centers to deliver products and services to customers more effectively and efficiently.

Objective 1. Enhance Program safety and mission success in the delivery of products and operational services. 2P1 2P2 Objective 2. Improve NASA’s engineering capability to remain as a premier engineering research and development organization. 2P3 N/A N/A N/A Objective 3. Capture engineering and technological best practices and process knowledge to continuously improve NASA’s program/project management. 2P4 N/A N/A N/A 2P5 Objective 4. Facilitate technology insertion and transfer, and utilize commercial partnerships in research and development to the maximum extent practicable. 2P6

Annual Performance Goal 2P3. Strengthen the Data Quality. The results accurately reflect activities NASA engineering capability through the completion of in FY 2002. two indicators in FY 2002. Data Sources. The Office of the Chief Engineer main- Although NASA’s engineering capability is strong, we tains systems engineering records. continually explore ways to improve it. The current activ- Indicator 2. Conduct an assessment of the systems ity will certainly make it better; however, those particular engineering capability based upon the identified sys- enhancements will start in FY 2003. NASA did not com- tems engineering standard (NPG) to identify target plete the indicators for FY 2002 and thus earned a rating areas for improvement of yellow. There are no trend data for this goal. Results. We did not achieve this indicator because Indicator 1. Complete an assessment to identify a suitable the assessment cannot be performed until the standard systems engineering standard for NASA. Document the is complete. standard in the appropriate NASA system (example: NASA Procedures and Guidelines (NPG)) Data Quality. The results are complete and reflect actual schedule status. Results. We did not achieve this indicator in FY 2002. Data Sources. The systems engineering records are However, we have developed a framework for improving maintained in the Office of the Chief Engineer. our engineering capability that consists of three parts: Strategic Objective 3. Capture engineering and •Develop process standards, guidelines, and requirements technological best practices and process knowl- for systems engineering in programs and projects edge to continuously improve NASA’s program/ • Recommend tools and methodology for comprehensive project management assessment of the systems engineering capability in NASA Annual Performance Goal 2P4. Improve program and project management through the completion of two of the •Evaluate the training curriculum for systems engi- three indicators in FY 2002. neering offered by the Agency and provide inputs for its improvement. NASA accomplishes its mission through effective program and project management. The Agency’s expecta- In 2002, we wrote the first draft of a new policy docu- tions and best practices for program and project management. We established working groups to define, evaluate, ment are published in NASA Program and Project and implement the tools, assessments, and training. We Management Processes and Requirements (NPG 7120.5), also identified the resources required to develop an which sets forth the procedures and guidance for imple- advanced collaborative engineering environment. menting program and project management. To validate

220 NASA FY 2002 Performance and Accountability Report the procedures, NASA benchmarks similar organizations, at least one from each of the four Provide Aerospace includes training as an integral part of the process, and Products and Capabilities (PAPAC) subprocesses, com- continually feeds lessons learned back into the process. In mensurate with current program status. FY 2002, we performed well in all areas and earned a All Centers have well-established processes to identify green rating. There are no trend data for this goal. best practices and lessons learned. The information is Indicator 1. Benchmark high-tech, successful commercial maintained and updated, made accessible and disseminat- companies and government organizations and apply the ed through symposia, electronic media, biweekly results to revise NASA’s program/project management newsletters, and other forms to each program or project office. Project status reviews, independent review teams, Results. This indicator was achieved. The directors of and the Agency-wide Lessons Learned Information the Systems Management Office and the Office of the System (LLIS) database also capture and disseminate les- Chief Engineer benchmarked several high-tech organiza- sons learned. The FY 2002 rating for this goal is green, tions, including Boeing’s Integrated Defense Systems marking an improvement from FY 2001. Program, DOD Acquisition University, Rational Soft- ware, Inc., and Lockheed Martin. The results from the Indicator 1. Lessons learned from the PAPAC subprocess- benchmarking were used to improve processes at the es are collected and utilized in process improvement and Centers and were to validate several changes to the draft project and program training by the Program policy document (NPG 7120.5B). These benchmarking Management Council Working Group (PMCWG) and activities are ongoing. Code FT (Training and Development Division) Data Quality. The performance data are complete and Results. This indicator was achieved. Agency programs accurately reflect the activities of FY 2002. and projects are participating by including discipline experts on the formal review teams by including lessons Data Sources. The Systems Management Office and learned discussions in monthly project status reviews and the Office of the Chief Engineer collect these data. by using independent review teams, which assess multi- Indicator 2. Increase the number of program and project ple programs and projects, to transfer lessons across managers completing the Advanced Program Manage- projects. The Centers are working closely with the ment Training compared to the number that completed the Academy of Program Project Leadership on case studies training in FY 2001 and project manager lessons learned forums. Many project managers have contributed their stories and lessons to Results. There were 79 participants in the advanced pro- the ASK magazine and project management courses. gram management course in FY 2002, an increase from Various other lessons learned systems and processes are 38 in FY 2001. This is a new measure, introduced in the also very effective. FY 2002 Revised Final Performance Plan. Data Quality. The performance data accurately reflect Data Quality. Use of two data sources and an internal activities in FY 2002. functional audit of the data have provided confidence in the accuracy of the reported participation levels. Data Sources. The performance assessments are based on data from normal management reporting, from the LLIS Data Sources. The Office of Human Resources and database and from the Academy of Program Project Education collects and validates training data. The logis- Leadership. For more information about the LLIS database tics contractor that handles registration for all of NASA’s and the lessons learned database, see http://llis.gsfc.nasa.gov corporate courses also maintains training records. and http://iss-www.jsc.nasa.gov/ss/issapt/lldb/, respectively. Indicator 3. Complete the incorporation of NASA Integrated Action Team (NIAT) actions into NASA policy Strategic Objective 4. Facilitate technology insertion and transfer, and utilize commercial partner- Results. NASA incorporated the NASA Integrated ships in research and development to the maxi- Action Team (NIAT) actions into policy, specifically NPG mum extent practicable 7120.5B. We revised other policy documents and released new ones such as “Risk Management” Annual Performance Goal 2P6. Dedicate 10 to 20 (NPG 800.4). percent of the Agency’s research and development budget to commercial partnerships. Data Quality. The Office of the Chief Engineer verifies the information. Each year NASA has contributed significantly to commercial partnerships. These partnerships allow us to Data Sources. The NIAT actions status is maintained in leverage both financial and human capital to further our the Office of the Chief Engineer. missions. The trend is always at the top of the range for Annual Performance Goal 2P5. Capture a set of best the goal and for FY 2002 we exceeded the goal, main- practices/lessons learned from each program, to include taining a blue rating for the third consecutive year.

Part II • Supporting Data • Provide Aerospace Products and Capabilities 221 Indicator 1. Each of the Enterprises reports contribution FY 2002. The Office of Aerospace Technology’s to commercial partnerships Commercial Technology Division administers this metric’s collection and reporting via NASA TechTracS, Results. The percentage of NASA’s research and the Agency-wide commercial technology management development budget dedicated to commercial partner- information system. ships affects integrated technology planning and development with NASA partners. In FY 2002, NASA Data Sources. Each Center’s Commercial Technology contributed 21.9 percent of its research and development Office collects and validates the information they enter investment to commercial partnerships. The FY 2002 into NASA TechTracS. NASA budget information is from performance exceeded the goal. the schedule and cost data of major programs and projects. For more information about NASA Commercial Data Quality. The performance data on which our Technology, see http://www.nctn.hq.nasa.gov/. assessment is based accurately reflect achievements of

222 NASA FY 2002 Performance and Accountability Report Generate Knowledge Crosscutting Process

NASA provides new scientific and technological knowl- Results. NASA exceeded its goal by awarding edge gained from exploring the Earth system, the solar 94 percent of science and basic research funds through system, and the universe, and gained from researching merit competition. biological, chemical, and physical processes. This research is useful to scientists, engineers, technologists, Data Quality. The performance data accurately reflect natural resource managers, policymakers, educators, and achievements in FY 2002. the public. In generating knowledge, NASA aims to Data Sources. Program budget analysts compile the extend the boundaries of knowledge of science and engi- performance assessment data from budget information. neering through high-quality research in three basic research Enterprises: Space Science, Earth Science, and Strategic Objective 2. Archive data and publish, Biological and Physical Research. patent, and share results

The generate knowledge process did not submit metrics Annual Performance Goal. Research programs of the to the FY 2002 Revised Final Performance Plan. Our ear- Space Science Enterprise, the Earth Science Enterprise, lier attempts to establish metrics for this process proved and Office of Life and Microgravity Sciences and unsuccessful. First, the metrics overlooked the impor- Applications (OLMSA, currently Biological and Physical tance of the research conducted. Second, they did not help Research Enterprise/Human Exploration and Develop- the Agency improve a well-established process that ment of Space (HEDS)), taken together, will account for 5 percent of the “most important stories” in the annual complies with good national and international scientific review by Science News practice. Finally, the NASA organization that funds the research also reports its accomplishments. We achieved a rating of green for this annual performance goal. The trend for previous years also shows remarkable Nevertheless, we consider two metrics to be key to performance. NASA accounted for 8.3 percent of world- research programs: the percent of research funds going to wide science discoveries in calendar year 2001, the first peer-reviewed research proposals (a quality indicator) and three months of which were included in FY 2002, space the percent of NASA scientific discoveries that are con- science accounted for 6.9 percent, the Earth science for sidered among the “most important stories of the year” by 1.2 percent, and biological and physical research for Science News magazine (a relevance and 0.2 percent. By comparison, in calendar year 2000 performance indicator). (FY 2001), the NASA total was 8.1 percent; for calendar year 1999 (FY 2000), 5.1 percent; and for 1998 Strategic Goal 1. Extend the boundaries of knowl- (FY 1999), 6.5 percent. edge of science and engineering to capture new Results. NASA accounted for 8.3 percent of worldwide knowledge in useful and transferable media, and scientific discoveries between January 1, 2001, and to share new knowledge with customers December 31, 2001. It was the best overall NASA performance for this metric since 1994, with contributions Strategic Objective 1. Select, fund, and conduct from four centers (Goddard, Marshall, Ames, and the Jet research programs Propulsion Laboratory) and from NASA Headquarters. Annual Performance Goal. The Space Science Space science accounted for 6.9 percent of discoveries— Enterprise, the Earth Science Enterprise, and the its best performance by this metric since 1996. The Biological and Physical Research Enterprise will use Hubble Space Telescope produced 1.7 percent, including competitive merit review wherever possible to select performers for science and basic technology research the detection of atmosphere of extra-solar planet, a key step in construction of a planet; dust storms on Mars; a NASA achieved a score of green for this annual perform- clump of stars that may be one of the first building blocks ance goal. We have achieved this level of performance of a galaxy; and evidence that some mysterious force is since FY 2000 when we began collecting the data. pushing galaxies apart. The Chandra X-ray Observatory produced 1.3 percent of discoveries, including x-ray out- Indicator 1. NASA will use Announcements of Opport- burst providing further evidence of a black hole at the unity (AOs), NASA Research Announcements (NRAs), and Milky Way core, evidence that supermassive black holes Cooperative Agreement Notices (CANs) to award 80 per- grow after host galaxies formed, and evidence of event cent or more of science and basic research funds via merit horizons, such as the first x-ray image of Venus. Long- competition in the Enterprises and functional offices that term environmental monitoring in the Earth science area fund scientific research contributed 1.2 percent of scientific discovery, including

Part II • Supporting Data • Generate Knowledge 223 Annual Performance Goal Trends for Generate Knowledge

Annual Performance Assessment Performance Goal FY 1999 FY 2000 FY 2001 FY 2002 Strategic Goal 1. Extend the boundaries of knowledge of science and engineering to capture new knowledge in useful and transferable media, and to share new knowledge with customers

Objective 1. Select, fund, and conduct research programs.

2GK Objective 2. Archive data and publish, patent, and share results.

2GK

data from the Landsat. The Geostationary Operational Data Quality. Science News, a weekly periodical pub- Environmental Satellite (GOES) series of missions con- lished since 1973, issues an annual review of what the tributed to studies of large-scale deforestation in Central periodical’s editors consider the most important stories America and its effects on ecosystems and weather. for the year. The quality of the data is limited by the cycle Nimbus 4 data (combined with Advanced Earth of the publication, which covers stories from January 1, Observing Satellite, or ADEOS) provided evidence of an 2001, to December 31, 2001, instead of FY 2002. increase in the greenhouse effect between 1970 and 1997. Although the review covers what the editors consider all The biological and physical research effort made its first fields of science, it is limited by the subjective nature of contribution (0.2 percent) to the most important stories choosing which highlights are most newsworthy to incor- list. A physical sciences grant funded basic physics porate and by the limited space allotted for publication. research that brought traveling light to a full stop, held it, and then sent it on its way. Trapping and releasing light could have an important influence on the development of Data Sources. The source of data is the Science News future information technologies. edition from the week of January 7, 2002.

224 NASA FY 2002 Performance and Accountability Report Communicate Knowledge Crosscutting Process

Engaging the public is essential to our goal of increasing Data Sources. The data sources are monthly activity scientific and technological knowledge. To inspire a new reports from our Centers. generation of scientists and engineers, the Agency uses a variety of public media, such as exhibits, Internet portals, Indicator 2. Public attendance and participation in the interactive media, and face-to-face and remote contact NASA Art Program will increase, through exhibitions in with astronauts, engineers, and scientists. In support of 15 additional states education, we offer students and teachers the opportunity Results. The NASA Fine Arts Program exceeded its to interact with our personnel through numerous learning 40-state goal by traveling to 44 states with its Artrain, a modules. The education program offices collaborate with traveling exhibit that transports NASA’s art collection to school systems to develop aerospace and science curricu- cities nationwide. Artrain has traveled to new states la that will encourage and inspire. Private industry har- including Arkansas, Wyoming, Nebraska, Washington, nesses our extensive online databases to meld research Oregon, Nevada, Utah, and Colorado. The Artrain has data into products that raise humankind’s quality of life. broadened the Program’s exposure, registering increased Moreover, NASA pays heed to the arts through its nation- public attendance and participation in FY 2002. Stories in al Fine Arts Program in which world-renown artists dis- publications such as New York Magazine, the Tate play their interpretations of aerospace advancements. Museum Magazine, Brandweek, and the Los Angeles Times, as well as network programming, such as CBS Strategic Goal 1. Ensure that NASA’s customers Sunday Morning, generated great interest in NASA and receive information from the Agency’s efforts in a its art initiatives. A new exhibit that includes works from timely and useful form the Program was created by the U.S. Department of State and is traveling internationally to embassies. Strategic Objective 1. Share with the public the knowledge and excitement of NASA’s programs Data Quality. The Fine Arts Program outcomes in a form that is readily understandable accurately reflect performance and achievements in FY 2002. Annual Performance Goal 2CK1. Share the experience of expanding the frontiers of air and space with the Data Sources. The data sources are monthly activity public and other stakeholders by meeting four of the five reports from our field centers. indicators for this goal. Indicator 3. Agency officials and astronauts will convey NASA achieved this annual performance goal of sharing clear information on NASA activities through the most the experience of expanding the frontiers of air and space used media in America: television, through no less than with the public and other stakeholders. We earned a rat- 20 live shots per month on average ing of blue compared with ratings of blue in FY 2001 and Results. NASA averaged 40 live-shot interviews per green in both FY 2000 and FY 1999. month in FY 2002, 20 more than our target. The total Indicator 1. More Americans can visit a NASA exhibit, number of live interviews completed was 400. The inter- through a minimum of 350 events per year view topics included how to track and view the Station, flags for heroes and families, IMAX Space Station 3-D, Results. NASA sponsored more than 350 events featur- the Child Presence Sensor, the Viking 25th anniversary, ing NASA exhibits in FY 2002. The number of interac- and the art of Landsat. tive exhibits increased in FY 2002. In a continuing effort to create more interactive exhibits, we upgraded video- Data Quality. The NASA Television Live-Shot Program tape audiovisuals to CDs. In addition, we are producing outcomes accurately reflect performance and achieve- new components exclusively on DVDs. ments in FY 2002. Data Sources. The data sources include monthly activ- Two Centers produced two virtual exhibits. One is called ity reports from our field centers. NASA television pro- the Shuttle Launch Experience and the other one is a vir- ducers maintain on-air records and reports. tual conversation with John Glenn. NASA added an inflatable astronaut to the inventory and produced Indicator 4. NASA’s activities and achievements will be exhibits for Centennial of Flight in 2003. Each of the chronicled and put into perspective for the American Centers updated graphics to keep programs current. public, through 10 new historical publications Data Quality. The Exhibits Program outcomes accurate- Results. The History Office exceeded its FY 2002 ly reflect performance and achievements in FY 2002. indicator by issuing 11 new historical publications. In

Part II • Supporting Data • Communicate Knowledge 225 Annual Performance Goal Trends for Communicate Knowledge

Annual Performance Assessment Performance Goal FY 1999 FY 2000 FY 2001 FY 2002

Strategic Goal 1. Ensure that NASA’s customers receive information from the Agency’s efforts in a timely and useful form.

Objective 1. Share with the public the knowledge and excitement of NASA’s programs in a form that is readily understandable 2CK1

Objective 2. Disseminate scientiﬁc information generated by NASA programs to our customers. 2CK2

Objective 3. Transfer NASA technologies and innovations to private industry and the public sector. 2CK3

Objective 4. Support the Nation’s education goals. 2CK4

addition, other publishers reprinted three publications For this annual performance goal, we achieved a rating that originally appeared in the NASA History Series. of blue. Our ratings were blue in FY 2001, and green in both FY 2000 and FY 1999. Data Quality. These publications are fully peer reviewed, and their quality is comparable to that of Indicator 1. Effective use of the NASA homepage to academic press publications. They are analytical and communicate knowledge about NASA’s scientific and scholarly in their treatment of complex technical and technological achievements to the public. Effectiveness historical issues. will be rated by placing at least 50 stories about breaking news on science and technology discoveries Data Sources. The data sources include monthly activ- Results. In FY 2002, the Office of Public Affairs con- ity reports from our field centers and NASA’s annual tinued to average more than one story posted per busi- History Program review. ness day on the NASA homepage, for nearly 300 stories covering the Agency’s entire program. Indicator 5. Documents significant in the Agency’s history will be made available to a larger audience by pro- Data Quality. The NASA homepage outcomes accu- ducing one, new electronic document—a CD-ROM rately reflect performance and achievements in FY 2002.

Results. The History Office completed a CD-ROM Data Sources. Data sources include monthly reports called Shuttle-Mir: The United States and Russia Share from NASA Centers. Automatic statistics gathering soft- History’s Highest Stage (SP-2001-4603, December ware collects Web site and related traffic statistics. 2001). This CD includes text of a book by the same title, NASA Center television producers maintained on-air as well as documents, multimedia materials, oral history records and reports. Other statistics come from counters transcripts, and additional analysis. on Web pages, normal management reporting, and the annual NASA History Program review. There is some Data Quality. NASA History CD-ROMs are peer limitation to these data because Web page counters do reviewed to ensure high quality standards. not document why an individual accesses a Web page. Indicator 2. The History Office will create one addition- Data Sources. The data sources include monthly activ- al online exhibit on the NASA History Web page ity reports from our field centers and NASA’s annual History Program review. Results. The History Office exceeded its performance indicator of creating one additional online exhibit on the NASA History Office Web page by creating 15 in Strategic Objective 2. Disseminate scientific FY 2002. Some of the online exhibits are as follows: information generated by NASA programs to our customers •Magellan: The Unveiling of Venus (JPL-400-345) http://history.nasa.gov/JPL-400-345/magellan.htm Annual Performance Goal 2CK2. Inform, provide status, enthuse, and explain results, relevance and ben- • The Space Shuttle Decision: NASA’s Search for a efits of NASA’s programs by meeting two of the three Reusable Space Vehicle (SP-4221) http://history.nasa. indicators for this goal. gov/SP-4221/sp4221.htm.

226 NASA FY 2002 Performance and Accountability Report Data Quality. These new historical sites fall into two have been commercialized by industry, through specific categories: electronic versions of previously published publications. Effectiveness will be measured by monitor- materials and totally new materials. The electronic ver- ing print and electronic distribution sions of books are faithful to the original hard copies, Results. NASA uses the Internet and educational which were peer reviewed, in that they include all the programs to make the latest technological developments text, images, and original pagination. New sites that are available to the public. For example, the NASA Tech not versions of existing books are peer reviewed for qual- Briefs Web site is available to download technical ity before they are placed on the Web. support packages, which provide in-depth information in Data Sources. Data sources include monthly reports the NASA Tech Briefs publication. NASA also uses the from Centers. Automatic statistics gathering software online edition of Aerospace Technology Innovation, the collects Web site and related traffic statistics. NASA public’s source for current information on NASA Center television producers maintained on-air records projects and opportunities in technology transfer and and reports. Other statistics come from counters on Web commercialization, aerospace technology development, pages, normal management reporting, and the annual and commercial development of space. NASA History Program review. There is some limitation Data Quality. The outcomes for the commercial use of to these data because Web page counters do not docu- technologies accurately reflect performance and ment why an individual accesses a Web page. achievements in FY 2002. Indicator 3. The History Office will meet the need for a timely and effective response to the public by meeting or Data Sources. Print and Web data are from the NASA exceeding 90 percent of the time a 15-day response standard TechTracS database, the NASA Headquarters Printing and Design Office, and the aerospace technology mis- Results. The History Office responded to its 200-plus sion, through its support organizations. monthly e-mail inquiries within 7 days 95 percent of the time, exceeding our goal. All commercial publications (NASA Tech Briefs, Aerospace Technology Innovation, and Spinoff) are Data Quality. The NASA History Office responded accessible online at http://www.nctn.hq.nasa.gov/. using its extensive historical reference collection, consisting of more than 1,500 linear feet of key primary and All commercial publications (NASA Tech Briefs, secondary sources on a wide range of aerospace history Aerospace Technology Innovation, and Spinoff) are topics. Numerous researchers both inside and outside of accessible online at http://www.nctn.hq.nasa.gov/. NASA have used this collection to answer with confi- Indicator 2. Publish at least one industry specific, spe- dence many historical queries. There is some limitation cial edition of Aerospace Technology Innovation issue in to these data because Web page counters do not docu- FY 2002, to attract new readership and encourage part- ment why an individual accesses a Web page. nerships with targeted industry sectors Data Sources. The data sources include monthly reports Results. NASA published two special editions of its from NASA Centers. Automatic statistics gathering soft- Aerospace Technology Innovation magazine in FY 2002: ware collects Web site and related traffic statistics. NASA “Medical Imaging: NASA’s New Initiative” and field center television producers maintained on-air records “Advancing Software Technology with U.S. Industry.” and reports. Other statistics come from counters on Web These special editions promoted NASA medical tech- pages, normal management reporting, and the annual nologies to targeted industry groups and NASA software NASA History Program review. technologies.

Strategic Objective 3. Transfer NASA technolo- Data Quality. The performance data reported accurate- gies and innovations to private industry and the ly reflect activities in FY 2002. Print and Web data were public sector controlled by the Office of Aerospace Technology and through its support organizations. Annual Performance Goal 2CK3. Ensure consistent, high-quality, external communication by meeting three of Data Sources. Performance data are obtained through the four indicators for this goal. normal management communications. Aerospace Technology Innovation is available to the public in NASA demonstrated our ability to provide high-quality print (by free subscription) and on the Web at external communications by achieving all indicators for http://www.nctn.hq.nasa.gov. this goal. For this annual performance goal, we maintained a rating of blue from FY 2001. We rated green in Indicator 3. Carry out effective NASA technology the two previous years, FY 2000 and FY 1999. transfer market outreach to the medical device industry Indicator 1. Effectively communicate technologies Results. In FY 2002, we published a Web-based available for commercial use and technologies that database that we use to collect and assist in the

Part II • Supporting Data • Communicate Knowledge 227 managing of research collaborations and licensing program; expectation about applying what was learned in opportunities in the medical device area at the program; and the value of the experience. http://www.nasamedical.com/. We held an event at Arizona State University promoting NASA medical and Data Quality. The performance data presented are com- information technologies to industry. The event was plete and accurately reflect progress made in FY 2002. attended by the medical industry from around the state. Data Sources. The data for the ratings are from the NASA We published (in print and on the Web) an industry- Education Program Framework and Evaluation System. specific edition of Aerospace Technology Innovation entitled “Medical Imaging: NASA’s New Initiative.” Indicator 2. NASA will involve the educational communi- Data Quality. The performance data reported accurately ty in its endeavors, maintaining a level of involvement of reflect activities in FY 2002. approximately 3 million participants which include teachers, faculty, and students Data Sources. Performance data are obtained through normal management communications. Results. Preliminary data show that 2,649,831 individuals directly participated in NASA education programs Indicator 4. The NASA TechTracS database, accessible in FY 2002. We expect the final data to show that we through the Internet, will list at least 18,000 NASA tech- exceeded the 3 million target. nologies that are considered to be of benefit to U.S. industry and the public Data Quality. Although program participation data collection ended on September 30, we are not able to Results. In FY 2002 the NASA TechTracS online data- include complete and verified data for this indicator. The base provided 20,890 viable NASA technologies consid- final FY 2002 assessment will be available in the second ered to be of benefit to U.S. industry and to the public. quarter of 2003. This exceeded the goal of 18,000. Data Sources. The education program offices maintain Data Quality. The performance data reported accurately an online data collection system, which captures partici- reflect activities in FY 2002. Data is maintained and con- pant demographic information and excellence ratings for figuration controlled by each NASA Center. specific program features. Data Sources. Data is available to the public via Web Indicator 3. Through meaningful partnerships, NASA at http://technology.nasa.gov. will increase the amount of total funding obligation from the FY 2000 baseline for Historically Black Colleges and Strategic Objective 4. Support the Nation’s Universities and Other Minority Universities education goals Results. We accomplished this indicator. The Minority Annual Performance Goal 2CK4. Using NASA’s University Research and Education Program was allocat- unique resources (mission, people, and facilities) to ed $82.1 million to manage the Historically Black support educational excellence for all, NASA supports the nation’s education goals by meeting three of the four Colleges and Universities (HBCU) Program and the indicators for this performance goal. Other Minority Universities (OMU) Program. This amount does not include the Centers’ and Enterprises’ For this annual performance goal, the communicate funding. Evidence of the Agency’s accomplishment in knowledge process achieved a rating of yellow. This these areas is shown by the 6 National Research yellow rating is because of incomplete data for FY 2002. Announcements (NRA) that resulted in 60 new awards: Partnership Awards for the Integration of Research into Indicator 1. Provide excellent and valuable educational undergraduate education (PAIR)—4 awards; Minority programs and services, maintaining an “excellence” University Mathematics, Science and Technology customer service rating ranging between 4.3 and 5.0 (on Awards for Teacher Education Program (MASTAP)—10 a 5.0 scale) 90 percent of the time awards; Precollege Achievement of Excellence in Results. The FY 2002 data are incomplete; however, Mathematics, Science, Engineering and Technology preliminary data show that the average excellence rating (PACE/MSET)—12 awards; Faculty Awards for is 4.63. Once the data are finalized in January 2003, the Research (FAR)—23 awards; NASA Group 3 HBCU results are expected to meet or exceed the 4.3 goal. University Research Centers (URC)—7 awards; and NASA Group 3 OMU University Research Centers— The excellence rating is an average of the responses for 4 awards. the following questions on the NASA Education Program Framework and Evaluation System: rate the Data Quality. The performance data presented program staff; what kind of recommendation one would are complete and accurately reflect progress made make to someone who asks about applying to the in FY 2002.

228 NASA FY 2002 Performance and Accountability Report Data Sources. We obtained the performance data from for the service component and therefore, this program budget documents. has not been developed in FY 2002. Indicator 4. NASA will establish an undergraduate Data Quality. The performance data presented are com- scholarship program beginning in FY 2002 plete and accurately reflect progress made in FY 2002. Results. We will establish the undergraduate scholar- Data Sources. We obtained this data from procurement ship program in FY 2004, pending legislative authority documentation.

Part II • Supporting Data • Communicate Knowledge 229

PART III

Financial

Letter From the Deputy Chief Financial Officer

I am pleased to present NASA’s first combined Performance and Accountability Report prepared in accordance with the Reports Consolidation Act of 2000. Further, NASA has received an unqualified audit opinion on NASA’s FY 2002 financial statements. This is a tremendous accomplishment for the Agency considering that the FY 2001 financial statements were disclaimed. Consistent with the Reports Consolidation Act and Office of Management and Budget guidance, NASA has met FY 2002 accelerated reporting requirements by preparing NASA’s performance results 2 months earlier than last year and preparing the audited financial statements 1 month earlier than last year. NASA could not have achieved these performance goals in both the quality and timeliness of reporting without the dedication of NASA employees at Headquarters, the Centers, the Office of Inspector General, our independent public accountant, and NASA contractors. NASA recognizes that these accelerated reporting requirements will remain the same for FY 2003 reporting, but will increase dramatically for FY 2004. NASA is working diligently with all NASA employees at Headquarters, the Centers, our contractors, and our auditors to reengineer our processes and associated internal reporting requirements and guidance to ensure NASA will meet the deadline of November 15, 2004, for issuance of the FY 2004 report. While working diligently with our auditors, we were able to overcome our previous year’s disclaimer of an audit opinion. NASA is pleased to be able to show the significant strides that we have made in FY 2002 in receiving an unqualified audit opinion for FY 2002 financial statements, which is good news for NASA. NASA acknowledges that other significant work is still needed to improve our overall financial management reporting. NASA management has identified through the Federal Managers’ Financial Integrity Act, and our auditors continue to report, the internal controls surrounding NASA’s Property, Plant and Equipment and Materials as a material weakness. During FY 2003, NASA plans to improve our Property, Plant and Equipment and Materials published policy and procedures. Also, NASA will provide additional guidance to contractors on the necessary contractor-held-property reporting and increase NASA-provided training to contractors on how to prepare these reports. Further, our auditors have also identified NASA’s process for preparing our Financial Statement and Performance and Accountability Report as a material weakness. NASA plans to review its Financial Statement and Performance and Accountability Report process and make significant changes to the FY 2003 preparation and reporting cycle. Finally, NASA and its auditors have concluded that our financial management systems are not substantially compliant with Federal financial management systems requirements. During FY 2003, NASA is installing a commercial off-the-shelf core accounting system that meets Federal requirements. NASA plans to be substantially compliant at the end of FY 2003. Overall, NASA has made significant financial management reporting improvement during FY 2002. I look forward to reporting more improvements in FY 2003.

Gwendolyn Brown Deputy Chief Financial Officer

Part III • Chief Financial Officer’s Letter 233

Financial Statements and Related Auditor’s Reports Financial Overview

SUMMARY OF FINANCIAL RESULTS, Assets in Space, which are various spacecraft operating POSITION, AND CONDITION above the atmosphere, constitutes $17.0 billion, or 71 percent, of NASA-owned and NASA-held property, NASA’s financial statements report the Agency’s finan- plant, and equipment. cial position and results of operations. The principal financial statements are the Consolidated Balance Cumulative Results of Operations represents the public’s Sheet, the Consolidated Statement of Net Cost, the investment in NASA, akin to stockholder’s equity in pri- Consolidated Statement of Changes in Net Position, vate industry. This investment is valued at $35.9 billion. the Combined Statement of Budgetary Resources, and the The Agency’s $39.8 billion net position includes Combined Statement of Financing. Additional financial $3.9 billion of unexpended appropriations (undelivered information is also presented in the required supple- orders and unobligated amounts, or funds provided but mentary schedules. not yet spent). Net position is shown on both the Consolidated Balance Sheet and the Consolidated The Chief Financial Officer’s Act of 1990 requires that Statement of Changes in Net Position. agencies prepare financial statements to be audited in accordance with Government Auditing Standards. While The Consolidated Statement of Net Cost presents the we prepared these financial statements from NASA’s “income statement” (the annual cost of programs) and books and records in accordance with formats prescribed distributes fiscal year expenses by program category. A by the OMB, the statements are in addition to financial chart depicting the distribution of expenses is included reports, prepared from the same books and records, that we under “Appropriations Used (Costs Expensed by use to monitor and control budgetary resources. The state- Enterprise)” in this overview. The Net Cost of Operations ments should be read with the realization that NASA is a is reported on the Consolidated Statement of Net Cost, component of the U.S. Government, a sovereign entity. the Consolidated Statement of Changes in Net Position, and the Combined Statement of Financing. NASA’s received a disclaimer of audit opinion on its FY 2001 financial statements. Consistent with Statement NASA makes substantial research and development of Federal Financial Accounting Standards No 21, investments on behalf of the Nation. To determine the net Reporting Corrections of Errors and Changes in cost of operations, these amounts are expensed as Accounting Principles, NASA has restated its FY 2001 incurred. Total Program Expenses are reported on the financial statements to correct material errors. While this Consolidated Statement of Net Cost and also on the did not remove the disclaimer of audit opinion associated table entitled “Required Supplementary Stewardship with FY 2001 statements, it provided FY 2002 beginning Information Statement regarding Stewardship balances so that NASA’s independent public accountant Investments: Research and Development.” Research and was able to express an unqualified audit opinion on the development includes all direct, incidental, and related FY 2002 financial statements. costs that either result from or are necessary to perform research and development, whether the research and The following is a brief description of each required development is performed by Federal agencies or by indi- financial statement and its relevance and a discussion of viduals and organizations under grant or contract. The significant account balances and financial trends. “Required Supplementary Stewardship Information The Consolidated Balance Sheet uses a format allowing Statement regarding Stewardship Investments: Research comparison of financial information for FY 2002 and and Development” identifies research and development FY 2001. It presents NASA’s assets, amounts owed investments by program; it relates to program expenses (liabilities), and equity (net position). The Consolidated shown on the Consolidated Statement of Net Cost. Balance Sheet reflects total assets of $44.2 billion and liabilities of $4.4 billion for FY 2002. Unfunded liabilities These investments fall into three categories: basic reported in the statements cannot be liquidated without research, applied research, and development. The objec- legislation that provides resources to do so. tive of basic research is to increase knowledge of the fundamental aspects of phenomena without regard to appli- About 79 percent of the assets are property, plant, and cations to specific processes or products. The objective of equipment, with a total book value of $35.1 billion. This applied research is to gain knowledge to determine how is property located at NASA installations (primarily the to meet a recognized, specific need. Development is the Centers), in space, and in contractor custody. NASA systematic use of the knowledge gained from research to holds almost 69 percent of these assets, while the remain- produce useful materials, devices, systems, or methods, ing 31 percent is in contractor custody. The book value of including design and development of prototypes and

236 NASA FY 2002 Performance and Accountability Report processes. It excludes quality control, routine product The Combined Statement of Financing reconciles the testing, and production. obligations incurred to finance operations with the net costs of operating programs. Costs that do not require NASA carried out its mission in FY 2002 through five resources include depreciation. Strategic Enterprises comprising the following major program areas: Space Science, Earth Science, Biological and Costs capitalized on the Consolidated Balance Sheet are Physical Research, Human Exploration and Development additions to capital assets made during the fiscal year. of Space, and Aerospace Technology. Funds are allocated Obligations Incurred include amounts of orders placed, by appropriation and then to programs. The Consolidated contracts awarded, services received, and similar transac- Statement of Net Costs distributes fiscal year expenses by tions that require payment during the same or a future programmatic category (budget line item). period. Obligations Incurred links the Combined Statement of Budgetary Resources to the Combined The Consolidated Statement of Changes in Net Position Statement of Financing. identifies appropriated funds used to pay for goods, services, or capital acquisitions. This statement presents REQUIRED SUPPLEMENTARY accounting events that changed the net position section of the Consolidated Balance Sheet between the beginning STEWARDSHIP INFORMATION and the end of the reporting period. Required Supplementary Stewardship Information provides both financial and non-financial information The Combined Statement of Budgetary Resources high- on resources and responsibilities not measured by lights the Agency’s budget authority. It provides infor- traditional financial reporting methods. This report pres- mation on budgetary resources available to NASA during ents two categories of Required Supplementary the year and the status of those resources at the end of the Stewardship Information: year. Detail on the amounts shown in the Combined Statement of Budgetary Resources is included in the dis- Heritage Assets—These are properties, plant, and equip- play entitled “Required Supplementary Information: ment that possess historical or natural significance; cul- Combined Schedule of Budgetary Resources.” Outlays tural, educational, or aesthetic value; or significant archi- reported in this statement reflect cash disbursements by tectural characteristics. Heritage assets are reported sim- the U.S. Department of the Treasury for NASA for the ply as physical units rather than with a dollar valuation, fiscal year. because their existence itself is the most relevant aspect of their value. For FY 2002, NASA reported 1,581 Budget Authority is the authority that Federal law gives to heritage assets. agencies to incur financial obligations that will eventually result in outlays or expenditures. Specific forms of Stewardship Investments (Research and Development)— budget authority that NASA receives are appropriations These are NASA-funded investments that yield long-term and spending authority from offsetting collections. For benefits to the general public. They include basic FY 2002, Congress provided NASA total appropriations research, applied research, and development. In FY 2002, of $14.9 billion. The funding was received and allocated these investments totaled approximately $8.5 billion. through the following appropriations: They included activities to expand knowledge of the Earth, the space environment, and the universe and to Human Space Flight—This appropriation provided for invest in aeronautics and space transportation technolo- the International Space Station and Space Shuttle pro- gies that support U.S. economic, scientific, and technical grams, including the development of the Space Station competitiveness. These investments are identified by pro- research facilities; continued safe, reliable access to space gram on the “Required Supplementary Stewardship through investments to improve Space Shuttle safety; Information Statement regarding Stewardship support of payload and expendable launch vehicle opera- Investments: Research and Development” table, and tie to tions; and other investments including innovative tech- the related program expenses shown on the Consolidated nology development and commercialization. Statement of Net Cost. Science, Aeronautics, and Technology—This appropriation provided for NASA’s research and development REQUIRED SUPPLEMENTARY activities, including all science activities, global change INFORMATION research, aeronautics, technology investments, education programs, space operations, and direct program support. Required Supplementary Information (RSI) presents a complete picture of financial results, position, and con- Inspector General—This appropriation provided for the dition. This information comprises intragovernmental workforce and other resources to perform audits, activities, deferred maintenance, and budgetary evaluations, and investigations of NASA’s programs resources. Intragovernmental Activities are transactions and operations. that occur between Federal agencies. Deferred

Part III • Financial Overview Maintenance is maintenance that was not performed now all included directly in program and project budgets. when it was needed, including maintenance that had The budget for FY 2002 includes three appropriations: been scheduled to be performed but was delayed until Human Space Flight; Science, Aeronautics and Tech- a future period. nology; and the Inspector General. Programmatically, the budget for FY 2002 supported both CHANGE IN APPROPRIATION near-term priorities, such as flying the Space Shuttle safe- STRUCTURE FOR FY 2002 ly and building and operating the International Space Station, and longer-term investments in America’s future, In the FY 2001 appropriation structure, the Mission such as developing more affordable, reliable means of Support appropriation provided a portion of the direct access to space and conducting cutting-edge scientific support required to execute NASA’s programs. This and technological research. It continued to support our included research and operations support, civil service traditional strengths in engineering and science as well as salaries, and travel. The new FY 2002 appropriation revolutionary insights and capabilities on the horizon in structure reflects NASA’s move to full cost management. areas such as biotechnology, nanotechnology, and infor- In this new structure, the budget for the support items pre- mation technology. viously included in the Mission Support appropriation is

Financial Statements

[ This section is being supplied under separate cover ]

238 NASA FY 2002 Performance and Accountability Report Auditor’s Reports

[ This section is being supplied under separate cover ]

Part III • Auditor’s Reports

NASA Office of Inspector General Summary of Serious Management Challenges 242 NASA FY 2002 Performance and Accountability Report Part III • Office of Inspector General Summary 243 244 NASA FY 2002 Performance and Accountability Report Other Agency-Specific Statutorily Required Reports Inspector General Act Amendment Reports

The Inspector General Act (as amended) requires semian- are taken on audit and inspection recommendations and nual reporting on IG audits and related activities as well that disagreements are resolved. The Audit Followup as Agency followup. The following is the report on Official has made a personal commitment to resolving Agency followup. As required by Section 106 of the and closing recommendations promptly. IG Act Amendments (P.L. 100-504), it includes statistics on audit reports with disallowed costs and recommenda- In addition to senior management’s significant attention tions that funds be put to better use for FY 2002. It also to open OIG recommendations, all levels of management provides information on the status of audit and are cooperating with the OIG to coordinate better on audit inspection reports that were pending final action as of followup. As a result, we have reduced the number of September 30, 2002. For the last four years, NASA has open OIG recommendations by 42 percent since included its management report annually in the Agency’s January 2002. This dramatic reduction follows several Performance and Accountability report. This was done years of increases. Management expects further reduc- under a pilot program established by the Government tions in the coming months. Performance and Results Act (GPRA). Now that the pilot program is over, NASA will continue this practice as rec- Over the last year, the Management Assessment Division ommended in the Reports Consolidation Act or 2000. of NASA’s Office of Management Systems has taken positive steps to improve communication with the OIG AUDIT FOLLOWUP throughout the audit cycle, to improve the audit/inspection report process, and to reconcile audit-tracking data Audit followup is a high priority for NASA. In May 2002, with the OIG. We also streamlined management’s audit the Agency’s Internal Control Council found that resolution process to enable more efficient decisions on open recommendations of the OIG were a potentially unresolved recommendations. NASA is transitioning our major vulnerability because the number of open recom- corrective action tracking system to a Web-based archi- mendations was becoming difficult to manage. In tecture. The new system, scheduled to be operational in September, the NASA Administrator designated the early 2003, will provide e-mail notification alerts to assist Deputy Administrator as the Agency’s Audit Followup in audit followup, as well as enhanced reporting and Official, responsible for ensuring that corrective actions analysis capabilities.

AUDIT REPORTS WITH DISALLOWED COSTS AND RECOMMENDATIONS

Statistical Table on Audit Reports With Disallowed Costs October 1, 2001 Through September 30, 2002 Number of Dollar Audit Reports Value

A. Audit reports with management decisions on which final action had not been taken at the 0 $0 beginning of the reporting period

B. Audit reports on which management decisions were made during the reporting period 1 $0

C. Total audit reports pending final action during the reporting period (total of A + B) 1 $0

D. Audit reports on which final action was taken during the reporting period 1 Value of disallowed costs collected by management 0 $0 2 Value of costs disallowed by management 1 $0 3 Total (lines D1 + D2) 1 $0

E. Audit reports needing final action at the end of the reporting period (C - D3) 0 $0

246 NASA FY 2002 Performance and Accountability Report Statistical Table on Audit Reports With Recommendations That Funds Be Put to Better Use October 1, 2001 Through September 30, 2002 Number of Audit Dollar Reports Value

A. Audit reports with management decisions on which final action had not been taken at the beginning 1 $4,000 of the reporting period

B. Audit reports on which management decisions were made during the reporting period 2 $1,669,750

C. Total audit reports pending final action during the reporting period (total of A + B) 3 $1,673,750

D. Audit reports on which final action was taken during the reporting period 1 Value of recommendations implemented 3 $1,673,750 2 Value of recommendations that management concluded should not or could not be implemented 0 $0 3 Total (lines D1 + D2) 3 $1,673,750

E. Audit reports needing final action at the end of the reporting period (C - D3) 0 $0

AUDIT AND INSPECTION REPORTS PENDING FINAL ACTION

Audit Reports

Report Report Report Report No. Date No. Date IG-98-030 09/14/98 IG-99-016 03/24/99 Single Source Suppliers of Critical Items Advanced X-ray Astrophysics Facility The OIG made three recommendations; management The OIG made two recommendations. Both remain open concurred with all. One recommendation remains open pending issuance of NPG 7120.5B, which is anticipated pending issuance of NASA Procedure and Guideline by 12/31/02. (NPG) 7120.5B, which is anticipated by 12/31/02.

IG-98-041 09/30/98 IG-99-020 03/31/99 CNMOS Cost Savings NASA Control of Export-Controlled Technologies This audit resulted in one recommendation, which is This audit resulted in six recommendations; one is closed. resolved and open. An OIG investigation is in progress to Management expects to complete corrective actions determine any possible dollar savings. The OIG estimates on the remaining five resolved recommendations that the investigation will be completed by 12/31/02. by 10/31/02.

IG-99-001 11/03/98 X-33 Funding Issues IG-99-047 09/22/99 The OIG made two recommendations; both are resolved Safety Considerations at Goddard Space Flight Center and open. Management is working with the OIG to close The OIG made five recommendations; one remains open. these recommendations by 11/29/02. Management expects to complete corrective action on this resolved recommendation by 12/31/02. IG-99-009 03/09/99 Space Station Contingency Planning for Interna- tional Partners IG-99-052 09/24/99 The audit resulted in two recommendations. A meeting X-33 Cost Estimating Processes was held with the Audit Followup Official on 9/30/02 The audit resulted in four recommendations; three are to discuss these unresolved recommendations. Manage- closed. The remaining open recommendation was ment and the OIG are working to resolve and close resolved during the reporting period, and management both recommendations. expects to complete corrective action by 12/31/02.

Part III • Inspector General Act Amendment Reports 247 Report Report Report Report No. Date No. Date

IG-00-009 02/23/00 IG-00-038 07/17/00 Staffing of the Expendable Launch Vehicle Program NASA’s Organizational Structure for Implementing the Office at the Kennedy Space Center Clinger-Cohen Act The OIG made three recommendations; two are closed. Two of the OIG’s four recommendations were closed Corrective action on the remaining resolved recommen- upon issuance of the final report. Management anticipates dation is planned for completion by 11/30/02. completion of corrective actions on the remaining two resolved recommendations by 3/30/03. IG-00-045 09/20/00 Review of NASA’s Independent Cost Estimating Capability IG-00-017 03/21/00 The OIG made five recommendations; three are closed. General Controls at Johnson Space Center’s Mission Corrective action on the two remaining resolved recom- Control Center mendations is scheduled to be completed by 12/31/02. The OIG made 14 recommendations in the final report; 11 are closed. The remaining three recommendations are IG-00-048 09/19/00 resolved and management expects to complete all correc- Contractor Exports of Controlled Technologies. tive actions by 12/31/02. The OIG made two recommendations; they are resolved and open. Management expects to complete corrective IG-00-018 03/23/00 actions on both recommendations by 10/31/02. NASA Oversight of Contractor Exports of Con- trolled Technologies IG-00-055 09/28/00 System Information Technology Security Planning The audit resulted in two recommendations; one is closed. The audit resulted in 10 recommendations; eight are Management plans to implement corrective action on the closed. Management anticipates completing corrective remaining resolved recommendation by 10/31/02. action on the two remaining resolved recommendations by 1/10/03. IG-00-029 03/30/00 X-34 Technology Demonstrator IG-00-057 09/28/00 The OIG made 16 recommendations to management; nine NASA’s Planning and Implementation for Presidential have been closed. The remaining seven recommendations Decision Directive 63-Phase I are resolved, and management expects to complete cor- The OIG made three recommendations; one is closed. rective action on all by 12/31/02. Management plans to implement corrective action on the remaining two resolved recommendations by 11/30/02. IG-00-030 03/21/00 IG-00-059 09/28/00 Compliance with the National Environmental Policy Act Software Assurance This audit resulted in nine recommendations; seven are This audit resulted in two recommendations; one is closed. Management anticipates completing corrective closed. The remaining recommendation is resolved, actions on the remaining two resolved recommendations and management expects to complete corrective action by 10/31/02. by 12/31/02.

IG-00-034 05/12/00 IG-01-003 12/21/00 Foreign National Visitors at NASA Centers Audit of Space Shuttle Payloads The OIG made four recommendations; one is closed. The This audit resulted in five recommendations; all remaining three recommendations are resolved, and man- are unresolved. A meeting was held with the Audit agement plans to implement corrective actions on all Followup Official on 9/30/02; management and the recommendations by 10/30/02. OIG are working towards resolution and closure of all recommendations.

IG-00-036 07/17/00 IG-01-008 2/16/01 Summary Report on Disaster Recovery Planning Audits Collection of Personal Information on NASA’s Publicly The audit resulted in two recommendations to manage- Accessible Web Sites ment; one is closed. Management expects to complete The OIG made six recommendations; two remain corrective action on the remaining resolved recommenda- resolved and open. Management plans to implement cor- tion by 12/16/02. rective actions by 10/29/02.

248 NASA FY 2002 Performance and Accountability Report Report Report Report Report No. Date No. Date

IG-01-009 03/13/01 IG-01-036 09/27/01 Faster, Better, Cheaper: Policy, Strategic Planning, and NASA’s Information Systems Processing National Human Resource Alignment Security Information The OIG made five recommendations; three are closed. The OIG made three recommendations; all are resolved Management is working with the OIG to close the two and open. Management anticipates completion of correc- remaining resolved recommendations by 10/31/02. tive actions by 12/31/02.

IG-01-018 03/27/01 IG-01-037 09/27/01 Agencywide IT Security Program for Unclassified Systems Advanced Aeronautics Program The audit resulted in seven recommendations; five This audit resulted in 13 recommendations; 12 are are open and resolved. Management plans to complete closed. The one remaining recommendation is resolved; corrective actions on all remaining recommendations management anticipates completing corrective action by 3/30/03. by 10/30/02. IG-01-038 09/27/01 IG-01-021 03/30/01 NASA's Planning and Implementation for PDD 63 X-37 Technology Demonstrator Project Management The OIG made two recommendations, both of which are The OIG made 13 recommendations; six are closed. resolved. Management expects to complete corrective Management anticipates completing corrective actions actions on both recommendations by 12/15/02. on the remaining seven resolved recommendations by 2/28/03. IG-01-042 09/28/01 Safety of Lifting Devices and Equipment at Stennis IG-01-022 03/30/01 Space Center Information Technology Security The OIG made 16 recommendations; one remains open. The audit resulted in four recommendations; three are Management anticipates implementing correction action open. Management plans to complete corrective actions on this resolved recommendation by 11/01/02. on these resolved recommendations by 7/1/03. IG-01-043 09/28/01 IG-01-032 08/22/01 Information Technology Security Requirements in NASA UNIX Operating System Security and Integrity in Contracts, Grants, and Cooperative Agreements MCC at JSC Of the three recommendations made by the OIG, one is This audit resulted in 28 recommendations; 19 are closed. The two remaining recommendations are resolved resolved and open. Management is working with the OIG and open. Completion of corrective action is expected to close all remaining recommendations by 12/31/02. by 1/30/03.

IG-01-033 08/21/01 Inspection Reports UNIX Operating System Security and Integrity of the New Business Systems at the JPL Report Report No. Date The OIG made 21 recommendations; 18 are closed. Management is working with the OIG to resolve one G-98-011 08/27/99 recommendation, and anticipates completing corrective Flight Termination Systems actions on all remaining open recommendations This review resulted in six recommendations; two are by 11/15/02. closed. The remaining four recommendations are resolved and open. Management anticipates completion IG-01-034 08/31/01 of all corrective actions by 11/22/02. Controls Over the Use of Plastic Films, Foams, and Adhesive Tapes in and Around the Space Shuttle G-99-006 12/11/98 Orbiter Vehicles NASA’s Implementation of a Public Key Infrastructure Of the five recommendations made in the report, one The OIG made seven recommendations; five are closed. remains open. It is resolved and management expects to Management will implement corrective action on the complete corrective action by 3/15/03. remaining two resolved recommendations by 3/28/03.

Part III • Inspector General Act Amendment Reports 249 Report Report Report Report No. Date No. Date G-99-007 08/06/99 G-00-021 02/20/01 Assessment of the NASIRC Assessment of NASA's Use of the Metric System This review resulted in 11 recommendations; six are This inspection resulted in eight recommendations; all closed. Management and the OIG are working to resolve are resolved and open. Management expects to complete three unresolved recommendations, and close all five corrective actions for all recommendations by 1/31/2003. open recommendations by 3/28/03. G-00-022 03/28/01 G-99-010 07/21/00 Review of the Designated Approving Authority International Space Station Command and Control at NASA Communications Security The OIG made seven recommendations; all are resolved This review resulted in five recommendations; four and open. Management anticipates completing corrective are closed. Management anticipates completing correc- actions for these recommendations by 11/15/02. tive action on the remaining resolved recommendation by 10/31/02. G-01-014 09/28/01 Langley Research Center Network Firewall G-99-014 05/26/00 This review resulted in five recommendations; four are NASA's Badging Program and Physical Access Controls closed. The remaining open recommendation is resolved, at the Wallops Flight Facility and management expects to complete corrective action The OIG made six recommendations in this report; by 10/31/02. five are closed. Management plans to implement corrective action on the remaining resolved recommendation G-01-019 9/28/01 by 11/30/02. Followup Review of the Independent Program Assess- ment Office G-00-004 07/14/00 The OIG made nine recommendations; seven are closed. NASA's Badging Program and Physical Access Controls The two remaining open recommendations are unre- at the GSFC solved. Management is working with the OIG to resolve The OIG made 17 recommendations in this report. All and close both recommendations by 10/15/02. recommendations are resolved; 14 recommendations are closed. Management anticipates completing correc- G-01-020 07/30/01 tive actions on the remaining three recommendations Inspection of NASA Headquarters Employee Background by 12/31/02. Investigations Process The OIG made 12 recommendations; 11 are closed. G-00-019 02/06/01 Completion of corrective action on the remaining Information Technology Security Training and Develop- resolved recommendation is planned by 12/2/02. ment and other Human Resources Considerations The OIG made seven recommendations; one is closed. Management and the OIG are working to resolve one rec- There are no disallowed costs or better use of funds asso- ommendation, and close all open ones by 07/01/03. ciated with any of these audit and inspection reports.

250 NASA FY 2002 Performance and Accountability Report Acronyms

Acronyms

2MASS 2-Micron All Sky Survey CORE Continuous Observations of the Rotation of the Earth A COS Cosmic Origins Spectrograph CRV Current Replacement Value ACEAdvanced Composition Explorer CRYSTAL Cirrus Regional Study of Tropical ADEOS Advanced Earth Observing Satellite Anvils and Layers ADP Acceptance data packages, also CRYSTAL-FACE Cirrus Regional Study of Tropical automatic data processing Anvils and Cirrus Layers-Florida AGAGEAdvanced Global Atmospheric Area Cirrus Experiment Gases Experiment CTV Crew Transfer Vehicle AIAA American Institute of Aeronautics and Astronautics D AIM Aeronomy of Ice in the Mesosphere mission DA Data assimilation ANOPP Aircraft Noise Prediction Program DAADeputy Associate Administrator DAAC Distributed Active Archive Center ARC Ames Research Center DAOData Assimilation Office AVATARAdvanced Vehicle Analysis Tool for Acoustics Research DARPA Defense Advanced Research Projects Agency AVHRR Advanced, Very-High-Resolution Radiometer DARWIN Developmental Aeronautics Revolutionizing Wind Tunnels AWIN Aviation weather information network DEM Digital Elevation Models DNA Deoxyribonucleic acid C DOD Department of Defense CATS Corrective Action Tracking System CBS Columbia Broadcasting System E ECR Environmental Compliance and CD compact disk Restoration CDC Centers for Disease Control and EIRT External independent review team Prevention ELV Expendable launch vehicle CD-ROM Compact Disk-Read-Only Memory ENSO El Niño Southern Oscillation CEOS Committee on Earth Observation Satellites EO Earth observing CERES Clouds and the Earth’s Radiant EOS Earth Observing System Energy System EOSDIS Earth Observing System Data CFD Computational Fluid Dynamics Information Systems CFO Chief Financial Officer EPA Environmental Protection Agency ER EXPRESS Rack CIO Chief Information Officer ERAST Environmental Research Aircraft CLPX Cold Land Processes Experiment and Sensor Technology CMC Ceramic matrix composite EROS Earth Resources Observation CNMOS Consolidated Network Mission Systems Operations Support Contract ESDIS Earth Science Data Information CONTOUR Comet Nucleus Tour Systems

Acronyms 253 ESIP Earth Science Information Partner HESSi High Energy Solar Spectroscopic EXPRESS Expedite the Processing of Imager Experiments to the Space Station HETE High Energy Transient Explorer HRF Human Research Facility F FAAFederal Aviation Administration I FACS Financial and contractual status ICAO International Civil Aviation FAIR Federal Activities Inventory Reform Organizations FAME Full-Sky Astrometric Mapping IceSAR Synthetic Aperture Radar Explorer ICESat Ice, Cloud, and Land Elevation FARFaculty Awards for Research Satellite IFC Intelligent flight control FAST Fast Auroral Snapshot Explorer IFM Integrated financial management FIDO Field integrated design and operations IFMP Integrated Financial Management Program FRD Flight Requirements Document IFSAR Intelligence Reform Interferometric FUSE Far Ultraviolet Spectroscopic Synthetic Aperture Radar Explorer iLAB Information Laboratory FY Fiscal Year IMAGE Imager for Magnetopause-to- Aurora Global Exploration G InSAR Satellite radar interferometry GALEX Galaxy Evolution Explorer IOP Intensive Observing Period GAO General Accounting Office IPCC Intergovernmental Panel on Climate GE General Electric Change GISS Goddard Institute for Space Studies IRI International Research Institute [for GLAST Gamma-ray Large Area Space Climate Prediction] Telescope ISCCP International Satellite Cloud GMI Global Modeling Initiative Climatology Project GOES Geostationary Operational ISS International Space Station Environmental Satellite IT Information Technology GPCP Global Precipitation Climatology Project J GPS Global Positioning System JPL Jet Propulsion Laboratory GRACE Gravity Recovery and Climate JSC Johnson Space Center Experiment GSFC Goddard Space Flight Center GTWS Global Tropospheric Wind K Sounding KSNN Kid’s Science News Network

H L HALOE Halogen Occultation Experiment LAI Leaf Area Index HBCU Historically black colleges and LBA-ECO Large-Scale Atmosphere Biosphere universities Experiment in Amazonia, HEDS Human Exploration and Ecological Research Program Development of Space LCLUC Land Cover Land Use Change

254 NASA FY 2002 Performance and Accountability Report LLIS Lessons Learned Information NMC New Millennium Carrier System NOAA National Oceanic and Atmospheric LPT Low Power Transceiver Administration LTMPF Low Temperature and Microgravity NODIS NASA Online Directives Physics Facility Information System NOx Oxides of nitrogen M NPD NASA Policy Directive MAEL Mobile Aeronautics Education NSA National Security Agency Laboratory NSIPP NASA’s Seasonal-to-Interannual Magsat Geomagnetic satellite Prediction Project MAM-1 Microarcsecond Metrology NTSB National Transportation Safety MASTAP Minority University Mathematics, Board Science and Technology Awards for Teacher Education Program O MER Mars Exploration Rover OBPR Office of Biological and Physical MIDEX Medium-Class Explorer Research MISR Multi-angle Imaging OCHMO Office of the Chief Health and Spectroradiometer Medical Officer MIT Massachusetts Institute of ODIN Outsourcing Desktop Initiative Technology OH Hydroxyl radical MODIS Moderate-Resolution Imaging Spectroradiometer OIG Office of Inspector General MOPITT Measurements of Pollution in the OLMSA Office of Life and Microgravity Troposphere Sciences and Applications MOZART Model for Ozone and Related OMB Office of Management and Budget Chemical Tracers OMU Other Minority Universities OPM Office of Personnel Management N OSSE Observing System Simulation NACC NASA Administrative Computer Experiments Complex OTD Optical Transient Detector NAIS NASA Acquisition Internet Service NASA National Aeronautics and Space P Administration PACE/MSET Precollege Achievement of NCAR National Center for Atmospheric Excellence in Mathematics, Research Science, Engineering and NCEP National Center for Environmental Technology Prediction PAIR Partnership Awards for the NCRP National Council on Research Integration of Research into Protection undergraduate education NEPA National Environmental Policy Act PAPACProvide Aerospace Products and Capabilities NESDIS National Environmental Satellite, Data, and Information PART Performance Assessment Rating Service/NOAA Tool NGST Next Generation Space Telescope PBC Performance Based Contract mission PBS Public Broadcasting System NIAT NASA Integrated Action Team PDARS Performance Data Analysis and NISN Integrated Services Network Reporting System

Acronyms 255 PDR Preliminary Design Review SHADOZ Southern Hemisphere Additional PIC Procurement Information Circular Ozonesondes PKI Public Key Infrastructure SHCP Strategic Human Capital plan PMA President’s Management Agenda SIM Space Interferometry Mission PMAP President’s Management Action SIMBIOS Sensor Intercomparison and Merger Plan for Biological and Interdisciplinary Oceanic Studies PMCWG Program Management Council SIRTF Space Infrared Telescope Facility Working Group spacecraft SLI Space Launch Initiative R SLR2000 Complete Solar Laser Ranging RADARSAT Canadian Radar Satellite 2000 satellite RAMM RADARSAT Antarctic Mapping SMB 3B Servicing Mission 3B Mission SOFBALL Structure of Flame Balls at Low ReMaP Research Maximization and Lewis-number Prioritization Task Force

RERP Radiobiology External Review SOHO Solar and Heliospheric Observatory Panel SOLAR NASA’s Web-based training system RHESSI Reuven Ramaty High Energy Solar Spectroscopic Imager SOLVE SAGE III Ozone Loss and Validation Experiment RNA Ribonucleic acid, a macromolecule found in the nucleus and cytoplasm SPIE International Society for Optical of cells Engineering RP Hydrocarbon SPIRE Spectral and Photometric Imaging Receiver RPA Remotely piloted aircraft SRTM Shuttle radar topography mission RXTE Rossi X-ray Timing Explorer SST sea surface temperature STARS Staffing and Recruiting System S STC Space Transportation Council SAGE Stratospheric Aeosol and Gas STES/PCAM Single-locker Thermal Enclosure Experiment satellite System/Protein Crystallization SAMPEX Solar, Anomalous, and Apparatus for Microgravity Magnetospheric Particle Explorer STTR Small Business Technology SATS Small Aircraft Transportation Transfer System SWAS Submillimeter Wave Astronomy SBIR Small Business Innovation Satellite Research SBUV/2 Solar Backscatter Ultraviolet T SCIGN Southern California Integrated GPS TCAT 21st Century Aircraft Technology Network TCU Tribal college SDO Solar Dynamics Observatory TDRS Tracking and Data Relay Satellite SeaDAS SeaWiFS sensor data analysis Project system THESEO Third European Stratospheric SeaWiFS Sea-viewing wide field-of-view Experiment on Ozone sensor TIMED Thermosphere, Ionosphere, SENH Solid Earth and Natural Hazards Mesosphere Energetics and SES Senior executive service Dynamics SESWG Solid Earth Science Working Group TOMS Total Ozone Mapping Spectrometer

256 NASA FY 2002 Performance and Accountability Report TOPEX Ocean Topography Experiment TPF Terrestrial Planet Finder TRACE-P Transport of Chemical Evolution over the Pacific TRL technology readiness level TRMM Tropical Rainfall Measuring Mission U UAV unmanned aerial vehicle UF utilization flight URC University Research Center USDA U.S. Department of Agriculture USGS U.S. Geological Survey V VA MS Virtual Airspace Modeling and Simulation VAST Virtual Airspace System Technology VDL Very high frequency (VHF) data link VHF Very high frequency VLBI Very Long Baseline Interferometry W WINN Weather Information Network WORF Window Observational Research Facility WMO/UNEP World Meteorological Organization/United Nations Environment Programme X X-43C Experimental vehicle 43 C XML eXtensible Markup Language

Acronyms 257

Cover design by Lesco. Editorial, graphics, and layout provided by ASRC Corporation. National Aeronautics and Space Administration NASA Headquarters Washington, DC 20546 http://www.nasa.gov NP-2003-01-297-HQ