Evaluating Structured Analytic Techniques

Total Page:16

File Type:pdf, Size:1020Kb

Evaluating Structured Analytic Techniques IMPROVING THE ANALYSIS OF FOREIGN AFFAIRS: EVALUATING STRUCTURED ANALYTIC TECHNIQUES By Stephen J. Coulthart B.A. in Political Science, State University of New York at Oswego, 2006 M.A. in International Relations and Diplomacy, Seton Hall University, 2010 M.P.A in Public Administration, Seton Hall University, 2010 Submitted to the Graduate Faculty of the Graduate School of Public and International Affairs in partial fulfillment of the requirements for the degree of PhD in Public and International Affairs University of Pittsburgh 2015 UNIVERSITY OF PITTSBURGH GRADUATE SCHOOL OF PUBLIC AND INTERNATIONAL AFFAIRS This dissertation was presented By Stephen Coulthart It was defended on June 4, 2015 and approved by Shawn Bird, PhD, Division Chief, U.S. Department of State-Bureau of Intelligence and Research Michael Kenney, PhD, Associate Professor, Graduate School of Public and International Affairs, University of Pittsburgh Phil Williams, PhD, Professor, Graduate School of Public and International Affairs, University of Pittsburgh Dissertation Chair: William N. Dunn, PhD, Professor, Graduate School of Public and International Affairs, University of Pittsburgh ii Copyright © by Stephen J. Coulthart 2015 iii IMPROVING ANALYSIS OF FOREIGN AFFAIRS: EVALUATING STRUCTURED ANALYTIC TECHNIQUES Stephen Coulthart, M.P.A./M.P.A University of Pittsburgh, 2015 Research suggests that foreign affairs analysis is weak—even the best analysts are accurate less than 35 percent of the time (Tetlock 2005). To compensate for analytic weaknesses, some have called for the use of structured analytic techniques, that is, formalized intelligence analysis methods. This imperative was enshrined in the Intelligence Reform and Terrorism Prevention Act (2004), which mandates that analysts use these techniques. This research investigates how the techniques have been applied in the U.S. intelligence community (IC) while making a modest attempt to evaluate 12 core techniques. The investigation of how the techniques are applied is based on semi-structured interviews with 5 intelligence experts and a survey of 80 analysts at an IC agency, along with follow-up interviews with 15 analysts. Interestingly, 1 in 3 analysts reported never using the techniques. Two factors were related to the use of the techniques: analytic training (p=0.001, Cramer's V=0.41) and the perception of their value (p=.049, Cramér's V= 0.23). There was not a statistically significant relation between the time pressure under which analysts work and their use of the techniques (p=0.74). Questions about the effectiveness of the techniques were answered in part by employing a “systematic review,” a novel methodology for synthesizing a large body of research. A random sample of more than 2,000 studies, suggests that there is moderate to iv strong evidence affirming the efficacy of using three techniques: Analysis of Competing Hypotheses, Brainstorming, and Devil’s Advocacy. There were three main findings: face- to-face collaboration decreases creativity, evidence weighting appears to be more important than seeking disconfirming evidence, and conflict tends to improve the quality of analysis. This research also employed an experiment with 21 graduate intelligence studies students, which confirmed the first two findings of the systematic review. The findings of the dissertation represent a contribution to “evidence-based intelligence analysis,” the systematic effort to develop a robust evidence-base linking the use of specific analytic techniques to the improvement of analysis in foreign affairs. Future research might build on the evidence-base presented here to improve intelligence analysis, one of the most important areas of judgment in foreign affairs. v TABLE OF CONTENTS 1.0 CHAPTER 1: ADDRESSING THE LIMITS OF FOREIGN AFFAIRS ANALYSIS ................................................................................................................................... 1 1.1 THE LIMITATIONS OF EXPERTISE IN FOREIGN AFFAIRS ANALYSIS .... 2 1.2 SPANNING THE DIVIDE: IMPROVING DECISION AND ANALYSIS IN FOREIGN AFFAIRS .......................................................................................................... 4 1.2.1 The Theory-Application Gap- Evaluating the Intelligence Reform Act 6 1.3 DEVELOPING A THEORY OF STRUCTURED ANALYTIC TECHNIQUES 10 1.3.1 A Theory of Structured Analytic Techniques ........................................ 13 1.4 ADOPTING EVIDENCE-BASED INTELLIGENCE ANALYSIS TO ANSWER THE RESEARCH QUESTIONS ..................................................................................... 17 1.4.1 Research Question 1: The Implementation of Structured Analytic Techniques ................................................................................................................ 18 1.4.2 Research Question 2: The Effectiveness of Structured Analytic Techniques ................................................................................................................ 20 1.5 AT THE FRONTIER OF FOREIGN AFFAIRS ANALYSIS .............................. 24 2.0 CHAPTER 2: ASSESSING THE QUALITY OF INTELLIGENCE ANALYSIS: A SYNTHESIS AND REFORMULATION .............................................................................. 26 2.1 WHAT IS ‘QUALITY’ INTELLIGENCE ANALYSIS AND WHY IT’S SO HARD TO PRODUCE? ................................................................................................... 28 vi 2.1.1 Defining Intelligence Analysis Quality .................................................. 29 2.1.2 The Diminishing Returns of Expert Judgment ...................................... 34 2.2 REFRAMING INTELLIGENCE ANALYSIS AS AN “INEXACT SCIENCE” 38 2.2.1 Intelligence Analysis as an “Inexact Science” ....................................... 39 2.2.2 A Justification for Structured Analytic Techniques: System 1 and 2 Thinking .................................................................................................................... 44 2.2.3 A New Theory of Structured Analytic Techniques .............................. 46 2.3 IMPLEMENTING STRUCTURED ANALYTIC TECHNIQUES IN THE IC . 51 2.3.1 The Answer is in the Head, not the Numbers ........................................ 51 2.3.2 New Era, New Analysis .............................................................................. 54 2.3.3 Intelligence Reform and Terrorism Prevention Act of 2004 and Large- Scale Implementation .............................................................................................. 57 2.3.4 Factors Affecting the Implementation of Structured Analytic Techniques ................................................................................................................ 59 2.4 SUMMARIZING THE ARGUMENT .................................................................... 62 3.0 CHAPTER 3: RESEARCH DESIGN AND METHODOLOGY ................................. 65 3.1 FIELD STUDY: IMPLEMENTING STRUCTURED ANALYTIC TECHNIQUES 66 3.1.1 Semi-structured Interviews with Intelligence Analysis Experts ........ 67 3.1.2 Survey and Interviews at the Bureau of Intelligence and Research .. 68 3.2 EVALUATING STRUCTURED ANALYTIC TECHNIQUES: A SYSTEMATIC REVIEW AND FIELD EXPERIMENT .......................................................................... 76 vii 3.2.1 A Systematic Review of Structured Analytic Techniques................... 77 3.2.2 An Experiment of ACH and Indicators ................................................... 84 3.3 CONCLUSION ........................................................................................................... 94 4.0 CHAPTER 4: WHO USES STRUCTURED ANALYTIC TECHNIQUES AND WHY?: A SURVEY IN THE INTELLIGENCE COMMUNITY ........................................ 96 4.1 FRAMING THE STUDY: TESTING THE VARIABLES AT STATE DEPARTMENT INR ........................................................................................................ 97 4.1.1 Study Hypotheses ........................................................................................ 98 4.1.2 State Department’s Bureau of Intelligence and Research ................... 99 4.1.3 Gauging the Use of Structured Analytic Techniques at INR ........... 101 4.2 STUDY HYPOTHESIS 1: ANALYST TRAINING .................................. 102 4.3 PERCEPTIONS OF THE TECHNIQUES, TIME PRESSURE AND DEMOGRAPHICS ......................................................................................................... 106 4.3.1 Perception of Structured Analytic Techniques .................................... 107 4.3.2 Time Pressure ............................................................................................. 110 4.3.3 Demographics: Age ................................................................................... 112 4.4 SUMMARY OF RESULTS AND CONCLUSIONS ................................ 115 5.0 CHAPTER 5: “WHAT WORKS?” A SYSTEMATIC REVIEW OF STRUCTURED ANALYTIC TECHNIQUES ..................................................................... 117 5.1 OVERVIEW: “WHAT WORKS?” ............................................................... 120 5.1.1 Selecting and Describing the Evaluative Studies ............................... 121 5.1.2 Assessing the Credibility of Evidence................................................... 123 viii 5.2 UNDER WHAT CONDITIONS ARE THE TECHNIQUES EFFECTIVE? 127 5.2.1 Analysis of Competing Hypotheses Studies ........................................ 128 5.2.2 Analysis of Competing Hypotheses Discussion ................................. 130 5.2.3 Brainstorming Studies .............................................................................
Recommended publications
  • @Last Software 2019 10Th Street Boulder Co 80302 1 Professional Cleaning Services 10801 South Lowe Chicago Il 60628 100 Black Wo
    @LAST SOFTWARE 2019 10TH STREET BOULDER CO 80302 1 PROFESSIONAL CLEANING SERVICES 10801 SOUTH LOWE CHICAGO IL 60628 100 BLACK WOMEN OF FUNERAL SERVICE 9501 S VERMONT AVE LOS ANGELES CA 90044 101 MEDIA PHONES 1375 BROADWAY, SUITE 600 NEW YORK NY 10018 1-800-BATTERIES 2301 ROBB DRIVE RENO NY 89523 1-800-CONFERENCE P O BOX 5075 SAGINAW MI 48605-5075 1-800-CONFERENCE P O BOX 95537 CHICAGO IL 60694-5537 1-800-CONFERENCE 33252 TREASURY CENTER CHICAGO IL 60694 1998 BROADWAY ARMORY 5900 N BROADWAY CHICAGO IL 60614 1999 ILLINOIS-CUBA HUMANITARIAN MISSION ATTN ED RODRIGUEZ CHICAGO IL 60618 1ST AYD CORPORATION 450 S LOMBARD ROAD - UNIT C ADDISON IL 60101 1ST CHOICE DIGITAL P.O BOX 6220 CAROL STREAM IL 60197-6220 1ST CLASS SOUND INC 5249 W JACKSON BLVD CHICAGO IL 60644 1ST FINANCIAL 4801 EMERSON AVENUE - SUITE 112 PALATINE IL 60067 2 FOR 1 INKJET 11492 BLUEGRASS PARKWAY LOUISVILLE KY 40299 21ST CENTURY URBAN SCHOOLS 200 E RANDOLPH ST - 9TH FLR CHICAGO IL 60601 3E LITHOGRAPHING CO 3933 N VENTURA DR ARLINGTON HEIGHTS IL 60004 47TH STREET CHAMBER OF COMMERCE ATTN: TONI FONSECA CHICAGO IL 60609 4IMPRINT INC P O BOX 32383 HARTFORD CT 06150-2383 4IMPRINT INC 210 COMMERCE STREET OSHKOSH WI 54901 63RD & WESTERN CURRENCY EXCHANGE 2400 W 63RD STREET CHICAGO IL 60636 800-4-BALLOONS 595 LAKEVIEW PARKWAY VERNON HILLS IL 60061 A - LINE MOVERS INC 1112 E MAIN ST GRIFFITH IN 46319 A & A OFFICE MACHINES 2385 HAMMOND DRIVE SCHAUMBURG IL 60173 A & E STORE P O BOX 2284 SOUTH BURLINGTON VT 05407 A & H LITHOPRINT 2540 SOUTH 27TH AVE BROADVIEW IL 60155 A & M UPHOLSTERY
    [Show full text]
  • 1991 the Regional Medical Library Network Was Expanded from Seven to Eight Regions
    TUTES O F HEALTH NATIONAL LIBRARY OF MEDICINE PROGRAMS & SERVICES FISCAL YEAR 1 99 1 Further information about the programs described in this administrative report is available from: Office of Public Information National Library of Medicine 8600 Rockville Pike Bethesda, MD 20894 (301)496-6308 Cover: In Fiscal Year 1991 the Regional Medical Library Network was expanded from seven to eight regions. It also underwent a name change and is now designated the National Network of Libraries of Medicine (abbreviated NN/LM). The network is described on page 10 of this report. NATIONAL INSTITUTES O F HEALTH NATIONAL LIBRARY OF MEDICINE PROGRAMS & SERVICES FISCAL YEAR 1 991 U.S. DEPARTMENT O F HEALTH AND HUMAN SERVICES • Public Health Service National Library of Medicine Catalog in Publication 2 National Library of Medicine (US) 675 M4 National Library of Medicine programs and services -- U56an 1977- - Bethesda, Md The Library, [1978- v ill, ports Report covers fiscal year Continues National Library of Medicine (US) Programs and services Vols for 1977-78 issued as DHEW publication , no (NIH) 78-256, etc , for 1979-80 as NIH publication , no 80-256, etc Vols for 1981-available from the National Technical Information Service, Springfield, Va ISSN 0163-4569 = National Library of Medicine programs and services 1 Information Services - United States - periodicals 2 Libraries, Medical - United States - periodicals I Title II Series DHEW publication , no 80-256, etc Ill PREFACE The reader of this year's report will note a number of important events. New 5- year contracts were signed with the eight Regional Medical Libraries that, together with 130 Resource Libraries (primarily at medical schools) and 3600 Local Libraries (primarily at hospitals), make up the National Network of Libraries of Medicine.
    [Show full text]
  • Microsoft from Wikipedia, the Free Encyclopedia Jump To: Navigation, Search
    Microsoft From Wikipedia, the free encyclopedia Jump to: navigation, search Coordinates: 47°38′22.55″N 122°7′42.42″W / 47.6395972°N 122.12845°W / 47.6395972; -122.12845 Microsoft Corporation Public (NASDAQ: MSFT) Dow Jones Industrial Average Type Component S&P 500 Component Computer software Consumer electronics Digital distribution Computer hardware Industry Video games IT consulting Online advertising Retail stores Automotive software Albuquerque, New Mexico Founded April 4, 1975 Bill Gates Founder(s) Paul Allen One Microsoft Way Headquarters Redmond, Washington, United States Area served Worldwide Key people Steve Ballmer (CEO) Brian Kevin Turner (COO) Bill Gates (Chairman) Ray Ozzie (CSA) Craig Mundie (CRSO) Products See products listing Services See services listing Revenue $62.484 billion (2010) Operating income $24.098 billion (2010) Profit $18.760 billion (2010) Total assets $86.113 billion (2010) Total equity $46.175 billion (2010) Employees 89,000 (2010) Subsidiaries List of acquisitions Website microsoft.com Microsoft Corporation is an American public multinational corporation headquartered in Redmond, Washington, USA that develops, manufactures, licenses, and supports a wide range of products and services predominantly related to computing through its various product divisions. Established on April 4, 1975 to develop and sell BASIC interpreters for the Altair 8800, Microsoft rose to dominate the home computer operating system (OS) market with MS-DOS in the mid-1980s, followed by the Microsoft Windows line of OSes. Microsoft would also come to dominate the office suite market with Microsoft Office. The company has diversified in recent years into the video game industry with the Xbox and its successor, the Xbox 360 as well as into the consumer electronics market with Zune and the Windows Phone OS.
    [Show full text]
  • UC San Diego UC San Diego Electronic Theses and Dissertations
    UC San Diego UC San Diego Electronic Theses and Dissertations Title Asian Indian immigrant women in the San Francisco-Oakland Bay Area : work, home, and the construction of the self Permalink https://escholarship.org/uc/item/5jz3b525 Author Das, Ashidhara Publication Date 2006 Peer reviewed|Thesis/dissertation eScholarship.org Powered by the California Digital Library University of California UNIVERSITY OF CALIFORNIA, SAN DIEGO Asian Indian Immigrant Women in the San Francisco-Oakland Bay Area: Work, Home, and the Construction of the Self A dissertation submitted in partial satisfaction of the requirements for the degree of Doctor of Philosophy in Anthropology by Ashidhara Das Committee in charge: Professor Suzanne Brenner, Chair Professor Frederick Bailey Professor Yen-Le Espiritu Professor Rosemary George Professor Tanya Luhrmann 2006 Copyright Ashidhara Das, 2006 All Rights Reserved. The dissertation of Ashidhara Das is approved, and it is acceptable in quality and form for publication on microfilm: ____________________________________________ ____________________________________________ ____________________________________________ ____________________________________________ ____________________________________________ Chair University of California, San Diego 2006 iii TABLE OF CONTENTS SIGNATURE PAGE.......................................................................................................................... iii TABLE OF CONTENTS ...................................................................................................................iv
    [Show full text]
  • Digital Paint Systems: an Anecdotal and Historical Overview
    Digital Paint Systems: An Anecdotal and Historical Overview Alvy Ray Smith The history of digital paint systems derives from many things— chance meetings, coincidences and boredom, artistic license, brilliant researchers, a wealthy benefactor, and, of course, lawsuits. Alvy Ray Smith tells the fascinating story—facts first, then anecdotes—in his own words. This article is based on a talk presented in tal 2D (two-dimensional) and 3D modeling and January 2000 at an evening hosted by the animation, film recording, video editing, and Computer History Museum on Moffatt Field, audio synthesis. An excellent rendering of my near Palo Alto, California. I shared the floor time with Dick Shoup (sounds like “shout,” not with longtime colleague Richard G. “Dick” like “hoop”) in the early days at Xerox PARC Shoup who figures highly in what follows. It is (Palo Alto Research Center) can be found in the also based on a document I submitted to the recent book Dealers of Lightning: Xerox PARC Academy of Motion Picture Arts and Sciences and the Dawn of the Computer Age.4 For other (AMPAS) in 1997 in answer to a call from them PARC references, see Lavendel,5 Pake,6 Perry,7 for information about early paint programs and and Smith.8 their contribution to the film business.1 The time frame dates from the late 1960s to Definitions the early 1980s, from the beginnings of the A digital paint program and a digital paint technology of digital painting up to the first system are distinguished by their functions. A consumer products that implemented it.
    [Show full text]
  • Strategies for Improving Student Performance in an Online Introductory Computer Course Sharon C
    Walden University ScholarWorks Walden Dissertations and Doctoral Studies Walden Dissertations and Doctoral Studies Collection 2019 Strategies for Improving Student Performance in an Online Introductory Computer Course Sharon C. Little Walden University Follow this and additional works at: https://scholarworks.waldenu.edu/dissertations Part of the Education Commons This Dissertation is brought to you for free and open access by the Walden Dissertations and Doctoral Studies Collection at ScholarWorks. It has been accepted for inclusion in Walden Dissertations and Doctoral Studies by an authorized administrator of ScholarWorks. For more information, please contact [email protected]. Walden University College of Education This is to certify that the doctoral study by Sharon Little has been found to be complete and satisfactory in all respects, and that any and all revisions required by the review committee have been made. Review Committee Dr. Robert Hogan, Committee Chairperson, Education Faculty Dr. Jennifer McLean, Committee Member, Education Faculty Dr. Kelly Hall, University Reviewer, Education Faculty The Office of the Provost Walden University 2019 Abstract Strategies for Improving Student Performance in an Online Introductory Computer Course by Sharon Little MA, Nova University, 1990 BS, North Carolina Agricultural and Technical University, 1981 Doctoral Proposal Submitted in Partial Fulfillment of the Requirements for the Degree of Doctor of Education Walden University August 2019 Abstract The failure rate for students enrolled in the online sections of a gateway course, Introduction to Computers , was 15% higher than for students enrolled in the face-to-face sections at a rural community college in the southeastern United States. The computer course is required by all of the college’s programs of study to obtain an associate degree.
    [Show full text]
  • Intellectual Property - Strategy and Policy ACIVES
    Intellectual Property - Strategy and Policy ACIVES By Rishi Ahuja B.E., Electronics Engineering University of Pune, 1997 ES Submitted to the System Design and Management Program in Partial Fulfillment of the Requirements for the Degree of Master of Science in Engineering and Management at the Massachusetts Institute of Technology February 2012 @ 2012 Rishi Ahuja. All rights Reserved The author hereby grants to MIT permission to reproduce and to distribute publicly paper and electronic copies of this thesis document in whole or in part in any medium now known or hereafter created. S ig natu re o f A utho r.................................................(..,..... ..................................... Rishi Ahuja System Design and Management Program Ce rtifie d by...................................... ....... ....... .......... /'Joe Hadzima /Senior Lecturer, MIT Entrepreneurship Center Thesis Supervisor Acce pte d by.......................................................... ........... .......... Pat Hale Thesis Supervisor and Director, System Design and Management Program 1 Intellectual Property - Strategy and Policy By Rishi Ahuja B.E., Electronics Engineering University of Pune, 1997 Submitted to the System Design and Management Program in Partial Fulfillment of the Requirements for the Degree of Master of Science in Engineering and Management Abstract The thesis that follows is an attempt to gain a deeper understanding of intellectual property from a policy as well as a strategic perspective. While the discussion that follows is applicable to intellectual property in general, the focus of this thesis is on a particular aspect of intellectual property i.e patents. Policy and strategic perspectives are covered in section I and 11 respectively. The section on policy explores the origin and evolution of intellectual property related policies by discussing key legislation and court cases.
    [Show full text]
  • A Sprite Theory of Image Computing
    A Sprite Theory of Image Computing Technical Memo 5 Alvy Ray Smith July 17, 1995 TABLE OF CONTENTS TABLE OF CONTENTS____________________________________________0-1 CHAPTER 1: OVERVIEW__________________________________________1-3 Introduction ______________________________________________________ 1-3 Origins___________________________________________________________ 1-3 Sampling v Geometry ______________________________________________ 1-5 Creative Space v Display Space_______________________________________ 1-8 Definition of Image ________________________________________________ 1-8 Definition of Sprite and Shape ______________________________________ 1-11 Coordinate Systems _______________________________________________ 1-12 Continuous Operators on Discrete Sprites _____________________________ 1-13 CHAPTER 2: BOX ALGEBRA _____________________________________2-16 Box Algebra______________________________________________________ 2-16 Support _________________________________________________________ 2-16 Points___________________________________________________________ 2-16 Boxes ___________________________________________________________ 2-18 Box Operators ____________________________________________________ 2-20 Special Box Routines ______________________________________________ 2-22 Alternative Algebra _______________________________________________ 2-23 CHAPTER 3: IMAGE ALGEBRA___________________________________3-27 Image Algebra____________________________________________________ 3-27 Channels ________________________________________________________
    [Show full text]
  • Apple Confidential 2.0 the Definitive History of the World's Most Colorful
    vi Reviewers love Apple Confidential “The Apple story itself is here in all its drama.” New York Times Book Review “An excellent textbook for Apple historians.” San Francisco Chronicle “Written with humor, respect, and care, it absolutely is a must-read for every Apple fan.” InfoWorld “Pretty much irresistible is the only way to describe this quirky, highly detailed and illustrated look at the computer maker’s history.” The Business Reader Review “The book is full of basic facts anyone will appreciate. But it’s also full of interesting extras that Apple fanatics should love.” Arizona Republic “I must warn you. This 268-page book is hard to put down for a MacHead like me, and probably you too.” MacNEWS “You’ll love this book. It’s a wealth of information.” AppleInsider “Rife with gems that will appeal to Apple fanatics and followers of the computer industry.” Amazon.com “Mr. Linzmayer has managed to deliver, within the confines of a single book, just about every juicy little tidbit that was ever leaked from the company.” MacTimes “The most entertaining book about Apple yet to be published.” Booklist i …and readers love it too! “Congratulations! You should be very proud. I picked up Apple Confidential and had a hard time putting it down. Obviously, you invested a ton of time in this. I hope it zooms off the shelves.” David Lubar, Nazareth, PA “I just read Apple Confidentialfrom cover to cover…you have written a great book!” Jason Whong, Rochester, NY “There are few books out there that reveal so much about Apple and in such a fun and entertaining manner.
    [Show full text]
  • Legitimacy and the Use of Natural Resources in Kruger National Park, South Africa
    University of Montana ScholarWorks at University of Montana Graduate Student Theses, Dissertations, & Professional Papers Graduate School 2007 Legitimacy and the Use of Natural Resources in Kruger National Park, South Africa Randy Tanner The University of Montana Follow this and additional works at: https://scholarworks.umt.edu/etd Let us know how access to this document benefits ou.y Recommended Citation Tanner, Randy, "Legitimacy and the Use of Natural Resources in Kruger National Park, South Africa" (2007). Graduate Student Theses, Dissertations, & Professional Papers. 619. https://scholarworks.umt.edu/etd/619 This Dissertation is brought to you for free and open access by the Graduate School at ScholarWorks at University of Montana. It has been accepted for inclusion in Graduate Student Theses, Dissertations, & Professional Papers by an authorized administrator of ScholarWorks at University of Montana. For more information, please contact [email protected]. LEGITIMACY AND THE USE OF NATURAL RESOURCES IN KRUGER NATIONAL PARK, SOUTH AFRICA By Randy Tanner M.S., Resource Conservation, The University of Montana, Missoula, Montana, 2004 B.S., Mathematics, Southern Illinois University, Carbondale, Illinois, 2001 Dissertation presented in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Forestry The University of Montana Missoula, MT Autumn 2007 Approved by: Dr. David A. Strobel, Dean Graduate School Wayne Freimund, Chair Department of Society and Conservation Perry Brown College of Forestry and Conservation Mike Patterson Department of Society and Conservation Doug Dalenberg Department of Economics Karen Adams Department of Political Science Tanner, Randy, Ph.D., December 2007 Forestry Legitimacy and the Use of Natural Resources in Kruger National Park, South Africa Chairperson: Wayne Freimund Around the globe, protected area managers confront an increasingly complex web of interests and demands, expressed by a variety parties, that often compete or conflict.
    [Show full text]
  • Loanrange Businessname City Jobs a $5-10 Million 50 X 20 HOLDING
    LoanRange BusinessName City Jobs a $5-10 million 50 X 20 HOLDING COMPANY CANTON 250 a $5-10 million ADENA CORPORATION ONTARIO 337 a $5-10 million AG-PRO OHIO, LLC LONDON 484 a $5-10 million ALFRED NICKLES BAKERY, INC. NAVARRE 500 a $5-10 million ALLIANCE SOLUTIONS GROUP, LLC INDEPENDENCE a $5-10 million ALLIED MACHINE & ENGINEERING CORP DOVER 434 a $5-10 million ALLIED MINERAL PRODUCTS HOLDING INC COLUMBUS 500 a $5-10 million AMERATHON, LLC CINCINNATI 500 a $5-10 million AMERICAN BREAD COMPANY LLC CLEVELAND 500 a $5-10 million AMERICHEM, INC. CUYAHOGA FALLS 500 a $5-10 million ANCHOR HOCKING, LLC COLUMBUS 500 a $5-10 million ARC INDUSTRIES INC. OF FRANKLIN COUNTY OHIO COLUMBUS 250 a $5-10 million AREA ENERGY & ELECTRIC, INC. SIDNEY 408 a $5-10 million ATLAS INDUSTRIAL HOLDINGS LLC COLUMBUS a $5-10 million AVI FOODSYSTEMS INC. WARREN 500 a $5-10 million BEAR DIVERSIFIED INC CUYAHOGA HEIGHTS 500 a $5-10 million BENESCH, FRIEDLANDER, COPLAN & ARONOFF LLP CLEVELAND 470 a $5-10 million BLUE CHIP 2000 COMMERCIAL CLEANING INC. CINCINNATI 475 a $5-10 million BREWSTER CHEESE COMPANY BREWSTER a $5-10 million BRUNER CORPORATION HILLIARD 400 a $5-10 million BUCA RESTAURANTS 2 INC COLUMBUS 500 a $5-10 million BURGESS & NIPLE, LTD. COLUMBUS 334 a $5-10 million BUTECH BLISS SALEM 317 a $5-10 million BWI NORTH AMERICA INC KETTERING 434 a $5-10 million CAD CPAPITAL LLC WARREN 500 a $5-10 million CADLE LLC WARREN 500 a $5-10 million CALIMIRA, LLC COLUMBUS 500 a $5-10 million CAMERON MITCHELL RESTAURANTS, LLC COLUMBUS 249 a $5-10 million CANDLE-LITE COMPANY, LLC BLUE ASH 499 a $5-10 million CAPITAL CITY GROUP, INC.
    [Show full text]
  • 9780262019095.Pdf
    Moving Innovation Moving Innovation A History of Computer Animation Tom Sito The MIT Press Cambridge, Massachusetts London, England © 2013 Massachusetts Institute of Technology All rights reserved. No part of this book may be reproduced in any form by any electronic or mechanical means (including photocopying, recording, or information storage and retrieval) without permission in writing from the publisher. MIT Press books may be purchased at special quantity discounts for business or sales promotional use. For information, please email [email protected] or write to Special Sales Depart- ment, The MIT Press, 55 Hayward Street, Cambridge, MA 02142. This book was set in Stone Sans and Stone Serif by Toppan Best-set Premedia Limited, Hong Kong. Printed and bound in the United States of America. Library of Congress Cataloging-in-Publication Data Sito, Tom, 1956– Moving innovation : a history of computer animation / Tom Sito. pages cm Includes bibliographical references and index. ISBN 978-0-262-01909-5 (hardcover : alk. paper) 1. Computer animation—History. I. Title. TR897.7.S48 2013 777'.709—dc23 2012038048 10 9 8 7 6 5 4 3 2 1 For Shamus Culhane 1911 – 1995 In 1977, a day after visiting NYIT, he looked up from his typewriter and said to me, “ Ya know, computers are comin ’ . Gonna change everything. The Business [animation] won ’ t ever be the same. ” Contents Acknowledgments ix Introduction 1 1 Film and Television at the Dawn of the Digital Revolution 5 2 Analog Dreams: Bohemians, Beatniks, and the Whitneys 11 3 Spook Work:
    [Show full text]