Management System Design for Sustainable Excellence: Framework, Practices and Considerations

Total Page:16

File Type:pdf, Size:1020Kb

Management System Design for Sustainable Excellence: Framework, Practices and Considerations PRACTICE PAPER Management System Design for Sustainable Excellence: Framework, Practices and Considerations JOHN R. LATHAM UNIVERSITY OF NORTHERN COLORADO © 2012, ASQ Building on practice, action research, and theory, this paper presents a framework and approach for the INTRODUCTION design of management systems that create sustainable Successful leaders in the future will have to become value for multiple stakeholders. This positive approach architects of enduring organizations by design- to design builds on a foundation of Baldrige-based ing systems that create sustainable results for performance excellence concepts and principles and integrates aspects of systems theory, design thinking, multiple stakeholders. There are numerous system appreciative inquiry, and sustainability to design failures, such as the recent “meltdown” of the U.S. management systems that integrate the perspectives mortgage finance system (Zipkin 2009; Latham 2009). of economic, environmental, and social stakeholders. Over the last several decades, leaders have tried to The design framework, practices, and considerations improve organization performance using a variety of originally emerged from practice and action research models, tools, and techniques. While some of these and were refined at the Monfort Institute applications lab using action research methods enhanced with methods have proved useful, many attempts have met selected case study practices. The purpose of this paper with varying degrees of success. As Avital et al. (2006, is to provide new insights on the process and practices 537) point out, some organizations have experienced of management system design to help practitioners disappointing results using many of these approaches, design custom leadership and management systems, including activity-based costing (ABC), total qual- as well as provide new insights for academic research- ity management (TQM), earned value analysis, ers interested in advancing the theory of management by design. Examples and experiences are included to and balanced scorecard. In addition, in the last two illustrate key concepts related to the “art and science” decades there have been more than 1000 applicants of management system design. for the Baldrige award, yet fewer than 10 percent have Key words: Baldrige award, collaborative design, received the award. Part of the reason the other 90 criteria for performance excellence, design think- percent did not receive the award is due to the design ing, design principles, management system design, of their management systems. More than half of the managerial practices, managerial processes, positive points used to determine Baldrige award recipients deviance, stakeholders, stakeholder-centered design, are derived from an assessment of the organization’s sustainability, sustainable value, system integration, systematic approaches (management systems) in six systems theory, systems thinking categories including: leadership; strategic planning; customer focus; measurement, analysis, and knowl- edge management; workforce focus; and operations focus. The remaining points are derived from actual www.asq.org 7 Management System Design for Sustainable Excellence: Framework, Practices and Considerations results produced by these systems. Unfortunately, leverage points to create sustainable value for stake- many of these approaches to improvement were either holders. In addition, this approach incorporates design narrowly focused on “fixing” near-term problems in thinking and shifts the senior leader’s role from a the organization or were focused on individual com- focus on decision making and “operator” of the exist- ponents and opportunities for improvement (OFIs) ing system to that of “architect” of new organization without the benefit of a systems perspective or consid- systems and integrates design thinking throughout the eration of the needs of diverse stakeholders, or both. process (Boland et al. 2008). The framework is also However, organizations and management systems are informed by approaches used in product and service human created and consequently can be recreated. It design such as Moggridge (2007). Finally, the design may be time to take a design approach to improving framework incorporates sustainability concepts management systems; unfortunately, “the idea of including the needs and perspectives of diverse stake- applying design approaches to management is new holders (economic, societal, and environmental) and, as yet, largely undeveloped” (Dunne and Martin to create a sustainable stakeholder-centered design 2006, 512). (Elkington, Emerson, and Beloe 2006). The stakeholder-centered design framework, prac- The focus of this paper is on the collaborative tices, and considerations presented in this paper build design of management systems. Management systems on the foundation of the Malcolm Baldrige National are coherent combinations of managerial processes, Quality Award (MBNQA) Criteria for Performance practices, and activities to achieve a particular pur- Excellence (CPE) framework (NIST 2011). While pose or function within the organization such as the CPE provide a management systems framework, strategic planning. According to NIST (2011, 63), sys- nonprescriptive questions, core values, and concepts, tematic approaches “are well-ordered, are repeatable, along with a maturity model style scoring scale, they and use data and information so learning is possible. do not provide any advice or guidance on how to use In other words, approaches are systematic if they these components to design high-performing manage- build in the opportunity for evaluation, improvement, ment systems. This paper provides a framework for and sharing, thereby permitting a gain in maturity.” using these CPE components to design management The concept of management systems is not new systems. In addition, this framework integrates four and dates back to at least 500 BCE when the Chinese additional concepts including appreciative inquiry, philosopher Mo-Tze (a.k.a. Miscius) noted: systems thinking, design thinking, and sustainability into the approach to enhance the design of manage- “Whoever pursues a business in this world must ment systems that create sustainable value for key have a system. A business which has attained stakeholders. The design framework incorporates success without a system does not exist. From appreciative inquiry (AI) and intelligence in a positive ministers and generals down to the hundreds of approach to address the design challenges of systems craftsmen, every one of them has a system. The that serve multiple stakeholders. Instead of focusing craftsmen employ the ruler to make a square and on simply “fixing” problems, this approach to system the compass to make a circle. All of them, both design incorporates an appreciative approach using a skilled and unskilled, use this system. The skilled positive “lens.” may at times accomplish a circle and a square by This positive approach is also informed by systems their own dexterity. But with a system, even the theory and thinking to ensure the system design is unskilled may achieve the same result, though internally congruent and coordinated with the larger dexterity they have none. Hence, every craftsman internal and external systems such as incentive systems possesses a system as a model. Now, if we govern and scorecards, just to name a few. Systems theory is the empire, or a large state, without a system as integrated in the design process to facilitate the devel- a model, are we not even less intelligent than a opment of generative solutions that take advantage of common craftsman?” (Wu 1928, 226) 8 QMJ VOL. 19, NO. 2/© 2012, ASQ Management System Design for Sustainable Excellence: Framework, Practices and Considerations Figure 1 Design framework. 1. Purpose and requirements 2. Nature of the system 3. Theories and concepts Understand the purpose(s) of the Understand the “nature” of the system. Understand the empirical evidence system. Why do you need this system? related to this system. Identify the physical, knowledge, and What are the expected benets? creative components. Understand what works, what doesn’t Understand the multiple stakeholders work, and in what contexts. Identify the level of customization and their requirements for the system. (bespoke) needed. Understand the leading-edge ideas What key capabilities are needed? that could inform the design of the system. 8. Diagnosis 9. Design, develop, and deploy 4. Inspiring examples Understand the current system design. Understand how others have done it. Ideal Doable Detailed Identify the strengths (technical and design design design Review example conceptual designs human). during the rst round to clarify concepts and inspire creative thinking. Identify the opportunities for improvement (technical and human). Proto- Develop Reect Review detailed designs during the type deploy improve detailed design phase. 7. System integration 6. Design principles 5. Unique context Understand how the system “ts” within Identify the desired role model Understand the organization’s unique the other established managerial characteristics to embed into the design. context. systems. Choose from established design Identify the key internal and external Identify key inputs, outputs, and principles (e.g., balance). organiztional factors that impact the interconnections and relationships with desigin of the particular process. Identify new principles unique to your other internal and external systems. organization, strategy,
Recommended publications
  • Linking Design Management Skills and Design Function Organization: an Empirical Study of Spanish and Italian Ceramic Tile Producers
    CASTELLÓN (SPAIN) LINKING DESIGN MANAGEMENT SKILLS AND DESIGN FUNCTION ORGANIZATION: AN EMPIRICAL STUDY OF SPANISH AND ITALIAN CERAMIC TILE PRODUCERS Ricardo Chiva (1), Joaquín Alegre (2), David Gobert (3), Rafael Lapiedra (1) (1) Universitat Jaume I, (2) Universitat de València, (3) ITC, Universitat Jaume I, ABSTRACT Design management is an increasingly important concept, research into which is very scarce. This paper deals with the fit between design management skills and design function organization, ranging from solely in-house to solely outsourced and including a mixture of the two. We carried out a survey in the Spanish and Italian ceramic tile industry, to which 177 product development managers responded. Our results revealed that companies have different degrees of design management skills depending on the approach to design function organization. Solely in-house design approach companies are the most skilled firms and solely outsourced ones are the least skilled. Despite the fact that the design function has apparently evolved towards outsourcing, this research supports the idea that, under certain conditions, the in-house design department is the best option in order to attain higher degrees of design management skills. Implications of the findings for both academics and practitioners are examined. P.BA - 79 CASTELLÓN (SPAIN) 1. INTRODUCTION In today’s competitive environment, design is becoming increasingly important. Good design, though, does not emerge by accident but as the result of a managed process (Bruce and Bessant, 2002, p. 38). Apart from the development process leading up to the creation of an artifact or product, the concept of design has traditionally involved a series of organizational activities, practices or skills that are required for this development to be achieved (Gorb and Dumas, 1987).
    [Show full text]
  • Theoretically Comparing Design Thinking to Design Methods for Large- Scale Infrastructure Systems
    The Fifth International Conference on Design Creativity (ICDC2018) Bath, UK, January 31st – February 2nd 2018 THEORETICALLY COMPARING DESIGN THINKING TO DESIGN METHODS FOR LARGE- SCALE INFRASTRUCTURE SYSTEMS M.A. Guerra1 and T. Shealy1 1Civil Engineering, Virginia Tech, Blacksburg, USA Abstract: Design of new and re-design of existing infrastructure systems will require creative ways of thinking in order to meet increasingly high demand for services. Both the theory and practice of design thinking helps to exploit opposing ideas for creativity, and also provides an approach to balance stakeholder needs, technical feasibility, and resource constraints. This study compares the intent and function of five current design strategies for infrastructure with the theory and practice of design thinking. The evidence suggests the function and purpose of the later phases of design thinking, prototyping and testing, are missing from current design strategies for infrastructure. This is a critical oversight in design because designers gain much needed information about the performance of the system amid user behaviour. Those who design infrastructure need to explore new ways to incorporate feedback mechanisms gained from prototyping and testing. The use of physical prototypes for infrastructure may not be feasible due to scale and complexity. Future research should explore the use of prototyping and testing, in particular, how virtual prototypes could substitute the experience of real world installments and how this influences design cognition among designers and stakeholders. Keywords: Design thinking, design of infrastructure systems 1. Introduction Infrastructure systems account for the vast majority of energy use and associated carbon emissions in the United States (US EPA, 2014).
    [Show full text]
  • Managing Design with the Effective Use of Communication Media: the Relationship Between Design Dialogues and Design Team Meetings
    1072 CIB World Building Congress 2007 CIB2007- 213 Managing Design With The Effective Use Of Communication Media: The Relationship Between Design Dialogues And Design Team Meetings Stephen Emmitt and Ad den Otter ABSTRACT Effective and efficient design team communication is an essential component of architectural design and construction projects. Face-to-face communication, via meetings and dialogue, is an essential means for design team members to discuss and communicate design ideas. Meetings represent an important forum in which all parties have an opportunity to understand the implications of design decisions on a number of levels. Dialogue between design team members forms an important part of the interpersonal communication that occurs during design development. Dialogues have the highest chance of achieving understanding of the design, especially in the early phases when uncertainty is high and less design information is generated compared with later stages in the project. A survey of communication practices via project websites across multiple cases found that design team members chose dialogues as their preferred communication medium. The results are discussed against research findings from communication in design and management team meetings. The relationship between dialogues and team meetings is then explored from a design team management perspective. The results have implications for the effectiveness of communications within international design teams and hence the manner in which communications are planned and managed. Keywords: Design management, Team communication, Dialogues, Interaction, Meetings, Project Websites. CIB World Building Congress 2007 1073 1. INTRODUCTION Architectural design is a collaborative act that relies on effective interaction between project actors and stakeholders. Interaction affects the strength of relationships between the actors and ultimately colors their ability to work together successfully.
    [Show full text]
  • Changing Cultures of Design Identifying Roles in a Co-Creative Landscape
    Changing Cultures of Design Identifying roles in a co-creative landscape Marie Elvik Hagen Department of Product Design Norwegian University of Science and Technology ABSTRACT The landscape of design is expanding and designers today are moving from expert practice to work with users as partners on increasingly complex issues. This article draws up the lines of the emerging co-creative design practice, and discusses the changing roles of the designer, the user as a partner, and design practice itself. Methods and tools will not be considered, as the roles will be discussed in terms of their relations. The co-design approach breaks down hierarchies and seeks equal participation. Research suggests that the designer needs to be responsive or switch tactics in order to take part in a co-creative environment. A case study exploring co-creative roles complements the theory, and finds that the designer role needs to be flexible even when having equal agency as partners and other stakeholders. Sometimes it is necessary to lead and facilitate as long as it is a collaborative decision. Bringing users in as partners in the process changes the design culture, and this article suggests that Metadesign can be the holistic framework that the design community need in order to understand how the different design practices are connected. KEYWORDS: Co-design, Co-creativity, Roles in the Design Process, Participatory Design, Metadesign, Cultures of participation, Design Agenda 1. INTRODUCTION This article seeks to examine how the role of the designer, the role of the user and the role The landscape of design is changing.
    [Show full text]
  • Industrialdesign
    National Endowment for the Arts I N D U S T R I A L D E S I G N A Competitive Edge for U.S. Manufacturing Success in the Global Economy I N D U S T R I A L D E S I G N A Competitive Edge for U.S. Manufacturing Success in the Global Economy April 2017 National Endowment for the Arts 400 7th Street SW Washington, DC 20506 Telephone: 202-682-5400 arts.gov Produced by Office of Programs and Partnerships, Design Program Jason Schupbach, Director of Design Programs, National Endowment for the Arts Content by Heidi Sheppard, Advisor for Technology Collaborations, National Institute for Standards and Technology, Manufacturing Extension Partnership; Courtney Spearman, Design Specialist, Office of Programs and Partnerships, NEA; and Katryna Carter, Design Consultant, Office of Programs and Partnerships, NEA Other Staff Contributors: Don Ball, Assistant Director - Publications, Office of Public Affairs, NEA; Bonnie Nichols, Operations Research Analyst, Office of Research and Analysis, NEA. Designed by Katryna Carter For their valuable assistance with this report, the NEA Design Program would like to thank the following people: Daniel Martinage, Industrial Designers Society of America; Susan Page Estes and Paul Hatch, DesignHouse; all those who were interviewed; and Laska Hurley, Office of Programs and Partnerships. 202-682-5496 Voice/TTY (a device for individuals who are deaf or hearing-impaired) Individuals who do not use conventional print materials may contact the Arts Endowment’s Office for Accessibility at 202-682-5532 to obtain this publication in an alternate format. This publication is available free of charge in PDF format at arts.gov.
    [Show full text]
  • Service Design - a Conceptualization of an Emerging Practice
    Katarina Wetter Edman Katarina Wetter Licentiate thesis Service Design - a conceptualization of an emerging practice Service Service Design - a conceptualization of an emerging practice Katarina Wetter Edman Thesis for the degree of Licentiate of Philosophy in Design (with the specia- lization Design Management) at HDK-School of Design and Crafts, Faculty of Fine, Applied and Performing Arts, University of Gothenburg Business & Design Lab is a center of expertise and research in Design Management and is a collaboration between HDK-School of Design and Crafts and the School of Business, Economics and Law at Gothenburg University ArtMonitor Doctoral Dissertations and Licentiate Theses No 28 ArtMonitor is a publication series from the Board for Artistic Research (NKU), Faculty of Fine, Applied and Performing Arts, University of Gothenburg Address: ArtMonitor University of Gothenburg Konstnärliga fakultetskansliet Box 141 SE-405 30 Göteborg www.konst.gu.se Linguistic editing: Jill Woodilla Illustrations: Katarina Wetter Edman Graphic design: Katarina Wetter Edman Cover design: Mikael Sjömilla Printed by: Intellecta Infolog AB, Kållered 2011 © Katarina Wetter Edman 2011 ISBN: 978-91-978477-7-3 Service Design - a conceptualisation of an emerging practice Katarina Wetter Edman Katarina Wetter Edman Service Design - a conceptualization of an emerging practice Faculty of Fine, Applied and Performing Arts, University of Gothenburg Acknowledgements I resisted as long as I could, not seeing myself as a scholarly person. I was (and still am) a designer – yet there was someone more persistent than me. Now, some six to seven years after the first persuasive attempts, I am very happy to be part of academia. The person I have to thank for this is Professor Ulla Johansson.
    [Show full text]
  • DESIGN E INOVAÇÃO SOCIAL Metadesign SOBRE O AUTOR
    DESIGN E INOVAÇÃO SOCIAL Metadesign SOBRE O AUTOR Caio Adorno Vassão | [email protected] Lattes: http://lattes.cnpq.br/5857678399360729 É graduado, mestre e doutor pela FAUUSP, pesquisa a relação entre tecnologia e ambiente urbano há mais de 20 anos e desenvolveu uma visão abrangente para o metadesign. É consultor associado ao núcleo Naweb (FAUUSP). Uma abordagem para o entendimento do “ecossistema” como objeto de conhecimento e ação prática: o uso do metadesign como ferramenta para uma pragmática ecológica Towards an understanding of the “ecosystem” as an object of knowledge and action: the usage of “metadesign” as a tool for an ecology pragmatics Caio Adorno Vassão Resumo O ecossistema é um objeto de conhecimento em crescente uso fora do contexto das ciências biológicas, da sustentabilidade e da gestão ambiental. Esse uso não é alheio e independente à sua origem na Ecologia, mas dialoga com ela e pode ser considerado uma extensão justificada do conceito para abarcar uma ecossistêmica que não distingue entre “sistemas naturais” e “sistemas artificiais”. O metadesign é uma abordagem eficaz para se realizar a construção coletiva e em grande escala do projeto, gestão, interferência e desenvolvimento de ecossistemas. Detalham-se os métodos do metadesign e indicam-se aplicações para o seu uso na composição de ecossistemas. Palavras-chave: Complexidade, Metadesign, Ecossistemas, Governança, Epistemologia. Abstract The ecosystem is a knowledge object increasingly used outside the context of bio-sciences, sustainability and environmental management. This usage isn’t incompatible and independent from its origin in Ecology, but it does dialogue with that origin, and can be considered as a justified extension of the concept to encompass an Ecosystemics that doesn’t distinguish between “natural systems” and “artificial systems”.
    [Show full text]
  • Design, Metadesign and the Importance of Vision Design
    Strategic Design Research Journal, 5(2): 84-90 May-August 2012 ©2012 by Unisinos - doi: 10.4013/sdrj.2012.52.04 Design, metadesign and the importance of vision Design, metaprojeto e a importância da visão Manuela Celi [email protected] Politecnico di Milano. INDACO, School of Design. Via Durando 38/a, 20158, Milano, Italy Abstract Resumo In the European context today there are many reasons to re- No contexto europeu atualmente existe muitas razões para think and re-design didactic activities. Design education in repensar e reprojetar atividades didáticas. O ensino de design particular seems to be at the core of European Union goals: em particular parece estar no centro das metas da União Eu- (i) the EU underlines, in several recent documents1, the im- ropeia: (i) a União Europeia sublinha, em vários documentos portance of research and educating future researchers, (ii) recentes, a importância da pesquisa e a formação dos futuros there is a continuous stress and promotion of interdisciplin- pesquisadores; (ii) há um estresse contínuo na promoção de ary approaches and of internationalization to maintain and abordagens interdisciplinares e de internacionalização para improve the higher education level and strengthen its com- manter e melhorar o nível de ensino superior e reforçar a com- petitiveness. Within our institution there is an educational petitividade. Dentro de nossa instituição existe um modelo model based on the so-called Research and didactic units, educativo baseado na pesquisa e em unidades didáticas, en- between which there is a virtuous circle. Starting from the tre as quais existe um círculo virtuoso. A partir do círculo virtu- virtuous circle between research and education and the im- oso entre pesquisa e educação e a importância da criatividade portance of creativity in design activities the paper will ex- nas atividades de design o artigo vai explorar a importância plore the importance of a metacognitive approach and the de uma abordagem metacognitiva e do papel central das ati- central role of envisioning activities.
    [Show full text]
  • Design Management an Introduction by Ms Shruti Hemani with Prof
    D’source 1 Digital Learning Environment for Design - www.dsource.in Design Course Design Management An Introduction by Ms Shruti Hemani with Prof. Ravi Mokashi Punekar DoD, IIT Guwahati Source: http://www.dsource.in/course/design-management 1. Introduction 2. What is Design Management 3. A People-Centric Approach 4. Designing Management 5. Measuring Success 6. Marketing and Branding 7. Innovation 8. Video 9. Contact Details D’source 2 Digital Learning Environment for Design - www.dsource.in Design Course Introduction Design Management An Introduction We find some interface with design in every aspect of our life and hence forming a close connection with our by living culture linked to the society, environment, technology, economics, and politics. Today, creative industry Ms Shruti Hemani with Prof. Ravi Mokashi Punekar (creative economy) including the areas of industrial design, arts and crafts, architecture, fashion, advertising, mu- DoD, IIT Guwahati sic, etc can be identified as one of the fastest-growing sectors in the world and one of the best ways to increase competitive advantage between companies or even countries. Companies that invest in design tend to be more innovative and profitable, and grow faster than companies that do not [1]. For example, a well-designed product not only caters to the user’s real needs but is also vital to a company’s sur- vival as superior-designs contribute to enhancement of brand image, corporate vitality and profits. The European Commission considers design management to be a competence that comes under the umbrella of innovation Source: management, in recognition of the fact that companies need innovation capability to be able to respond to new http://www.dsource.in/course/design-management/ market opportunities and threats.
    [Show full text]
  • Collaborative Design Management
    INTERNATIONAL DESIGN CONFERENCE - DESIGN 2016 Dubrovnik - Croatia, May 16 - 19, 2016. COLLABORATIVE DESIGN MANAGEMENT J.-E. Park, Y. Choi and C. Holt Keywords: architectural design, design management, interdisciplinary collaboration, participatory design 1. Introduction Research on design management since 1964 has been extensive [Farr 2011], so the definition of design management varies according to the researcher’s perspective. In some studies Design Management (DM) is divided into three terms - strategic, tactical, and operational - according to the level at which the design is managed [Cooper and Press 1995], [Borja de Mozota 2003], [Best 2009], [Holland and Lam 2014]. DM’s main objective is to enable the company to build an environment in which it can achieve its strategic goals efficiently and effectively [Borja de Mozota 2003], [Best 2009]. DM exploits design and corporate strategy to enhance creative processes, innovative culture, and communications for ongoing corporate development and success [Holland and Lam 2014]. When design is managed and exploited strategically and systematically, the company can secure a competitive advantage with industry attractiveness and increased customer awareness, since design differentiates it from its competitors [Hands 2009]. Best [2009] insisted that implementing DM creates added value for clients, business, and all the stakeholders by meeting their different interests at the appropriate stages. Architectural design firms are design-driven organisations, classified as professional service firms delivering design to clients to meet their requirements [Emmitt 2014]. An architectural design project involves a range of professionals, including engineering, structural, mechanical, electrical, civil, and landscaping experts to solve complex building problems and create an effective solution [Gä nshirt 2007].
    [Show full text]
  • Design and Its Management in the Service Sector - Updating the Standard
    1 Design management: branding/ Design and its management in the service sector - updating the standard. (Practice based research) Bill Hollins, Carol Blackman and Sadie Shinkins ABSTRACT The world’s first standard into the management of service design was published in 1994 (BS 7000-3 1994). It followed the realisation that services are also products that have to be designed and this design managed. Since that time our theoretical understanding of design and its management have grown, especially with regard to design in the service sector The paper will present results from research into the work of practitioners currently working within the service sector. The results of this research reveal that there are aspects of service design that are now consciously being undertaken within various organisations within the service sector but there are others which are still not. These results also show that in most organisations there is still little realisation that services can be designed or this design managed. The results of this research are being used by the British Standards Institution (BSI) in the update of this standard. INTRODUCTION The service sector is growing both in size, employment and importance to the economies of all industrialised countries as the manufacturing sector declines. In industrialised countries worldwide, there is an increase in the contribution of the GNP and in the level of employment derived from non-manufactures, or more especially, the service sector. The service sector now accounts for almost 80% of employment in the UK and 67 % GNP. The percentage of those employed in the service sector is rising throughout the EC and USA, as might be expected, but it is also rising in developing countries.
    [Show full text]
  • The Charrette Test Method
    CIFECENTER FOR INTEGRATED FACILITY ENGNEERING The Charrette Test Method By Mark Clayton, John Kunz, and Martin Fischer CIFE Technical Report #120 September, 1998 STANFORD UNIVERSITY CIFE CENTER FOR INTEGRATED FACILITY ENGINEERING, STANFORD UNIVERSITY Copyright © 1998 by Center for Integrated Facility Engineering If you would like to contact the authors, please write to: c/o CIFE, Civil and Environmental Engineering Stanford University Terman Engineering Center Mail Code: 4020 Stanford, CA 95305-4020 1 The Charrette Test Method THE CHARRETTE TEST METHOD Mark J. Clayton, John C. Kunz, Martin A. Fischer Introduction This paper discusses validation of an evaluation process in building design. We claim that it both matches designers’ cognitive activities and is implementable as software that partially automates the process. The working SME system provides evidence for the latter claim. An example of the Cyclotron Suite shows that the software can automatically create a product model of a building as the result of performing design activities including evaluation. This paper presents methods that we used to provide evidence that the software and the design theories that it embodies are usable by other designers. We developed and used the Charrette Test Method for testing the effectiveness of computing methods. We report on its use to develop evidence for the general suitability of SME and its effectiveness in aiding the design evaluation process. The experiment compares a manual process of solving a design evaluation problem to a partially automated process using the SME prototype. The problem The basic issue that we address in the Charrette Test Method is how to determine whether a process performed using one set of tools is superior to a process performed using another set of tools.
    [Show full text]