DOCSLIB.ORG

Quality Engineering in the Devops Time Period. the New Way of Testing

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
Quality Engineering in the Devops Time Period. the New Way of Testing Quality Engineering in the DevOps time period. The new way of Testing Geoffrey van der Tas @Gavdtas DevOps Time Period Definition of Testing Old “Independent judgement about the quality of the testobject” New “Means of getting fast feedback on your product” 2 DevOps Time Period Waterfall DevOps SpecsSpecs FeedbackTest FeedbackTest Design FeedbackTest Code FeedbackTest TestTest FeedbackTest FeedbackTest MaintainMaintain 3 DevOps Time Period 4 DevOps Time Period From Assurance towards Engineering “Quality Engineering is the management, development, operation and maintenance of IT systems and enterprise architectures with a high quality standard.” - New Perspectives on Software Quality by Ruth Breu; Annie Kuntzmann-Combelles; Michael Felderer (January–February 2014). 5 QA/ Testing to Quality Engineering What needs to happen • Testers becoming Quality Engineers • Quality from the start • Automation, Automation, Automation • Explore to test • The Grand Tour 6 Testers becoming Quality Engineers 7 Testers becoming Quality Engineers What is changing The Team Dev Ops Analist Dev Ops Test Quality Engineer Quality Assistant Agile Test Coach Quality 8 Testers becoming Quality Engineers At other companies Quality Engineering at Spotify “The Quality Engineer will help developers and teams cultivate a quality mindset, advocating for quality while assisting engineers with software development and test automation best practices.” Quality Assistance at Atlassian “They optimised the process by empowering and educating developers to test their own features to production quality standards.” 9 Testers becoming Quality Engineers Quality Engineer • Advocate for quality • Actively coach developers/business • Make testing part of Development Process • Coordinate testing efforts • Maintain test reporting and visualization • Spot opportunities for (Test) Automation 10 Quality from the start 11 Quality from the start Backlog Items – Sprint Backlog Items Crap in, Crap out 12 Quality from the start Tell the story 13 Quality from the start 14 Quality from the start Techniques Impact Mapping User Story Mapping 15 Quality Engineering in Scrum Understanding the big picture 16 Quality from the start Big Picture to User Stories Specifications: Spec one Spec two … Acceptance Criteria: Criteria one Criteria two Criteria three ….. 17 Quality from the start Communication 18 Quality from the start Refinements by examples 19 Quality from the start Specification By Example User story: As an employee I want to find other employees so I can find more information about employees. Example ATDD: Search parameter Result Peter Peter Janssen Jan Annie Jansen Jan van Buren Peter Janssen Jans Annie Jansen Peter Janssen Bakkr (geen) 20 Quality from the start Techniques 21 Quality Engineering in Scrum Powerful Refinements Understanding the big picture 22 Quality from the start ATDD TDD Failing Acceptance Test Failing Passing test test Passing Acceptance Test Refactor 23 Quality Engineering in Scrum Powerful Refinements Understanding the big picture Good Development Practices 24 Automation, Automation, Automation 25 Automation, Automation, Automation Why Automate Automation vs Manual Fast Reliable Repeatable Reuseable Control Money Fun Manual Automation 26 Automation, Automation, Automation How to approach it User Interface Slow, Big, Many Dependencies & 10 % High Maintenance Fast, Bit Bigger, Some 20 % Integration Dependecies, Easy Maintenance ATDD Fast, Small, Easy Maintenance Unit/Component 70 % TDD 27 Automation, Automation, Automation What to automate Context is key Self build vs bought software User Interface Java, Javascript, C++, C# Employee vs Client facing Integration Unit/Component 28 Automation, Automation, Automation Quality goes further then Test Automation Continuous Delivery Pipeline - Xebia 29 Automation, Automation, Automation Even further 30 Quality Engineering in Scrum Powerful Refinements Understanding the big picture Good Development Practices Automation 31 Explore to test 32 Explore to test 33 Explore to test Testing helps Checks https://findingdeefex.com/2016/05/20/the-testing-checkingsynergy/ 34 Explore to test Exploratory Testing “Exploratory Testing is a style of testing in which you explore the software while simultaneously designing and executing tests, using feedback from the last test to inform the next.” – Elisabeth Hendrickson • Timeboxed • Charters • Debrief • In Pairs 35 Explore to test Exploratory Testing Design Charters Steer Execute Debrief Learn 36 Explore to test Release Strategy Customers Product Customer Selection Canaries #Feature Toggles Pilot 37 Explore to test Examples 38 Explore to test Examples 39 Quality Engineering in Scrum Powerful Refinements Understanding the big picture Good Development Practices Automation Explore Explore 40 41 The Grand Tour About the experience 42 The Grand Tour Quality Engineering Functionality Other software components Performance Infrastructure Resilience Servers Security Databases Usability Monitoring Accesability Build pipeline 43 The Grand Tour Quality Engineering with the customer in mind 44 Quality Engineering in Scrum Powerful Refinements Understanding Quality the big picture Engineers Grand Tour Good Development Practices Automation Explore Explore 45 Quality Engineering Values Key Principles Customer first Whole team is responsible for quality Tested = Checked + Explored Bugs are fixed when they are found ‘Done’ means fully tested Quality before new functionality Collaboration is key for quality 46 How do I get from here to there? Study and practice, years of it. 47 Geoffrey van der Tas Explorer and Advocate for Quality! E-mail: [email protected] Twitter: @Gavdtas LinkedIn: https://nl.linkedin.com/in/geoffreyvdtas.
Load more

Recommended publications
  • Agile Methodologies and Extreme Programming Corso Di Laurea
    Agile Methodologies and EXtreme Programming Lecturer: Giuseppe Santucci (Some slides taken from slideshare.net) Outline • Development Methodologies • Agile Development (12 Key Practices) • Extreme Programming (XP) – How does it work ? 2 What is a SE Methodology? • A SE methodology is a rigorously defined process (or set of practices) for creating software – A set of rules you have to follow – A set of conventions the organization decides to follow – A systematical, engineered approach for organizing software projects 3 Agile Development Agile Manifesto “Our highest priority is to satisfy the customer through early and continuous delivery of valuable software“ [Manifesto for Agile] 5 The agile spirit • Incremental – Working software over comprehensive documentation • Cooperation – Customer collaboration over contract negotiation • Straightforward – Individuals and interactions over processes and tools • Adaptive – Responding to change over following a plan 6 Agile Methodologies • eXtreme Programming (XP) • Scrum • Crystal family of methodologies • Feature-Driven Development (FDD) • Adaptive Software Development (ASD) • Dynamic System Development Model (DSDM) • Agile Unified Process (AUP) 7 The XP inventor: Kent Beck • eXtreme Programming – The most prominent agile development methodology Kent Beck 8 The 12 Key Practices 1. Metaphor 2. The Planning Game 3. Test-Driven Development 4. Pair Programming 5. Refactoring 6. Simple Design 7. Collective Ownership 8. Continuous Integration 9. On-site Customer 10. Small Releases 11. 40-Hour Workweek
    [Show full text]
  • Agile Practices in Commercial Saas Teams
    SAMINT-MILI 2036 Master’s Thesis 30 credits May 2020 Agile Practices in Commercial SaaS Teams A case study on the adoption of agile practices in non-software teams Bruno Petersen Master’s Programme in Industrial Management and Innovation Masterprogram i industriell ledning och innovation Abstract Agile Practices in Commercial SaaS Teams Bruno Petersen Faculty of Science and Technology Agile software development methods have seen great success in software Visiting address: Ångströmlaboratoriet teams. Research on the topic of adopting agile methods in development teams Lägerhyddsvägen 1 is extensive. In the literature key enabling factors are identified and numerous House 4, Level 0 benefits of agile ways of working are named. Less attention has been payed to Postal address: the non-software functions in software development organizations, though. Box 536 Moreover, little is known about how well the enabling factors and benefits for 751 21 Uppsala software teams translate to other teams in the organization. The goal of this Telephone: study is to evaluate what benefits agile methods provide to non-software teams, +46 (0)18 – 471 30 03 whether the enabling factors are similar and what the challenges and drawbacks Telefax: for adopting agile methods in commercial teams are. Using the case of the +46 (0)18 – 471 30 00 Swedish Software-as -a-Service company Funnel, which introduced agile Web page: practices into their commercial teams, these questions are tackled. The study http://www.teknik.uu.se/student-en/ finds that knowledge transfer and governance are core areas that need to be engaged in during the adoption process. With decisions being made more autonomously ensuring the exchange of relevant information is crucial.
    [Show full text]
  • Agile-Methodologies-And-Extreme
    Agile Development and Extreme Programming Rouhollah Rahmati & Sina Khankhajeh Department of Computer Engineering Sharif University of Technology Agenda • Development Methodologies • Agile Development • Extreme Programming (XP) • In Practise • Develop Your Own Methodology Development Methodologies What is a Methodology? • A methodology is a formalized process or set of practices for creating software • A set of rules you have to follow • A set of conventions the organization decides to follow • unlike method • which systematically details a given procedure or process • Software development methodology • framework acts as a basis for applying specific approaches to develop and maintain software The Waterfall Development Process The Waterfall Process • The traditional development process: Software Requirements Analysis Design Implementation • Or at worst … Testing maintenance • But this always ends up happening! Agile Development Agile Manifesto “Our highest priority is to satisfy the customer through early and continuous delivery of valuable software“ [Manifesto for Agile] principles underlie the Agile Manifesto • Welcome changing requirements, even late in development • Working software is delivered frequently (weeks rather than months) • Working software is the principal measure of progress • Close, daily co-operation between business people and developers principles underlie the Agile Manifesto (continued) • Face-to-face conversation is the best form of communication (co-location) • Projects are built around motivated individuals, who
    [Show full text]
  • Continuous Delivery
    Continuous Quality Improvement Vijay kumar Vankamamidi Joseph Eapen Ebin John Poovathany Delivery Quality Goal Faster Time to Market Reduce Risk Build software that is production ready at all times Frequent, low risk Fast feedback, Built-in Software visibility and Quality releases control 2 Agile development philosophy > The process for releasing/deploying software must be repeatable and reliable. > Build quality in! > Automate everything! > Done means “potentially shippable”. - Complete PSR > Everybody has responsibility for quality. > Improve continuously. 3 Continuous Quality Improvement People, Process & Systems Communities of practice for continuous learning (Design, Coding, Testing) Software Craftsmanship Product Business Functional B A / Developer Field / IT Ops Customer Director Analyst Architect Tester Product Design, Coding Customer Release and Customer Need Requirement Requirement High level Testing Director and testing Validation deployment Collection Analysis Design Validation Agile Methodologies DevOps ( Development, IT Operations, and Support) Standardize the frameworks Hygiene factors like Definition of Done Establish a standard Continuous Continuous Improvement culture Integration Framework 4 Agile Methodologies Focus on People & Process 5 Quality through Agile > Standardize the frameworks (Scrum, Kanban and Scrumban) - Bring in common understanding of Agile - Informal learning opportunities > Hygiene practices - Constructive partnership with customer • Product vision and Requirement clarity - Definition of Done • User
    [Show full text]
  • Stephan Goericke Editor the Future of Software Quality Assurance the Future of Software Quality Assurance Stephan Goericke Editor
    Stephan Goericke Editor The Future of Software Quality Assurance The Future of Software Quality Assurance Stephan Goericke Editor The Future of Software Quality Assurance Editor Stephan Goericke iSQI GmbH Potsdam Germany Translated from the Dutch Original book: ‘AGILE’, © 2018, Rini van Solingen & Manage- ment Impact – translation by tolingo GmbH, © 2019, Rini van Solingen ISBN 978-3-030-29508-0 ISBN 978-3-030-29509-7 (eBook) https://doi.org/10.1007/978-3-030-29509-7 This book is an open access publication. © The Editor(s) (if applicable) and the Author(s) 2020 Open Access This book is licensed under the terms of the Creative Commons Attribution 4.0 Inter- national License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence and indicate if changes were made. The images or other third party material in this book are included in the book’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the book’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. The use of general descriptive names, registered names, trademarks, service marks, etc. in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use.
    [Show full text]
  • Agile Processes in Software Engineering and Extreme
    Juan Garbajosa · Xiaofeng Wang Ademar Aguiar (Eds.) Agile Processes in Software Engineering and Extreme Programming LNBIP 314 19th International Conference, XP 2018 Porto, Portugal, May 21–25, 2018 Proceedings Lecture Notes in Business Information Processing 314 Series Editors Wil M. P. van der Aalst RWTH Aachen University, Aachen, Germany John Mylopoulos University of Trento, Trento, Italy Michael Rosemann Queensland University of Technology, Brisbane, QLD, Australia Michael J. Shaw University of Illinois, Urbana-Champaign, IL, USA Clemens Szyperski Microsoft Research, Redmond, WA, USA More information about this series at http://www.springer.com/series/7911 Juan Garbajosa • Xiaofeng Wang Ademar Aguiar (Eds.) Agile Processes in Software Engineering and Extreme Programming 19th International Conference, XP 2018 Porto, Portugal, May 21–25, 2018 Proceedings Editors Juan Garbajosa Ademar Aguiar Technical University of Madrid University of Porto Madrid, Madrid Porto Spain Portugal Xiaofeng Wang Free University of Bozen-Bolzano Bolzano Italy ISSN 1865-1348 ISSN 1865-1356 (electronic) Lecture Notes in Business Information Processing ISBN 978-3-319-91601-9 ISBN 978-3-319-91602-6 (eBook) https://doi.org/10.1007/978-3-319-91602-6 Library of Congress Control Number: 2018944291 © The Editor(s) (if applicable) and The Author(s) 2018. This book is an open access publication. Open Access This book is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.
    [Show full text]
  • ATDD by Example: a Practical Guide to Acceptance Test-Driven
    ATDD by Example The Addison-Wesley Signature Series Kent Beck, Mike Cohn, and Martin Fowler, Consulting Editors Visit informit.com/awss for a complete list of available products. The Addison-Wesley Signature Series provides readers with practical and authoritative information on the latest trends in modern technology for computer professionals. The series is based on one simple premise: Great books come from great authors. Titles in the series are personally chosen by expert advisors, world-class authors in their own right. These experts are proud to put their signatures on the covers, and their signatures ensure that these thought leaders have worked closely with authors to defi ne topic coverage, book scope, critical content, and overall uniqueness. The expert signatures also symbolize a promise to our readers: You are reading a future classic. Make sure to connect with us! informit.com/socialconnect ATDD by Example A Practical Guide to Acceptance Test-Driven Development Markus Gartner¨ Upper Saddle River, NJ • Boston • Indianapolis • San Francisco New York • Toronto • Montreal • London • Munich • Paris • Madrid Capetown • Sydney • Tokyo • Singapore • Mexico City Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and the publisher was aware of a trademark claim, the designations have been printed with initial capital letters or in all capitals. The author and publisher have taken care in the preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein.
    [Show full text]
  • ART-ATDD-BDD-Quick-Start Aug 2021Docx
    ART BDD/ATDD Quick Start℠ “Built-In Quality”, a core value of SAFe®, allows quicker delivery of business value. A key practice to realize built- In quality is using Behavior Driven Development (BDD) / Acceptance Test-Driven Development (ATDD). This workshop describes how the Triad (the customer, tester, and developer perspectives) collaborates to create a shared understanding of the desired behavior of an application. It shows how to define scenarios which specify that behavior and use these scenarios as a communication and verification tool. Applying BDD/ATDD helps to decrease rework, raise customer satisfaction, and promotes trust. This workshop is based on the SAFe recommended book Lean-Agile Acceptance Test-Driven Development: Better Software through Collaboration by Ken Pugh. APPROACH The workshop begins with an interactive lecture for the entire ART (product owners, architects, release train engineer, testers, and developers) to help everyone obtain a common BDD/ATDD background. Following the initial session, each team has a session that revolves around their particular environment and stories. The topics are based on their individual needs. This immersive workshop uses your teams’ actual stories for the exercises during the interactive lecture and individual team sessions. One of the outcomes will be scenarios that are ready for implementation. OBJECTIVES By the end of this workshop, participants will know and have experienced: The benefits of Behavior Driven Development / Acceptance Test-Driven Development Decreasing misunderstanding
    [Show full text]
  • Evaluating Effectiveness and Efficiency
    Test-Driven Development, Acceptance Test-Driven Development, and Behaviour-Driven Development [Note: This is an excerpt from Agile Testing Foundations: An ISTQB Foundation Level Agile Tester Guide, by Rex Black, Marie Walsh, Gerry Coleman, Bertrand Cornanguer, Istvan Forgacs, Kari Kakkonen, and Jan Sabak, published July 2017. Kari Kakkonen wrote this selection. The authors are all members of the ISTQB Working Group that wrote the ISTQB Agile Tester Foundation syllabus.] The traditional way of developing code is to write the code first, and then test it. Some of the major challenges of this approach are that testing is generally conducted late in the process and it is difficult to achieve adequate test coverage. Test-first practices can help solve these challenges. In this environment, tests are designed first, in a collaboration between business stakeholders, testers, and developers. Their knowledge of what will be tested helps developers write code that fulfils the tests. A test-first approach allows the team to focus on and clarify the expressed needs through a discussion of how to test the resulting code. Developers can use these tests to guide their development. Developers, testers, and business stakeholders can use these tests to verify the code once it is developed.1 A number of test-first practices have been created for Agile projects, as mentioned in section 2.1 of this book. They tend to be called X Driven Development, where X stands for the driving force for the development. In Test Driven Development (TDD), the driving force is testing. In Acceptance Test- Driven Development (ATDD), it is the acceptance tests that will verify the implemented user story.
    [Show full text]
  • Acceptance Test Driven Development with Cucumber & Java (Custom for Capital One)
    "Charting the Course ... ... to Your Success!" Acceptance Test Driven Development with Cucumber & Java (Custom for Capital One) Course Summary Description This is a two day overview course which introduces students to the ideas, practices and methodology of Acceptance Test Driven Development (ATDD). The first day explores the collaborative practices used in the ATDD cycle of Discuss – Distill – Develop - Demo from initial requirements and specification by example through writing executable acceptance tests in Gherkin. Emphasis is on the integration of ATDD with other best practices such as continuous testing, software craftsmanship, Agile software delivery, test driven development, Agile testing and others while remaining focused on ATDD within the Capital One IT context. The application of ATDD in the areas of new application development, support programming in existing systems and API or micro-services are covered. The second day focuses on implementing automated acceptance tests using Cucumber, Java, TestNG, Maven and other tools and frameworks used at Capital One. Students work through illustrative examples of converting Gherkin features into test automation code emphasizing the best practices in writing, testing, deploying maintaining the automation code. Automation of tests in web based applications and RESTful APIs are examined in detail. Objectives At the end of this course, students will be able to: Describe the ATDD Discuss – Distill – Develop – Demo cycle and the activities that occur at each stage. What the common errors are that occur during the software development process and how ATDD practices work to prevent or correct those errors. Explain and perform the collaborative activities used in each stage of ATDD. Create robust acceptance tests in Gherkin Implement Gherkin acceptance tests using Cucumber and related tools to implement executable acceptance tests for web based based applications, RESTful APIs and other interfaces.
    [Show full text]
  • BDD Vitals Course
    Spec Solutions Kft. Adony u. 23., H-1116 Budapest +36 30 4748955 [email protected] HU25347867 BDD Vitals Course An essential course for the entire team with the author of the BDD Books series on Behavior Driven Development and Given/When/Then-based specification. COURSE DESCRIPTION The BDD training shows how to write and maintain executable specification that is easy to maintain even for a larger number of tests. The attendees shall expect a lot of exercises and discussions, through which they can learn about all important aspects of BDD. LEARNING OBJECTIVES Learn how to: • work with Behavior Driven Development • involve testers and other members of the team already for the detailed specification process • improve requirement gathering by focusing on rules and examples • write and maintain executable specification using the Gherkin (Given/When/Then) specification format • become a strong member of a BDD team TARGET AUDIENCE The course is for the entire team: Product Owners, Business Analysts, Testers, Developers or anyone involved in specification/requirement workshops that yield formalized Gherkin specifications. No development knowledge required. STRUCTURE & TOPICS The course is planned for one or two days normally. The one-day edition is also included in our BDD with SpecFlow/Cucumber courses. The table below indicates the depth of the different topics discussed in the different editions. A custom training agenda can be provided on request. ● – covered in depth, ∙ – briefly discussed, □ – discussed as part of the automation course days 1st day of BDD with Topic 1-day 2-days SpecFlow/Cucumber Quick intro/refresh on Behavior Driven Development ● ● ● Discovery – Exploring requirements using examples Discovering rules and examples using structured conversations ● ● ● and Example Mapping (Specification by Example) Formulation – Writing good BDD scenarios ● ● ● ●●● page 1/3 Spec Solutions Kft.
    [Show full text]
  • Specification by Example Workshop
    Specification By Example Workshop 24 April 2014, 17 July 2014, 16 October 2014 Duration: 5 days Workshop Overview Learning Objective Specifying collaboratively is a great way to build a shared By the end of the session attendees will be able to apply the understanding of the business domain and helps teams to Specification by Example technique to help them: produce specifications and tests that are comprehensive, easy to understand and highly maintainable. ● Collaboratively define a specification for development using examples During a specification workshop, different roles participate ● Align development, analysis and test activities in creating a single version of truth that captures everyone’s understanding of the implementation. Realistic examples ● Deliver living documentation that will remain valuable are used instead of abstract statements to provide clarity after the project release and precision. A refined set of examples becomes a ● Achieve an in-depth shared understanding of the specification and an acceptance test, reducing opportunities implementation for misunderstandings and misinterpretation of the underlying requirement and leading to much more valuable ● Remove opportunities for misinterpretation of the and accessible specifications. The implementation of requirements specification by example is also a strategic stepping stone ● Identify edge cases and boundaries towards achieving effective automated acceptance testing and a living documentation system. ● Understand the most important examples that the system needs to cater for The approach of using realistic examples for discussion and then selecting a set of them to concisely specify the system ● Understand how to move towards selective works with any development systems or methodology. automation. On an agile project, a specification workshop would be held for each development iteration.
    [Show full text]