DOCSLIB.ORG

To Download PDF File of Guidelines for Application Software Testing

Total Page：16

File Type：pdf, Size：1020Kb

Download full-text PDF Read full-text
To Download PDF File of Guidelines for Application Software Testing Office of the Government Chief Information Officer GUIDELINES FOR APPLICATION SOFTWARE TESTING [G20] Version: 1.10 May 2018 ©The Government of the Hong Kong Special Administrative Region of the People’s Republic of China The contents of this document remain the property of and may not be reproduced in whole or in part without express permission of the Government of the HKSAR GUIDELINES FOR AMENDMENT HISTORY APPLICATION SOFTWARE TESTING ________________________________________________________________________________ Amendment History Change Revision Description Pages Revision Date Number Affected Number 1 Update the document style in order to Whole 1.1 Dec 1999 conform with the Document Style document Manual Version 2.0. 2 Revise the outdated contents to reflect 2-1, 5-2, 1.1 Dec 1999 current practices. 6-2, 7-2, 7-4, 7-5, 7-7, 8-9, 10-1, 11-1 3 The personnel to take up the quality 5-2, 6-4, 1.1 Dec 1999 assurance role is revised. 8-1, 9-2, 9-3 4 Remove the banner ‘Standards & Front Cover 1.2 Jun 2003 Methods Document’. Page 5 Remove page number of Amendment Amendment 1.2 Jun 2003 History and Tables of Contents History and Tables of Contents 6 Remove the Distribution and Release Distribution 1.2 Jun 2003 Page and Release Page 7 Merging of ITSD into the Commerce, Whole 1.3 Jul 2004 Industry and Technology Bureau on 1 Document July 2004. Replace ‘Information Technology Services Department (ITSD)’ by ‘The Office of the Government Chief Information Officer (OGCIO)’. Replace logo of ITSD by OGCIO Front Cover Page 8 Review the update-ness 1.4 Sep 2005 _______________________________________________________________________________ GUIDELINES FOR AMENDMENT HISTORY APPLICATION SOFTWARE TESTING ________________________________________________________________________________ 9 Review the update-ness 1.5 Aug 2008 10 Review the update-ness 1.6 Oct 2009 11 Correct typos 7-1, 7-5, 1.7 Jul 2012 7-8, 8-1, 9-2, D-1, F-1 12 Revise the outdated contents to reflect Whole 1.8 Mar 2015 current practices and insert a new document appendix on Independent Testing Services 13 Revise to add guidelines for the 7-5 1.9 Feb 2018 essential need of involvement and effort of business users in User Acceptance Testing 14 Revise to add guidelines for better 3.2, 5.2, 7.5 1.10 May 2018 communication of test plans (especially User Acceptance Testing plans) developed at different stages amongst stakeholders for timely completion of IT projects _______________________________________________________________________________ GUIDELINES FOR TABLE OF CONTENTS APPLICATION SOFTWARE TESTING ________________________________________________________________________________ 1. PURPOSE ..................................................................................................................... 1-1 2. SCOPE .......................................................................................................................... 2-1 3. REFERENCES ............................................................................................................ 3-1 3.1 STANDARDS ............................................................................................................... 3-1 3.2 OTHER REFERENCES ................................................................................................ 3-1 4. DEFINITIONS AND CONVENTIONS .................................................................... 4-1 4.1 DEFINITIONS .............................................................................................................. 4-1 4.2 CONVENTIONS ........................................................................................................... 4-1 5. OVERVIEW ................................................................................................................. 5-1 5.1 PROJECT ORGANISATION ....................................................................................... 5-1 5.1.1 Project Organisation Structure ....................................................................................... 5-1 5.1.2 Test Group ..................................................................................................................... 5-1 5.2 TESTING ACTIVITIES ................................................................................................ 5-2 5.3 TEST DOCUMENTATION .......................................................................................... 5-4 5.4 TEST PLANNING AND CONTROL ........................................................................... 5-4 5.4.1 Progress Control ............................................................................................................ 5-4 5.4.2 Quality Control / Assurance .......................................................................................... 5-4 5.4.3 Resource Estimation ...................................................................................................... 5-4 6. GENERAL CONCEPTS OF TESTING ................................................................... 6-1 6.1 TESTING OBJECTIVES .............................................................................................. 6-1 6.2 TESTING APPROACH ................................................................................................ 6-1 6.3 LEVELS OF TESTING ................................................................................................. 6-2 6.4 GENERAL TESTING PRINCIPLES............................................................................ 6-3 6.5 COMPLEMENTARY REVIEWS................................................................................. 6-3 6.6 INDEPENDENT TESTING .......................................................................................... 6-4 6.6.1 Independent Testing Services by outsourced contractors .............................................. 6-4 6.6.2 Independent Testing by In-house Resources ................................................................. 6-5 7. LEVELS OF TESTING .............................................................................................. 7-1 7.1 UNIT TESTING ............................................................................................................ 7-1 7.1.1 Scope of Testing ............................................................................................................ 7-1 7.1.2 Activities, Documentation and Parties Involved ........................................................... 7-1 7.1.3 Practical Guidelines ....................................................................................................... 7-1 7.2 LINK/INTEGRATION TESTING ................................................................................ 7-2 7.2.1 Scope of Testing ............................................................................................................ 7-2 7.2.2 Activities, Documentation and Parties Involved ........................................................... 7-2 7.2.3 Practical Guidelines ....................................................................................................... 7-3 _______________________________________________________________________________ GUIDELINES FOR TABLE OF CONTENTS APPLICATION SOFTWARE TESTING ________________________________________________________________________________ 7.3 FUNCTION TESTING ................................................................................................. 7-4 7.3.1 Scope of Testing ............................................................................................................ 7-4 7.3.2 Activities, Documentation and Parties Involved ........................................................... 7-4 7.3.3 Practical Guidelines ....................................................................................................... 7-4 7.4 SYSTEM TESTING ...................................................................................................... 7-6 7.4.1 Scope of Testing ............................................................................................................ 7-6 7.4.2 Activities, Documentation and Parties Involved ........................................................... 7-6 7.4.3 Practical Guidelines ....................................................................................................... 7-6 7.5 ACCEPTANCE TESTING ........................................................................................... 7-9 7.5.1 Scope of Testing ............................................................................................................ 7-9 7.5.2 Activities, Documentation and Parties Involved ........................................................... 7-9 7.5.3 Practical Guidelines ....................................................................................................... 7-9 8. TEST DOCUMENTATION ....................................................................................... 8-1 8.1 INTRODUCTION ......................................................................................................... 8-1 8.2 TEST PLAN .................................................................................................................. 8-2 8.2.1 Purpose of Document .................................................................................................... 8-2 8.2.2 Outline of Document ..................................................................................................... 8-2 8.3 TEST SPECIFICATION ..............................................................................................
Load more

Recommended publications
  • Learn Python the Hard Way
    ptg11539604 LEARN PYTHON THE HARD WAY Third Edition ptg11539604 Zed Shaw’s Hard Way Series Visit informit.com/hardway for a complete list of available publications. ed Shaw’s Hard Way Series emphasizes instruction and making things as ptg11539604 Zthe best way to get started in many computer science topics. Each book in the series is designed around short, understandable exercises that take you through a course of instruction that creates working software. All exercises are thoroughly tested to verify they work with real students, thus increasing your chance of success. The accompanying video walks you through the code in each exercise. Zed adds a bit of humor and inside jokes to make you laugh while you’re learning. Make sure to connect with us! informit.com/socialconnect LEARN PYTHON THE HARD WAY A Very Simple Introduction to the Terrifyingly Beautiful World of Computers and Code Third Edition ptg11539604 Zed A. Shaw Upper Saddle River, NJ • Boston • Indianapolis • San Francisco New York • Toronto • Montreal • London • Munich • Paris • Madrid Capetown • Sydney • Tokyo • Singapore • Mexico City Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and the publisher was aware of a trademark claim, the designations have been printed with initial capital letters or in all capitals. The author and publisher have taken care in the preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein.
    [Show full text]
  • Studying the Feasibility and Importance of Software Testing: an Analysis
    Dr. S.S.Riaz Ahamed / Internatinal Journal of Engineering Science and Technology Vol.1(3), 2009, 119-128 STUDYING THE FEASIBILITY AND IMPORTANCE OF SOFTWARE TESTING: AN ANALYSIS Dr.S.S.Riaz Ahamed Principal, Sathak Institute of Technology, Ramanathapuram,India. Email:[email protected], [email protected] ABSTRACT Software testing is a critical element of software quality assurance and represents the ultimate review of specification, design and coding. Software testing is the process of testing the functionality and correctness of software by running it. Software testing is usually performed for one of two reasons: defect detection, and reliability estimation. The problem of applying software testing to defect detection is that software can only suggest the presence of flaws, not their absence (unless the testing is exhaustive). The problem of applying software testing to reliability estimation is that the input distribution used for selecting test cases may be flawed. The key to software testing is trying to find the modes of failure - something that requires exhaustively testing the code on all possible inputs. Software Testing, depending on the testing method employed, can be implemented at any time in the development process. Keywords: verification and validation (V & V) 1 INTRODUCTION Testing is a set of activities that could be planned ahead and conducted systematically. The main objective of testing is to find an error by executing a program. The objective of testing is to check whether the designed software meets the customer specification. The Testing should fulfill the following criteria: ¾ Test should begin at the module level and work “outward” toward the integration of the entire computer based system.
    [Show full text]
  • Types of Software Testing
    Types of Software Testing We would be glad to have feedback from you. Drop us a line, whether it is a comment, a question, a work proposition or just a hello. You can use either the form below or the contact details on the rightt. Contact details [email protected] +91 811 386 5000 1 Software testing is the way of assessing a software product to distinguish contrasts between given information and expected result. Additionally, to evaluate the characteristic of a product. The testing process evaluates the quality of the software. You know what testing does. No need to explain further. But, are you aware of types of testing. It’s indeed a sea. But before we get to the types, let’s have a look at the standards that needs to be maintained. Standards of Testing The entire test should meet the user prerequisites. Exhaustive testing isn’t conceivable. As we require the ideal quantity of testing in view of the risk evaluation of the application. The entire test to be directed ought to be arranged before executing it. It follows 80/20 rule which expresses that 80% of defects originates from 20% of program parts. Start testing with little parts and extend it to broad components. Software testers know about the different sorts of Software Testing. In this article, we have incorporated majorly all types of software testing which testers, developers, and QA reams more often use in their everyday testing life. Let’s understand them!!! Black box Testing The black box testing is a category of strategy that disregards the interior component of the framework and spotlights on the output created against any input and performance of the system.
    [Show full text]
  • Digital Rights Management and the Process of Fair Use Timothy K
    University of Cincinnati College of Law University of Cincinnati College of Law Scholarship and Publications Faculty Articles and Other Publications Faculty Scholarship 1-1-2006 Digital Rights Management and the Process of Fair Use Timothy K. Armstrong University of Cincinnati College of Law Follow this and additional works at: http://scholarship.law.uc.edu/fac_pubs Part of the Intellectual Property Commons Recommended Citation Armstrong, Timothy K., "Digital Rights Management and the Process of Fair Use" (2006). Faculty Articles and Other Publications. Paper 146. http://scholarship.law.uc.edu/fac_pubs/146 This Article is brought to you for free and open access by the Faculty Scholarship at University of Cincinnati College of Law Scholarship and Publications. It has been accepted for inclusion in Faculty Articles and Other Publications by an authorized administrator of University of Cincinnati College of Law Scholarship and Publications. For more information, please contact [email protected]. Harvard Journal ofLaw & Technology Volume 20, Number 1 Fall 2006 DIGITAL RIGHTS MANAGEMENT AND THE PROCESS OF FAIR USE Timothy K. Armstrong* TABLE OF CONTENTS I. INTRODUCTION: LEGAL AND TECHNOLOGICAL PROTECTIONS FOR FAIR USE OF COPYRIGHTED WORKS ........................................ 50 II. COPYRIGHT LAW AND/OR DIGITAL RIGHTS MANAGEMENT .......... 56 A. Traditional Copyright: The Normative Baseline ........................ 56 B. Contemporary Copyright: DRM as a "Speedbump" to Slow Mass Infringement ..........................................................
    [Show full text]
  • Microsoft Office Application Specialist, Short-Term Certificate 1
    Microsoft Office Application Specialist, Short-Term Certificate 1 MICROSOFT OFFICE Suggested Semester Sequence Course Title Credit APPLICATION SPECIALIST, Hours Summer Start SHORT-TERM CERTIFICATE Select one of the following: 3 ACCT-1011 Business Math Applications ACCT-1020 Applied Accounting This short-term certificate provides knowledge and skills in preparation Select one of the following: 3 for the Word, Excel, Access, PowerPoint, and Outlook MOS (Microsoft IT-1010 Introduction to Microcomputer Office Specialist) exams. Students enrolled in this certificate program will Applications acquire competencies in advanced word processing, spreadsheet design IT-101H Honors Introduction to Microcomputer and use, presentation software, email application features including Applications calendaring, and database maintenance. Credit Hours 6 Program contact: Learn more (http://www.tri-c.edu/programs/business- First Semester management/business-technology/microsoft-office-specialist-short- BT-1201 Word Processing 3 term-certificate.html) BT-2040 Emerging Workplace Technology 3 This certificate will be automatically awarded when the certificate BT-2210 Presentation Software 2 requirements are completed. If you do not want to receive the certificate, BT-2300 Business Database Systems (Access) 3 please notify the Office of the Registrar at [email protected]. Credit Hours 11 Learn more (http://catalog.tri-c.edu/archives/2017-2018/pathways/ Second Semester business/business-technology) about how certificate credits apply to the BT-2200 Advanced Word Processing 3 related degree. BT-2220 Business Spreadsheet Applications (Excel) 3 Credit Hours 6 Gainful Employment Disclosure (http://www.tri-c.edu/about/disclosure/ Microsoft_Office_Specialist/Gedt.html) Total Credit Hours 23 Students must be able to touch type at a combined speed and accuracy rate of 25 wpm.
    [Show full text]
  • Acceptance Testing Tools - a Different Perspective on Managing Requirements
    Acceptance Testing Tools - A different perspective on managing requirements Wolfgang Emmerich Professor of Distributed Computing University College London http://sse.cs.ucl.ac.uk Learning Objectives • Introduce the V-Model of quality assurance • Stress the importance of testing in terms of software engineering economics • Understand that acceptance tests are requirements specifications • Introduce acceptance and integration testing tools for Test Driven Development • Appreciate that automated acceptance tests are executable requirements specifications 2 V-Model in Distributed System Development Requirements Acceptance Test Software Integration Architecture Test Detailed System Design Test See: B. Boehm Guidelines for Verifying and Validating Software Unit Requirements and Design Code Specifications. Euro IFIP, P. A. Test Samet (editor), North-Holland Publishing Company, IFIP, 1979. 3 1 Traditional Software Development Requirements Acceptance Test Software Integration Architecture Test Detailed System Design Test Unit Code Test 4 Test Driven Development of Distributed Systems Use Cases/ User Stories Acceptance QoS Requirements Test Software Integration & Architecture System Test Detailed Unit Design Test These tests Code should be automated 5 Advantages of Test Driven Development • Early definition of acceptance tests reveals incomplete requirements • Early formalization of requirements into automated acceptance tests unearths ambiguities • Flaws in distributed software architectures (there often are many!) are discovered early • Unit tests become precise specifications • Early resolution improves productivity (see next slide) 6 2 Software Engineering Economics See: B. Boehm: Software Engineering Economics. Prentice Hall. 1981 7 An Example Consider an on-line car dealership User Story: • I first select a locale to determine the language shown at the user interface. I then select the SUV I want to buy.
    [Show full text]
  • Model-Based Fuzzing Using Symbolic Transition Systems
    Model-Based Fuzzing Using Symbolic Transition Systems Wouter Bohlken [email protected] January 31, 2021, 48 pages Academic supervisor: Dr. Ana-Maria Oprescu, [email protected] Daily supervisor: Dr. Machiel van der Bijl, [email protected] Host organisation: Axini, https://www.axini.com Universiteit van Amsterdam Faculteit der Natuurwetenschappen, Wiskunde en Informatica Master Software Engineering http://www.software-engineering-amsterdam.nl Abstract As software is getting more complex, the need for thorough testing increases at the same rate. Model- Based Testing (MBT) is a technique for thorough functional testing. Model-Based Testing uses a formal definition of a program and automatically extracts test cases. While MBT is useful for functional testing, non-functional security testing is not covered in this approach. Software vulnerabilities, when exploited, can lead to serious damage in industry. Finding flaws in software is a complicated, laborious, and ex- pensive task, therefore, automated security testing is of high relevance. Fuzzing is one of the most popular and effective techniques for automatically detecting vulnerabilities in software. Many differ- ent fuzzing approaches have been developed in recent years. Research has shown that there is no single fuzzer that works best on all types of software, and different fuzzers should be used for different purposes. In this research, we conducted a systematic review of state-of-the-art fuzzers and composed a list of candidate fuzzers that can be combined with MBT. We present two approaches on how to combine these two techniques: offline and online. An offline approach fully utilizes an existing fuzzer and automatically extracts relevant information from a model, which is then used for fuzzing.
    [Show full text]
  • An Analysis of Current Guidance in the Certification of Airborne Software
    An Analysis of Current Guidance in the Certification of Airborne Software by Ryan Erwin Berk B.S., Mathematics I Massachusetts Institute of Technology, 2002 B.S., Management Science I Massachusetts Institute of Technology, 2002 Submitted to the System Design and Management Program In Partial Fulfillment of the Requirements for the Degree of Master of Science in Engineering and Management at the ARCHIVES MASSACHUSETrS INS E. MASSACHUSETTS INSTITUTE OF TECHNOLOGY OF TECHNOLOGY June 2009 SEP 2 3 2009 © 2009 Ryan Erwin Berk LIBRARIES All Rights Reserved The author hereby grants to MIT permission to reproduce and to distribute publicly paper and electronic copies of this thesis document in whole or in part in any medium now known or hereafter created. Signature of Author Ryan Erwin Berk / System Design & Management Program May 8, 2009 Certified by _ Nancy Leveson Thesis Supervisor Professor of Aeronautics and Astronautics pm-m A 11A Professor of Engineering Systems Accepted by _ Patrick Hale Director System Design and Management Program This page is intentionally left blank. An Analysis of Current Guidance in the Certification of Airborne Software by Ryan Erwin Berk Submitted to the System Design and Management Program on May 8, 2009 in Partial Fulfillment of the Requirements for the Degree of Master of Science in Engineering and Management ABSTRACT The use of software in commercial aviation has expanded over the last two decades, moving from commercial passenger transport down into single-engine piston aircraft. The most comprehensive and recent official guidance on software certification guidelines was approved in 1992 as DO-178B, before the widespread use of object-oriented design and complex aircraft systems integration in general aviation (GA).
    [Show full text]
  • Web Gui Testing Checklist
    Web Gui Testing Checklist Wes recrystallizing her quinone congruously, phytophagous and sulphonic. How imponderable is Schroeder when barbate whileand soft-footed Brewer gliff Zachery some incisure yakety-yak affluently. some chatoyancy? Fulgurating and battiest Nealson blossoms her amontillados refine Wbox aims to the field to be able to the automated support data, testing web gui checklist Planned testing techniques, including scripted testing, exploratory testing, and user experience testing. This gui content will the css or dynamic values? Test all input fields for special characters. For instance, create test data assist the maximum and minimum values in those data field. Assisted by timing testing is not tested to the order to achieve true black art relying on gui testing web checklist will best. The web hosting environments you start all web testing gui checklist can provide tests has had made. The gui testing procedures are the weak factors causing delays in agile here offering, gui testing web? At anytime without giving us a testing web gui checklist can also has on. How gui testing checklist for a gui testing web checklist to induce further eliminating redundant if there is transmitted without the below to use of jobs with. Monkey testing tool that an application or even perform testing web gui changes some test android scripts behind successful only allows an. Discusses the preceding css or if a sql injections through an application penetration testing on gui testing web? How much regression testing is enough? Fully automated attack simulations and highly automated fuzzing tests are appropriate here, and testers might also use domain testing to pursue intuitions.
    [Show full text]
  • Testing Guide 4Deets
    TESTING GUIDE Automated Testing for SuccessFactors Introduction This guide will give you an overview of the different aspects of testing your SuccessFactors environment. As most employees interact in some way or form with the system, it’s crucial to test your system regularly and around crucial events to make sure you provide an excellent employee experience. The following topics will be explored: • Testing During An Implementation • Testing For Configuration Changes • Testing For Quarterly Releases • Manual vs. Automated Testing © 2019 Page | 2 Automated Testing For SuccessFactors Testing During An Implementation During an implementation, testing is critical to make sure the system is designed and configured according to expectations. One of the most known test is User Acceptance Testing (UAT) in which a client signs off that the system works as expected. Before UAT, there are many different tests you would like to perform. These tests are done during different phases of a project. Some only once, others multiple times. Let’s start with looking at what phases there are during a SuccessFactors implementation. This may differ slightly, but all SuccessFactors implementations basically follow the same path. The reason for this is that the Agile methodology, which is the preferred method defined by SAP, needs to be followed by SAP professional services and all the certified implementation partners. This methodology has been proven to be most successful. The Agile methodology is an iterative approach. Iterative approach is a way of breaking down the system development of a large application into smaller chunks. In iterative development, functionality is designed, configured and tested in repeated cycles.
    [Show full text]
  • Introduction to Computers and Office Productivity Software
    Wright State University CORE Scholar Computer Science & Engineering Syllabi College of Engineering & Computer Science Fall 2011 CS 205-08: Introduction to Computers and Office oductivityPr Software Terri Bauer Wright State University - Main Campus, [email protected] Follow this and additional works at: https://corescholar.libraries.wright.edu/cecs_syllabi Part of the Computer Engineering Commons, and the Computer Sciences Commons Repository Citation Bauer, T. (2011). CS 205-08: Introduction to Computers and Office oductivityPr Software. https://corescholar.libraries.wright.edu/cecs_syllabi/363 This Syllabus is brought to you for free and open access by the College of Engineering & Computer Science at CORE Scholar. It has been accepted for inclusion in Computer Science & Engineering Syllabi by an authorized administrator of CORE Scholar. For more information, please contact [email protected]. COURSE SYLLABUS <WEUS Introduction to Computers and Office Productivity Software Fall 2011 General Course Information Instructor: E-mail: [email protected] Classroom: 320 Delman Web site: http://oilot.wright.edu Prerequisites: No course pre-requisites, however a basic understanding of computers and word processing ­ as acquired in high school - is assumed. Credit Hours: 4 Quarter Hours Textbook: New Perspectives Microsoft Office 2010 First Course ISBN: 978-0-538-7463-3 SAM Assessment and Projects Software - comes bundled with book Course Description Focus on learning MS Office software applications including intermediate word processing, spreadsheets, database and presentation graphics using a case study approach where critical thinking and problem solving skills are required. Computer concepts are integrated throughout the course to provide an understanding of the basics of computing, the latest technological advances and how they are used in industry.
    [Show full text]
  • Acceptance Testing How Cslim and Fitnesse Can Help You Test Your Embedded System
    Acceptance Testing How CSlim and FitNesse Can Help You Test Your Embedded System Doug Bradbury Software Craftsman, 8th Light Tutorial Environment git clone git://github.com/dougbradbury/c_learning.git cd c_learning ./bootstrap.sh or with a live CD: cp -R cslim_agile_package c_clearning cd c_learning git pull ./bootstrap.sh Overview Talk w/ exercises: Acceptance Tests Tutorial: Writing Acceptance tests Tutorial: Fitnesse Tutorial: CSlim Talk: Embedded Systems Integration Bonus Topics Introductions Who are you? Where do you work? What experience do you have with ... embedded systems? acceptance testing? FitNesse and Slim? Objectives As a result of this course you will be able to: Understand the purposes of acceptance testing; Use acceptance tests to define and negotiate scope on embedded systems projects; Integrate a CSlim Server into your embedded systems; Objectives (cont) As a result of this course you will be able to: Add CSlim fixtures to your embedded system; Write Fitnesse tests to drive the execution of CSlim fixtures; Write and maintain suites of tests in a responsible manner. Points on a star How many points does this star have? Star Point Specification Points on a star are counted by the number of exterior points. Points on a star How many points does this star have? By Example 3 5 9 Points on a star Now, how many points does this star have? Robo-draw Pick a partner ... Acceptance Testing Collaboratively producing examples of what a piece of software is supposed to do Unit Tests help you build the code right. Acceptance Tests
    [Show full text]