Orthogonal Array Application for Optimized Software Testing
Total Page:16
File Type:pdf, Size:1020Kb
Load more
Recommended publications
-
Types of Software Testing
Types of Software Testing We would be glad to have feedback from you. Drop us a line, whether it is a comment, a question, a work proposition or just a hello. You can use either the form below or the contact details on the rightt. Contact details [email protected] +91 811 386 5000 1 Software testing is the way of assessing a software product to distinguish contrasts between given information and expected result. Additionally, to evaluate the characteristic of a product. The testing process evaluates the quality of the software. You know what testing does. No need to explain further. But, are you aware of types of testing. It’s indeed a sea. But before we get to the types, let’s have a look at the standards that needs to be maintained. Standards of Testing The entire test should meet the user prerequisites. Exhaustive testing isn’t conceivable. As we require the ideal quantity of testing in view of the risk evaluation of the application. The entire test to be directed ought to be arranged before executing it. It follows 80/20 rule which expresses that 80% of defects originates from 20% of program parts. Start testing with little parts and extend it to broad components. Software testers know about the different sorts of Software Testing. In this article, we have incorporated majorly all types of software testing which testers, developers, and QA reams more often use in their everyday testing life. Let’s understand them!!! Black box Testing The black box testing is a category of strategy that disregards the interior component of the framework and spotlights on the output created against any input and performance of the system. -
Human Performance Regression Testing
Human Performance Regression Testing Amanda Swearngin, Myra B. Cohen Bonnie E. John, Rachel K. E. Bellamy Dept. of Computer Science & Eng. IBM T. J. Watson Research Center University of Nebraska-Lincoln, USA P.O. Box 704 Lincoln, NE 68588-0115 Yorktown Heights, NY 10598, USA faswearn,[email protected] fbejohn,[email protected] Abstract—As software systems evolve, new interface features common tasks, necessitating longer mouse movements and, in such as keyboard shortcuts and toolbars are introduced. While fact, decrease efficiency. In addition, many toolbars with small it is common to regression test the new features for functional icons may add screen clutter and may decrease a new user’s correctness, there has been less focus on systematic regression testing for usability, due to the effort and time involved in human ability to discover how to accomplish a task over a simpler studies. Cognitive modeling tools such as CogTool provide some UI design. help by computing predictions of user performance, but they still Usability testing has traditionally been empirical, bringing require manual effort to describe the user interface and tasks, end-users in to a testing facility, asking them to perform tasks limiting regression testing efforts. In recent work, we developed on the system (or prototype), and measuring such things as the CogTool-Helper to reduce the effort required to generate human performance models of existing systems. We build on this work time taken to perform the task, the percentage of end-users by providing task specific test case generation and present our who can complete the task in a fixed amount of time, and vision for human performance regression testing (HPRT) that the number and type of errors made by the end-users. -
Orthogonal Arrays and Row-Column and Block Designs for CDC Systems
Current Trends on Biostatistics & L UPINE PUBLISHERS Biometrics Open Access DOI: 10.32474/CTBB.2018.01.000103 ISSN: 2644-1381 Review Article Orthogonal Arrays and Row-Column and Block Designs for CDC Systems Mahndra Kumar Sharma* and Mekonnen Tadesse Department of Statistics, Addis Ababa University, Addis Ababa, Ethiopia Received: September 06, 2018; Published: September 20, 2018 *Corresponding author: Mahndra Kumar Sharma, Department of Statistics, Addis Ababa University, Addis Ababa, Ethiopia Abstract In this article, block and row-column designs for genetic crosses such as Complete diallel cross system using orthogonal arrays (p2, r, p, 2), where p is prime or a power of prime and semi balanced arrays (p(p-1)/2, p, p, 2), where p is a prime or power of an odd columnprime, are designs derived. for Themethod block A designsand C are and new row-column and consume designs minimum for Griffing’s experimental methods units. A and According B are found to Guptato be A-optimalblock designs and thefor block designs for Griffing’s methods C and D are found to be universally optimal in the sense of Kiefer. The derived block and row- Keywords:Griffing’s methods Orthogonal A,B,C Array;and D areSemi-balanced orthogonally Array; blocked Complete designs. diallel AMS Cross; classification: Row-Column 62K05. Design; Optimality Introduction d) one set of F ’s hybrid but neither parents nor reciprocals Orthogonal arrays of strength d were introduced and applied 1 F ’s hybrid is included (v = 1/2p(p-1). The problem of generating in the construction of confounded symmetrical and asymmetrical 1 optimal mating designs for CDC method D has been investigated factorial designs, multifactorial designs (fractional replication) by several authors Singh, Gupta, and Parsad [10]. -
Evaluation Approaches in Software Testing Ayaz Farooq, Reiner R
Nr.: FIN-05-2008 Evaluation Approaches in Software Testing Ayaz Farooq, Reiner R. Dumke Arbeitsgruppe Softwaretechnik Fakultät für Informatik Otto-von-Guericke-Universität Magdeburg Impressum (§ 10 MDStV): Herausgeber: Otto-von-Guericke-Universität Magdeburg Fakultät für Informatik Der Dekan Verantwortlich für diese Ausgabe: Otto-von-Guericke-Universität Magdeburg Fakultät für Informatik Reiner Dumke Postfach 4120 39016 Magdeburg E-Mail: [email protected] http://www.cs.uni-magdeburg.de/Preprints.html Auflage: 81 Redaktionsschluss: Juli 2008 Herstellung: Dezernat Allgemeine Angelegenheiten, Sachgebiet Reproduktion Bezug: Universitätsbibliothek/Hochschulschriften- und Tauschstelle Otto-von-Guericke-University of Magdeburg Faculty of Computer Science Institute for Distributed Systems Software Engineering Group Evaluation Approaches in Software Testing Authors: Ayaz Farooq Reiner R. Dumke University of Magdeburg Faculty of Computer Science P.O. Box 4120, 39016 Magdeburg Germany Farooq, Ayaz Dumke, Reiner R. Evaluation Approaches in Software Testing Technical Report Otto-von-Guericke-University of Magdeburg 2008. Contents i Contents 1 Introduction 1 1.1 Evaluation Defined . 2 1.2 Evaluation in Software Engineering . 2 1.3 Evaluation in Software Testing . 3 1.4 Structure of the Report . 5 2 Test Processes: Basics & Maturities 7 2.1 Test Process Fundamentals . 7 2.1.1 Test Process Contexts . 9 2.1.2 Research over Test Process . 10 2.2 Test Process Definition & Modeling . 11 2.2.1 Generic Test Process Descriptions . 11 2.2.1.1 Test Management Approach-TMap . 13 2.2.1.2 Drabick’s Formal Testing Process . 13 2.2.1.3 Test Driven Development . 15 2.2.1.4 Independent Verification & Validation . 17 2.2.2 Domain Specific Test Processes . -
Orthogonal Array Experiments and Response Surface Methodology
Unit 7: Orthogonal Array Experiments and Response Surface Methodology • A modern system of experimental design. • Orthogonal arrays (sections 8.1-8.2; appendix 8A and 8C). • Analysis of experiments with complex aliasing (part of sections 9.1-9.4). • Brief response surface methodology, central composite designs (sections 10.1-10.2). 1 Two Types of Fractional Factorial Designs • Regular (2n−k, 3n−k designs): columns of the design matrix form a group over a finite field; the interaction between any two columns is among the columns, ⇒ any two factorial effects are either orthogonal or fully aliased. • Nonregular (mixed-level designs, orthogonal arrays) some pairs of factorial effects can be partially aliased ⇒ more complex aliasing pattern. This includes 3n−k designs with linear-quadratic system. 2 A Modern System of Experimental Design It has four branches: • Regular orthogonal arrays (Fisher, Yates, Finney, ...): 2n−k, 3n−k designs, using minimum aberration criterion. • Nonregular orthogonal designs (Plackett-Burman, Rao, Bose): Plackett-Burman designs, orthogonal arrays. • Response surface designs (Box): fitting a parametric response surface. • Optimal designs (Kiefer): optimality driven by specific model/criterion. 3 Orthogonal Arrays • In Tables 1 and 2, the design used does not belong to the 2k−p series (Chapter 5) or the 3k−p series (Chapter 6), because the latter would require run size as a power of 2 or 3. These designs belong to the class of orthogonal arrays. m1 mγ • An orthogonal array array OA(N,s1 ...sγ ,t) of strength t is an N × m matrix, m = m1 + ... + mγ, in which mi columns have si(≥ 2) symbols or levels such that, for any t columns, all possible combinations of symbols appear equally often in the matrix. -
Software Testing: Essential Phase of SDLC and a Comparative Study Of
International Journal of System and Software Engineering Volume 5 Issue 2, December 2017 ISSN.: 2321-6107 Software Testing: Essential Phase of SDLC and a Comparative Study of Software Testing Techniques Sushma Malik Assistant Professor, Institute of Innovation in Technology and Management, Janak Puri, New Delhi, India. Email: [email protected] Abstract: Software Development Life-Cycle (SDLC) follows In the software development process, the problem (Software) the different activities that are used in the development of a can be dividing in the following activities [3]: software product. SDLC is also called the software process ∑ Understanding the problem and it is the lifeline of any Software Development Model. ∑ Decide a plan for the solution Software Processes decide the survival of a particular software development model in the market as well as in ∑ Coding for the designed solution software organization and Software testing is a process of ∑ Testing the definite program finding software bugs while executing a program so that we get the zero defect software. The main objective of software These activities may be very complex for large systems. So, testing is to evaluating the competence and usability of a each of the activity has to be broken into smaller sub-activities software. Software testing is an important part of the SDLC or steps. These steps are then handled effectively to produce a because through software testing getting the quality of the software project or system. The basic steps involved in software software. Lots of advancements have been done through project development are: various verification techniques, but still we need software to 1) Requirement Analysis and Specification: The goal of be fully tested before handed to the customer. -
Latin Squares in Experimental Design
Latin Squares in Experimental Design Lei Gao Michigan State University December 10, 2005 Abstract: For the past three decades, Latin Squares techniques have been widely used in many statistical applications. Much effort has been devoted to Latin Square Design. In this paper, I introduce the mathematical properties of Latin squares and the application of Latin squares in experimental design. Some examples and SAS codes are provided that illustrates these methods. Work done in partial fulfillment of the requirements of Michigan State University MTH 880 advised by Professor J. Hall. 1 Index Index ............................................................................................................................... 2 1. Introduction................................................................................................................. 3 1.1 Latin square........................................................................................................... 3 1.2 Orthogonal array representation ........................................................................... 3 1.3 Equivalence classes of Latin squares.................................................................... 3 2. Latin Square Design.................................................................................................... 4 2.1 Latin square design ............................................................................................... 4 2.2 Pros and cons of Latin square design................................................................... -
1. Can You Explain the PDCA Cycle and Where Testing Fits In?
1. Can you explain the PDCA cycle and where testing fits in? Software testing is an important part of the software development process. In normal software development there are four important steps, also referred to, in short, as the PDCA (Plan, Do, Check, Act) cycle. Let's review the four steps in detail. 1. Plan: Define the goal and the plan for achieving that goal. 2. Do/Execute: Depending on the plan strategy decided during the plan stage we do execution accordingly in this phase. 3. Check: Check/Test to ensure that we are moving according to plan and are getting the desired results. 4. Act: During the check cycle, if any issues are there, then we take appropriate action accordingly and revise our plan again. So developers and other stakeholders of the project do the "planning and building," while testers do the check part of the cycle. Therefore, software testing is done in check part of the PDCA cyle. 2. What is the difference between white box, black box, and gray box testing? Black box testing is a testing strategy based solely on requirements and specifications. Black box testing requires no knowledge of internal paths, structures, or implementation of the software being tested. White box testing is a testing strategy based on internal paths, code structures, and implementation of the software being tested. White box testing generally requires detailed programming skills. There is one more type of testing called gray box testing. In this we look into the "box" being tested just long enough to understand how it has been implemented. -
Generating and Improving Orthogonal Designs by Using Mixed Integer Programming
European Journal of Operational Research 215 (2011) 629–638 Contents lists available at ScienceDirect European Journal of Operational Research journal homepage: www.elsevier.com/locate/ejor Stochastics and Statistics Generating and improving orthogonal designs by using mixed integer programming a, b a a Hélcio Vieira Jr. ⇑, Susan Sanchez , Karl Heinz Kienitz , Mischel Carmen Neyra Belderrain a Technological Institute of Aeronautics, Praça Marechal Eduardo Gomes, 50, 12228-900, São José dos Campos, Brazil b Naval Postgraduate School, 1 University Circle, Monterey, CA, USA article info abstract Article history: Analysts faced with conducting experiments involving quantitative factors have a variety of potential Received 22 November 2010 designs in their portfolio. However, in many experimental settings involving discrete-valued factors (par- Accepted 4 July 2011 ticularly if the factors do not all have the same number of levels), none of these designs are suitable. Available online 13 July 2011 In this paper, we present a mixed integer programming (MIP) method that is suitable for constructing orthogonal designs, or improving existing orthogonal arrays, for experiments involving quantitative fac- Keywords: tors with limited numbers of levels of interest. Our formulation makes use of a novel linearization of the Orthogonal design creation correlation calculation. Design of experiments The orthogonal designs we construct do not satisfy the definition of an orthogonal array, so we do not Statistics advocate their use for qualitative factors. However, they do allow analysts to study, without sacrificing balance or orthogonality, a greater number of quantitative factors than it is possible to do with orthog- onal arrays which have the same number of runs. -
Orthogonal Array Sampling for Monte Carlo Rendering
Eurographics Symposium on Rendering 2019 Volume 38 (2019), Number 4 T. Boubekeur and P. Sen (Guest Editors) Orthogonal Array Sampling for Monte Carlo Rendering Wojciech Jarosz1 Afnan Enayet1 Andrew Kensler2 Charlie Kilpatrick2 Per Christensen2 1Dartmouth College 2Pixar Animation Studios (a) Jittered 2D projections (b) Multi-Jittered 2D projections (c) (Correlated) Multi-Jittered 2D projections wy wu wv wy wu wv wy wu wv y wx wx wx u wy wy wy v wu wu wu x y u x y u x y u Figure 1: We create high-dimensional samples which simultaneously stratify all bivariate projections, here shown for a set of 25 4D samples, along with their six stratified 2D projections and expected power spectra. We can achieve 2D jittered stratifications (a), optionally with stratified 1D (multi-jittered) projections (b). We can further improve stratification using correlated multi-jittered (c) offsets for primary dimension pairs (xy and uv) while maintaining multi-jittered properties for cross dimension pairs (xu, xv, yu, yv). In contrast to random padding, which degrades to white noise or Latin hypercube sampling in cross dimensional projections (cf. Fig.2), we maintain high-quality stratification and spectral properties in all 2D projections. Abstract We generalize N-rooks, jittered, and (correlated) multi-jittered sampling to higher dimensions by importing and improving upon a class of techniques called orthogonal arrays from the statistics literature. Renderers typically combine or “pad” a collection of lower-dimensional (e.g. 2D and 1D) stratified patterns to form higher-dimensional samples for integration. This maintains stratification in the original dimension pairs, but looses it for all other dimension pairs. -
Association Schemes for Ordered Orthogonal Arrays and (T, M, S)-Nets W
Canad. J. Math. Vol. 51 (2), 1999 pp. 326–346 Association Schemes for Ordered Orthogonal Arrays and (T, M, S)-Nets W. J. Martin and D. R. Stinson Abstract. In an earlier paper [10], we studied a generalized Rao bound for ordered orthogonal arrays and (T, M, S)-nets. In this paper, we extend this to a coding-theoretic approach to ordered orthogonal arrays. Using a certain association scheme, we prove a MacWilliams-type theorem for linear ordered orthogonal arrays and linear ordered codes as well as a linear programming bound for the general case. We include some tables which compare this bound against two previously known bounds for ordered orthogonal arrays. Finally we show that, for even strength, the LP bound is always at least as strong as the generalized Rao bound. 1 Association Schemes In 1967, Sobol’ introduced an important family of low discrepancy point sets in the unit cube [0, 1)S. These are useful for quasi-Monte Carlo methods such as numerical inte- gration. In 1987, Niederreiter [13] significantly generalized this concept by introducing (T, M, S)-nets, which have received considerable attention in recent literature (see [3] for a survey). In [7], Lawrence gave a combinatorial characterization of (T, M, S)-nets in terms of objects he called generalized orthogonal arrays. Independently, and at about the same time, Schmid defined ordered orthogonal arrays in his 1995 thesis [15] and proved that (T, M, S)-nets can be characterized as (equivalent to) a subclass of these objects. Not sur- prisingly, generalized orthogonal arrays and ordered orthogonal arrays are closely related. -
Cost Justifying Usability a Case-Study at Ericsson
Master thesis Computer science Thesis ID:MCS-2011-01 January 2011 Cost justifying usability a case-study at Ericsson Parisa Yousefi Pegah Yousefi School of Computing Blekinge Institute of Technology SE 371 39 Karlskrona Sweden 1 This thesis is submitted to the School of Computing at Blekinge Institute of Technology in partial fulfilment of the requirements for the degree of Master of Science in Computer Sci- ence. The thesis is equivalent to 20 weeks of full time studies. Contact Information: Author(s): Parisa Yousefi Address: Näktergalsvagen 5, Rödeby, 371 30 E-mail: [email protected] Pegah Yousefi Address: Drottninggatan 36, Karlskrona, 371 37 E-mail: [email protected] External advisor(s): Helen Sjelvgren Ericsson Address: Ölandsgatan 6 Karlskrona, 371 23 Phone: +46 10 7158732 University advisor(s): Dr Kari Rönkkö, Ph.D Jeff Winter Licentiate School of Computing Internet : www.bth.se/com Blekinge Institute of Technology Phone : +46 455 38 50 00 SE – 371 39 Karlskrona Fax : +46 455 38 50 57 Sweden 2 Abstract Usability in Human-computer Interaction and user- centered design is indeed a key factor, in success of any software products. However, software industries, in particular the attitude of revenue management, express a need of a economic and academic case, for justification of usability discipline. In this study we investigate the level of usability and usability issues and the gaps concerning usability activities and the potential users, in a part of charging system products in Ericsson. Also we try identifying the cost-benefit factors, usability brings to this project, in order to attempt 'justifying the cost of usability for this particular product'.