Recording Concerns in Source Code Using Annotations

Total Page:16

File Type:pdf, Size:1020Kb

Recording Concerns in Source Code Using Annotations Recording Concerns in Source Code Using Annotations Matúš Sulír, Milan Nosáľ, Jaroslav Porubän Department of Computers and Informatics Faculty of Electrical Engineering and Informatics Technical University of Košice Letná 9, 042 00 Košice, Slovakia Abstract A concern can be characterized as a developer’s intent behind a piece of code, often not explicitly captured in it. We discuss a technique of recording concerns using source code annotations (concern annotations). Using two studies and two controlled experiments, we seek to answer the following 3 research questions: 1) Do programmers’ mental models overlap? 2) How do developers use shared concern annotations when they are available? 3) Does using annotations cre- ated by others improve program comprehension and maintenance correctness, time and confidence? The first study shows that developers’ mental models, recorded using concern annotations, overlap and thus can be shared. The sec- ond study shows that shared concern annotations can be used during program comprehension for the following purposes: hypotheses confirmation, feature lo- cation, obtaining new knowledge, finding relationships and maintenance notes. The first controlled experiment with students showed that the presence of an- notations significantly reduced program comprehension and maintenance time by 34%. The second controlled experiment was a differentiated replication of the first one, focused on industrial developers. It showed a 33% significant im- provement in correctness. We conclude that concern annotations are a viable way to share developers’ thoughts. Keywords: program comprehension, concerns, source code annotations, Email addresses: [email protected] (Matúš Sulír), [email protected] (Milan Nosáľ), [email protected] (Jaroslav Porubän) c 2016. This manuscript version is made available under the CC-BY-NC-ND 4.0 license: http://creativecommons.org/licenses/by-nc-nd/4.0/. This is the accepted version of: M. Sulír, M. Nosáľ, J. Porubän. Recording concerns in source code using annotations. Computer Languages, Systems and Structures (COMLAN), Vol. 46, 2016, pp. 44–65, Elsevier. http://doi.org/10.1016/j.cl.2016.07.003 empirical studies 1. Introduction Programmers developing a program continuously create a mental model, which is a representation of the program in their mind. They try to express the mental model in the programming language constructions. However, some parts of the mental model are not explicitly expressed in the source code. They are either implicitly indicated in complicated implementation details, or lost. 1.1. Motivation Suppose a developer encounters the Java code excerpt shown in Figure 1 a). While reading it, the following ideas may gradually appear in his or her mind: • The method addProduct adds some product somewhere. • As it is in the Catalog class, it adds the product to the catalog. • An addition to a catalog changes its state – the catalog is modified. • There is a condition checking whether a user is logged. • To successfully perform this operation, a logged user must be a manager; otherwise an exception is thrown. While this process may seem natural, it has the following shortcomings: • The fact that the code modifies a catalog is formed only after reading two parts of the code far apart. • The information that a “manager account” is necessary is formed after reading a rather lengthy piece of code. • There is one important piece of information not identified at all: The added product actually appears in the catalog only after the administrator approves it. This information is not apparent from this excerpt, and may be the result of cooperation of many remotely related classes. 2 a) Source code public class Catalog { ... public void addProduct (Product product) { if (!user.isLogged() || !user.getRoles().contains(UserRole.MANAGER)) { throw new SecurityException("Insufficient privilleges"); } this.productList.add(product); } } b) Mental model product catalog manager adding modification account required … Figure 1: An example of unannotated source code and the corresponding mental model Now suppose the developer originally writing the code, or any other pro- grammer maintaining it, annotated the source code with concern annotations (source code annotations are declarative marks used to decorate source code with metadata [1]), as displayed in Figure 2 a). The developer later reading it would rapidly obtain a mental model containing useful information about the code, without even looking at the method implementation, scrolling through the code to stitch the pieces of information, or even debug it to explain unex- pected behavior. Furthermore, it would be possible to find all methods requiring approval in case of refactoring or business policy changes. As annotations are a part of the Java language, no additional tools are required: standard IDE (integrated development environment) features like Find Usages could be used. 1.2. Aim The purpose of this paper is to investigate the viability of source code an- notations as a medium to share parts of developers’ mental models. Therefore, we form our hypothesis as follows: Annotations created by one group of devel- opers are useful for comprehension and maintenance tasks performed by other developers. 3 a) Source code public class Catalog { ... @CatalogModification @AccountRequired(UserRole.MANAGER) @ApprovalRequired(UserRole.ADMIN) public void addProduct (Product product) { if (!user.isLogged() ...) ... } } b) Mental model product catalog manager approval by adding modification account admin required required … Figure 2: The annotated source code and the corresponding mental model Our first goal is to find out whether at least some of the concerns recognized by one programmer can be recognized by other developers. If so, then the mental model of one developer at least partially overlaps with the other persons’ mental model. This is a necessary condition for concern annotation sharing to be useful. Then we examine the usability of concern annotations using an observational study and two controlled experiments. We formulate the research questions as follows: • RQ1: Do programmers’ mental models, recorded using concern annota- tions, overlap? • RQ2: How do developers use shared annotations when they are available? • RQ3: Can annotations created by others improve program comprehension and maintenance correctness, time and confidence? To answer each of the questions, we used an appropriate empirical research method [2]. 4 2. Basic Concepts Before describing the studies, we introduce the notion of concerns, concern annotations, and their relation to a mental model. 2.1. Mental Model A mental model is “an internal, working representation of the software under consideration” [3]. It is described by its static structures – pieces of knowledge, and by dynamic behavior – the processes forming these pieces. Now we will focus mainly on the static structures. Since there have been multiple attempts to describe the structure of a men- tal model, each researcher has its own point of view. Mayrhauser and Vans distinguish these types of structures in their review [3]: Chunks are mappings from a label like “sorting” to the program text implementing it, or to a set of other chunks like “comparing” and “swapping”. Plans are similar, but they may include relationships across various pieces of the code, and the problem domain knowledge. Hypotheses are conjectures about parts of the program, which the programmers try to prove or disprove. Our view of a mental model unifies chunks, plans and hypotheses into a set of concerns. In the programmer’s mind, a concern is represented by a short label, as shown in Figure 1 b), and its corresponding source code elements. 2.2. Concerns A concern can be characterized as a developer’s intent of a particular piece of code: What should this code accomplish? What am I trying to achieve with it? How would I tersely characterize it? Is there something special about it? Some concerns may be obvious by looking at the code itself (chiefly from the identifiers), but many concerns are hidden. Basically, a concern represents a software system requirement, or a design decision about the code [4]. A concern can be observed in three dimensions [5]: stakeholders (from whose perspective is the concern observed – e.g., a programmer); level (at what level of construct granularity is the concern expressed, e.g., low-level constructs such as 5 a loop); and expression (how is the concern expressed, starting with the mental model and ending with the source code). Due to these and other reasons, concerns’ coverage can overlap. For exam- ple, a single method can implement persistence – contributing to the persistence concern; and in the same time it can contain code securing it against unautho- rized access – a part of the security concern implementation. Thus, one piece of code can belong to multiple concerns [6], in this case, both persistence and security. 2.3. Concern Annotations Since a method can belong to multiple concerns, expressing concerns using only identifiers (naming conventions) is not sufficient: naming conventions do not scale well. See Listing 1 for an example using the Persistence keyword in the identifier to express that the method implements persistence, and Secured- Method with OnlyAdmin to specify that it contributes to the security concern by allowing access only to an administrator. Listing 1: Expressing concerns using naming conventions public addNewUserPersistenceSecuredMethodOnlyAdmin(User user) { ... } It is possible for
Recommended publications
  • Annotation File Format Specification
    Annotation File Format Specification https://checkerframework.org/annotation-file-utilities/ September 1, 2021 Contents 1 Purpose: External storage of annotations 1 2 Grammar 2 2.1 Grammar conventions . 2 2.2 Java file grammar . 2 2.2.1 Package definitions . 3 2.2.2 Class definitions . 3 2.2.3 Field definitions . 5 2.2.4 Method definitions . 5 2.3 Bytecode Locations . 6 2.3.1 Bytecode offsets . 7 2.3.2 Source code indexes . 7 2.3.3 Code locations grammar . 7 2.3.4 AST paths . 9 2.4 Annotations . 15 2.4.1 Annotation definitions . 15 2.4.2 Annotation uses . 15 3 Example 17 4 Types and values 17 5 Alternative formats 19 1 Purpose: External storage of annotations Java annotations are meta-data about Java program elements, as in \@Deprecated class Date f ... g". Ordinarily, Java annotations are written in the source code of a .java Java source file. When javac compiles the source code, it inserts the annotations in the resulting .class file (as \attributes"). Sometimes, it is convenient to specify the annotations outside the source code or the .class file. • When source code is not available, a textual file provides a format for writing and storing annotations that is much easier to read and modify than a .class file. Even if the eventual purpose is to insert the annotations in the .class file, the annotations must be specified in some textual format first. • Even when source code is available, sometimes it should not be changed, yet annotations must be stored somewhere for use by tools.
    [Show full text]
  • Studying Social Tagging and Folksonomy: a Review and Framework
    Studying Social Tagging and Folksonomy: A Review and Framework Item Type Journal Article (On-line/Unpaginated) Authors Trant, Jennifer Citation Studying Social Tagging and Folksonomy: A Review and Framework 2009-01, 10(1) Journal of Digital Information Journal Journal of Digital Information Download date 02/10/2021 03:25:18 Link to Item http://hdl.handle.net/10150/105375 Trant, Jennifer (2009) Studying Social Tagging and Folksonomy: A Review and Framework. Journal of Digital Information 10(1). Studying Social Tagging and Folksonomy: A Review and Framework J. Trant, University of Toronto / Archives & Museum Informatics 158 Lee Ave, Toronto, ON Canada M4E 2P3 jtrant [at] archimuse.com Abstract This paper reviews research into social tagging and folksonomy (as reflected in about 180 sources published through December 2007). Methods of researching the contribution of social tagging and folksonomy are described, and outstanding research questions are presented. This is a new area of research, where theoretical perspectives and relevant research methods are only now being defined. This paper provides a framework for the study of folksonomy, tagging and social tagging systems. Three broad approaches are identified, focusing first, on the folksonomy itself (and the role of tags in indexing and retrieval); secondly, on tagging (and the behaviour of users); and thirdly, on the nature of social tagging systems (as socio-technical frameworks). Keywords: Social tagging, folksonomy, tagging, literature review, research review 1. Introduction User-generated keywords – tags – have been suggested as a lightweight way of enhancing descriptions of on-line information resources, and improving their access through broader indexing. “Social Tagging” refers to the practice of publicly labeling or categorizing resources in a shared, on-line environment.
    [Show full text]
  • Aspectj in Action, Second Edition
    Introducing AspectJ This chapter covers ■ Writing an AspectJ “Hello, world!” application ■ Becoming familiar with the AspectJ language ■ Weaving mechanisms ■ Integrating with Spring In chapter 1, we focused on general concepts in AOP. With those behind us, we can now look at one specific AOP implementation: AspectJ. AspectJ is an aspect- oriented extension to the Java programming language. Like any AOP implementa- tion, AspectJ consists of two parts: the language specification, which defines the grammar and semantics of the language; and the language implementation, which includes weavers that take various forms such as a compiler and a linker. A weaver produces byte code that conforms to the Java byte-code specification, allowing any compliant Java virtual machine (VM) to execute those class files. The language implementation also offers support for integrated development environments (IDEs), to simplify building and debugging applications. AspectJ started and initially grew as a special language that extends the Java lan- guage with new keywords. It also provided a special compiler that could understand those extensions. But recently, a lot has changed in its form as a language, as well as 27 Licensed to Manning Marketing <[email protected]> 28 CHAPTER 2 Introducing AspectJ in the weaver. First, AspectJ offers an alternative syntax based on the Java annotation facil- ity to express crosscutting constructs. This lets you use a plain Java compiler instead of the special compiler. Second, AspectJ offers new options for weaving classes with aspects. Finally, it has gained a strong foothold in the Spring Framework with several integration options. All these changes have made adoption of AspectJ easier than ever before.
    [Show full text]
  • Instructions on the Annotation of Pdf Files
    P-annotatePDF-v11b INSTRUCTIONS ON THE ANNOTATION OF PDF FILES To view, print and annotate your chapter you will need Adobe Reader version 9 (or higher). This program is freely available for a whole series of platforms that include PC, Mac, and UNIX and can be downloaded from http://get.adobe.com/reader/. The exact system requirements are given at the Adobe site: http://www.adobe.com/products/reader/tech-specs.html. Note: if you opt to annotate the file with software other than Adobe Reader then please also highlight the appropriate place in the PDF file. PDF ANNOTATIONS Adobe Reader version 9 Adobe Reader version X and XI When you open the PDF file using Adobe Reader, the To make annotations in the PDF file, open the PDF file using Commenting tool bar should be displayed automatically; if Adobe Reader XI, click on ‘Comment’. not, click on ‘Tools’, select ‘Comment & Markup’, then click If this option is not available in your Adobe Reader menus on ‘Show Comment & Markup tool bar’ (or ‘Show then it is possible that your Adobe Acrobat version is lower Commenting bar’ on the Mac). If these options are not than XI or the PDF has not been prepared properly. available in your Adobe Reader menus then it is possible that your Adobe Acrobat version is lower than 9 or the PDF has not been prepared properly. This opens a task pane and, below that, a list of all (Mac) Comments in the text. PDF ANNOTATIONS (Adobe Reader version 9) The default for the Commenting tool bar is set to ‘off’ in version 9.
    [Show full text]
  • Advanced-Java.Pdf
    Advanced java i Advanced java Advanced java ii Contents 1 How to create and destroy objects 1 1.1 Introduction......................................................1 1.2 Instance Construction.................................................1 1.2.1 Implicit (Generated) Constructor.......................................1 1.2.2 Constructors without Arguments.......................................1 1.2.3 Constructors with Arguments........................................2 1.2.4 Initialization Blocks.............................................2 1.2.5 Construction guarantee............................................3 1.2.6 Visibility...................................................4 1.2.7 Garbage collection..............................................4 1.2.8 Finalizers...................................................5 1.3 Static initialization..................................................5 1.4 Construction Patterns.................................................5 1.4.1 Singleton...................................................6 1.4.2 Utility/Helper Class.............................................7 1.4.3 Factory....................................................7 1.4.4 Dependency Injection............................................8 1.5 Download the Source Code..............................................9 1.6 What’s next......................................................9 2 Using methods common to all objects 10 2.1 Introduction...................................................... 10 2.2 Methods equals and hashCode...........................................
    [Show full text]
  • Inversion of Control in Spring – Using Annotation
    Inversion of Control in Spring – Using Annotation In this chapter, we will configure Spring beans and the Dependency Injection using annotations. Spring provides support for annotation-based container configuration. We will go through bean management using stereotypical annotations and bean scope using annotations. We will then take a look at an annotation called @Required, which allows us to specify which dependencies are actually required. We will also see annotation-based dependency injections and life cycle annotations. We will use the autowired annotation to wire up dependencies in the same way as we did using XML in the previous chapter. You will then learn how to add dependencies by type and by name. We will also use qualifier to narrow down Dependency Injections. We will also understand how to perform Java-based configuration in Spring. We will then try to listen to and publish events in Spring. We will also see how to reference beans using Spring Expression Language (SpEL), invoke methods using SpEL, and use operators with SpEL. We will then discuss regular expressions using SpEL. Spring provides text message and internationalization, which we will learn to implement in our application. Here's a list of the topics covered in this chapter: • Container configuration using annotations • Java-based configuration in Spring • Event handling in Spring • Text message and internationalization [ 1 ] Inversion of Control in Spring – Using Annotation Container configuration using annotation Container configuration using Spring XML sometimes raises the possibility of delays in application development and maintenance due to size and complexity. To solve this issue, the Spring Framework supports container configuration using annotations without the need of a separate XML definition.
    [Show full text]
  • Type Annotations Specification
    Type Annotations Specification (JSR 308) Michael D. Ernst [email protected] May 2, 2013 The JSR 308 webpage is http://types.cs.washington.edu/jsr308/. It contains the latest version of this document, along with other information such as a FAQ, the reference implementation, and sample annotation processors. Contents 1 Introduction 2 2 Java language syntax extensions 2 2.1 Source locations for annotations on types . 2 2.1.1 Implicit type uses are not annotatable . 5 2.1.2 Not all type names are annotatable . 5 2.2 Java language grammar changes . 6 2.2.1 Syntax of array annotations . 8 2.2.2 Syntax of annotations on qualified types . 9 2.3 Target meta-annotations for type annotations . 9 3 Class file format extensions 11 3.1 The type annotation structure . 12 3.2 The target type field: the type of annotated element . 13 3.3 The target info field: identifying a program element . 13 3.3.1 Type parameters . 13 3.3.2 Class supertypes: extends and implements clauses . 14 3.3.3 Type parameter bounds . 14 3.3.4 Method return type, receiver, and fields . 15 3.3.5 Method formal parameters . 15 3.3.6 throws clauses . 15 3.3.7 Local variables and resource variables . 15 3.3.8 Exception parameters (catch clauses) . 16 3.3.9 Type tests, object creation, and method/constructor references . 16 3.3.10 Casts and type arguments to constructor/method invocation/references . 16 3.4 The type path structure: Identifying part of a compound type . 17 A Examples of classfile structure 18 A.1 Examples of type parameter bounds .
    [Show full text]
  • Folksannotation: a Semantic Metadata Tool for Annotating Learning Resources Using Folksonomies and Domain Ontologies
    FolksAnnotation: A Semantic Metadata Tool for Annotating Learning Resources Using Folksonomies and Domain Ontologies Hend S. Al-Khalifa and Hugh C. Davis Learning Technology Research Group, ECS, The University of Southampton, Southampton, UK {hsak04r/hcd}@ecs.soton.ac.uk Abstract Furthermore, web resources stored in social bookmarking services have potential for educational There are many resources on the Web which are use. In order to realize this potential, we need to add suitable for educational purposes. Unfortunately the an extra layer of semantic metadata to the web task of identifying suitable resources for a particular resources stored in social bookmarking services; this educational purpose is difficult as they have not can be done via adding pedagogical values to the web typically been annotated with educational metadata. resources so that they can be used in an educational However, many resources have now been annotated in context. an unstructured manner within contemporary social In this paper, we will focus on how to benefit from 2 bookmaking services. This paper describes a novel tool social bookmarking services (in particular del.icio.us ), called ‘FolksAnnotation’ that creates annotations with as vehicles to share and add semantic metadata to educational semantics from the del.icio.us bookmarked resources. Thus, the research question we bookmarking service, guided by appropriate domain are tackling is: how folksonomies can support the ontologies. semantic annotation of web resources from an educational perspective ? 1. Introduction The organization of the paper is as follows: Section 2 introduces folksonomies and social bookmarking Metadata standards such as Dublin Core (DC) and services. In section 3, we review some recent research IEEE-LOM 1 have been widely used in e-learning on folksonomies and social bookmarking services.
    [Show full text]
  • Supporting Source Code Annotations with Metadata-Aware Development Environment
    Proceedings of the Federated Conference on DOI: 10.15439/2019F161 Computer Science and Information Systems pp. 411–420 ISSN 2300-5963 ACSIS, Vol. 18 Supporting Source Code Annotations with Metadata-Aware Development Environment Ján Juhár Department of Computers and Informatics Technical University of Košice Letná 9, 042 00 Košice, Slovakia Email: [email protected] Abstract—To augment source code with high-level metadata Recovering approaches use intrinsic metadata, which either with the intent to facilitate program comprehension, a program- define source code elements themselves or can be derived from mer can use annotations. There are several types of annotations: these elements. In contrast to them, preserving approaches either those put directly in the code or external ones. Each type comes with a unique workflow and inherent limitations. focus on extrinsic metadata, which complement the intrinsic In this paper, we present a tool providing uniform annotation ones by adding custom, high-level details explicitly recorded process, which also adds custom metadata-awareness for an by programmers. On one side, the more accurate preserved industrial IDE. We also report an experiment in which we sought knowledge may help to bridge the abstraction gap better than whether the created annotating support helps programmers to the lower-level recovered one. On the other side, recording annotate code with comments faster and more consistently. The experiment showed that with the tool the annotating consistency programmer’s mental model of the code brings in an additional was significantly higher but also that the increase in annotating cost: the programmer must spend extra time to record it.
    [Show full text]
  • User Needs/Requirements: Social Reading/Text Annotation
    NYU-UAG User Needs/Requirements: Social Reading/Text Annotation Immediate Needs ● Text-specific annotations (with ability to color-code or otherwise mark the author of the annotation) in following forms: ○ Text, including rich-text editor and to use mathematical notation (minimally, for underline, bold, italics; ideally, for embed of images, video, footnotes, etc.) ○ Link ○ Audio response/voiceover (both simultaneous narration and video stopped while comment plays) ○ Comment on annotations ● Collaborative Annotation/Social Reading ○ Ability to designate members who can see/post/share annotations ○ Ability to create private sub-groups ○ Ability for all sub-group members to post annotations (with annotations that can be set either to be visible only to sub-group members or beyond the sub-group) ○ Ability for a group member to post queries (annotations that ask for additional information/response from the group), with optional notification to other group members ○ Ability to thread responses and to easily open all responses in a thread at once ○ Ability for instructor to save annotations for future use (with student permission; option to anonymize) ○ Option to anonymize comments to students but reveal author to instructor ● Markers to show where annotations are placed ● Optional time-stamps on annotations ● Option to set deadline for submission of comments; ability to grade comments and send grade to gradebook; ability, when appropriate, to machine-grade annotations ● Annotation overlay on major document formats (pdf, google docs, Word) and
    [Show full text]
  • Java Class Annotation Example
    Java Class Annotation Example Bud etherealizing her matriarch inimitably, unwavering and decayed. Antimonious and regulation Rog violated almost anywhere, though Saunderson tosses his Creon outdating. Which Roland disinhuming so ordinarily that Westleigh tooth her opposites? It is class to classes are pretty easy to reflection to list to catch, company or property to generate mock for? First method of java example. The java are given list of bibliography. Default annotations example, java code examples of the compiler to be applied to json. The new project for extracting information to create web sites without editions but i go into the annotated bibliography paper, we welcome to isolate the mechanics of using. Parsing the examples can be used from open source and. We will utilize the class analyzes the same type declaration etc at runtime reflection methods or evaluative lists the suite itself which are. Nice explanation about the front controller, we added and then issues a class of the information, management example demonstrates how can be executed and. There are working standalone spring boot application into system proposed here, because of annotations. Its annotations example annotation examples java. Hibernate does not to class or specify java example of fundamental never hurt or not. Read from java class acts as each article has been designed with examples select then we learned about? We made as classes that class or examples of annotation example classes or an earlier article example it tells spring. The table pointing back to interface. From java example is applied only contains a second argument. Junit provides a test cases, we want specific warnings and ideas into our newsletter for an understanding takt time in.
    [Show full text]
  • Wandaml a Markup Language for Digital Document Annotation
    WandaML a markup language for digital document annotation Katrin Franke2, Isabelle Guyon1, Lambert Schomaker3, and Louis Vuurpijl4 1. ClopiNet, 955 Creston Rd, Berkeley, USA, [email protected] (corresponding author.) 2. Fraunhofer Institute, Berlin, Germany. 3. Rijksuniversiteit Groningen, The Netherlands. 4. University of Nijmegen, The Netherlands. Abstract WandaML is an XML-based markup language for the annotation and filter jour- naling of digital documents. It addresses in particular the needs of forensic handwriting data examination, by allowing experts to enter information about writer, material (pen, paper), script and content, and to record chains of image filtering and feature extrac- tion operations applied to the data. We present the design of this format and some annotation examples, in the more general perspective of digital document annotation. Annotations may be organized in a structure that reflects the document layout via a hierarchy of document regions. WandaML can lend itself to a variety of applications, including the annotation all kinds of handwriting documents (on-line or off-line), im- ages of printed text, medical images, and satellite images. Keywords: Handwriting, forensic data, XML, annotations, data format, document analysis. 1 Introduction We present the design of an XML-based markup language to annotate digital documents, called WandaML . This markup language is designed for processing, analyzing and storing handwriting samples in application to forensic handwriting examination and writer iden- tification. In the context of this application, particular specifications were met to ensure objectivity and reproducibility of the processing steps and examination results [6, 5]. Writer identification can never be as accurate as iris or DNA-based identification.
    [Show full text]