Course "Empirical Software Engineering"

Metadata inference

University of Koblenz-Landau Department of Computer Science Ralf Lämmel Software Languages Team

Languages

Your arbitrary Technologies program Concepts

Features https://commons.wikimedia.org/wiki/File:Prism-rainbow.svg

How to automatically detect ... perhaps speciﬁcally used software languages, in the context of the 101companies project used software technologies, relevant software concepts, implemented system features?

© 2013 101companies and Ralf Lämmel 4 Sesame XPATH TXL What’sJPA the problem? Jena Rose JDBC EMF.gen XText jDOM JAXB Jersey RDF(S) Jena UTF8 ODM MOF XSD JeanBeans Teneo UML VLDB Stratego BNF xerces Too GWTmany SLE2010languages.Json OCL sax RDFS saxon OWL OWL Ecore Rest Too many technologies. MySQL ORACLE RDF Jean OMG XMI JMI JMF EMF XSD ArgoUML xalan RDFa ODBC SparQLTooXMLSpy manyYacc concepts. LALR Prolog XSLT JAXP Protegé SBVR DOM Java ATOM ER CFG Too little time. SQL DDL Dragan SQL Antlr QVT TENEO XLST Awk DTD sed Saxon TCS grep ASCII XSD Hibernate XQuery

New 101contributions with unforeseen technologies and concepts and new ways of implementing features. Different platforms and repositories: Apache, .NET Framework, gem, Maven repository, hackageDB, ... Lack of an established ontology: sets of tags or categories used by the different platforms and repositories. Overall: scalability, generality

© 2013 101companies and Ralf Lämmel 8 What’s a software chrestomathy? • Quick deﬁnition ‣ A collection of software systems (‘programs’) ✦ designed as an aid in learning a CS subject ✦ exercising diverse languages & technologies • Examples (more or less) ‣ 99 Bottles of Beer ‣ Rosetta Code ‣ HollingBerries ‣ 101companies

Company X: Swing + JDBC

Company Y: SWT + Hibernate

Company Z: GWT + MongoDB

• Java • JSON • Text • WSDL • C# • Ecore • Markdown • Rascal • VB.NET • PHP • Prolog • Javascript • Python • PHP4 • F# • 101meta • XML • PHP5 • Perl • Ruby • GIF • SQL • CSS • C++ • Haskell • .sh • XMI • Cobol • XHTML • PNG • AspectJ • (make) • .properties • ATL • Smalltalk • (Ant) • .ini • XSD • JAR • ... • HTML • Scala • Erlang © 2013 101companies and Ralf Lämmel “101” covers many technologies

• make • Eclipse • SOA • Java RMI • Ant • Hibernate • JPA • JDBC • Maven • Java collections • EMFCompare • zip • sbt • VS • 101explorer • jEdit • JAXB • java.util • Mediawiki • jdom • xjc • java.io • hackage • w3c.dom • EF • java.lang.reﬂect • cabal • dom4j • xsd.exe • LINQ • ghci • xom • XmlSerializer • System.Xml • ghc • SAX • ANTLR • System.Xml.Linq • Swing • ... • javac • ADO • AWT

• Check condition on ﬁles • Associate metadata with ﬁles or fragments ‣ Languages “Metadata ‣ Technologies inference” ‣ Concepts ‣ Tools for validation, fragment selection, ...

When is a ﬁle ... • ... the ANTLR library? • ... an ANTLR grammar? • ... an ANTLR-generated parser? • ... a source that imports ANTLR? (See more rules online.)

© 2013 101companies and Ralf Lämmel www.antlr.orghttp:// What’s ANTLR? company : 'company' STRING '{' department* '}' EOF; department : 'department' STRING '{' ('manager' employee) ('employee' employee)* department* ANTLR style '}'; grammar for employee : companies STRING '{' 'address' STRING 'salary' FLOAT '}'; Grammars were hot in the 70ies? You are so wrong!

[−] ANTLR theme ANTLR-centric grammarware theme yapg A ANTLR-based generator for text-to-object mappings antlrAcceptor An ANTLR-based acceptor for textual syntax antlrLexer Lexer-based processing with ANTLR antlrObjects Object/Text mapping for Java with ANTLR for parsing antlrParser Processing textual syntax with semantic actions of ANTLR antlrTrees Parsing text to trees and walk them with ANTLR gra2mol Grammar to model transformation with Grammar2Model xtext An XText- and Eclipse-based DSL editor

“Condition” of the rule { "basename" : "#^antlr-(.*)\\.jar$#", "metadata" : { "partOf" : "ANTLR", Expressed relationship "comment" : "The ANTLR library, Version $1" } } Assigned metadata

“Condition” of the rule { "sufx" : ".g", Expressed relationship "metadata" : { "inputOf" : "ANTLR", "comment" : "An ANTLR grammar" } } Assigned metadata

© 2013 101companies and Ralf Lämmel A 101meta rule to ﬁnd a generated parser { "basename" : "#^.*Parser\\.java$#", "content" : "// \\$ANTLR.*\\.g", "metadata" : [ { Condition on text of ﬁle "outputOf" : "ANTLR", "comment" : "An ANTLR-generated parser" }, { "concept" : "Parser" } Metadata for software concept ] }

{ Programmatic condition "sufx" : ".java", "predicate" : "technologies/Java_platform/javaImport.sh", "args" : [ "org.antlr.runtime" ], Java package to "metadata" : { be tested for "dependsOn" : "ANTLR", "comment" : "A source that imports ANTLR" } }

• Metadata declaration with rules, as demonstrated • Metadata assignment with a rule engine • Metadata exploration with a browser (as seen in second)

101worker continuously walks over 101repo to construct data for ﬁles matches 101meta rules. In fact, each ﬁle is associated with such matches.

http://data.101companies.org/resources/contributions/antlrObjects/org/softlang/parser/ CompanyParser.java.summary.json

Disclaimer: This is not even beta.