Deterministic Finite Automata with Recursive Calls and Dpdas

Total Page:16

File Type:pdf, Size:1020Kb

Deterministic Finite Automata with Recursive Calls and Dpdas Information Processing Letters 87 (2003) 187–193 www.elsevier.com/locate/ipl Deterministic finite automata with recursive calls and DPDAs ✩ Jean H. Gallier a, Salvatore La Torre b,∗, Supratik Mukhopadhyay c a University of Pennsylvania, Philadelphia, PA 19104, USA b Università degli Studi di Salerno, Dipartimento di Informatica ed Applicazioni, Via S. Allende, Baronissi (SA) 84081, Italy c West Virginia University, Morgantown, WV 26506, USA Received 4 December 2002; received in revised form 6 March 2003 Communicated by H. Ganzinger Abstract We study deterministic finite automata (DFA) with recursive calls, that is, finite sequences of component DFAs that can call each other recursively. DFAs with recursive calls are akin to recursive state machines and unrestricted hierarchic state machines. We show that they are language equivalent to deterministic pushdown automata (DPDA). 2003 Elsevier B.V. All rights reserved. Keywords: Formal Languages 1. Introduction spond to system transitions. To describe complex sys- tems using finite automata, several extensions are use- Finite automata are a very intuitive and widely ful. studied formalism. They are a natural framework for In this paper, we study an extension of the concept modeling and studying finite state systems. Descrip- of a DFA by allowing certain transitions to be “calls” tions using automata are useful to represent the con- to other DFAs. The automata we define are similar trol flow of a computer program, and in general the to restricted types of augmented transition networks behavior of a digital system. This makes them suit- (ATN) used in natural language processing [18], and to able for formal analysis via well-founded technolo- other hierarchic state machine models that have been gies, such as model checking. In the simplest setting, proposed in different contexts where the need for a a finite automaton consists of a labeled graph whose nesting capability is either natural or convenient. Such vertices correspond to system states and edges corre- machines have been studied in the context of inter- procedural dataflow analysis. They can model control- ✩ This research was partially supported by the supported by the flow graphs of procedures in programming languages MIUR in the framework of the project “Metodi Formali per la such as C. Our model is also related to the strict deter- Sicurezza” (MEFISTO) and MIUR grant 60% 2002. ministic grammars of Harrison and Havel [11]. In [12] * Corresponding author. a class of nondeterministic finite automata with recur- E-mail addresses: [email protected] (J.H. Gallier), [email protected] (S. La Torre), [email protected] sive calls is proved to correspond to the unambiguous (S. Mukhopadhyay). context-free languages. In the design and verification 0020-0190/$ – see front matter 2003 Elsevier B.V. All rights reserved. doi:10.1016/S0020-0190(03)00281-3 188 J.H. Gallier et al. / Information Processing Letters 87 (2003) 187–193 of large systems the use of hierarchic paradigms has guess whether the current symbol is the last symbol of been advocated by many authors both to have succinct w or not, and only in the second case, a recursive call descriptions and exploit modularity [9,4,1]. Recent re- is made after this symbol is read. sults have been concerned with the verification of re- The equivalence problem for deterministic push- cursive finite state machines [3,2]. down automata has been recently shown to be decid- Here, we are interested in recursive (deterministic) able [15]. Another proof of this result can be found finite state machines from a formal languages theo- in [17]. Besides the importance of such a result the retic perspective. It is well known that (determinis- DPDA equivalence problem has a number of impor- tic) finite automata define exactly the class of regu- tant implications which have been discussed in [16]. lar languages. Our aim is to extend this class of au- By our results, we derive from the decidability of the tomata to capture the deterministic context-free lan- DPDA equivalence problem also the decidability of guages. We define a DFA with recursive calls as the equivalence problem for DFAs with recursive calls. a finite sequence of component DFAs that can call If we see the DFAs with recursive calls as recursive each other recursively. There are three kinds of tran- program schemes, we have also that a certain kind of sitions: ordinary transitions, calls and returns (from strong equivalence is decidable (we might call it “flow calls). A call corresponds to entering another compo- equivalence”). nent DFA, and a return to exiting it. The main lim- Unwinding the recursion in a DFA with recursive itation we place on the model is that if from a state calls we obtain a deterministic automaton whose tran- q there is a call to a DFA then this is the only tran- sition graph is an infinite graph (infinite automaton). sition from q. This restriction is needed to preserve It is possible to prove that this infinite automaton is the determinism of the model. For any call we allow the “initial fixpoint” (in the sense of Lehmann [13]) multiple return points, i.e., multiple exits in the com- of a “substitution functor” induced by the set of DFAs ponent DFAs. with recursive calls. In fact, such automaton turns out The main result of this paper is that the class to be the colimit of a sequence of finite approximating of DFAs with recursive calls defines exactly the DFAs. class of deterministic context-free languages. To prove The rest of the paper is organized as follows. that this class of automata accepts only deterministic In Section 2 we introduce the model and recall the context-free languages, we use the atomic normal main definitions. In Section 3 we prove that DFAs form of deterministic pushdown automata given in [8]. with recursive calls characterize exactly the class of The completeness result, that is, each deterministic deterministic context-free languages. We conclude in context-free language has an equivalent DFA with Section 4 with further remarks. recursive calls accepting it, is shown by translating an infinite tree of a recursion scheme to a DFA with recursive calls and using the fact that such trees can 2. The model be used to characterize the class of deterministic context-free languages [8]. It is worth noticing that if In this section we introduce the notion of determin- in our model we allow nondeterminism on ordinary istic finite automata with recursive calls. transitions (i.e., transitions that are neither calls nor Let Σ be a finite alphabet and let Φ ={F1,...,FN } returns), also nondeterministic context-free languages be a set of function symbols, each having arity r(Fi) can be accepted. For example, consider the language 0. Let M = max{r(Fi) | 1 i N} and let [1,M] L ={wwR | w ∈ Σ},whereΣ is an alphabet. We can denote the set {1,...,M} (with [1, 0]=∅). The define an automaton with deterministic recursive calls symbols of Φ will be called nonterminals, while the that accepts L, as follows. The automaton consists of a symbol in Σ will be called terminals. The elements of single component that can call itself recursively. Calls Φ can be considered as procedure names. are used to push symbols onto the stack and returns to A deterministic finite automaton with recursive pop symbols from the stack. The top of the stack can calls is a set of component DFAs that can call each be stored in the state of the current activation of the other recursively. Calls and returns are modeled as component. Thus, nondeterminism is needed only to special transitions that do not read input symbols. J.H. Gallier et al. / Information Processing Letters 87 (2003) 187–193 189 Moreover, if from a state q there exists a call transition • δ : Q × Σ ∪ Φ ∪[1,M]→Q is a partial function then this is the only transition leaving from q.Ifp called the transition function and satisfies the is the state reached after a call, it can have only an following conditions: entering transition, and the transitions exiting p are (1) For every p ∈ Q and Fj ∈ Φ,ifq = δ(p,Fj ) exactly the returns from this call and each of them is defined, then δ(p,α) is not defined for any corresponds to an exit of the called component. There other α ∈ Σ ∪ Φ ∪[1,M],thatis,δ(p,Fj ) is exists a one-to-one correspondence between the exits the only transition defined from p. of a called component and the returns of the calling (2) If δ(p,Fj ) = q then δ(q,k) is defined only component. For any call we allow multiple return for k such that 1 k r(Fj ),andδ(q,α) is points, i.e., multiple exits in the component DFAs. not defined for any α ∈ Σ ∪ Φ. Formally, a deterministic finite automaton with re- (3) If defined, δ(p,Fj ) is not a final state and has cursive calls consists of a finite sequence D = F ⇐ 1 no other incoming edges. D ,...,F ⇐ D of DFA definitions, where D 1 N N i Furthermore, the entry state in has no incoming is a DFA which can issue calls F ,...,F respec- 1 N transitions, every state in dom(OUT) has no out- tively to any of the component DFAs D1,...,DN . going transitions and every state lies on a path The first definition F1 ⇐ D1 is considered to be the from in to some exit state. “main definition”. Given an Fi ∈ Φ, a DFA definition Fi ⇐ Di for Fi of arity m is a 6-tuple Q, Σ ∪ Φ ∪ [1,M],δ,in, OUT, FINAL where: As an example of a DFA with recursive calls, consider the automaton D given by the tuple of ⇐ ⇐ ⇐ • Q is a finite set of states.
Recommended publications
  • Practical Experiments with Regular Approximation of Context-Free Languages
    Practical Experiments with Regular Approximation of Context-Free Languages Mark-Jan Nederhof German Research Center for Arti®cial Intelligence Several methods are discussed that construct a ®nite automaton given a context-free grammar, including both methods that lead to subsets and those that lead to supersets of the original context-free language. Some of these methods of regular approximation are new, and some others are presented here in a more re®ned form with respect to existing literature. Practical experiments with the different methods of regular approximation are performed for spoken-language input: hypotheses from a speech recognizer are ®ltered through a ®nite automaton. 1. Introduction Several methods of regular approximation of context-free languages have been pro- posed in the literature. For some, the regular language is a superset of the context-free language, and for others it is a subset. We have implemented a large number of meth- ods, and where necessary, re®ned them with an analysis of the grammar. We also propose a number of new methods. The analysis of the grammar is based on a suf®cient condition for context-free grammars to generate regular languages. For an arbitrary grammar, this analysis iden- ti®es sets of rules that need to be processed in a special way in order to obtain a regular language. The nature of this processing differs for the respective approximation meth- ods. For other parts of the grammar, no special treatment is needed and the grammar rules are translated to the states and transitions of a ®nite automaton without affecting the language.
    [Show full text]
  • CIT 425- AUTOMATA THEORY, COMPUTABILITY and FORMAL LANGUAGES LECTURE NOTE by DR. OYELAMI M. O. Introduction • This Course Cons
    CIT 425- AUTOMATA THEORY, COMPUTABILITY AND FORMAL LANGUAGES LECTURE NOTE BY DR. OYELAMI M. O. Status: Core Description: Words and String. Concatenation, word Length; Language Definition. Regular Expression, Regular Language, Recursive Languages; Finite State Automata (FSA), State Diagrams; Pumping Lemma, Grammars, Applications in Computer Science and Engineering, Compiler Specification and Design, Text Editor and Implementation, Very Large Scale Integrated (VLSI) Circuit Specification and Design, Natural Language Processing (NLP) and Embedded Systems. Introduction This course constitutes the theoretical foundation of computer science. Loosely speaking we can think of automata, grammars, and computability as the study of what can be done by computers in principle, while complexity addresses what can be done in practice. This course has applications in the following areas: o Digital design, o Programming languages o Compilers construction Languages Dictionaries define the term informally as a system suitable for the expression of certain ideas, facts, or concepts, including a set of symbols and rules for their manipulation. While this gives us an intuitive idea of what a language is, it is not sufficient as a definition for the study of formal languages. We need a precise definition for the term. A formal language is an abstraction of the general characteristics of programming languages. Languages can be specified in various ways. One way is to list all the words in the language. Another is to give some criteria that a word must satisfy to be in the language. Another important way is to specify a language through the use of some terminologies: 1 Alphabet: A finite, nonempty set Σ of symbols.
    [Show full text]
  • Theory of Computation
    Theory of Computation Todd Gaugler December 14, 2011 2 Contents 1 Mathematical Background 5 1.1 Overview . .5 1.2 Number System . .5 1.3 Functions . .6 1.4 Relations . .6 1.5 Recursive Definitions . .8 1.6 Mathematical Induction . .9 2 Languages and Context-Free Grammars 11 2.1 Languages . 11 2.2 Counting the Rational Numbers . 13 2.3 Grammars . 14 2.4 Regular Grammar . 15 3 Normal Forms and Finite Automata 17 3.1 Review of Grammars . 17 3.2 Normal Forms . 18 3.3 Machines . 20 3.3.1 An NFA λ ..................................... 22 4 Regular Languages 23 4.1 Computation . 24 4.2 The Extended Transition Function . 24 4.3 Algorithms . 26 4.3.1 Removing Non-Determinism . 26 4.3.2 State Minimization . 26 4.3.3 Expression Graph . 26 4.4 The Relationship between a Regular Grammar and the Finite Automaton . 26 4.4.1 Building an NFA corresponding to a Regular Grammar . 27 4.4.2 Closure . 27 4.5 Review for the First Exam . 28 4.6 The Pumping Lemma . 28 5 Pushdown Automata and Context-Free Languages 31 5.1 Pushdown Automata . 31 5.2 Variations on the PDA Theme . 34 5.3 Acceptance of Context-Free Languages . 36 3 CONTENTS CONTENTS 5.4 The Pumping Lemma for Context-Free Languages . 36 5.5 Closure Properties of Context- Free Languages . 37 6 Turing Machines 39 6.1 The Standard Turing Machine . 39 6.2 Turing Machines as Language Acceptors . 40 6.3 Alternative Acceptance Criteria . 41 6.4 Multitrack Machines . 42 6.5 Two-Way Tape Machines .
    [Show full text]
  • On the Complexity of Regular-Grammars with Integer Attributes ∗ M
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by Elsevier - Publisher Connector Journal of Computer and System Sciences 77 (2011) 393–421 Contents lists available at ScienceDirect Journal of Computer and System Sciences www.elsevier.com/locate/jcss On the complexity of regular-grammars with integer attributes ∗ M. Manna a, F. Scarcello b,N.Leonea, a Department of Mathematics, University of Calabria, 87036 Rende (CS), Italy b Department of Electronics, Computer Science and Systems, University of Calabria, 87036 Rende (CS), Italy article info abstract Article history: Regular grammars with attributes overcome some limitations of classical regular grammars, Received 21 August 2009 sensibly enhancing their expressiveness. However, the addition of attributes increases the Received in revised form 17 May 2010 complexity of this formalism leading to intractability in the general case. In this paper, Available online 27 May 2010 we consider regular grammars with attributes ranging over integers, providing an in-depth complexity analysis. We identify relevant fragments of tractable attribute grammars, where Keywords: Attribute grammars complexity and expressiveness are well balanced. In particular, we study the complexity of Computational complexity the classical problem of deciding whether a string belongs to the language generated by Models of computation any attribute grammar from a given class C (call it parse[C]). We consider deterministic and ambiguous regular grammars, attributes specified by arithmetic expressions over {| |, +, −, ÷, %, ∗}, and a possible restriction on the attributes composition (that we call strict composition). Deterministic regular grammars with attributes computed by arithmetic expressions over {| |, +, −, ÷, %} are P-complete. If the way to compose expressions is strict, they can be parsed in L, and they remain tractable even if multiplication is allowed.
    [Show full text]
  • Computation of Infix Probabilities for Probabilistic Context-Free Grammars
    View metadata, citation and similar papers at core.ac.uk brought to you by CORE provided by St Andrews Research Repository Computation of Infix Probabilities for Probabilistic Context-Free Grammars Mark-Jan Nederhof Giorgio Satta School of Computer Science Dept. of Information Engineering University of St Andrews University of Padua United Kingdom Italy [email protected] [email protected] Abstract or part-of-speech, when a prefix of the input has al- ready been processed, as discussed by Jelinek and The notion of infix probability has been intro- Lafferty (1991). Such distributions are useful for duced in the literature as a generalization of speech recognition, where the result of the acous- the notion of prefix (or initial substring) prob- tic processor is represented as a lattice, and local ability, motivated by applications in speech recognition and word error correction. For the choices must be made for a next transition. In ad- case where a probabilistic context-free gram- dition, distributions for the next word are also useful mar is used as language model, methods for for applications of word error correction, when one the computation of infix probabilities have is processing ‘noisy’ text and the parser recognizes been presented in the literature, based on vari- an error that must be recovered by operations of in- ous simplifying assumptions. Here we present sertion, replacement or deletion. a solution that applies to the problem in its full generality. Motivated by the above applications, the problem of the computation of infix probabilities for PCFGs has been introduced in the literature as a generaliza- 1 Introduction tion of the prefix probability problem.
    [Show full text]
  • 1 Finite Automata and Regular Languages
    Aalto University Department of Computer Science CS-C2150 Theoretical Computer Science Solved Example Problems, Spring 2020 1 Finite Automata and Regular Languages 1. Problem: Describe the following languages both in terms of regular expressions and in terms of deterministic finite automata: (a) fw 2 f0; 1g∗ j w contains 101 as a substringg, (b) fw 2 f0; 1g∗ j w does not contain 101 as a substringg. Solution: (a) A regular expression for this language is easy to construct: (0j1)∗101(0j1)∗: A nondeterministic finite automaton is also easy to come up with: 0; 1 0; 1 1 0 1 start q0 q1 q2 q3 Let us then determinise this using the subset construction: 0 1 ! fq0g fq0g fq0; q1g fq0; q1g fq0; q2g fq0; q1g fq0; q2g fq0g fq0; q1; q3g f:::; q3g f:::; q3g f:::; q3g The last row of the table has been simplified based on the observation that from a set containing the accepting state q3, one always moves again to some set con- taining q3, and so all such states are equivalent. Thus, we obtain the following deterministic automaton: 1 0; 1 0 1 0 1 start fq0g fq0; q1g fq0; q2g f:::; q3g 0 (b) Observe that the language here is the complement of the language in part (a), and the DFA provided in part (a) is complete, i.e. all possible transitions are explicitly listed. Therefore, complementing the DFA from part (a) yields a DFA for this language: 0 1 0; 1 1 0 1 start q0 q1 q2 q3 0 All accepting states are inaccessible from state q3, thus we may ignore it.
    [Show full text]
  • Problem Book
    Faculty of Mathematics, Informatics and Mechanics, UW Computational Complexity Problem book Spring 2011 Coordinator Damian Niwiński Contributors: Contents 1 Turing Machines 5 1.1 Machines in general.........................................5 1.2 Coding objects as words and problems as languages.......................5 1.3 Turing machines as computation models..............................5 1.4 Turing machines — basic complexity................................7 1.5 One-tape Turing machines......................................7 1.6 Decidability and undecidability...................................7 2 Circuits 9 2.1 Circuit basics.............................................9 2.2 More on the parity function..................................... 11 2.3 Circuit depth and communication complexity........................... 12 2.4 Machines with advice......................................... 12 2.4.1 P-selective problems..................................... 13 3 Basic complexity classes 15 3.1 Polynomial time........................................... 15 3.2 Logarithmic space.......................................... 17 3.3 Alternation.............................................. 18 3.4 Numbers................................................ 19 3.5 PSPACE................................................ 20 3.6 NP................................................... 21 3.7 BPP.................................................. 21 3.8 Diverse................................................ 22 3 4 Chapter 1 Turing Machines Contributed: Vince Bárány,
    [Show full text]
  • Formal Languages and Automata Theory
    5Th Semester(COMPUTER SCIENCE AND ENGG .GCEKJR) Formal Languages and Automata Theory. Introduction -:Automata theory is a study of abstract machine , automat and a theoretical way solve computational problem using this abstract machine .It is the theoretical computer science .The word automata plural of automaton comes from Greek word ...which means “self making”. This automaton consists of states (represented in the figure by circles) and transitions (represented by arrows). As the automaton sees a symbol of input, it makes a transition (or jump) to another state, according to its transition function , which takes the current state and the recent symbol as its inputs. Automata theory is closely related to formal language theory. A formal language consist of word whose latter are taken from an alphabet and are well formed according to specific set of rule . so we can say An automaton is a finite representation of a formal language that may be an infinite set. Automata are often classified by the class of formal languages they can recognize, typically illustrated by the CHOMSKY HIERARCHY which describes the relations between various languages and kinds of formalized logics. Following are the few automata over formal language. Automaton Recognizable Language. Nondetermistic /Deterministic Finate Regular language. state Machine(FSM) Deterministic push down Deterministic context free language. automaton(DPDA) Pushdown automaton(PDA) Context_free language. Linear bounded automata(LBA) Context _sensitive language. Turing machine Recursively enumerable language. Why Study of automata theory is important? Because Automata play a major role in theory of computation, compiler construction, artificial intelligence , parsing and formal verification. Alphabets, Strings and Languages; Automata and Grammars-: Symbols and Alphabet: Symbol-: is an abstract user defined entity for example if we say pi(π) its value is 1.414.
    [Show full text]
  • Learning Finite-State Machines: Algorithmic and Statistical Aspects
    Learning Finite-State Machines Statistical and Algorithmic Aspects Borja de Balle Pigem Thesis Supervisors: Jorge Castro and Ricard Gavald`a Department of Software | PhD in Computing Thesis submitted to obtain the qualification of Doctor from the Universitat Polit`ecnicade Catalunya Copyright © 2013 by Borja de Balle Pigem This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by-nc-sa/3.0/. Abstract The present thesis addresses several machine learning problems on generative and predictive models on sequential data. All the models considered have in common that they can be defined in terms of finite-state machines. On one line of work we study algorithms for learning the probabilistic analog of Deterministic Finite Automata (DFA). This provides a fairly expressive generative model for sequences with very interesting algorithmic properties. State-merging algorithms for learning these models can be interpreted as a divisive clustering scheme where the \dependency graph" between clusters is not necessarily a tree. We characterize these algorithms in terms of statistical queries and a use this charac- terization for proving a lower bound with an explicit dependency on the distinguishability of the target machine. In a more realistic setting, we give an adaptive state-merging algorithm satisfying the strin- gent algorithmic constraints of the data streams computing paradigm. Our algorithms come with strict PAC learning guarantees. At the heart of state-merging algorithms lies a statistical test for distribu- tion similarity. In the streaming version this is replaced with a bootstrap-based test which yields faster convergence in many situations.
    [Show full text]
  • 13.2 Finite-State Machines with Output
    Discrete Mathematics Rosen and Its Applications Kenneth H. Rosen The Leading Text in Discrete Mathematics The seventh edition of Kenneth Rosen’s Discrete Mathematics and Its Applications is a substantial revision of the most widely used textbook in its field. This new edition refl ects extensive feedback from instructors, students, and more than 50 reviewers. It also reflects the insights of the author based on his experience in industry and academia. SEVENTH Key benefi ts of this edition are: EDITION and Its and Discrete Mathematics Applications MD DALIM 1145224 05/14/11 Discrete Mathematics CYAN and Its MAG Applications YELO BLACK SEVENTH EDITION TM P1: 1/1 P2: 1/2 QC: 1/1 T1: 2 FRONT-7T Rosen-2311T MHIA017-Rosen-v5.cls May 13, 2011 10:21 Discrete Mathematics and Its Applications Seventh Edition Kenneth H. Rosen Monmouth University (and formerly AT&T Laboratories) i P1: 1/1 P2: 1/2 QC: 1/1 T1: 2 FRONT-7T Rosen-2311T MHIA017-Rosen-v5.cls May 13, 2011 10:21 DISCRETE MATHEMATICS AND ITS APPLICATIONS, SEVENTH EDITION Published by McGraw-Hill, a business unit of The McGraw-Hill Companies, Inc., 1221 Avenue of the Americas, New York, NY 10020. Copyright © 2012 by The McGraw-Hill Companies, Inc. All rights reserved. Previous editions © 2007, 2003, and 1999. No part of this publication may be reproduced or distributed in any form or by any means, or stored in a database or retrieval system, without the prior written consent of The McGraw-Hill Companies, Inc., including, but not limited to, in any network or other electronic storage or transmission, or broadcast for distance learning.
    [Show full text]
  • Automata Theory
    Automata Theory About this Tutorial Automata Theory is a branch of computer science that deals with designing abstract self- propelled computing devices that follow a predetermined sequence of operations automatically. An automaton with a finite number of states is called a Finite Automaton. This is a brief and concise tutorial that introduces the fundamental concepts of Finite Automata, Regular Languages, and Pushdown Automata before moving onto Turing machines and Decidability. Audience This tutorial has been prepared for students pursuing a degree in any information technology or computer science related field. It attempts to help students grasp the essential concepts involved in automata theory. Prerequisites This tutorial has a good balance between theory and mathematical rigor. The readers are expected to have a basic understanding of discrete mathematical structures. Copyright & Disclaimer Copyright 2016 by Tutorials Point (I) Pvt. Ltd. All the content and graphics published in this e-book are the property of Tutorials Point (I) Pvt. Ltd. The user of this e-book is prohibited to reuse, retain, copy, distribute or republish any contents or a part of contents of this e-book in any manner without written consent of the publisher. We strive to update the contents of our website and tutorials as timely and as precisely as possible, however, the contents may contain inaccuracies or errors. Tutorials Point (I) Pvt. Ltd. provides no guarantee regarding the accuracy, timeliness or completeness of our website or its contents including this tutorial. If you discover any errors on our website or in this tutorial, please notify us at [email protected] i Automata Theory Table of Contents About this Tutorial ...........................................................................................................................................
    [Show full text]
  • Generalizing Input-Driven Languages: Theoretical and Practical Benefits
    Generalizing input-driven languages: theoretical and practical benefits Dino Mandrioli1, Matteo Pradella1,2 1 DEIB – Politecnico di Milano, via Ponzio 34/5, Milano, Italy 2 IEIIT – Consiglio Nazionale delle Ricerche, via Golgi 42, Milano, Italy {dino.mandrioli, matteo.pradella}@polimi.it Abstract. Regular languages (RL) are the simplest family in Chomsky’s hierar- chy. Thanks to their simplicity they enjoy various nice algebraic and logic prop- erties that have been successfully exploited in many application fields. Practically all of their related problems are decidable, so that they support automatic verifi- cation algorithms. Also, they can be recognized in real-time. Context-free languages (CFL) are another major family well-suited to formalize programming, natural, and many other classes of languages; their increased gen- erative power w.r.t. RL, however, causes the loss of several closure properties and of the decidability of important problems; furthermore they need complex pars- ing algorithms. Thus, various subclasses thereof have been defined with different goals, spanning from efficient, deterministic parsing to closure properties, logic characterization and automatic verification techniques. Among CFL subclasses, so-called structured ones, i.e., those where the typical tree-structure is visible in the sentences, exhibit many of the algebraic and logic properties of RL, whereas deterministic CFL have been thoroughly exploited in compiler construction and other application fields. After surveying and comparing the main properties of those various language families, we go back to operator precedence languages (OPL), an old family through which R. Floyd pioneered deterministic parsing, and we show that they offer unexpected properties in two fields so far investigated in totally independent ways: they enable parsing parallelization in a more effective way than traditional sequential parsers, and exhibit the same algebraic and logic properties so far ob- tained only for less expressive language families.
    [Show full text]